-- Logs begin at Fri 2022-06-17 12:04:40 UTC, end at Fri 2022-06-17 13:54:31 UTC. -- Jun 17 12:48:22.590657 dv-cinder-837543-5-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 17 12:48:22.602126 dv-cinder-837543-5-iscsi devstack@n-api.service[103133]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 17 12:48:22.602126 dv-cinder-837543-5-iscsi devstack@n-api.service[103133]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Jun 17 12:48:22 2022] *** Jun 17 12:48:22.602126 dv-cinder-837543-5-iscsi devstack@n-api.service[103133]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 17 12:48:22.602126 dv-cinder-837543-5-iscsi devstack@n-api.service[103133]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 17 12:48:22.602126 dv-cinder-837543-5-iscsi devstack@n-api.service[103133]: nodename: dv-cinder-837543-5-iscsi Jun 17 12:48:22.602126 dv-cinder-837543-5-iscsi devstack@n-api.service[103133]: machine: x86_64 Jun 17 12:48:22.602126 dv-cinder-837543-5-iscsi devstack@n-api.service[103133]: clock source: unix Jun 17 12:48:22.602126 dv-cinder-837543-5-iscsi devstack@n-api.service[103133]: pcre jit disabled Jun 17 12:48:22.602126 dv-cinder-837543-5-iscsi devstack@n-api.service[103133]: detected number of CPU cores: 4 Jun 17 12:48:22.602126 dv-cinder-837543-5-iscsi devstack@n-api.service[103133]: current working directory: / Jun 17 12:48:22.602126 dv-cinder-837543-5-iscsi devstack@n-api.service[103133]: detected binary path: /usr/bin/uwsgi-core Jun 17 12:48:22.602126 dv-cinder-837543-5-iscsi devstack@n-api.service[103133]: your processes number limit is 47680 Jun 17 12:48:22.602126 dv-cinder-837543-5-iscsi devstack@n-api.service[103133]: your memory page size is 4096 bytes Jun 17 12:48:22.602126 dv-cinder-837543-5-iscsi devstack@n-api.service[103133]: detected max file descriptor number: 2048 Jun 17 12:48:22.602126 dv-cinder-837543-5-iscsi devstack@n-api.service[103133]: lock engine: pthread robust mutexes Jun 17 12:48:22.602126 dv-cinder-837543-5-iscsi devstack@n-api.service[103133]: thunder lock: enabled Jun 17 12:48:22.602126 dv-cinder-837543-5-iscsi devstack@n-api.service[103133]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 17 12:48:22.602126 dv-cinder-837543-5-iscsi devstack@n-api.service[103133]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 17 12:48:22.645315 dv-cinder-837543-5-iscsi devstack@n-api.service[103133]: Python main interpreter initialized at 0x555c5a5b89c0 Jun 17 12:48:22.645315 dv-cinder-837543-5-iscsi devstack@n-api.service[103133]: python threads support enabled Jun 17 12:48:22.645315 dv-cinder-837543-5-iscsi devstack@n-api.service[103133]: your server socket listen backlog is limited to 100 connections Jun 17 12:48:22.645315 dv-cinder-837543-5-iscsi devstack@n-api.service[103133]: your mercy for graceful operations on workers is 90 seconds Jun 17 12:48:22.645752 dv-cinder-837543-5-iscsi devstack@n-api.service[103133]: mapped 403077 bytes (393 KB) for 2 cores Jun 17 12:48:22.645752 dv-cinder-837543-5-iscsi devstack@n-api.service[103133]: *** Operational MODE: preforking *** Jun 17 12:48:22.646051 dv-cinder-837543-5-iscsi devstack@n-api.service[103133]: *** uWSGI is running in multiple interpreter mode *** Jun 17 12:48:22.646051 dv-cinder-837543-5-iscsi devstack@n-api.service[103133]: spawned uWSGI master process (pid: 103133) Jun 17 12:48:22.647016 dv-cinder-837543-5-iscsi devstack@n-api.service[103133]: spawned uWSGI worker 1 (pid: 103134, cores: 1) Jun 17 12:48:22.646341 dv-cinder-837543-5-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 17 12:48:22.647314 dv-cinder-837543-5-iscsi devstack@n-api.service[103133]: spawned uWSGI worker 2 (pid: 103135, cores: 1) Jun 17 12:48:22.647458 dv-cinder-837543-5-iscsi devstack@n-api.service[103133]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 17 12:48:23.304960 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 17 12:48:23.305997 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 17 12:48:24.489210 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 17 12:48:24.489210 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: from cryptography.utils import int_from_bytes Jun 17 12:48:24.489935 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 17 12:48:24.489935 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: from cryptography.utils import int_from_bytes Jun 17 12:48:24.490371 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 17 12:48:24.490371 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: from cryptography.utils import int_from_bytes Jun 17 12:48:24.490487 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 17 12:48:24.490487 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: from cryptography.utils import int_from_bytes Jun 17 12:48:27.084646 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 17 12:48:27.085249 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 17 12:48:27.085428 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 17 12:48:27.085599 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 17 12:48:27.086017 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 17 12:48:27.086132 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 17 12:48:27.086221 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 17 12:48:27.086414 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 17 12:48:27.086565 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.086728 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 17 12:48:27.086859 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.086954 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 17 12:48:27.087029 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.087351 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.087495 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.087655 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.087748 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.087987 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.088114 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.088308 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.088435 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.088629 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.088769 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.088901 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.088999 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.089198 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.089342 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.089515 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.089659 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.089836 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-837543-5-iscsi {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.089984 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.090123 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.090212 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.090457 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.090552 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.090762 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.090858 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-837543-5-iscsi {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.091074 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.091160 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.091377 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.091473 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.091694 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.091790 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.091997 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.092088 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.092303 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.092503 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.092920 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.092920 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.093147 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.093250 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.093421 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.093555 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.093730 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.093848 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.094133 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.094277 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.094472 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.094568 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.094788 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.094874 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.095095 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.095181 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.095416 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.095588 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.095720 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.095806 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.096035 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.096136 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-837543-5-iscsi {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.096360 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.096490 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.096672 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.096822 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.097019 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.097114 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-837543-5-iscsi {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.097360 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.097488 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.097674 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.097771 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.097994 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.098156 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.098341 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.098452 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.098666 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.098754 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.098976 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.099074 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.099337 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.099446 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.099651 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.099744 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.099972 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.100092 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.100303 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.100416 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.100603 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.100739 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.100909 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.101064 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.101218 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.101387 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.101545 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.101693 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.101850 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.102006 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.102175 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.102348 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.102495 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.102670 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.102797 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.102979 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.103111 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.103286 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.103423 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.103552 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.103688 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.103829 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.103964 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.104132 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.104266 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.104458 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.104576 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.104780 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.104866 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.105037 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.105129 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.105303 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.105398 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.105615 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.105708 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.105953 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.106057 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.106281 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.106370 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.106586 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.106677 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.106893 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.106994 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.107200 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.107300 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.107506 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.107589 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.107815 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.107915 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.108123 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.108207 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.108427 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.108511 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.108749 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.108848 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.109067 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.109163 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.48 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.109388 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.109475 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.48 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.109693 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.109794 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.110012 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.110150 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.110410 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.110501 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.48 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.110684 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.48 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.110804 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.110996 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.111229 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.111338 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.111575 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.111710 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.111883 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.112075 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.112289 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.112374 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.112605 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.112703 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.112916 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.113058 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.113225 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.113430 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.113521 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.113843 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.113926 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.114162 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.114284 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.114579 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.114666 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.114932 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.115022 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.115243 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.115544 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.115628 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.115929 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.116396 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.116582 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.116718 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.116893 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.117107 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.117222 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.117340 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.117495 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.117645 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.117804 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.117958 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.118129 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.118298 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.118443 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.118607 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.118749 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.118916 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.119055 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.119225 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.119360 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.119533 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.119665 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.119843 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.119970 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.120151 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.120289 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.120458 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.120608 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.120782 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.120915 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.121107 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.121217 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.121415 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.121522 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.121722 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.121908 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.122041 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.122158 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.122365 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.122450 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.122690 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.122781 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.122999 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.123089 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.123307 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.123400 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.123628 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.123717 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.123933 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.124019 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.124237 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.124318 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.124539 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.124623 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.124853 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.124934 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.125153 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.125234 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.125458 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.125542 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.125761 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.125842 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.126065 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.126170 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.126389 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.126474 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.126690 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.126773 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.126992 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.127075 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.127299 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.127403 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.127598 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.127682 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.127898 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.127989 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.128202 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.128284 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.128500 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.128592 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.128801 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.128893 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.129104 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.129195 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.129409 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.129511 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.129713 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.129818 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.130014 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.130115 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.130381 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.130468 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.130783 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.130891 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.131119 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.131202 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:48:27.131464 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.131554 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.131786 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.131882 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.132121 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.132242 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.132442 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.132526 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.132765 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.132847 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.133076 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.133161 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.133390 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.133480 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.133713 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.133800 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.134021 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.134139 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.134356 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.134452 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.134669 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.134759 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.134981 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.135062 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.135296 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.135391 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.135619 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.135730 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.135934 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.136017 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.136255 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.136394 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.136567 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.136652 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.136878 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.136961 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.137195 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.137392 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.137510 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.137593 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.137832 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.137916 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.138164 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.138270 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.138550 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.138643 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.138821 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.138905 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.139149 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.139245 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.139479 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.139569 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.139803 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.139887 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.140115 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.140200 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.140425 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.140508 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.140736 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.140820 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.141047 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.141130 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.141361 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.141446 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.141676 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.141757 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.141995 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.142079 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.142331 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.142414 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.142644 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.142728 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.142954 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.143038 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.143264 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.143353 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.143572 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.143661 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.143890 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.143975 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.144204 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.144288 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.144516 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.144608 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.144828 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.144917 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.145144 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.145264 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.145454 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.145549 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.145763 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.145846 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.146199 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.146304 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.146509 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.146671 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.146904 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.146993 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.147218 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.147303 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.147536 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.147640 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.147844 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.147927 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.148166 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.148262 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.148492 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.148600 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.148799 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.148884 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.149136 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.149219 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.149444 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.149527 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.149754 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.149837 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.150064 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.150218 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.150413 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.150496 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.150729 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.150823 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.151045 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.151128 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.151355 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.151454 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.151664 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.151750 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.151978 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.152069 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.152286 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.152370 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.152589 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.152674 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.152908 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.153042 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.153212 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.153296 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.153518 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.153602 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.153830 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.153920 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.154159 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.154246 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.154468 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.154562 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.154776 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.154874 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.155084 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.155166 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.155394 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.155475 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.155708 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.155799 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.156019 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.156109 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.156337 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.156419 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.156653 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.156741 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.156959 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.157049 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.157284 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.157367 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.157608 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.157701 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.157921 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.158010 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.158247 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.158333 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.158556 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.158641 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.158859 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.158948 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.159162 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.159253 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.159466 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.159555 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.159773 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.159856 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.160077 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.160168 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.160379 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.160461 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.160682 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.160770 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.160982 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.161073 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.161315 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.161416 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.161621 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.161760 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.161923 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.162125 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.162325 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.162505 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.162637 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.162751 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.162878 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.163058 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.163183 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.163402 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.163485 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.163711 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.163802 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.164055 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.164139 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.164394 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.164485 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.164718 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.164823 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.165044 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.165128 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.165358 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.165442 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.165681 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.165781 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.165991 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.166080 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.166331 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.166415 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.166643 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.166725 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.166951 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.167036 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.167261 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.167343 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.167571 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.167666 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.167886 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.167986 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.168192 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.168275 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.168503 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.168586 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.168814 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.168933 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.169127 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.169217 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.169431 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.169514 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.169741 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.169824 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.170058 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.170215 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.170425 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.170516 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.170741 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.170824 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.171064 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.171155 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.171376 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.171460 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.171690 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.171762 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.172053 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.172156 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.172302 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.172392 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.172610 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.172775 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.172918 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.173084 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.173229 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.173311 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.173542 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.173639 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.173854 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.173944 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.174185 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.174271 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.174496 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.174579 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.174803 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.174888 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.175118 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.175202 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.175424 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.175514 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.175730 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.175819 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.176044 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.176129 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.176378 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.176460 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.176687 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.176770 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.176998 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.177080 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.177424 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.177623 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.177714 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.177800 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.178033 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.178209 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.178371 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.178527 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.178686 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.178836 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.178996 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.179146 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.179306 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.179455 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.179620 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.179773 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.179939 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.180086 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.180252 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.180398 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.180564 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.180704 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.180871 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.181019 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.181190 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.181329 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.181531 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.181635 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.181896 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.181994 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.182230 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.182333 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.182549 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.182632 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.182872 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.182954 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.183186 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.183275 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.183505 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.183587 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.183810 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.183893 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.184113 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.184197 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.184418 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.184500 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.184733 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.184815 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.185039 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.185124 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.185345 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.185427 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.185645 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.185767 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.185950 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.186034 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.186309 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.186394 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.186619 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.186711 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.186927 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.187009 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.187246 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.187334 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.187558 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.187659 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.187870 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.187959 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.188183 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.188284 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.188491 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.188587 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.188801 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.188883 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.189117 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.189198 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.189429 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.189530 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.189739 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.189827 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.190047 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.190143 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.190381 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.190466 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.190691 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.190773 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.191003 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.191086 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.191312 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.191395 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.191621 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.191704 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.191932 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.192014 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.192234 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.192318 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.192541 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.192622 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.192880 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.193007 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.193199 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.193603 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.193768 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.193940 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.194144 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.194290 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.194446 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.194614 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.194768 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.194937 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.195200 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.195294 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.195530 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.195614 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.195864 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.195947 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.196203 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.196299 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.196528 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.196620 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.196840 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.196937 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.197147 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.197230 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.197455 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.197617 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.197771 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.197901 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.198073 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.198187 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.198399 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.198509 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.198705 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.198801 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.199010 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.199094 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.199314 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.199426 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.199619 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.199706 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.199923 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.200009 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.200246 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.200344 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.200537 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.200629 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.200840 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.200925 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.201150 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.201234 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.201452 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.201537 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.201761 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.201848 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.202078 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.202176 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.202419 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.202511 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.202709 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.202808 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.203029 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.203121 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.203319 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.203410 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.203649 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.203732 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.203961 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.204045 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.204302 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.204389 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.204637 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.204730 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.204942 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.205027 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.205250 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.205334 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.205574 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.205730 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.205899 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.206038 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.206202 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.206329 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.206509 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.206727 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.206817 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.206961 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.207114 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.207422 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.207521 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.207782 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.207887 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.208041 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.208132 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.208360 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.208535 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.208755 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.208862 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.209070 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.209163 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.209375 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.209468 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.209687 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.209771 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.209994 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.210137 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.210335 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.210429 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.210645 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.210734 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.210951 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.211041 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.211255 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.211348 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.211567 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.211656 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.211880 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.211962 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.212187 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.212278 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.212496 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.212579 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.212801 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.212892 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.213120 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.213258 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.213429 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.213535 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.213734 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.213820 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.214038 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.214208 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.214371 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.214456 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.214680 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.214766 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.214984 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.215071 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.215309 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.215392 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.215617 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.215715 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.215922 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.216007 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.216227 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.216310 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.216532 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.216647 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.216838 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.216934 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.217138 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.217224 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.217447 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.217549 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.217768 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.217859 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.218123 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.218212 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.218408 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.218504 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.218719 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.218813 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.219019 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.219105 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.219324 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.219432 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.219630 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.219725 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.219936 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.220021 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.220238 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.220325 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.220539 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.220625 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.220843 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.220926 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.221146 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.221230 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.221447 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.221538 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.221772 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.221859 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.222079 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.222220 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.222403 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.222489 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.222709 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.222809 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.223013 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.223098 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.223360 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.223457 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.223666 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.223769 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.224026 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.224141 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.224395 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.224487 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.224717 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.224825 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.225039 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.225132 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.225352 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.225445 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.225663 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.225767 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.225975 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.226066 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.226306 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.226398 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.226623 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.226723 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.226932 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.227033 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.227245 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.227338 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.227552 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.227644 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.227855 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.227947 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.228175 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.228266 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.228486 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.228575 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.228798 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.228890 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.229115 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.229200 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.229438 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.229551 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.229755 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.229843 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.230049 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.230156 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.230380 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.230467 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.230688 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.230773 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.230994 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.231086 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.231304 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.231389 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.231614 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.231708 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.231924 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.232025 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.232236 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.232321 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.232547 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.232632 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.232857 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.232952 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.233165 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.233249 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.233468 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.233553 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.233775 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.233869 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.234083 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.234190 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.234405 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.234491 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.234731 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.234825 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.235041 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.235132 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.235342 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.235426 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.235650 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.235735 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.235953 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.236046 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.236261 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.236356 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.236563 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.236650 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.236999 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.237082 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.237311 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.237408 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.237619 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.237710 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.237922 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.238006 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.238254 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.238352 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.238566 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.238652 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.238882 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.238970 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.239199 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.239293 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.239505 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.239589 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.239978 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.240083 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.240285 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.240382 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.240599 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.240767 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.240912 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.241436 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.241571 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.241746 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.241880 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.242056 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.242293 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.242424 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.242624 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.242755 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.242936 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.243074 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.243245 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.243394 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.243547 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.243686 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.243862 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.243990 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.244169 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.244301 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.244493 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.244639 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.244906 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.245036 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.245216 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.245361 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.245504 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.245633 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.245920 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.246053 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.246260 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.246396 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.246554 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.246688 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.246879 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.247013 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.247203 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.247342 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.247525 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.247675 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.247834 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.247981 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.248147 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.248287 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.248459 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.248599 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.248783 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.248915 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.249106 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.249203 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.249411 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.249504 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.249724 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.249809 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.250031 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.250171 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.250384 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.250488 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.250711 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.250802 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.251025 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.251110 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.251352 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.251446 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.251760 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.251844 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.252087 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.252170 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.252398 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.252501 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.252717 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.252808 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.253040 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.253124 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.253345 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.253430 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.253647 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.253730 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.254040 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.254173 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.254285 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.254370 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.254594 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.254688 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.254918 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.255010 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.255228 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.255312 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.255573 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.255698 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.255886 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.256018 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.256198 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.256329 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.256508 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.256637 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.256817 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.256944 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.257142 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.257268 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.257449 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.257562 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.257776 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.257887 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.258113 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.258235 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.258457 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.258558 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.258769 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.258856 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.259081 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.259169 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.259408 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.259494 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.259721 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.259815 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.260027 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.260112 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.260336 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.260428 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.260639 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.260723 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.260984 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.261069 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.261295 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.261389 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.261616 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.261712 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.261946 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.262030 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.262303 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.262403 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.262615 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.262707 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.262953 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.263037 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.263276 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.263371 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.263593 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.263678 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.263915 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.264000 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.264241 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.264347 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.264544 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.264630 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.264845 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.264928 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.265155 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.265249 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.265461 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.265545 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.265763 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.265847 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.266070 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.266175 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.266400 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.266495 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.266704 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.266797 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.267005 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.267091 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.267307 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.267392 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.267631 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.267811 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.267933 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.268018 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.268257 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.268340 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.268567 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.268675 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.268866 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.268953 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.269174 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.269262 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.269472 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.269565 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.269815 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.269901 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.270137 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.270240 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.270476 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.270576 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.270832 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.270920 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.271244 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.271332 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.271575 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.271717 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.271886 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.272046 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.272213 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.272382 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.272531 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.272707 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.272847 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.273032 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.273165 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.273353 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.273480 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.273673 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.273796 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.273994 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.274127 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.274385 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.274573 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.274690 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.274776 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.275005 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.275090 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.275325 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.275419 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.275646 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.275731 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.275965 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.276201 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.276515 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.276614 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.276829 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.276913 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.277144 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.277229 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.277456 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.277541 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.277768 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.277853 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.278080 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.278230 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.278410 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.278504 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.278721 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.278815 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.279031 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.279115 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.279345 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.279483 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.279671 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.279801 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.279992 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.280130 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.280318 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.280460 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.280651 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.280780 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.280969 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.281113 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.281290 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.281420 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.281607 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.281736 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.281936 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.282072 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.282252 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.282394 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.282592 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.282718 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.282897 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.283032 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.283211 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.283349 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.283525 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.283668 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.283842 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.283931 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.284154 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.284285 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.284464 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.284606 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.284775 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.284902 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.285089 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.285225 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.285397 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.285534 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.285711 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.285838 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.286022 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.286129 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.286357 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.286444 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.287183 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.287293 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.287376 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.287454 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.287570 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.287640 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.287781 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.287873 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.288191 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.288298 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.288417 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.288503 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.288804 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.288989 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.289297 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.289405 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.289584 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.289678 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.289924 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.290009 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.290282 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.290388 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.290604 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.290688 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.290924 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.291008 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.291249 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.291341 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.291555 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.291638 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.291861 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.291954 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.292169 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.292261 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.292477 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.292559 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.292785 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.292879 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.293092 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.293201 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.293406 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.293496 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.293711 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.293812 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.294018 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.294145 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.294354 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.294440 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.294673 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.294891 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.295207 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.295295 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.295552 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.295644 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.295869 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.295961 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.296200 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.296307 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.296519 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.296643 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.296831 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.296966 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.297161 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.297279 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.297473 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.297613 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.297785 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.297928 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.298145 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.298266 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.298433 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.298591 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.298739 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.298951 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.299058 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.299220 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.299345 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.299531 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.299656 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.299846 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.299960 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.300160 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.300272 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.300469 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.300566 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.300784 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.300890 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.301093 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.301201 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.301425 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.301519 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.301735 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.301821 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.302042 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.302178 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.302424 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.302520 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.302738 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.302829 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.303046 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.303131 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.303352 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.303496 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.303655 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.303796 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.303956 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.304088 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.304269 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.304416 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.304570 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.304710 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.304863 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.305004 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.305168 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.305322 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.305463 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.305610 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.305758 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.305897 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.306076 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.306260 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.306458 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.306608 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.306787 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.306946 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.307096 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.307245 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.307393 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.307546 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.307707 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.307938 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.308095 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.308236 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.308377 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.308516 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.308663 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.308826 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.308968 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.309206 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.309344 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.309494 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.309635 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.309808 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.310109 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.310256 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.310455 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.310584 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.310781 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.310928 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.311094 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.311221 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.311402 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.311622 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.311720 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.311848 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.312029 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.312181 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.312361 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.312506 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.312671 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.312817 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.312984 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.313126 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.313267 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.313370 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.313603 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.313734 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.313910 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.314041 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.314244 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.314395 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.314541 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.314647 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.314839 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.315054 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.315256 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.315458 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.315458 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.315812 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.316000 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.316193 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.316399 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.316574 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.316764 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.316952 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.316952 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.317302 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.317495 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.317675 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.317675 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.318189 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.318317 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.318462 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.318583 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.318701 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.318820 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.318945 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.319065 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.319200 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.319330 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.319451 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.319577 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.319759 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.319891 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.320024 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.320143 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.320265 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.320383 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.320502 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.320631 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.320752 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.320882 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.321004 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.321122 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.321241 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.321370 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.321596 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.321724 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.321910 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.322110 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.322258 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.322398 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.322580 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.322706 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.322889 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.323022 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.323212 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.323338 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.323541 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.323721 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.323857 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.323976 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.324145 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.324271 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.324458 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.324582 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.324792 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.324918 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.325099 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.325210 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.325404 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.325517 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.325714 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.325961 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.326052 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.326170 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.326353 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.326459 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.326664 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.326760 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.326970 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.327069 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.327277 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.327378 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.327589 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.327681 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.327896 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.327982 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.328205 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.328300 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.328509 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.328605 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.328845 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.328951 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.329118 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.329203 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.329420 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.329510 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.329718 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.329946 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.330153 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.330281 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.330424 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.330546 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.330667 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.330789 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.330908 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.331038 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.331208 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.331334 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.331507 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.331644 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.331812 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.331946 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.332116 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.332243 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.332419 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.332551 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.332718 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.332852 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.333020 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.333145 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.333328 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.333511 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.333723 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.333860 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.334045 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.334212 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.334381 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.334503 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.334766 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.334913 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.335044 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.335164 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.335323 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.335448 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.335643 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.335779 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.335960 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.336097 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.336290 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.336464 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.336626 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.336776 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.336938 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.337112 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.337232 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.337352 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.337480 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.337610 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.337793 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.337919 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.338123 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.338252 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.338442 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.338570 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.338771 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.338898 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.339100 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.339228 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.339409 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.339535 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.339734 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.339906 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.340031 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.340253 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.340385 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.340504 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.340661 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.340752 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.340973 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.341115 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.341305 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.341431 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.341616 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.341751 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.341925 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.342062 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.342266 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.342393 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.342582 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.342725 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.342894 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.343020 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.343209 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.343334 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.343519 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.343643 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.343834 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.343959 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.344153 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.344278 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.344461 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.344595 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.344790 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.344898 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.345118 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.345244 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.345435 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.345540 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.345764 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.345849 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.346138 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.346228 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.346451 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.346553 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.346767 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.346856 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.347078 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.347163 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.347383 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.347479 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.347628 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 17 12:48:27.347738 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.348053 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.348363 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:48:27.348612 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 17 12:48:27.410187 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: INFO dbcounter [None req-9b85c0a9-304a-4b35-8ab4-939e54c5181f None None] Registered counter for database nova_api Jun 17 12:48:27.411883 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: INFO dbcounter [None req-791fed6c-41d9-4d05-aee8-f3ee3e627991 None None] Registered counter for database nova_api Jun 17 12:48:27.431693 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG oslo_db.sqlalchemy.engines [None req-9b85c0a9-304a-4b35-8ab4-939e54c5181f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103134) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 17 12:48:27.432747 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG oslo_db.sqlalchemy.engines [None req-791fed6c-41d9-4d05-aee8-f3ee3e627991 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103135) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 17 12:48:27.438801 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG dbcounter [-] [103134] Writer thread running {{(pid=103134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 17 12:48:27.439967 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG dbcounter [-] [103135] Writer thread running {{(pid=103135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 17 12:48:27.497158 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.context [None req-9b85c0a9-304a-4b35-8ab4-939e54c5181f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c05da03c-5209-4a2b-9567-14e1f38bc35b(cell1) {{(pid=103134) load_cells /opt/stack/nova/nova/context.py:464}} Jun 17 12:48:27.497610 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.context [None req-791fed6c-41d9-4d05-aee8-f3ee3e627991 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c05da03c-5209-4a2b-9567-14e1f38bc35b(cell1) {{(pid=103135) load_cells /opt/stack/nova/nova/context.py:464}} Jun 17 12:48:27.501420 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG oslo_concurrency.lockutils [None req-9b85c0a9-304a-4b35-8ab4-939e54c5181f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:48:27.501877 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG oslo_concurrency.lockutils [None req-791fed6c-41d9-4d05-aee8-f3ee3e627991 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:48:27.503034 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG oslo_concurrency.lockutils [None req-9b85c0a9-304a-4b35-8ab4-939e54c5181f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:48:27.503501 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG oslo_concurrency.lockutils [None req-791fed6c-41d9-4d05-aee8-f3ee3e627991 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:48:27.503811 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG oslo_concurrency.lockutils [None req-9b85c0a9-304a-4b35-8ab4-939e54c5181f None None] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:48:27.504436 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG oslo_concurrency.lockutils [None req-791fed6c-41d9-4d05-aee8-f3ee3e627991 None None] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:48:27.505996 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG oslo_concurrency.lockutils [None req-9b85c0a9-304a-4b35-8ab4-939e54c5181f None None] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:48:27.506507 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG oslo_concurrency.lockutils [None req-791fed6c-41d9-4d05-aee8-f3ee3e627991 None None] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:48:27.508036 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: INFO dbcounter [None req-9b85c0a9-304a-4b35-8ab4-939e54c5181f None None] Registered counter for database nova_cell0 Jun 17 12:48:27.508533 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: INFO dbcounter [None req-791fed6c-41d9-4d05-aee8-f3ee3e627991 None None] Registered counter for database nova_cell0 Jun 17 12:48:27.512027 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: INFO dbcounter [None req-9b85c0a9-304a-4b35-8ab4-939e54c5181f None None] Registered counter for database nova_cell1 Jun 17 12:48:27.512518 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: INFO dbcounter [None req-791fed6c-41d9-4d05-aee8-f3ee3e627991 None None] Registered counter for database nova_cell1 Jun 17 12:48:27.519250 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG oslo_db.sqlalchemy.engines [None req-9b85c0a9-304a-4b35-8ab4-939e54c5181f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103134) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 17 12:48:27.520705 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG oslo_db.sqlalchemy.engines [None req-791fed6c-41d9-4d05-aee8-f3ee3e627991 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103135) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 17 12:48:27.524346 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG dbcounter [-] [103134] Writer thread running {{(pid=103134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 17 12:48:27.525867 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG dbcounter [-] [103135] Writer thread running {{(pid=103135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 17 12:48:27.527287 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG oslo_db.sqlalchemy.engines [None req-791fed6c-41d9-4d05-aee8-f3ee3e627991 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103135) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 17 12:48:27.669568 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG oslo_db.sqlalchemy.engines [None req-9b85c0a9-304a-4b35-8ab4-939e54c5181f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103134) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 17 12:48:27.669852 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG dbcounter [-] [103135] Writer thread running {{(pid=103135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 17 12:48:27.677752 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG dbcounter [-] [103134] Writer thread running {{(pid=103134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 17 12:48:27.679646 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: INFO dbcounter [None req-791fed6c-41d9-4d05-aee8-f3ee3e627991 None None] Registered counter for database nova_cell0 Jun 17 12:48:27.689080 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG oslo_db.sqlalchemy.engines [None req-791fed6c-41d9-4d05-aee8-f3ee3e627991 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103135) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 17 12:48:27.692232 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: INFO dbcounter [None req-9b85c0a9-304a-4b35-8ab4-939e54c5181f None None] Registered counter for database nova_cell0 Jun 17 12:48:27.694649 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG dbcounter [-] [103135] Writer thread running {{(pid=103135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 17 12:48:27.702514 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG oslo_db.sqlalchemy.engines [None req-9b85c0a9-304a-4b35-8ab4-939e54c5181f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103134) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 17 12:48:27.707562 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG dbcounter [-] [103134] Writer thread running {{(pid=103134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 17 12:48:28.035865 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: WARNING keystonemiddleware.auth_token [None req-791fed6c-41d9-4d05-aee8-f3ee3e627991 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 17 12:48:28.042029 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: WARNING keystonemiddleware.auth_token [None req-9b85c0a9-304a-4b35-8ab4-939e54c5181f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 17 12:48:28.043366 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: WARNING keystonemiddleware.auth_token [None req-791fed6c-41d9-4d05-aee8-f3ee3e627991 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 17 12:48:28.050611 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: WARNING keystonemiddleware.auth_token [None req-9b85c0a9-304a-4b35-8ab4-939e54c5181f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 17 12:48:28.387903 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: WARNING keystonemiddleware.auth_token [None req-791fed6c-41d9-4d05-aee8-f3ee3e627991 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 17 12:48:28.394181 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: WARNING keystonemiddleware.auth_token [None req-791fed6c-41d9-4d05-aee8-f3ee3e627991 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 17 12:48:28.396738 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: WARNING keystonemiddleware.auth_token [None req-9b85c0a9-304a-4b35-8ab4-939e54c5181f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 17 12:48:28.399440 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x555c5a5b89c0 pid: 103135 (default app) Jun 17 12:48:28.401596 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi [None req-791fed6c-41d9-4d05-aee8-f3ee3e627991 None None] Calling method '>' {{(pid=103135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:48:28.402747 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: WARNING keystonemiddleware.auth_token [None req-9b85c0a9-304a-4b35-8ab4-939e54c5181f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 17 12:48:28.402880 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: INFO nova.api.openstack.requestlog [None req-791fed6c-41d9-4d05-aee8-f3ee3e627991 None None] 10.222.0.48 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001845 Jun 17 12:48:28.403732 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: [pid: 103135|app: 0|req: 1/1] 10.222.0.48 () {50 vars in 788 bytes} [Fri Jun 17 12:48:28 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:48:28.408037 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x555c5a5b89c0 pid: 103134 (default app) Jun 17 12:49:46.132745 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi [None req-791fed6c-41d9-4d05-aee8-f3ee3e627991 None None] Calling method '>' {{(pid=103135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:49:46.133743 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: INFO nova.api.openstack.requestlog [None req-791fed6c-41d9-4d05-aee8-f3ee3e627991 None None] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 Jun 17 12:49:46.139023 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: [pid: 103135|app: 0|req: 2/2] 10.222.0.48 () {54 vars in 930 bytes} [Fri Jun 17 12:49:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:49:46.150111 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG dbcounter [-] [103134] Writing DB stats nova_api:SELECT=3 {{(pid=103134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:49:46.151510 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG dbcounter [-] [103134] Writing DB stats nova_cell1:SELECT=3 {{(pid=103134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:49:46.152374 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG dbcounter [-] [103134] Writing DB stats nova_cell0:SELECT=3 {{(pid=103134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:49:46.153439 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG dbcounter [-] [103134] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:49:46.602957 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi [None req-59f03dac-24c3-4ce8-a0fc-687bf300ae28 admin admin] Calling method '>' {{(pid=103134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:49:46.634316 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: INFO nova.api.openstack.requestlog [None req-59f03dac-24c3-4ce8-a0fc-687bf300ae28 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.493367 Jun 17 12:49:46.635362 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: [pid: 103134|app: 0|req: 1/3] 10.222.0.48 () {60 vars in 1291 bytes} [Fri Jun 17 12:49:46 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 12:49:48.797836 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi [None req-791fed6c-41d9-4d05-aee8-f3ee3e627991 None None] Calling method '>' {{(pid=103135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:49:48.798955 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: INFO nova.api.openstack.requestlog [None req-791fed6c-41d9-4d05-aee8-f3ee3e627991 None None] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001597 Jun 17 12:49:48.799723 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: [pid: 103135|app: 0|req: 3/4] 10.222.0.48 () {54 vars in 930 bytes} [Fri Jun 17 12:49:48 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:49:48.868368 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi [None req-3327e774-993d-4f2a-bf42-d0d09305ddda admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "vcpus": 1, "name": "cirros256", "id": "c1", "ram": 256, "disk": 1}} {{(pid=103134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 12:49:48.887997 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 17 12:49:48.887997 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: warnings.warn(msg) Jun 17 12:49:48.931426 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: INFO nova.api.openstack.requestlog [None req-3327e774-993d-4f2a-bf42-d0d09305ddda admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.124340 Jun 17 12:49:48.932482 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: [pid: 103134|app: 0|req: 2/5] 10.222.0.48 () {64 vars in 1282 bytes} [Fri Jun 17 12:49:48 2022] POST /compute/v2.1/flavors => generated 407 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:49:48.946254 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG dbcounter [-] [103135] Writing DB stats nova_api:SELECT=3 {{(pid=103135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:49:48.947315 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG dbcounter [-] [103135] Writing DB stats nova_cell0:SELECT=3 {{(pid=103135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:49:48.948024 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG dbcounter [-] [103135] Writing DB stats nova_cell1:SELECT=3 {{(pid=103135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:49:48.948974 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG dbcounter [-] [103135] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:49:49.149528 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi [None req-8874ae88-c042-49f7-b7a7-e1638dffba59 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 12:49:49.152001 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 17 12:49:49.152001 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: warnings.warn(msg) Jun 17 12:49:49.222872 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: INFO nova.api.openstack.requestlog [None req-8874ae88-c042-49f7-b7a7-e1638dffba59 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.282400 Jun 17 12:49:49.223782 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: [pid: 103135|app: 0|req: 4/6] 10.222.0.48 () {64 vars in 1335 bytes} [Fri Jun 17 12:49:48 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:49:51.403740 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi [None req-3327e774-993d-4f2a-bf42-d0d09305ddda admin admin] Calling method '>' {{(pid=103134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:49:51.404671 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: INFO nova.api.openstack.requestlog [None req-3327e774-993d-4f2a-bf42-d0d09305ddda admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001504 Jun 17 12:49:51.405072 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: [pid: 103134|app: 0|req: 3/7] 10.222.0.48 () {54 vars in 930 bytes} [Fri Jun 17 12:49:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:49:51.520811 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi [None req-2e1dfa27-6ff5-49d1-a986-6881fa0d4c11 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d1", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds512M", "ram": 512, "swap": 0, "rxtx_factor": 1.0, "disk": 5, "os-flavor-access:is_public": true, "vcpus": 1}} {{(pid=103135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 12:49:51.538796 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 17 12:49:51.538796 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: warnings.warn(msg) Jun 17 12:49:51.558906 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: INFO nova.api.openstack.requestlog [None req-2e1dfa27-6ff5-49d1-a986-6881fa0d4c11 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.147600 Jun 17 12:49:51.559696 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: [pid: 103135|app: 0|req: 5/8] 10.222.0.48 () {64 vars in 1282 bytes} [Fri Jun 17 12:49:51 2022] POST /compute/v2.1/flavors => generated 404 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:49:51.574517 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi [None req-23291c51-ea65-4f1f-92f0-20295105dd99 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 12:49:51.576123 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 17 12:49:51.576123 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: warnings.warn(msg) Jun 17 12:49:51.623118 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: INFO nova.api.openstack.requestlog [None req-23291c51-ea65-4f1f-92f0-20295105dd99 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.052429 Jun 17 12:49:51.623719 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: [pid: 103134|app: 0|req: 4/9] 10.222.0.48 () {64 vars in 1335 bytes} [Fri Jun 17 12:49:51 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:49:53.886507 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi [None req-2e1dfa27-6ff5-49d1-a986-6881fa0d4c11 admin admin] Calling method '>' {{(pid=103135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:49:53.887533 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: INFO nova.api.openstack.requestlog [None req-2e1dfa27-6ff5-49d1-a986-6881fa0d4c11 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001530 Jun 17 12:49:53.887913 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: [pid: 103135|app: 0|req: 6/10] 10.222.0.48 () {54 vars in 930 bytes} [Fri Jun 17 12:49:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:49:53.961610 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi [None req-cac9542f-27dc-48ef-bcae-8b0b551673f6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 1024, "name": "ds1G", "disk": 10, "vcpus": 1, "id": "d2", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 12:49:53.987480 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: INFO nova.api.openstack.requestlog [None req-cac9542f-27dc-48ef-bcae-8b0b551673f6 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.093536 Jun 17 12:49:53.994169 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: [pid: 103134|app: 0|req: 5/11] 10.222.0.48 () {64 vars in 1282 bytes} [Fri Jun 17 12:49:53 2022] POST /compute/v2.1/flavors => generated 404 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:49:54.001663 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi [None req-71ca5260-0df1-4c09-a14d-a34c414542af admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 12:49:54.028792 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: INFO nova.api.openstack.requestlog [None req-71ca5260-0df1-4c09-a14d-a34c414542af admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031262 Jun 17 12:49:54.034221 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: [pid: 103135|app: 0|req: 7/12] 10.222.0.48 () {64 vars in 1335 bytes} [Fri Jun 17 12:49:53 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 12:49:56.416039 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi [None req-cac9542f-27dc-48ef-bcae-8b0b551673f6 admin admin] Calling method '>' {{(pid=103134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:49:56.417060 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: INFO nova.api.openstack.requestlog [None req-cac9542f-27dc-48ef-bcae-8b0b551673f6 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001507 Jun 17 12:49:56.417474 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: [pid: 103134|app: 0|req: 6/13] 10.222.0.48 () {54 vars in 930 bytes} [Fri Jun 17 12:49:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:49:56.483073 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi [None req-71e4bee6-60cc-44d8-8c96-6e1c685377b7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "rxtx_factor": 1.0, "ram": 2048, "swap": 0, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d3", "os-flavor-access:is_public": true, "disk": 10}} {{(pid=103135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 12:49:56.504866 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: INFO nova.api.openstack.requestlog [None req-71e4bee6-60cc-44d8-8c96-6e1c685377b7 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.080481 Jun 17 12:49:56.505037 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: [pid: 103135|app: 0|req: 8/14] 10.222.0.48 () {64 vars in 1282 bytes} [Fri Jun 17 12:49:56 2022] POST /compute/v2.1/flavors => generated 404 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:49:56.518755 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi [None req-a5eb448b-acf8-49f4-9770-d5e74b6eb1dc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 12:49:56.545916 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: INFO nova.api.openstack.requestlog [None req-a5eb448b-acf8-49f4-9770-d5e74b6eb1dc admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030981 Jun 17 12:49:56.546559 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: [pid: 103134|app: 0|req: 7/15] 10.222.0.48 () {64 vars in 1335 bytes} [Fri Jun 17 12:49:56 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:49:58.824848 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi [None req-71e4bee6-60cc-44d8-8c96-6e1c685377b7 admin admin] Calling method '>' {{(pid=103135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:49:58.825779 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: INFO nova.api.openstack.requestlog [None req-71e4bee6-60cc-44d8-8c96-6e1c685377b7 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Jun 17 12:49:58.826215 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: [pid: 103135|app: 0|req: 9/16] 10.222.0.48 () {54 vars in 930 bytes} [Fri Jun 17 12:49:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:49:58.890319 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi [None req-fa924874-667c-48ca-97e9-0984c420828d admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "ds4G", "id": "d4", "rxtx_factor": 1.0, "vcpus": 4, "swap": 0, "disk": 20, "ram": 4096}} {{(pid=103134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 12:49:58.913779 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: INFO nova.api.openstack.requestlog [None req-fa924874-667c-48ca-97e9-0984c420828d admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.081415 Jun 17 12:49:58.914643 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: [pid: 103134|app: 0|req: 8/17] 10.222.0.48 () {64 vars in 1282 bytes} [Fri Jun 17 12:49:58 2022] POST /compute/v2.1/flavors => generated 404 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 17 12:49:58.926928 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi [None req-31648cc0-b8ff-466d-ac1c-ae6d6644cdc6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 12:49:58.953702 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: INFO nova.api.openstack.requestlog [None req-31648cc0-b8ff-466d-ac1c-ae6d6644cdc6 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030604 Jun 17 12:49:58.954677 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: [pid: 103135|app: 0|req: 10/18] 10.222.0.48 () {64 vars in 1335 bytes} [Fri Jun 17 12:49:58 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:50:01.179840 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi [None req-fa924874-667c-48ca-97e9-0984c420828d admin admin] Calling method '>' {{(pid=103134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:50:01.181338 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: INFO nova.api.openstack.requestlog [None req-fa924874-667c-48ca-97e9-0984c420828d admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001904 Jun 17 12:50:01.182112 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: [pid: 103134|app: 0|req: 9/19] 10.222.0.48 () {54 vars in 930 bytes} [Fri Jun 17 12:50:01 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:50:01.244599 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi [None req-2c77228e-2398-4c50-aa15-eed915f8eb1d admin admin] Calling method '>' {{(pid=103135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:50:01.268536 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: INFO nova.api.openstack.requestlog [None req-2c77228e-2398-4c50-aa15-eed915f8eb1d admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.079877 Jun 17 12:50:01.269383 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: [pid: 103135|app: 0|req: 11/20] 10.222.0.48 () {60 vars in 1291 bytes} [Fri Jun 17 12:50:01 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 12:50:03.542863 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi [None req-fa924874-667c-48ca-97e9-0984c420828d admin admin] Calling method '>' {{(pid=103134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:50:03.544063 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: INFO nova.api.openstack.requestlog [None req-fa924874-667c-48ca-97e9-0984c420828d admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001745 Jun 17 12:50:03.544572 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: [pid: 103134|app: 0|req: 10/21] 10.222.0.48 () {54 vars in 930 bytes} [Fri Jun 17 12:50:03 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 12:50:03.619856 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi [None req-27d6c237-d911-4902-87cf-d0f423b1688a admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "m1.tiny", "swap": 0, "id": "1", "rxtx_factor": 1.0, "ram": 512, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1}} {{(pid=103135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 12:50:03.641304 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: INFO nova.api.openstack.requestlog [None req-27d6c237-d911-4902-87cf-d0f423b1688a admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.089451 Jun 17 12:50:03.641815 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: [pid: 103135|app: 0|req: 12/22] 10.222.0.48 () {64 vars in 1282 bytes} [Fri Jun 17 12:50:03 2022] POST /compute/v2.1/flavors => generated 402 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:50:03.654740 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi [None req-874fdc6a-2d56-4834-8415-5f96a771927b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 12:50:03.683089 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: INFO nova.api.openstack.requestlog [None req-874fdc6a-2d56-4834-8415-5f96a771927b admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032278 Jun 17 12:50:03.683742 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: [pid: 103134|app: 0|req: 11/23] 10.222.0.48 () {64 vars in 1332 bytes} [Fri Jun 17 12:50:03 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:50:06.131096 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi [None req-27d6c237-d911-4902-87cf-d0f423b1688a admin admin] Calling method '>' {{(pid=103135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:50:06.132193 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: INFO nova.api.openstack.requestlog [None req-27d6c237-d911-4902-87cf-d0f423b1688a admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002258 Jun 17 12:50:06.132626 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: [pid: 103135|app: 0|req: 13/24] 10.222.0.48 () {54 vars in 930 bytes} [Fri Jun 17 12:50:06 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:50:06.199499 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi [None req-7596b738-74f6-478e-a31a-8068d6e21120 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "2", "name": "m1.small", "vcpus": 1, "ram": 2048, "swap": 0}} {{(pid=103134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 12:50:06.221365 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: INFO nova.api.openstack.requestlog [None req-7596b738-74f6-478e-a31a-8068d6e21120 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.081836 Jun 17 12:50:06.222078 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: [pid: 103134|app: 0|req: 12/25] 10.222.0.48 () {64 vars in 1282 bytes} [Fri Jun 17 12:50:06 2022] POST /compute/v2.1/flavors => generated 405 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 17 12:50:06.236708 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi [None req-5b8b08fc-bb79-4cca-8143-8f069f14d9f1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 12:50:06.264501 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: INFO nova.api.openstack.requestlog [None req-5b8b08fc-bb79-4cca-8143-8f069f14d9f1 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032107 Jun 17 12:50:06.265253 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: [pid: 103135|app: 0|req: 14/26] 10.222.0.48 () {64 vars in 1332 bytes} [Fri Jun 17 12:50:06 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:50:08.570450 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi [None req-7596b738-74f6-478e-a31a-8068d6e21120 admin admin] Calling method '>' {{(pid=103134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:50:08.571602 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: INFO nova.api.openstack.requestlog [None req-7596b738-74f6-478e-a31a-8068d6e21120 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001561 Jun 17 12:50:08.572088 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: [pid: 103134|app: 0|req: 13/27] 10.222.0.48 () {54 vars in 930 bytes} [Fri Jun 17 12:50:08 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:50:08.634818 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi [None req-724fe804-2900-44db-9fc7-82ce5e535528 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 2, "id": "3", "ram": 4096, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "name": "m1.medium", "disk": 40}} {{(pid=103135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 12:50:08.654037 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: INFO nova.api.openstack.requestlog [None req-724fe804-2900-44db-9fc7-82ce5e535528 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.075353 Jun 17 12:50:08.654616 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: [pid: 103135|app: 0|req: 15/28] 10.222.0.48 () {64 vars in 1282 bytes} [Fri Jun 17 12:50:08 2022] POST /compute/v2.1/flavors => generated 406 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:50:08.666790 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi [None req-9f2edd15-d1c2-4793-9cdb-f0b000cf6926 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 12:50:08.693823 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: INFO nova.api.openstack.requestlog [None req-9f2edd15-d1c2-4793-9cdb-f0b000cf6926 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030869 Jun 17 12:50:08.694479 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: [pid: 103134|app: 0|req: 14/29] 10.222.0.48 () {64 vars in 1332 bytes} [Fri Jun 17 12:50:08 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:50:10.867172 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi [None req-724fe804-2900-44db-9fc7-82ce5e535528 admin admin] Calling method '>' {{(pid=103135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:50:10.868707 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: INFO nova.api.openstack.requestlog [None req-724fe804-2900-44db-9fc7-82ce5e535528 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001962 Jun 17 12:50:10.869147 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: [pid: 103135|app: 0|req: 16/30] 10.222.0.48 () {54 vars in 930 bytes} [Fri Jun 17 12:50:10 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:50:10.936245 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi [None req-db89a7c6-da1d-451d-8aa0-636d2e813424 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "rxtx_factor": 1.0, "name": "m1.large", "vcpus": 4, "ram": 8192, "id": "4", "disk": 80, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 12:50:10.956493 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: INFO nova.api.openstack.requestlog [None req-db89a7c6-da1d-451d-8aa0-636d2e813424 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.081127 Jun 17 12:50:10.957175 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: [pid: 103134|app: 0|req: 15/31] 10.222.0.48 () {64 vars in 1282 bytes} [Fri Jun 17 12:50:10 2022] POST /compute/v2.1/flavors => generated 405 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 17 12:50:10.969924 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi [None req-fc613ed5-5d2f-446d-b2d2-dcf7ac342ea9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 12:50:10.994975 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: INFO nova.api.openstack.requestlog [None req-fc613ed5-5d2f-446d-b2d2-dcf7ac342ea9 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028342 Jun 17 12:50:10.995561 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: [pid: 103135|app: 0|req: 17/32] 10.222.0.48 () {64 vars in 1332 bytes} [Fri Jun 17 12:50:10 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:50:13.191823 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi [None req-db89a7c6-da1d-451d-8aa0-636d2e813424 admin admin] Calling method '>' {{(pid=103134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:50:13.193173 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: INFO nova.api.openstack.requestlog [None req-db89a7c6-da1d-451d-8aa0-636d2e813424 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001531 Jun 17 12:50:13.193466 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: [pid: 103134|app: 0|req: 16/33] 10.222.0.48 () {54 vars in 930 bytes} [Fri Jun 17 12:50:13 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:50:13.258391 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi [None req-f0876433-d6ac-4a95-a276-d2ca24b3c161 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 8, "rxtx_factor": 1.0, "ram": 16384, "swap": 0, "disk": 160, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "5", "name": "m1.xlarge"}} {{(pid=103135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 12:50:13.278769 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: INFO nova.api.openstack.requestlog [None req-f0876433-d6ac-4a95-a276-d2ca24b3c161 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.079297 Jun 17 12:50:13.279324 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: [pid: 103135|app: 0|req: 18/34] 10.222.0.48 () {64 vars in 1282 bytes} [Fri Jun 17 12:50:13 2022] POST /compute/v2.1/flavors => generated 408 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 17 12:50:13.291924 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi [None req-30c9d654-4f2d-4b0f-9d26-728029ed35fe admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 12:50:13.323753 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: INFO nova.api.openstack.requestlog [None req-30c9d654-4f2d-4b0f-9d26-728029ed35fe admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035653 Jun 17 12:50:13.324512 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: [pid: 103134|app: 0|req: 17/35] 10.222.0.48 () {64 vars in 1332 bytes} [Fri Jun 17 12:50:13 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 12:50:36.852177 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi [None req-f0876433-d6ac-4a95-a276-d2ca24b3c161 admin admin] Calling method '>' {{(pid=103135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:50:36.853204 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: INFO nova.api.openstack.requestlog [None req-f0876433-d6ac-4a95-a276-d2ca24b3c161 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 Jun 17 12:50:36.853598 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: [pid: 103135|app: 0|req: 19/36] 10.222.0.48 () {54 vars in 930 bytes} [Fri Jun 17 12:50:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:50:36.864878 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG dbcounter [-] [103134] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=103134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:50:36.919383 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi [None req-0e13499a-0181-4c3f-a9e7-179912b86623 admin admin] Calling method '>' {{(pid=103134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:50:36.938381 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: INFO nova.api.openstack.requestlog [None req-0e13499a-0181-4c3f-a9e7-179912b86623 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.078448 Jun 17 12:50:36.938944 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: [pid: 103134|app: 0|req: 18/37] 10.222.0.48 () {60 vars in 1291 bytes} [Fri Jun 17 12:50:36 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 12:50:37.956744 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi [None req-f0876433-d6ac-4a95-a276-d2ca24b3c161 admin admin] Calling method '>' {{(pid=103135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:50:37.958119 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: INFO nova.api.openstack.requestlog [None req-f0876433-d6ac-4a95-a276-d2ca24b3c161 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001904 Jun 17 12:50:37.958647 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: [pid: 103135|app: 0|req: 20/38] 10.222.0.48 () {56 vars in 1074 bytes} [Fri Jun 17 12:50:37 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 12:50:38.166252 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi [None req-2423c8e4-c1b9-4bfd-88cc-cb014b2e433d admin admin] Calling method '>' {{(pid=103134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:50:38.176943 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: INFO nova.api.openstack.wsgi [None req-2423c8e4-c1b9-4bfd-88cc-cb014b2e433d admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 17 12:50:38.180726 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi [None req-2423c8e4-c1b9-4bfd-88cc-cb014b2e433d admin admin] Request method failure captured: Jun 17 12:50:38.180726 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 17 12:50:38.180726 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: Accept: application/json Jun 17 12:50:38.180726 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: Accept-Encoding: gzip, deflate Jun 17 12:50:38.180726 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: Connection: keep-alive Jun 17 12:50:38.180726 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: Content-Length: 0 Jun 17 12:50:38.180726 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: Host: 10.222.0.48 Jun 17 12:50:38.180726 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: Openstack-Api-Version: compute 2.90 Jun 17 12:50:38.180726 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: Openstack-System-Scope: None Jun 17 12:50:38.180726 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: User-Agent: python-novaclient Jun 17 12:50:38.180726 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: X-Auth-Token: gAAAAABirHiddAKKtKPo-2xnTjMIyOiC6jppyrRKirDTc-hKsTIwH_AtxDzOL2p0_-dgzhMD6oukkSNe_bts2rcyow-t1stAXNdZaCwPjp0JrJMu0_eEm0gWBsqaXKXD5xEBi3tboseqtvimJ8KkQnOwPZQkBIT_nZmeDqrwG1yff-JUUU_Otkw Jun 17 12:50:38.180726 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: X-Domain-Id: None Jun 17 12:50:38.180726 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: X-Domain-Name: None Jun 17 12:50:38.180726 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: X-Identity-Status: Confirmed Jun 17 12:50:38.180726 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: X-Is-Admin-Project: True Jun 17 12:50:38.180726 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: X-Openstack-Nova-Api-Version: 2.90 Jun 17 12:50:38.180726 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: X-Project-Domain-Id: default Jun 17 12:50:38.180726 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: X-Project-Domain-Name: Default Jun 17 12:50:38.180726 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: X-Project-Id: 91e888714806438f834a0309a74fcb9e Jun 17 12:50:38.180726 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: X-Project-Name: admin Jun 17 12:50:38.180726 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: X-Role: admin,member,reader Jun 17 12:50:38.180726 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: X-Roles: admin,member,reader Jun 17 12:50:38.182310 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_91e888714806438f834a0309a74fcb9e", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/91e888714806438f834a0309a74fcb9e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/91e888714806438f834a0309a74fcb9e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/91e888714806438f834a0309a74fcb9e"}]}] Jun 17 12:50:38.182310 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: X-Tenant: admin Jun 17 12:50:38.182310 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: X-Tenant-Id: 91e888714806438f834a0309a74fcb9e Jun 17 12:50:38.182310 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: X-Tenant-Name: admin Jun 17 12:50:38.182310 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: X-User: admin Jun 17 12:50:38.182310 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: X-User-Domain-Id: default Jun 17 12:50:38.182310 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: X-User-Domain-Name: Default Jun 17 12:50:38.182310 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: X-User-Id: 037e9f95a2ad44f08247184b10274c13 Jun 17 12:50:38.182310 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: X-User-Name: admin Jun 17 12:50:38.182310 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: method: > Jun 17 12:50:38.182310 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: exception: Flavor 42 could not be found. Jun 17 12:50:38.182310 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: action_args: {'id': '42'} Jun 17 12:50:38.182310 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: {{(pid=103134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 12:50:38.182310 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 12:50:38.183197 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 17 12:50:38.183197 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 17 12:50:38.183197 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 17 12:50:38.183197 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 17 12:50:38.183197 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 17 12:50:38.183197 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 17 12:50:38.183197 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 17 12:50:38.183197 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 17 12:50:38.183197 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 17 12:50:38.183197 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 12:50:38.183197 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 17 12:50:38.183197 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 17 12:50:38.183197 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 17 12:50:38.183197 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi Jun 17 12:50:38.183197 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 12:50:38.183197 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi Jun 17 12:50:38.183197 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 12:50:38.183197 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 12:50:38.183197 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 12:50:38.184935 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 12:50:38.184935 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 12:50:38.184935 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 12:50:38.184935 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 12:50:38.184935 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 17 12:50:38.184935 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 17 12:50:38.184935 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 17 12:50:38.184935 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi Jun 17 12:50:38.184935 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 12:50:38.184935 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi Jun 17 12:50:38.184935 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 12:50:38.184935 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 12:50:38.184935 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 12:50:38.184935 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 12:50:38.184935 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 12:50:38.184935 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 17 12:50:38.184935 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi Jun 17 12:50:38.184935 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi [None req-2423c8e4-c1b9-4bfd-88cc-cb014b2e433d admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 12:50:38.186224 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: INFO nova.api.openstack.requestlog [None req-2423c8e4-c1b9-4bfd-88cc-cb014b2e433d admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.078434 Jun 17 12:50:38.186224 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: [pid: 103134|app: 0|req: 19/39] 10.222.0.48 () {60 vars in 1190 bytes} [Fri Jun 17 12:50:38 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 17 12:50:38.193710 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi [None req-52bc3091-1f03-42d0-a621-d4c77e8033e0 admin admin] Calling method '>' {{(pid=103135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:50:38.196854 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG dbcounter [-] [103135] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:50:38.217476 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: INFO nova.api.openstack.requestlog [None req-52bc3091-1f03-42d0-a621-d4c77e8033e0 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028455 Jun 17 12:50:38.218054 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: [pid: 103135|app: 0|req: 21/40] 10.222.0.48 () {60 vars in 1210 bytes} [Fri Jun 17 12:50:38 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 12:50:38.230211 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi [None req-eb85b6dc-d09b-45e7-92bd-c88fe2a7a105 admin admin] Calling method '>' {{(pid=103134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:50:38.257765 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: INFO nova.api.openstack.requestlog [None req-eb85b6dc-d09b-45e7-92bd-c88fe2a7a105 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.033096 Jun 17 12:50:38.258422 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: [pid: 103134|app: 0|req: 20/41] 10.222.0.48 () {60 vars in 1210 bytes} [Fri Jun 17 12:50:38 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 12:50:38.269099 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi [None req-772884ae-37bc-4955-bb9d-e5d39b262466 admin admin] Calling method '>' {{(pid=103135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:50:38.277075 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: INFO nova.api.openstack.wsgi [None req-772884ae-37bc-4955-bb9d-e5d39b262466 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 17 12:50:38.280123 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi [None req-772884ae-37bc-4955-bb9d-e5d39b262466 admin admin] Request method failure captured: Jun 17 12:50:38.280123 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 17 12:50:38.280123 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: Accept: application/json Jun 17 12:50:38.280123 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: Accept-Encoding: gzip, deflate Jun 17 12:50:38.280123 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: Connection: keep-alive Jun 17 12:50:38.280123 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: Content-Length: 0 Jun 17 12:50:38.280123 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: Host: 10.222.0.48 Jun 17 12:50:38.280123 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: Openstack-Api-Version: compute 2.90 Jun 17 12:50:38.280123 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: Openstack-System-Scope: None Jun 17 12:50:38.280123 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: User-Agent: python-novaclient Jun 17 12:50:38.280123 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: X-Auth-Token: gAAAAABirHiddAKKtKPo-2xnTjMIyOiC6jppyrRKirDTc-hKsTIwH_AtxDzOL2p0_-dgzhMD6oukkSNe_bts2rcyow-t1stAXNdZaCwPjp0JrJMu0_eEm0gWBsqaXKXD5xEBi3tboseqtvimJ8KkQnOwPZQkBIT_nZmeDqrwG1yff-JUUU_Otkw Jun 17 12:50:38.280123 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: X-Domain-Id: None Jun 17 12:50:38.280123 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: X-Domain-Name: None Jun 17 12:50:38.280123 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: X-Identity-Status: Confirmed Jun 17 12:50:38.280123 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: X-Is-Admin-Project: True Jun 17 12:50:38.280123 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: X-Openstack-Nova-Api-Version: 2.90 Jun 17 12:50:38.280123 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: X-Project-Domain-Id: default Jun 17 12:50:38.280123 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: X-Project-Domain-Name: Default Jun 17 12:50:38.280123 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: X-Project-Id: 91e888714806438f834a0309a74fcb9e Jun 17 12:50:38.280123 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: X-Project-Name: admin Jun 17 12:50:38.280123 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: X-Role: admin,member,reader Jun 17 12:50:38.280123 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: X-Roles: admin,member,reader Jun 17 12:50:38.282811 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_91e888714806438f834a0309a74fcb9e", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/91e888714806438f834a0309a74fcb9e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/91e888714806438f834a0309a74fcb9e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/91e888714806438f834a0309a74fcb9e"}]}] Jun 17 12:50:38.282811 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: X-Tenant: admin Jun 17 12:50:38.282811 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: X-Tenant-Id: 91e888714806438f834a0309a74fcb9e Jun 17 12:50:38.282811 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: X-Tenant-Name: admin Jun 17 12:50:38.282811 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: X-User: admin Jun 17 12:50:38.282811 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: X-User-Domain-Id: default Jun 17 12:50:38.282811 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: X-User-Domain-Name: Default Jun 17 12:50:38.282811 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: X-User-Id: 037e9f95a2ad44f08247184b10274c13 Jun 17 12:50:38.282811 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: X-User-Name: admin Jun 17 12:50:38.282811 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: method: > Jun 17 12:50:38.282811 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: exception: Flavor 42 could not be found. Jun 17 12:50:38.282811 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: action_args: {'id': '42'} Jun 17 12:50:38.282811 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: {{(pid=103135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 12:50:38.282811 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 12:50:38.284593 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 17 12:50:38.284593 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 17 12:50:38.284593 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 17 12:50:38.284593 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 17 12:50:38.284593 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 17 12:50:38.284593 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 17 12:50:38.284593 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 17 12:50:38.284593 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 17 12:50:38.284593 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 17 12:50:38.284593 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 12:50:38.284593 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 17 12:50:38.284593 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 17 12:50:38.284593 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 17 12:50:38.284593 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi Jun 17 12:50:38.284593 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 12:50:38.284593 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi Jun 17 12:50:38.284593 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 12:50:38.284593 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 12:50:38.284593 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 12:50:38.287608 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 12:50:38.287608 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 12:50:38.287608 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 12:50:38.287608 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 12:50:38.287608 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 17 12:50:38.287608 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 17 12:50:38.287608 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 17 12:50:38.287608 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi Jun 17 12:50:38.287608 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 12:50:38.287608 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi Jun 17 12:50:38.287608 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 12:50:38.287608 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 12:50:38.287608 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 12:50:38.287608 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 12:50:38.287608 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 12:50:38.287608 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 17 12:50:38.287608 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi Jun 17 12:50:38.287608 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi [None req-772884ae-37bc-4955-bb9d-e5d39b262466 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 12:50:38.289595 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: INFO nova.api.openstack.requestlog [None req-772884ae-37bc-4955-bb9d-e5d39b262466 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.016439 Jun 17 12:50:38.289595 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: [pid: 103135|app: 0|req: 22/42] 10.222.0.48 () {60 vars in 1190 bytes} [Fri Jun 17 12:50:38 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 17 12:50:39.160102 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi [None req-eb85b6dc-d09b-45e7-92bd-c88fe2a7a105 admin admin] Calling method '>' {{(pid=103134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:50:39.161143 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: INFO nova.api.openstack.requestlog [None req-eb85b6dc-d09b-45e7-92bd-c88fe2a7a105 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 Jun 17 12:50:39.161540 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: [pid: 103134|app: 0|req: 21/43] 10.222.0.48 () {56 vars in 1074 bytes} [Fri Jun 17 12:50:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:50:39.389567 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi [None req-2821f4fb-8b42-4208-84b4-a3e754e1e1a5 admin admin] Calling method '>' {{(pid=103135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:50:39.395619 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: INFO nova.api.openstack.wsgi [None req-2821f4fb-8b42-4208-84b4-a3e754e1e1a5 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 17 12:50:39.397938 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi [None req-2821f4fb-8b42-4208-84b4-a3e754e1e1a5 admin admin] Request method failure captured: Jun 17 12:50:39.397938 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 17 12:50:39.397938 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: Accept: application/json Jun 17 12:50:39.397938 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: Accept-Encoding: gzip, deflate Jun 17 12:50:39.397938 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: Connection: keep-alive Jun 17 12:50:39.397938 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: Content-Length: 0 Jun 17 12:50:39.397938 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: Host: 10.222.0.48 Jun 17 12:50:39.397938 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: Openstack-Api-Version: compute 2.90 Jun 17 12:50:39.397938 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: Openstack-System-Scope: None Jun 17 12:50:39.397938 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: User-Agent: python-novaclient Jun 17 12:50:39.397938 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: X-Auth-Token: gAAAAABirHifYHVXxKDpJYvjUs1x3mBPOb83l3OS6Wc356M8COeV_UioqG9j3KqDc-fm0K5qwRMSuLgWDZcEpALckdUfTXukJtEjM6c2fma1SE5uRFr4VeQ0pc5e9Q6nGnpGTilZhrKYeBPMThcGmZ7RrFLlLsgLeZblHf8D7YX3vZy0jUN2LRw Jun 17 12:50:39.397938 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: X-Domain-Id: None Jun 17 12:50:39.397938 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: X-Domain-Name: None Jun 17 12:50:39.397938 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: X-Identity-Status: Confirmed Jun 17 12:50:39.397938 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: X-Is-Admin-Project: True Jun 17 12:50:39.397938 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: X-Openstack-Nova-Api-Version: 2.90 Jun 17 12:50:39.397938 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: X-Project-Domain-Id: default Jun 17 12:50:39.397938 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: X-Project-Domain-Name: Default Jun 17 12:50:39.397938 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: X-Project-Id: 91e888714806438f834a0309a74fcb9e Jun 17 12:50:39.397938 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: X-Project-Name: admin Jun 17 12:50:39.397938 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: X-Role: admin,member,reader Jun 17 12:50:39.397938 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: X-Roles: admin,member,reader Jun 17 12:50:39.399459 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_91e888714806438f834a0309a74fcb9e", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/91e888714806438f834a0309a74fcb9e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/91e888714806438f834a0309a74fcb9e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/91e888714806438f834a0309a74fcb9e"}]}] Jun 17 12:50:39.399459 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: X-Tenant: admin Jun 17 12:50:39.399459 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: X-Tenant-Id: 91e888714806438f834a0309a74fcb9e Jun 17 12:50:39.399459 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: X-Tenant-Name: admin Jun 17 12:50:39.399459 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: X-User: admin Jun 17 12:50:39.399459 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: X-User-Domain-Id: default Jun 17 12:50:39.399459 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: X-User-Domain-Name: Default Jun 17 12:50:39.399459 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: X-User-Id: 037e9f95a2ad44f08247184b10274c13 Jun 17 12:50:39.399459 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: X-User-Name: admin Jun 17 12:50:39.399459 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: method: > Jun 17 12:50:39.399459 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: exception: Flavor 84 could not be found. Jun 17 12:50:39.399459 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: action_args: {'id': '84'} Jun 17 12:50:39.399459 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: {{(pid=103135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 12:50:39.399459 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 12:50:39.400430 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 17 12:50:39.400430 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 17 12:50:39.400430 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 17 12:50:39.400430 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 17 12:50:39.400430 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 17 12:50:39.400430 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 17 12:50:39.400430 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 17 12:50:39.400430 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 17 12:50:39.400430 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 17 12:50:39.400430 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 12:50:39.400430 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 17 12:50:39.400430 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 17 12:50:39.400430 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 17 12:50:39.400430 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi Jun 17 12:50:39.400430 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 12:50:39.400430 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi Jun 17 12:50:39.400430 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 12:50:39.400430 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 12:50:39.400430 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 12:50:39.401738 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 12:50:39.401738 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 12:50:39.401738 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 12:50:39.401738 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 12:50:39.401738 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 17 12:50:39.401738 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 17 12:50:39.401738 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 17 12:50:39.401738 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi Jun 17 12:50:39.401738 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 12:50:39.401738 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi Jun 17 12:50:39.401738 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 12:50:39.401738 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 12:50:39.401738 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 12:50:39.401738 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 12:50:39.401738 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 12:50:39.401738 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 17 12:50:39.401738 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi Jun 17 12:50:39.401738 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi [None req-2821f4fb-8b42-4208-84b4-a3e754e1e1a5 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 12:50:39.403043 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: INFO nova.api.openstack.requestlog [None req-2821f4fb-8b42-4208-84b4-a3e754e1e1a5 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.088206 Jun 17 12:50:39.403255 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: [pid: 103135|app: 0|req: 23/44] 10.222.0.48 () {60 vars in 1190 bytes} [Fri Jun 17 12:50:39 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 17 12:50:39.409218 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi [None req-938d3116-b2a4-4737-880a-f91efa6b3a51 admin admin] Calling method '>' {{(pid=103134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:50:39.425632 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: INFO nova.api.openstack.requestlog [None req-938d3116-b2a4-4737-880a-f91efa6b3a51 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019981 Jun 17 12:50:39.426205 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: [pid: 103134|app: 0|req: 22/45] 10.222.0.48 () {60 vars in 1210 bytes} [Fri Jun 17 12:50:39 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 12:50:39.436738 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi [None req-2acf873c-6fab-4e37-afb2-323df41f7f73 admin admin] Calling method '>' {{(pid=103135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:50:39.451061 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: INFO nova.api.openstack.requestlog [None req-2acf873c-6fab-4e37-afb2-323df41f7f73 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017944 Jun 17 12:50:39.451638 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: [pid: 103135|app: 0|req: 24/46] 10.222.0.48 () {60 vars in 1210 bytes} [Fri Jun 17 12:50:39 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 12:50:39.462496 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi [None req-f8e05a67-c729-420f-a3b0-904d7eba37e9 admin admin] Calling method '>' {{(pid=103134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:50:39.468387 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: INFO nova.api.openstack.wsgi [None req-f8e05a67-c729-420f-a3b0-904d7eba37e9 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 17 12:50:39.469906 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi [None req-f8e05a67-c729-420f-a3b0-904d7eba37e9 admin admin] Request method failure captured: Jun 17 12:50:39.469906 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 17 12:50:39.469906 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: Accept: application/json Jun 17 12:50:39.469906 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: Accept-Encoding: gzip, deflate Jun 17 12:50:39.469906 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: Connection: keep-alive Jun 17 12:50:39.469906 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: Content-Length: 0 Jun 17 12:50:39.469906 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: Host: 10.222.0.48 Jun 17 12:50:39.469906 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: Openstack-Api-Version: compute 2.90 Jun 17 12:50:39.469906 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: Openstack-System-Scope: None Jun 17 12:50:39.469906 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: User-Agent: python-novaclient Jun 17 12:50:39.469906 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: X-Auth-Token: gAAAAABirHifYHVXxKDpJYvjUs1x3mBPOb83l3OS6Wc356M8COeV_UioqG9j3KqDc-fm0K5qwRMSuLgWDZcEpALckdUfTXukJtEjM6c2fma1SE5uRFr4VeQ0pc5e9Q6nGnpGTilZhrKYeBPMThcGmZ7RrFLlLsgLeZblHf8D7YX3vZy0jUN2LRw Jun 17 12:50:39.469906 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: X-Domain-Id: None Jun 17 12:50:39.469906 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: X-Domain-Name: None Jun 17 12:50:39.469906 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: X-Identity-Status: Confirmed Jun 17 12:50:39.469906 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: X-Is-Admin-Project: True Jun 17 12:50:39.469906 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: X-Openstack-Nova-Api-Version: 2.90 Jun 17 12:50:39.469906 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: X-Project-Domain-Id: default Jun 17 12:50:39.469906 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: X-Project-Domain-Name: Default Jun 17 12:50:39.469906 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: X-Project-Id: 91e888714806438f834a0309a74fcb9e Jun 17 12:50:39.469906 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: X-Project-Name: admin Jun 17 12:50:39.469906 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: X-Role: admin,member,reader Jun 17 12:50:39.469906 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: X-Roles: admin,member,reader Jun 17 12:50:39.471438 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_91e888714806438f834a0309a74fcb9e", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/91e888714806438f834a0309a74fcb9e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/91e888714806438f834a0309a74fcb9e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/91e888714806438f834a0309a74fcb9e"}]}] Jun 17 12:50:39.471438 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: X-Tenant: admin Jun 17 12:50:39.471438 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: X-Tenant-Id: 91e888714806438f834a0309a74fcb9e Jun 17 12:50:39.471438 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: X-Tenant-Name: admin Jun 17 12:50:39.471438 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: X-User: admin Jun 17 12:50:39.471438 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: X-User-Domain-Id: default Jun 17 12:50:39.471438 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: X-User-Domain-Name: Default Jun 17 12:50:39.471438 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: X-User-Id: 037e9f95a2ad44f08247184b10274c13 Jun 17 12:50:39.471438 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: X-User-Name: admin Jun 17 12:50:39.471438 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: method: > Jun 17 12:50:39.471438 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: exception: Flavor 84 could not be found. Jun 17 12:50:39.471438 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: action_args: {'id': '84'} Jun 17 12:50:39.471438 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: {{(pid=103134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 12:50:39.471438 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 12:50:39.473406 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 17 12:50:39.473406 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 17 12:50:39.473406 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 17 12:50:39.473406 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 17 12:50:39.473406 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 17 12:50:39.473406 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 17 12:50:39.473406 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 17 12:50:39.473406 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 17 12:50:39.473406 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 17 12:50:39.473406 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 12:50:39.473406 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 17 12:50:39.473406 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 17 12:50:39.473406 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 17 12:50:39.473406 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi Jun 17 12:50:39.473406 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 12:50:39.473406 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi Jun 17 12:50:39.473406 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 12:50:39.473406 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 12:50:39.473406 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 12:50:39.474954 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 12:50:39.474954 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 12:50:39.474954 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 12:50:39.474954 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 12:50:39.474954 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 17 12:50:39.474954 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 17 12:50:39.474954 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 17 12:50:39.474954 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi Jun 17 12:50:39.474954 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 12:50:39.474954 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi Jun 17 12:50:39.474954 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 12:50:39.474954 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 12:50:39.474954 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 12:50:39.474954 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 12:50:39.474954 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 12:50:39.474954 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 17 12:50:39.474954 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi Jun 17 12:50:39.474954 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi [None req-f8e05a67-c729-420f-a3b0-904d7eba37e9 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 12:50:39.476148 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: INFO nova.api.openstack.requestlog [None req-f8e05a67-c729-420f-a3b0-904d7eba37e9 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.013026 Jun 17 12:50:39.476148 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: [pid: 103134|app: 0|req: 23/47] 10.222.0.48 () {60 vars in 1190 bytes} [Fri Jun 17 12:50:39 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 17 12:50:40.347816 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi [None req-2acf873c-6fab-4e37-afb2-323df41f7f73 admin admin] Calling method '>' {{(pid=103135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:50:40.348940 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: INFO nova.api.openstack.requestlog [None req-2acf873c-6fab-4e37-afb2-323df41f7f73 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001598 Jun 17 12:50:40.349382 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: [pid: 103135|app: 0|req: 25/48] 10.222.0.48 () {56 vars in 1074 bytes} [Fri Jun 17 12:50:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:50:40.549406 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi [None req-b0a1ce3e-4737-4f66-9d89-bff7f6013f81 admin admin] Calling method '>' {{(pid=103134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:50:40.555457 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: INFO nova.api.openstack.wsgi [None req-b0a1ce3e-4737-4f66-9d89-bff7f6013f81 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 17 12:50:40.556967 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi [None req-b0a1ce3e-4737-4f66-9d89-bff7f6013f81 admin admin] Request method failure captured: Jun 17 12:50:40.556967 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 17 12:50:40.556967 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: Accept: application/json Jun 17 12:50:40.556967 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: Accept-Encoding: gzip, deflate Jun 17 12:50:40.556967 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: Connection: keep-alive Jun 17 12:50:40.556967 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: Content-Length: 0 Jun 17 12:50:40.556967 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: Host: 10.222.0.48 Jun 17 12:50:40.556967 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: Openstack-Api-Version: compute 2.90 Jun 17 12:50:40.556967 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: Openstack-System-Scope: None Jun 17 12:50:40.556967 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: User-Agent: python-novaclient Jun 17 12:50:40.556967 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: X-Auth-Token: gAAAAABirHigWcv1bG79k3KUVlKicM89HqGmCDC-DXm_wyxYUadkp9xH03uejCU-adf_l9s4f9H7jBVDcBNA_Bato04ajap0sCrfK4TK7Oh5xwwxb2s4ULiabZPD_xC3zzzGgJqfb7HT2TsOmMqEO5eSk_GP74MKi5hsiEjpPe65gaDt1cMU2UY Jun 17 12:50:40.556967 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: X-Domain-Id: None Jun 17 12:50:40.556967 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: X-Domain-Name: None Jun 17 12:50:40.556967 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: X-Identity-Status: Confirmed Jun 17 12:50:40.556967 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: X-Is-Admin-Project: True Jun 17 12:50:40.556967 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: X-Openstack-Nova-Api-Version: 2.90 Jun 17 12:50:40.556967 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: X-Project-Domain-Id: default Jun 17 12:50:40.556967 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: X-Project-Domain-Name: Default Jun 17 12:50:40.556967 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: X-Project-Id: 91e888714806438f834a0309a74fcb9e Jun 17 12:50:40.556967 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: X-Project-Name: admin Jun 17 12:50:40.556967 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: X-Role: admin,member,reader Jun 17 12:50:40.556967 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: X-Roles: admin,member,reader Jun 17 12:50:40.558580 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_91e888714806438f834a0309a74fcb9e", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/91e888714806438f834a0309a74fcb9e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/91e888714806438f834a0309a74fcb9e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/91e888714806438f834a0309a74fcb9e"}]}] Jun 17 12:50:40.558580 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: X-Tenant: admin Jun 17 12:50:40.558580 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: X-Tenant-Id: 91e888714806438f834a0309a74fcb9e Jun 17 12:50:40.558580 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: X-Tenant-Name: admin Jun 17 12:50:40.558580 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: X-User: admin Jun 17 12:50:40.558580 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: X-User-Domain-Id: default Jun 17 12:50:40.558580 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: X-User-Domain-Name: Default Jun 17 12:50:40.558580 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: X-User-Id: 037e9f95a2ad44f08247184b10274c13 Jun 17 12:50:40.558580 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: X-User-Name: admin Jun 17 12:50:40.558580 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: method: > Jun 17 12:50:40.558580 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: exception: Flavor 451 could not be found. Jun 17 12:50:40.558580 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: action_args: {'id': '451'} Jun 17 12:50:40.558580 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: {{(pid=103134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 12:50:40.558580 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 12:50:40.559513 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 17 12:50:40.559513 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 17 12:50:40.559513 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 17 12:50:40.559513 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 17 12:50:40.559513 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 17 12:50:40.559513 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 17 12:50:40.559513 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 17 12:50:40.559513 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 17 12:50:40.559513 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 17 12:50:40.559513 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 12:50:40.559513 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 17 12:50:40.559513 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 17 12:50:40.559513 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 17 12:50:40.559513 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi Jun 17 12:50:40.559513 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 12:50:40.559513 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi Jun 17 12:50:40.559513 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 12:50:40.559513 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 12:50:40.559513 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 12:50:40.560763 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 12:50:40.560763 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 12:50:40.560763 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 12:50:40.560763 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 12:50:40.560763 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 17 12:50:40.560763 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 17 12:50:40.560763 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 17 12:50:40.560763 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi Jun 17 12:50:40.560763 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 12:50:40.560763 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi Jun 17 12:50:40.560763 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 12:50:40.560763 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 12:50:40.560763 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 12:50:40.560763 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 12:50:40.560763 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 12:50:40.560763 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 17 12:50:40.560763 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi Jun 17 12:50:40.560763 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi [None req-b0a1ce3e-4737-4f66-9d89-bff7f6013f81 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 12:50:40.561937 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: INFO nova.api.openstack.requestlog [None req-b0a1ce3e-4737-4f66-9d89-bff7f6013f81 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.068350 Jun 17 12:50:40.561937 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: [pid: 103134|app: 0|req: 24/49] 10.222.0.48 () {60 vars in 1193 bytes} [Fri Jun 17 12:50:40 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 17 12:50:40.568094 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi [None req-69fd03dd-32d2-4f7f-b551-7d807f27642e admin admin] Calling method '>' {{(pid=103135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:50:40.582215 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: INFO nova.api.openstack.requestlog [None req-69fd03dd-32d2-4f7f-b551-7d807f27642e admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017661 Jun 17 12:50:40.582750 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: [pid: 103135|app: 0|req: 26/50] 10.222.0.48 () {60 vars in 1210 bytes} [Fri Jun 17 12:50:40 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 12:50:40.592590 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi [None req-c976ec93-614a-4adf-9798-0f351b0ad764 admin admin] Calling method '>' {{(pid=103134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:50:40.606842 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: INFO nova.api.openstack.requestlog [None req-c976ec93-614a-4adf-9798-0f351b0ad764 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017808 Jun 17 12:50:40.607382 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: [pid: 103134|app: 0|req: 25/51] 10.222.0.48 () {60 vars in 1210 bytes} [Fri Jun 17 12:50:40 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 12:50:40.623348 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi [None req-9e81eacb-7a53-43f9-a684-64655cff805d admin admin] Calling method '>' {{(pid=103135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:50:40.632045 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: INFO nova.api.openstack.wsgi [None req-9e81eacb-7a53-43f9-a684-64655cff805d admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 17 12:50:40.633550 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi [None req-9e81eacb-7a53-43f9-a684-64655cff805d admin admin] Request method failure captured: Jun 17 12:50:40.633550 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 17 12:50:40.633550 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: Accept: application/json Jun 17 12:50:40.633550 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: Accept-Encoding: gzip, deflate Jun 17 12:50:40.633550 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: Connection: keep-alive Jun 17 12:50:40.633550 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: Content-Length: 0 Jun 17 12:50:40.633550 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: Host: 10.222.0.48 Jun 17 12:50:40.633550 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: Openstack-Api-Version: compute 2.90 Jun 17 12:50:40.633550 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: Openstack-System-Scope: None Jun 17 12:50:40.633550 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: User-Agent: python-novaclient Jun 17 12:50:40.633550 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: X-Auth-Token: gAAAAABirHigWcv1bG79k3KUVlKicM89HqGmCDC-DXm_wyxYUadkp9xH03uejCU-adf_l9s4f9H7jBVDcBNA_Bato04ajap0sCrfK4TK7Oh5xwwxb2s4ULiabZPD_xC3zzzGgJqfb7HT2TsOmMqEO5eSk_GP74MKi5hsiEjpPe65gaDt1cMU2UY Jun 17 12:50:40.633550 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: X-Domain-Id: None Jun 17 12:50:40.633550 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: X-Domain-Name: None Jun 17 12:50:40.633550 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: X-Identity-Status: Confirmed Jun 17 12:50:40.633550 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: X-Is-Admin-Project: True Jun 17 12:50:40.633550 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: X-Openstack-Nova-Api-Version: 2.90 Jun 17 12:50:40.633550 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: X-Project-Domain-Id: default Jun 17 12:50:40.633550 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: X-Project-Domain-Name: Default Jun 17 12:50:40.633550 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: X-Project-Id: 91e888714806438f834a0309a74fcb9e Jun 17 12:50:40.633550 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: X-Project-Name: admin Jun 17 12:50:40.633550 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: X-Role: admin,member,reader Jun 17 12:50:40.633550 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: X-Roles: admin,member,reader Jun 17 12:50:40.635183 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_91e888714806438f834a0309a74fcb9e", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/91e888714806438f834a0309a74fcb9e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/91e888714806438f834a0309a74fcb9e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/91e888714806438f834a0309a74fcb9e"}]}] Jun 17 12:50:40.635183 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: X-Tenant: admin Jun 17 12:50:40.635183 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: X-Tenant-Id: 91e888714806438f834a0309a74fcb9e Jun 17 12:50:40.635183 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: X-Tenant-Name: admin Jun 17 12:50:40.635183 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: X-User: admin Jun 17 12:50:40.635183 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: X-User-Domain-Id: default Jun 17 12:50:40.635183 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: X-User-Domain-Name: Default Jun 17 12:50:40.635183 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: X-User-Id: 037e9f95a2ad44f08247184b10274c13 Jun 17 12:50:40.635183 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: X-User-Name: admin Jun 17 12:50:40.635183 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: method: > Jun 17 12:50:40.635183 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: exception: Flavor 451 could not be found. Jun 17 12:50:40.635183 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: action_args: {'id': '451'} Jun 17 12:50:40.635183 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: {{(pid=103135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 12:50:40.635183 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 12:50:40.636164 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 17 12:50:40.636164 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 17 12:50:40.636164 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 17 12:50:40.636164 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 17 12:50:40.636164 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 17 12:50:40.636164 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 17 12:50:40.636164 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 17 12:50:40.636164 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 17 12:50:40.636164 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 17 12:50:40.636164 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 12:50:40.636164 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 17 12:50:40.636164 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 17 12:50:40.636164 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 17 12:50:40.636164 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi Jun 17 12:50:40.636164 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 12:50:40.636164 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi Jun 17 12:50:40.636164 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 12:50:40.636164 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 12:50:40.636164 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 12:50:40.638073 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 12:50:40.638073 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 12:50:40.638073 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 12:50:40.638073 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 12:50:40.638073 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 17 12:50:40.638073 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 17 12:50:40.638073 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 17 12:50:40.638073 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi Jun 17 12:50:40.638073 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 12:50:40.638073 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi Jun 17 12:50:40.638073 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 12:50:40.638073 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 12:50:40.638073 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 12:50:40.638073 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 12:50:40.638073 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 12:50:40.638073 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 17 12:50:40.638073 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: ERROR nova.api.openstack.wsgi Jun 17 12:50:40.638073 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi [None req-9e81eacb-7a53-43f9-a684-64655cff805d admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 12:50:40.639406 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: INFO nova.api.openstack.requestlog [None req-9e81eacb-7a53-43f9-a684-64655cff805d admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.018096 Jun 17 12:50:40.639406 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: [pid: 103135|app: 0|req: 27/52] 10.222.0.48 () {60 vars in 1193 bytes} [Fri Jun 17 12:50:40 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 17 12:50:41.526423 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi [None req-c976ec93-614a-4adf-9798-0f351b0ad764 admin admin] Calling method '>' {{(pid=103134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:50:41.527444 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: INFO nova.api.openstack.requestlog [None req-c976ec93-614a-4adf-9798-0f351b0ad764 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001490 Jun 17 12:50:41.527836 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: [pid: 103134|app: 0|req: 26/53] 10.222.0.48 () {56 vars in 1074 bytes} [Fri Jun 17 12:50:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:50:41.736644 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi [None req-b17e7dab-a05f-413e-8967-8ab1ca00c500 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 12:50:41.759459 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: INFO nova.api.openstack.requestlog [None req-b17e7dab-a05f-413e-8967-8ab1ca00c500 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.093647 Jun 17 12:50:41.760007 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: [pid: 103135|app: 0|req: 28/54] 10.222.0.48 () {64 vars in 1235 bytes} [Fri Jun 17 12:50:41 2022] POST /compute/v2.1/flavors => generated 404 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:50:42.651494 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi [None req-c976ec93-614a-4adf-9798-0f351b0ad764 admin admin] Calling method '>' {{(pid=103134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:50:42.652640 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: INFO nova.api.openstack.requestlog [None req-c976ec93-614a-4adf-9798-0f351b0ad764 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001610 Jun 17 12:50:42.653050 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: [pid: 103134|app: 0|req: 27/55] 10.222.0.48 () {56 vars in 1074 bytes} [Fri Jun 17 12:50:42 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:50:42.863437 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi [None req-0828fa85-90eb-4afd-822b-2646da003956 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 12:50:42.887526 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: INFO nova.api.openstack.requestlog [None req-0828fa85-90eb-4afd-822b-2646da003956 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.085083 Jun 17 12:50:42.888101 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: [pid: 103135|app: 0|req: 29/56] 10.222.0.48 () {64 vars in 1235 bytes} [Fri Jun 17 12:50:42 2022] POST /compute/v2.1/flavors => generated 405 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:50:43.779602 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi [None req-c976ec93-614a-4adf-9798-0f351b0ad764 admin admin] Calling method '>' {{(pid=103134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:50:43.780682 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: INFO nova.api.openstack.requestlog [None req-c976ec93-614a-4adf-9798-0f351b0ad764 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001506 Jun 17 12:50:43.781079 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: [pid: 103134|app: 0|req: 28/57] 10.222.0.48 () {56 vars in 1074 bytes} [Fri Jun 17 12:50:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:50:44.005449 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi [None req-5cc18ece-924f-4b2e-b93b-b7637597f302 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 12:50:44.032431 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: INFO nova.api.openstack.requestlog [None req-5cc18ece-924f-4b2e-b93b-b7637597f302 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.096360 Jun 17 12:50:44.032975 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: [pid: 103135|app: 0|req: 30/58] 10.222.0.48 () {64 vars in 1235 bytes} [Fri Jun 17 12:50:43 2022] POST /compute/v2.1/flavors => generated 407 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:50:45.001285 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi [None req-c976ec93-614a-4adf-9798-0f351b0ad764 admin admin] Calling method '>' {{(pid=103134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:50:45.002378 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: INFO nova.api.openstack.requestlog [None req-c976ec93-614a-4adf-9798-0f351b0ad764 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001486 Jun 17 12:50:45.002777 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: [pid: 103134|app: 0|req: 29/59] 10.222.0.48 () {56 vars in 1074 bytes} [Fri Jun 17 12:50:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:50:45.203083 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi [None req-f6799532-b68e-4627-a43f-58cd7fadd8b9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 12:50:45.223220 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: INFO nova.api.openstack.requestlog [None req-f6799532-b68e-4627-a43f-58cd7fadd8b9 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.081129 Jun 17 12:50:45.223800 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: [pid: 103135|app: 0|req: 31/60] 10.222.0.48 () {64 vars in 1235 bytes} [Fri Jun 17 12:50:45 2022] POST /compute/v2.1/flavors => generated 409 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:50:46.116508 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi [None req-c976ec93-614a-4adf-9798-0f351b0ad764 admin admin] Calling method '>' {{(pid=103134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:50:46.117535 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: INFO nova.api.openstack.requestlog [None req-c976ec93-614a-4adf-9798-0f351b0ad764 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 Jun 17 12:50:46.117937 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: [pid: 103134|app: 0|req: 30/61] 10.222.0.48 () {56 vars in 1074 bytes} [Fri Jun 17 12:50:46 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:50:46.317438 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi [None req-708be21a-a8f1-4c88-994f-24534e9777e5 admin admin] Calling method '>' {{(pid=103135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:50:46.337633 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: INFO nova.api.openstack.requestlog [None req-708be21a-a8f1-4c88-994f-24534e9777e5 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.077947 Jun 17 12:50:46.338213 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: [pid: 103135|app: 0|req: 32/62] 10.222.0.48 () {60 vars in 1202 bytes} [Fri Jun 17 12:50:46 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 12:51:34.847997 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi [None req-c976ec93-614a-4adf-9798-0f351b0ad764 admin admin] Calling method '>' {{(pid=103134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:51:34.849016 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: INFO nova.api.openstack.requestlog [None req-c976ec93-614a-4adf-9798-0f351b0ad764 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Jun 17 12:51:34.849410 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: [pid: 103134|app: 0|req: 31/63] 10.222.0.48 () {54 vars in 930 bytes} [Fri Jun 17 12:51:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:51:34.863886 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG dbcounter [-] [103135] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:51:34.926525 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi [None req-31c13c8b-4b6f-4dc3-b7e8-f3b9d147393a admin admin] Calling method '>' {{(pid=103135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:51:34.951138 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: INFO nova.api.openstack.requestlog [None req-31c13c8b-4b6f-4dc3-b7e8-f3b9d147393a admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.094664 Jun 17 12:51:34.951773 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: [pid: 103135|app: 0|req: 33/64] 10.222.0.48 () {60 vars in 1291 bytes} [Fri Jun 17 12:51:34 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 12:51:34.977751 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi [None req-bcc4004b-d568-41ea-bec7-e94b3bd3fb5d admin admin] Calling method '>' {{(pid=103134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:51:34.981260 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG dbcounter [-] [103134] Writing DB stats nova_api:SELECT=14 {{(pid=103134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:51:34.987385 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: INFO nova.api.openstack.requestlog [None req-bcc4004b-d568-41ea-bec7-e94b3bd3fb5d admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013315 Jun 17 12:51:34.987928 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: [pid: 103134|app: 0|req: 32/65] 10.222.0.48 () {60 vars in 1282 bytes} [Fri Jun 17 12:51:34 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:51:35.000509 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi [None req-d8b3c496-5f31-44ea-afca-986fbb65e14c admin admin] Calling method '>' {{(pid=103135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:51:35.009456 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: INFO nova.api.openstack.requestlog [None req-d8b3c496-5f31-44ea-afca-986fbb65e14c admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012607 Jun 17 12:51:35.009988 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: [pid: 103135|app: 0|req: 34/66] 10.222.0.48 () {60 vars in 1285 bytes} [Fri Jun 17 12:51:34 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:51:35.022068 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi [None req-5585444b-18e4-4b24-988a-9c08d23f92ba admin admin] Calling method '>' {{(pid=103134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:51:35.030621 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: INFO nova.api.openstack.requestlog [None req-5585444b-18e4-4b24-988a-9c08d23f92ba admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012123 Jun 17 12:51:35.031303 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: [pid: 103134|app: 0|req: 33/67] 10.222.0.48 () {60 vars in 1285 bytes} [Fri Jun 17 12:51:35 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:51:35.042856 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi [None req-7453051c-8634-4b18-8953-b20708ff1bd1 admin admin] Calling method '>' {{(pid=103135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:51:35.050757 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: INFO nova.api.openstack.requestlog [None req-7453051c-8634-4b18-8953-b20708ff1bd1 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011605 Jun 17 12:51:35.051289 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: [pid: 103135|app: 0|req: 35/68] 10.222.0.48 () {60 vars in 1282 bytes} [Fri Jun 17 12:51:35 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:54:58.522744 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi [None req-5585444b-18e4-4b24-988a-9c08d23f92ba admin admin] Calling method '>' {{(pid=103134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:54:58.523778 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: INFO nova.api.openstack.requestlog [None req-5585444b-18e4-4b24-988a-9c08d23f92ba admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001521 Jun 17 12:54:58.524170 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: [pid: 103134|app: 0|req: 34/69] 10.222.0.48 () {56 vars in 1074 bytes} [Fri Jun 17 12:54:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:54:58.688076 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG dbcounter [-] [103135] Writing DB stats nova_api:SELECT=6 {{(pid=103135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:54:58.808023 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi [None req-6af2fd3d-0731-43a0-919d-47c8f61babde admin admin] Calling method '>' {{(pid=103135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:54:58.809603 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 17 12:54:58.809603 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: warnings.warn(msg) Jun 17 12:54:58.810875 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG oslo_concurrency.lockutils [None req-6af2fd3d-0731-43a0-919d-47c8f61babde admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:58.811296 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG oslo_concurrency.lockutils [None req-6af2fd3d-0731-43a0-919d-47c8f61babde admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:58.812117 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG oslo_concurrency.lockutils [None req-6af2fd3d-0731-43a0-919d-47c8f61babde admin admin] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:58.812544 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG oslo_concurrency.lockutils [None req-6af2fd3d-0731-43a0-919d-47c8f61babde admin admin] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:58.848228 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: INFO nova.api.openstack.requestlog [None req-6af2fd3d-0731-43a0-919d-47c8f61babde admin admin] 10.222.0.48 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.161664 Jun 17 12:54:58.848803 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: [pid: 103135|app: 0|req: 36/70] 10.222.0.48 () {60 vars in 1193 bytes} [Fri Jun 17 12:54:58 2022] GET /compute/v2.1/os-services => generated 791 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:54:59.761142 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi [None req-5585444b-18e4-4b24-988a-9c08d23f92ba admin admin] Calling method '>' {{(pid=103134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:54:59.762394 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: INFO nova.api.openstack.requestlog [None req-5585444b-18e4-4b24-988a-9c08d23f92ba admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001753 Jun 17 12:54:59.762900 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: [pid: 103134|app: 0|req: 35/71] 10.222.0.48 () {56 vars in 1074 bytes} [Fri Jun 17 12:54:59 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:54:59.966501 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi [None req-4b022ecf-d92a-497a-94cb-9838254b73fd admin admin] Calling method '>' {{(pid=103135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:54:59.967788 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 17 12:54:59.967788 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: warnings.warn(msg) Jun 17 12:54:59.969045 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG oslo_concurrency.lockutils [None req-4b022ecf-d92a-497a-94cb-9838254b73fd admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:59.969488 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG oslo_concurrency.lockutils [None req-4b022ecf-d92a-497a-94cb-9838254b73fd admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:59.970314 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG oslo_concurrency.lockutils [None req-4b022ecf-d92a-497a-94cb-9838254b73fd admin admin] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:54:59.970739 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG oslo_concurrency.lockutils [None req-4b022ecf-d92a-497a-94cb-9838254b73fd admin admin] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:54:59.992891 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: INFO nova.api.openstack.requestlog [None req-4b022ecf-d92a-497a-94cb-9838254b73fd admin admin] 10.222.0.48 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.086125 Jun 17 12:54:59.993476 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: [pid: 103135|app: 0|req: 37/72] 10.222.0.48 () {60 vars in 1193 bytes} [Fri Jun 17 12:54:59 2022] GET /compute/v2.1/os-services => generated 791 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:55:11.563729 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi [None req-5585444b-18e4-4b24-988a-9c08d23f92ba admin admin] Calling method '>' {{(pid=103134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:55:11.564681 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: INFO nova.api.openstack.requestlog [None req-5585444b-18e4-4b24-988a-9c08d23f92ba admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001618 Jun 17 12:55:11.565080 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: [pid: 103134|app: 0|req: 36/73] 10.222.0.48 () {56 vars in 1074 bytes} [Fri Jun 17 12:55:11 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:55:11.750143 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG dbcounter [-] [103135] Writing DB stats nova_cell0:SELECT=4 {{(pid=103135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:55:11.750925 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG dbcounter [-] [103135] Writing DB stats nova_cell1:SELECT=4 {{(pid=103135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:55:11.751508 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG dbcounter [-] [103135] Writing DB stats nova_api:SELECT=8 {{(pid=103135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:55:11.822313 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi [None req-f11fbfb1-e1a6-4d20-9f77-0ca70e10328c admin admin] Calling method '>' {{(pid=103135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:55:11.823559 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 17 12:55:11.823559 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: warnings.warn(msg) Jun 17 12:55:11.824855 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG oslo_concurrency.lockutils [None req-f11fbfb1-e1a6-4d20-9f77-0ca70e10328c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:55:11.825299 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG oslo_concurrency.lockutils [None req-f11fbfb1-e1a6-4d20-9f77-0ca70e10328c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:55:11.826119 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG oslo_concurrency.lockutils [None req-f11fbfb1-e1a6-4d20-9f77-0ca70e10328c admin admin] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:55:11.826529 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG oslo_concurrency.lockutils [None req-f11fbfb1-e1a6-4d20-9f77-0ca70e10328c admin admin] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:55:11.852957 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: INFO nova.api.openstack.requestlog [None req-f11fbfb1-e1a6-4d20-9f77-0ca70e10328c admin admin] 10.222.0.48 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.108150 Jun 17 12:55:11.853532 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: [pid: 103135|app: 0|req: 38/74] 10.222.0.48 () {60 vars in 1193 bytes} [Fri Jun 17 12:55:11 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 12:55:12.794899 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi [None req-5585444b-18e4-4b24-988a-9c08d23f92ba admin admin] Calling method '>' {{(pid=103134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:55:12.796734 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: INFO nova.api.openstack.requestlog [None req-5585444b-18e4-4b24-988a-9c08d23f92ba admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002584 Jun 17 12:55:12.797444 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: [pid: 103134|app: 0|req: 37/75] 10.222.0.48 () {56 vars in 1074 bytes} [Fri Jun 17 12:55:12 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:55:13.112647 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG nova.api.openstack.wsgi [None req-8988e500-4ec8-47ae-aef5-1cce560a1980 admin admin] Calling method '>' {{(pid=103135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:55:13.114304 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 17 12:55:13.114304 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: warnings.warn(msg) Jun 17 12:55:13.116589 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG oslo_concurrency.lockutils [None req-8988e500-4ec8-47ae-aef5-1cce560a1980 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:55:13.117359 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG oslo_concurrency.lockutils [None req-8988e500-4ec8-47ae-aef5-1cce560a1980 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:55:13.118790 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG oslo_concurrency.lockutils [None req-8988e500-4ec8-47ae-aef5-1cce560a1980 admin admin] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:55:13.119550 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: DEBUG oslo_concurrency.lockutils [None req-8988e500-4ec8-47ae-aef5-1cce560a1980 admin admin] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:55:13.158910 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: INFO nova.api.openstack.requestlog [None req-8988e500-4ec8-47ae-aef5-1cce560a1980 admin admin] 10.222.0.48 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.110787 Jun 17 12:55:13.159874 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: [pid: 103135|app: 0|req: 39/76] 10.222.0.48 () {60 vars in 1193 bytes} [Fri Jun 17 12:55:13 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 12:56:12.542750 dv-cinder-837543-5-iscsi devstack@n-api.service[103133]: Fri Jun 17 12:56:12 2022 - graceful shutdown triggered... Jun 17 12:56:12.543013 dv-cinder-837543-5-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jun 17 12:56:12.543988 dv-cinder-837543-5-iscsi devstack@n-api.service[103134]: Gracefully killing worker 1 (pid: 103134)... Jun 17 12:56:12.544383 dv-cinder-837543-5-iscsi devstack@n-api.service[103135]: Gracefully killing worker 2 (pid: 103135)... Jun 17 12:56:13.545165 dv-cinder-837543-5-iscsi devstack@n-api.service[103133]: worker 1 buried after 1 seconds Jun 17 12:56:13.545165 dv-cinder-837543-5-iscsi devstack@n-api.service[103133]: worker 2 buried after 1 seconds Jun 17 12:56:13.545165 dv-cinder-837543-5-iscsi devstack@n-api.service[103133]: goodbye to uWSGI. Jun 17 12:56:13.546920 dv-cinder-837543-5-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jun 17 12:56:13.547473 dv-cinder-837543-5-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jun 17 12:56:13.550322 dv-cinder-837543-5-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 17 12:56:13.562521 dv-cinder-837543-5-iscsi devstack@n-api.service[117642]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 17 12:56:13.565046 dv-cinder-837543-5-iscsi devstack@n-api.service[117642]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Jun 17 12:56:13 2022] *** Jun 17 12:56:13.565046 dv-cinder-837543-5-iscsi devstack@n-api.service[117642]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 17 12:56:13.565046 dv-cinder-837543-5-iscsi devstack@n-api.service[117642]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 17 12:56:13.565046 dv-cinder-837543-5-iscsi devstack@n-api.service[117642]: nodename: dv-cinder-837543-5-iscsi Jun 17 12:56:13.565046 dv-cinder-837543-5-iscsi devstack@n-api.service[117642]: machine: x86_64 Jun 17 12:56:13.565046 dv-cinder-837543-5-iscsi devstack@n-api.service[117642]: clock source: unix Jun 17 12:56:13.565046 dv-cinder-837543-5-iscsi devstack@n-api.service[117642]: pcre jit disabled Jun 17 12:56:13.565046 dv-cinder-837543-5-iscsi devstack@n-api.service[117642]: detected number of CPU cores: 4 Jun 17 12:56:13.565046 dv-cinder-837543-5-iscsi devstack@n-api.service[117642]: current working directory: / Jun 17 12:56:13.565046 dv-cinder-837543-5-iscsi devstack@n-api.service[117642]: detected binary path: /usr/bin/uwsgi-core Jun 17 12:56:13.565046 dv-cinder-837543-5-iscsi devstack@n-api.service[117642]: your processes number limit is 47680 Jun 17 12:56:13.565046 dv-cinder-837543-5-iscsi devstack@n-api.service[117642]: your memory page size is 4096 bytes Jun 17 12:56:13.565046 dv-cinder-837543-5-iscsi devstack@n-api.service[117642]: detected max file descriptor number: 2048 Jun 17 12:56:13.565046 dv-cinder-837543-5-iscsi devstack@n-api.service[117642]: lock engine: pthread robust mutexes Jun 17 12:56:13.566010 dv-cinder-837543-5-iscsi devstack@n-api.service[117642]: thunder lock: enabled Jun 17 12:56:13.566010 dv-cinder-837543-5-iscsi devstack@n-api.service[117642]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 17 12:56:13.566010 dv-cinder-837543-5-iscsi devstack@n-api.service[117642]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 17 12:56:13.612375 dv-cinder-837543-5-iscsi devstack@n-api.service[117642]: Python main interpreter initialized at 0x55d1670049c0 Jun 17 12:56:13.612656 dv-cinder-837543-5-iscsi devstack@n-api.service[117642]: python threads support enabled Jun 17 12:56:13.612784 dv-cinder-837543-5-iscsi devstack@n-api.service[117642]: your server socket listen backlog is limited to 100 connections Jun 17 12:56:13.612899 dv-cinder-837543-5-iscsi devstack@n-api.service[117642]: your mercy for graceful operations on workers is 90 seconds Jun 17 12:56:13.613352 dv-cinder-837543-5-iscsi devstack@n-api.service[117642]: mapped 403077 bytes (393 KB) for 2 cores Jun 17 12:56:13.613584 dv-cinder-837543-5-iscsi devstack@n-api.service[117642]: *** Operational MODE: preforking *** Jun 17 12:56:13.614051 dv-cinder-837543-5-iscsi devstack@n-api.service[117642]: *** uWSGI is running in multiple interpreter mode *** Jun 17 12:56:13.614204 dv-cinder-837543-5-iscsi devstack@n-api.service[117642]: spawned uWSGI master process (pid: 117642) Jun 17 12:56:13.614623 dv-cinder-837543-5-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 17 12:56:13.615346 dv-cinder-837543-5-iscsi devstack@n-api.service[117642]: spawned uWSGI worker 1 (pid: 117659, cores: 1) Jun 17 12:56:13.615877 dv-cinder-837543-5-iscsi devstack@n-api.service[117642]: spawned uWSGI worker 2 (pid: 117660, cores: 1) Jun 17 12:56:13.616166 dv-cinder-837543-5-iscsi devstack@n-api.service[117642]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 17 12:56:14.299574 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 17 12:56:14.316884 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 17 12:56:15.563613 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 17 12:56:15.563613 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: from cryptography.utils import int_from_bytes Jun 17 12:56:15.564102 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 17 12:56:15.564102 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: from cryptography.utils import int_from_bytes Jun 17 12:56:15.617706 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 17 12:56:15.617706 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: from cryptography.utils import int_from_bytes Jun 17 12:56:15.618461 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 17 12:56:15.618461 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: from cryptography.utils import int_from_bytes Jun 17 12:56:17.966360 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 17 12:56:17.967018 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 17 12:56:17.967519 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 17 12:56:17.967865 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 17 12:56:17.968128 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 17 12:56:17.968522 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:17.968844 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:17.969162 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:17.969520 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:17.969800 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:17.970140 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:17.970457 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:17.970773 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:17.971101 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:17.971356 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:17.971670 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:17.971991 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-837543-5-iscsi {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:17.972307 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:17.972607 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:17.972915 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:17.973230 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:17.973540 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:17.973832 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:17.974188 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:17.974688 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:17.976109 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:17.976109 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:17.976109 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:17.976109 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:17.976492 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:17.976728 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:17.976928 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:17.977269 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:17.977559 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:17.977893 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:17.978331 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-837543-5-iscsi {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:17.978651 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:17.978962 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:17.979269 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:17.979693 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:17.979988 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:17.980290 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:17.980589 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:17.980940 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:17.981230 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:17.981688 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:17.981976 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:17.982715 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:17.983239 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:17.983397 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:17.983645 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:17.987779 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:17.987779 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:17.987779 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:17.987779 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:17.987779 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:17.987779 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:17.987779 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:17.987779 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:17.988937 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:17.988937 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:17.988937 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:17.988937 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:17.988937 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:17.988937 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:17.989731 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:17.989731 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:17.989731 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:17.989731 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:17.989731 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:17.989731 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:17.989731 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:17.990726 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:17.990726 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:17.990726 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:17.991150 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:17.991292 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:17.991741 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.48 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:17.991895 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.48 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:17.992124 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:17.992963 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:17.992963 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:17.993286 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:17.993423 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:17.993761 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:17.993950 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:17.994406 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:17.994712 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:17.995023 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:17.995350 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:17.995653 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:17.995900 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:17.996200 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:17.996498 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:17.996808 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:17.997113 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:17.997413 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:17.998074 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:17.998432 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:17.998736 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:17.999042 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:17.999340 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:17.999650 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:17.999953 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:18.000258 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:18.000539 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:18.000859 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:18.001140 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:18.001471 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:18.001932 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:18.002146 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:18.002396 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:18.002682 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:18.002985 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:18.003306 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:18.003609 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:18.003912 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:18.004227 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:18.004526 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:18.004826 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:18.005135 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:18.005440 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:18.005743 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:18.006056 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:18.006376 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:18.006677 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:18.006990 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:18.007293 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:18.007593 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:18.007895 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:18.008195 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:18.008571 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:18.008790 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:18.009090 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:18.009388 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:18.009684 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:18.009998 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:18.010337 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:18.010643 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:18.010945 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:18.011244 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:18.011587 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:18.011947 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.012218 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.012561 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.012873 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.013208 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.013564 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.013881 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.014213 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.014524 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.014847 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.015155 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.015464 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.015773 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.016089 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.016467 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.016720 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.017032 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.017343 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.017657 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.017990 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.018293 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.018709 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.018947 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.019230 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.019569 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.019924 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.020227 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.020539 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.020858 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.021165 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.021471 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.021778 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.022144 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.022430 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.022737 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.023058 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.023364 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.023670 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.023976 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.024284 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.024590 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.024924 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.025237 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.025549 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.025857 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.026191 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.026574 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.026806 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.027112 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.027414 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.027717 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.028123 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.028373 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.028673 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.029015 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.029363 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.029798 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.030159 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.030467 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.030776 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.031085 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.031391 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.031692 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.032001 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.032324 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.032606 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.032922 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.033232 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.033533 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.033851 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.034189 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.034488 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.034798 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.035102 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.035412 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.035715 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.036020 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.036335 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.036685 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.036949 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.037278 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.037609 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.037911 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.038251 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.038574 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.038901 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.039188 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.039493 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.039793 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.040093 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.040391 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.040700 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.041000 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.041345 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.041601 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.041944 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.042280 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.042620 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.042892 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.043194 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.043493 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.043794 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.044136 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.044492 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.044820 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.045146 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.045563 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.045891 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.046316 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.046538 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.046854 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.047162 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.047472 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.047780 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.048096 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.048405 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.048722 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.049030 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.049352 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.049659 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.049976 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.050299 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.050614 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.050953 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.051281 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.051596 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.051914 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.052222 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.052565 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.052843 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.053149 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.053453 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.053760 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.054075 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.054401 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.054713 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.055020 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.055336 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.055643 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.055953 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.056327 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.056575 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.056911 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.057196 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.057503 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.057810 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.058147 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.058456 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.058761 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.059066 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.059444 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.059666 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.059971 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.060370 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.060760 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.061131 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.061437 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.061750 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.062325 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.062509 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.062797 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.063043 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.063266 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.063573 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.063891 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.064205 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.064508 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.064808 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.065125 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.065430 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.065732 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.066032 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.066450 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.066701 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 17 12:56:18.067299 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.067457 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 17 12:56:18.067651 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.067651 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.067944 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 17 12:56:18.068109 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.068257 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 17 12:56:18.068402 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.068547 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 17 12:56:18.068686 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.068842 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:18.069087 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.069087 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.069366 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:18.069528 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.069771 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:18.069913 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.070182 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:18.070341 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.070480 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:18.070617 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.070754 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:18.070899 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.071045 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:18.071183 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.071328 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:18.071466 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.071609 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:18.071762 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.071908 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:18.072071 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.072210 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:18.072347 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.072498 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-837543-5-iscsi {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:18.072645 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.072964 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:18.073208 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.073359 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:18.073498 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.073645 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:18.073796 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.073936 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:18.074081 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.074266 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:18.074266 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:18.074550 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.074698 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:18.074842 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.074842 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.075113 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:18.075280 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.075428 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:18.075565 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.075710 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:18.076014 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.076156 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:18.076302 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.076442 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:18.076442 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:18.076929 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.076929 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.076929 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.077425 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:18.077570 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.077708 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:18.077854 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.078001 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:18.078179 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.078323 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:18.078503 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.078503 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.078786 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:18.078932 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.079231 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-837543-5-iscsi {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:18.079379 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.079519 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:18.079671 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.079835 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:18.080084 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.080246 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:18.080385 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.080385 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.080656 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:18.080794 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.080931 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:18.081076 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.081221 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:18.081372 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.081517 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:18.081655 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.081801 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:18.081938 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.082126 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:18.082286 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.082438 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:18.082576 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.082714 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:18.082850 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.083199 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:18.083446 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.083590 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:18.083728 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.083865 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:18.084001 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.084148 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:18.084316 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.084456 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:18.084592 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.084739 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:18.084876 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.085027 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:18.085166 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.085303 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:18.085447 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.085586 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:18.085722 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.085870 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:18.086167 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.086314 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:18.086461 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.086599 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:18.086827 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.087077 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:18.087225 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.087370 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:18.087606 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.087750 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:18.087905 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.088053 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:18.088203 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.088341 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:18.088479 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.088615 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:18.088760 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.088904 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:18.089043 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.089181 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:18.089432 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.089586 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:18.089725 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.089862 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:18.090001 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.090309 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:18.090454 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.090604 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:18.090749 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.090887 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:18.091032 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.091169 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:18.091305 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.091456 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:18.091650 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.091799 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:18.092063 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.092063 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.093356 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:18.093615 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.093763 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:18.093910 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.093910 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.093910 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.094402 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.48 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:18.094558 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.098665 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.48 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:18.098842 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.099009 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:18.099157 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.099331 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:18.099597 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.099757 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:18.099899 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.100038 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:18.100184 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.100184 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.100756 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:18.100897 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.101044 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:18.101184 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.101322 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:18.101475 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.101634 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:18.101773 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.101911 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:18.102055 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.102230 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:18.102384 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.102524 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:18.102670 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.102814 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:18.102959 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.103185 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:18.103517 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.103772 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:18.103937 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.104086 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:18.104232 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.104380 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:18.104519 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.104658 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:18.104802 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.104947 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:18.105085 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.105238 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:18.105376 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.105514 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:18.105667 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.105807 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:18.105944 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.106108 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:18.106270 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.106412 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:18.106549 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.106692 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:18.106841 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.106979 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:18.107148 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.107411 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:18.107562 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.107720 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:18.107916 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.108067 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:18.108212 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.108543 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:18.108792 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.108937 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:18.109086 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.109086 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.109471 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:18.109471 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:18.109886 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.110030 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:18.110233 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.110383 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:18.110558 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.110842 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:18.110988 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.111126 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:18.111269 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.111414 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:18.111559 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.111710 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:18.111848 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.111848 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.112125 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:18.112273 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.112420 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:18.112557 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.112701 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:18.112844 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.112989 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:18.113128 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.113273 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:18.113428 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.113758 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:18.114000 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.114173 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:18.114324 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.114489 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:18.114627 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.114765 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:18.114900 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.114900 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.114900 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.115300 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:18.115445 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.115583 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:18.115726 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.115873 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:18.116018 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.116175 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:18.116323 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.116461 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:18.116597 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.116742 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:18.116893 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.117038 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:18.117174 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.117320 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:18.117553 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.117697 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:18.117859 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.117997 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:18.118161 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.118306 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:18.118504 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.118504 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.119043 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:18.119187 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.119326 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:18.119463 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.119607 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:18.119753 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.120114 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:18.120262 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.120417 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:56:18.120576 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.120715 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.120887 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.121114 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.121272 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.121417 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.121564 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.121710 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.121871 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.122011 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.122196 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.122349 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.122508 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.123192 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.123352 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.123499 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.123662 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.123907 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.124141 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.124295 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.124442 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.124580 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.124726 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.124864 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.125044 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.125209 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.125348 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.125348 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.125617 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.125617 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.125883 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.126029 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.126191 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.126349 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.126489 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.126626 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.126762 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.126762 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.127052 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.127190 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.127334 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.127470 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.127704 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.127862 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.128000 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.128137 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.128272 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.128419 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.128565 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.128851 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.129015 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.129246 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.129389 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.129526 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.129676 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.129814 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.129952 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.130244 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.130396 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.130564 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.130762 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.130911 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.131050 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.131328 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.131551 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.131703 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.131703 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.131967 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.132110 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.132248 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.132385 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.132532 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.132670 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.132806 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.132951 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.133108 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.133331 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.133484 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.133630 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.133775 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.134016 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.134258 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.134416 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.134554 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.134691 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.134835 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.134972 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.134972 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.135247 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.135395 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.135543 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.135687 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.135824 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.135966 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.136117 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.136267 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.136422 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.136422 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.136702 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.136847 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.136998 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.137166 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.137319 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.137464 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.137606 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.137922 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.138100 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.138267 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.138455 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.138602 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.138753 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.139074 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.139240 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.139240 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.139713 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.139868 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.140051 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.140051 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.140348 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.140348 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.140348 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.140348 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.140348 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.141151 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.141324 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.141324 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.141705 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.141862 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.142021 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.142244 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.142401 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.142586 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.142738 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.142889 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.143048 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.143192 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.143362 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.143583 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.143732 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.143882 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.144136 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.144380 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.144541 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.144693 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.144845 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.144998 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.145159 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.145312 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.145465 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.145610 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.145762 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.145984 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.146161 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.146317 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.146465 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.146620 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.146620 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.146620 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.146620 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.147177 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.147321 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.147473 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.147617 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.147770 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.148004 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.148166 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.148320 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.148465 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.148608 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.148761 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.148930 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.149219 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.149373 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.149533 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.149766 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.149918 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.150061 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.150245 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.150401 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.150401 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.150724 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.150962 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.151114 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.151267 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.151412 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.151581 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.151834 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.151992 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.152145 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.152289 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.152440 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.152621 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.153377 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.153542 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.153788 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.153940 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.154256 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.154582 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.154745 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.154899 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.155046 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.155198 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.155350 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.155521 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.155669 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.155821 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.155973 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.156119 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.156263 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.156429 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.156575 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.156719 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.156874 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.157033 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.157230 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.157390 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.157561 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.157720 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.157866 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.158026 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.158283 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.158435 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.158588 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.158732 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.158877 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.159020 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.159322 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.159475 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.159630 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.159879 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.159879 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.160169 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.160325 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.160478 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.160631 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.160783 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.160953 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.161184 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.161344 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.161499 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.161499 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.161780 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.162044 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.162275 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.162433 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.162593 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.162740 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.162897 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.163313 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.163478 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.163634 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.163803 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.164023 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.164181 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.164181 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.164789 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.164951 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.165106 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.165260 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.165260 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.165537 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.165690 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.165835 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.165986 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.166149 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.166305 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.166472 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.166640 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.166794 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.166938 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.167082 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.167226 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.167380 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.167533 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.167774 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.167980 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.168130 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.168437 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.168648 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.168813 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.168967 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.169135 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.169524 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.169780 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.170167 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.170343 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.170492 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.170645 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.170791 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.170950 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.171103 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.171454 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.171645 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.171795 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.172158 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.172336 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.172492 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.172684 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.172861 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.173018 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.173179 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.173331 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.174332 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.174603 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.174817 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.175065 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.175237 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.175393 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.175546 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.175742 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.175900 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.176101 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.176257 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.176412 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.176558 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.176709 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.176867 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.177012 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.177167 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.177312 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.177462 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.177613 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.177765 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.177924 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.178078 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.178287 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.178460 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.178713 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.178870 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.179041 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.179198 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.179342 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.179698 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.179849 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.180004 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.180367 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.180530 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.180683 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.180845 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.180996 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.181141 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.181294 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.181459 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.181612 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.181757 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.181907 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.182080 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.182482 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.182636 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.182780 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.182938 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.183083 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.183238 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.183238 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.183523 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.184291 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.184577 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.184835 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.184986 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.185348 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.185534 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.185744 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.185919 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.186118 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.186281 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.186451 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.186627 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.186776 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.186921 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.187073 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.187813 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.187992 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.188155 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.188155 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.188439 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.188586 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.188750 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.189020 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.189180 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.189385 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.189538 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.189907 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.190069 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.190278 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.190538 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.190697 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.190851 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.190996 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.191141 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.191294 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.191450 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.191606 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.191751 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.191894 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.192038 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.192194 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.192367 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.192782 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.192945 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.193092 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.193250 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.193396 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.193543 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.193694 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.193872 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.194030 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.194691 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.194868 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.195118 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.195286 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.195545 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.195706 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.195860 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.196006 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.196150 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.196310 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.196473 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.196639 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.196639 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.196927 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.197071 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.197217 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.197370 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.197523 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.197676 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.197835 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.198281 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.198457 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.198606 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.198767 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.198912 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.199202 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.199363 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.199690 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.199690 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.200271 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.200729 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.200934 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.201089 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.201246 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.201392 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.201536 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.201694 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.201849 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.202003 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.202003 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.202311 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.202311 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.202311 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.203025 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.203179 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.203326 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.203476 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.203630 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.203784 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.203942 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.204087 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.204232 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.204377 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.204522 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.204766 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.205029 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.205292 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.205445 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.205445 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.205847 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.206007 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.206224 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.206395 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.206553 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.206707 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.206859 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.207017 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.207171 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.207319 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.207472 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.207472 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.207755 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.207755 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.208045 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.208201 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.208345 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.208345 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.208644 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.208790 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.208933 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.209084 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.209270 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.209417 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.209681 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.209681 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.209995 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.210265 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.210374 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.210495 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.210602 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.210710 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.210789 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.210871 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.210944 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.211030 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.211111 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.211192 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.211271 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.211350 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.211428 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.211527 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.211610 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.211682 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.211682 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.211810 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.211891 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.211973 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.212055 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.212055 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.212184 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.212263 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.212343 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.212422 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.212422 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.212422 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.212616 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.212688 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.212771 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.212852 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.212852 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.212996 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.213068 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.213068 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.213204 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.213277 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.213348 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.213426 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.213426 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.213564 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.213643 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.213716 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.213787 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.213857 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.213857 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.214002 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.214082 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.214184 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.214268 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.214350 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.214422 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.214503 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.214575 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.214646 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.214646 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.214866 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.214966 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.215056 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.215137 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.215215 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.215288 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.215365 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.215456 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.215539 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.215620 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.215700 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.215778 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.215850 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.215935 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.216008 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.216079 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.216151 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.216235 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.216308 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.216393 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.216500 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.216675 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.216796 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.216881 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.216955 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.217036 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.217110 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.217189 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.217268 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.217268 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.217415 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.217488 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.217560 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.217638 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.217731 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.217803 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.217883 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.217963 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.218042 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.218512 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.218609 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.218695 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.218778 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.218852 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.218929 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.219002 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.219079 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.219158 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.219238 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.219311 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.219388 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.219485 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.219560 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.219640 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.219720 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.219793 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.219864 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.219942 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.220027 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.220107 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.220186 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.220280 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.220359 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.220431 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.220509 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.220589 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.220662 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.220732 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.220802 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.220871 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.220942 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.220942 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.220942 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.221152 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.221233 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.221311 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.221391 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.221469 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.221547 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.221625 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.221703 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.221781 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.221864 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.221936 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.221936 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.221936 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.222150 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.222226 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.222309 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.222382 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.222453 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.222523 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.222600 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.222672 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.222826 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.222901 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.222973 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.223044 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.223115 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.223193 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.223266 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.223343 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.223415 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.223485 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.223555 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.223634 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.223706 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.223706 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.223845 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.223922 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.224000 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.224081 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.224160 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.224232 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.224232 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.224359 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.224359 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.224501 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.224580 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.224657 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.224728 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.224806 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.224886 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.224886 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.225024 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.225095 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.225165 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.225234 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.225319 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.225391 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.225470 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.225541 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.225618 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.225891 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.225997 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.226079 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.226173 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.227944 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.228046 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.228144 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.228235 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.228316 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.228397 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.228469 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.228548 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.228629 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 17 12:56:18.228702 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.228702 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.228702 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.228902 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.229169 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.229420 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.229735 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.230048 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.230386 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.230719 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.231112 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.231358 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.231786 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.232187 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.233182 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.233624 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.233953 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.234302 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.234639 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.234974 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.235311 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.235627 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.235955 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.236264 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.236599 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.236932 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.237249 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.237571 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.237899 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.238237 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.238568 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.238889 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.239219 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.239676 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.239970 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.240287 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.240618 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.240949 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.241263 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.241575 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.241892 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.242228 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.242541 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.242870 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.243183 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.243502 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.243825 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.244145 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.244455 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.244766 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.245095 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.245408 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.245739 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.246062 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.246411 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.246740 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.247050 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.247380 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.248294 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.249000 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.249324 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.249644 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.250004 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.250348 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.250681 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.251025 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.251365 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.251686 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.252030 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.252371 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.252760 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.253025 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.253360 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.253675 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.253994 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.254353 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.254667 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.254979 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.255291 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.255610 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.255921 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.256234 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.256544 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.256875 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.257184 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.257515 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.257830 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.258175 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.258489 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.258795 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.259144 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.259454 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.259794 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.260123 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.260451 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.260782 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.261096 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.261428 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.261748 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.262069 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.262422 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.262742 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.263063 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.263453 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.264376 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.264708 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.265036 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.265361 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.265686 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.266297 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.266630 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.266953 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.267272 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.267593 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.267924 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.268229 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.268558 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.268875 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.269186 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.269500 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.269834 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.270487 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.270597 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.270917 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.271175 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.271492 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.271814 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.272133 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.272496 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.272815 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.273126 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.273444 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.273766 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.274110 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.274428 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.274738 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.275055 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.275371 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.275687 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.276002 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.276399 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.276643 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.276977 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.277315 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.277637 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.277953 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.278306 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.278627 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.279501 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.280278 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.280625 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.280964 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.281297 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.281621 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.281946 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.282305 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.282641 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.282926 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.283244 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.283560 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.283870 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.284197 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.284519 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.284874 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.285198 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.285514 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.286069 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.286458 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.286785 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.287117 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.287448 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.287772 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.288085 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.288417 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.288730 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.289042 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.289363 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.289680 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.290028 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.290326 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.290639 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.290954 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.291269 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.291578 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.291823 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO dbcounter [None req-563a8aa2-00f1-451f-8318-240b3f205250 None None] Registered counter for database nova_api Jun 17 12:56:18.291921 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.292205 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.292516 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.292826 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.293134 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.293454 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.293756 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.294065 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.294402 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.294894 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.295831 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.296148 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.296463 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.296780 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.297098 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.297414 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.297728 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.298119 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.298498 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.298779 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.299124 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.299447 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.299764 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.300096 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.300410 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.300706 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.301059 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.301383 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.301967 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.302333 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.302662 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.303011 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.303364 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.303678 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.303992 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.304302 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.304639 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.304941 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.305258 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.309739 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.309739 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.309739 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.309739 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.309739 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.309739 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.309739 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.309739 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.310598 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.310598 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.310598 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.310598 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.310598 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.310598 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.310598 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.310598 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.311529 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.311529 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.312392 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.312392 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.312543 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.313172 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.313294 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_db.sqlalchemy.engines [None req-563a8aa2-00f1-451f-8318-240b3f205250 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117660) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 17 12:56:18.313392 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.313491 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.313812 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.314307 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.314615 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.314949 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.315276 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.315594 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.315923 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.316259 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.316576 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.316904 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.317224 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.317568 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.317911 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.318276 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.318606 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.319580 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.319580 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.319580 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.319941 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.320137 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.320314 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writer thread running {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 17 12:56:18.320456 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.320765 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.321074 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.321388 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.321695 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.321997 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.322363 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.322676 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.322991 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.323302 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.323609 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.323921 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.324226 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.324543 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.324852 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.325164 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.325471 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.325781 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.326792 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.327121 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.327437 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.327784 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.328128 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.328450 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.328782 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.329099 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.329431 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.329747 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.330077 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.330440 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.330753 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.331068 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.331406 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.331728 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.332039 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.332353 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.332667 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.332980 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.333297 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.333632 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.333961 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.334293 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.334626 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.334952 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.335276 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.335597 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.335911 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.336249 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.336564 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.336879 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.337199 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.337512 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.337828 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.338170 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.338494 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.338828 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.339161 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.339483 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.339811 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.340142 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.340502 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.340838 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.341212 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.341712 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.342643 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.342970 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.343257 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:56:18.343505 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 17 12:56:18.378602 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.context [None req-563a8aa2-00f1-451f-8318-240b3f205250 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c05da03c-5209-4a2b-9567-14e1f38bc35b(cell1) {{(pid=117660) load_cells /opt/stack/nova/nova/context.py:464}} Jun 17 12:56:18.382884 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-563a8aa2-00f1-451f-8318-240b3f205250 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:18.384483 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-563a8aa2-00f1-451f-8318-240b3f205250 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:18.385316 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-563a8aa2-00f1-451f-8318-240b3f205250 None None] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:18.387405 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-563a8aa2-00f1-451f-8318-240b3f205250 None None] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:18.389826 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO dbcounter [None req-563a8aa2-00f1-451f-8318-240b3f205250 None None] Registered counter for database nova_cell0 Jun 17 12:56:18.394033 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO dbcounter [None req-563a8aa2-00f1-451f-8318-240b3f205250 None None] Registered counter for database nova_cell1 Jun 17 12:56:18.403042 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_db.sqlalchemy.engines [None req-563a8aa2-00f1-451f-8318-240b3f205250 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117660) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 17 12:56:18.404311 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_db.sqlalchemy.engines [None req-563a8aa2-00f1-451f-8318-240b3f205250 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117660) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 17 12:56:18.409029 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writer thread running {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 17 12:56:18.409522 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO dbcounter [None req-d577a625-ba73-4f9d-b268-bd3ecd984594 None None] Registered counter for database nova_api Jun 17 12:56:18.431475 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_db.sqlalchemy.engines [None req-d577a625-ba73-4f9d-b268-bd3ecd984594 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117659) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 17 12:56:18.439451 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writer thread running {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 17 12:56:18.501918 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.context [None req-d577a625-ba73-4f9d-b268-bd3ecd984594 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c05da03c-5209-4a2b-9567-14e1f38bc35b(cell1) {{(pid=117659) load_cells /opt/stack/nova/nova/context.py:464}} Jun 17 12:56:18.506300 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d577a625-ba73-4f9d-b268-bd3ecd984594 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:18.507955 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d577a625-ba73-4f9d-b268-bd3ecd984594 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:18.508750 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d577a625-ba73-4f9d-b268-bd3ecd984594 None None] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:56:18.510787 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d577a625-ba73-4f9d-b268-bd3ecd984594 None None] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:56:18.512868 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO dbcounter [None req-d577a625-ba73-4f9d-b268-bd3ecd984594 None None] Registered counter for database nova_cell0 Jun 17 12:56:18.517936 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO dbcounter [None req-d577a625-ba73-4f9d-b268-bd3ecd984594 None None] Registered counter for database nova_cell1 Jun 17 12:56:18.525150 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_db.sqlalchemy.engines [None req-d577a625-ba73-4f9d-b268-bd3ecd984594 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117659) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 17 12:56:18.527388 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_db.sqlalchemy.engines [None req-d577a625-ba73-4f9d-b268-bd3ecd984594 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117659) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 17 12:56:18.532821 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writer thread running {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 17 12:56:18.556884 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writer thread running {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 17 12:56:18.567747 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO dbcounter [None req-563a8aa2-00f1-451f-8318-240b3f205250 None None] Registered counter for database nova_cell0 Jun 17 12:56:18.575374 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_db.sqlalchemy.engines [None req-563a8aa2-00f1-451f-8318-240b3f205250 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117660) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 17 12:56:18.580261 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writer thread running {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 17 12:56:18.679571 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writer thread running {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 17 12:56:18.690773 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO dbcounter [None req-d577a625-ba73-4f9d-b268-bd3ecd984594 None None] Registered counter for database nova_cell0 Jun 17 12:56:18.697934 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_db.sqlalchemy.engines [None req-d577a625-ba73-4f9d-b268-bd3ecd984594 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117659) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 17 12:56:18.703870 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writer thread running {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 17 12:56:18.905493 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: WARNING keystonemiddleware.auth_token [None req-563a8aa2-00f1-451f-8318-240b3f205250 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 17 12:56:18.913104 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: WARNING keystonemiddleware.auth_token [None req-563a8aa2-00f1-451f-8318-240b3f205250 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 17 12:56:19.042354 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: WARNING keystonemiddleware.auth_token [None req-d577a625-ba73-4f9d-b268-bd3ecd984594 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 17 12:56:19.051496 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: WARNING keystonemiddleware.auth_token [None req-d577a625-ba73-4f9d-b268-bd3ecd984594 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 17 12:56:19.275604 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: WARNING keystonemiddleware.auth_token [None req-563a8aa2-00f1-451f-8318-240b3f205250 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 17 12:56:19.281900 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: WARNING keystonemiddleware.auth_token [None req-563a8aa2-00f1-451f-8318-240b3f205250 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 17 12:56:19.287969 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d1670049c0 pid: 117660 (default app) Jun 17 12:56:19.423930 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: WARNING keystonemiddleware.auth_token [None req-d577a625-ba73-4f9d-b268-bd3ecd984594 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 17 12:56:19.430189 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: WARNING keystonemiddleware.auth_token [None req-d577a625-ba73-4f9d-b268-bd3ecd984594 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 17 12:56:19.436205 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d1670049c0 pid: 117659 (default app) Jun 17 12:57:01.174176 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_api:SELECT=3 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:57:01.175600 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell0:SELECT=3 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:57:01.177350 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=3 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:57:01.178797 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell0:SELECT=3 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:57:02.477335 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-21f06f1f-a603-4626-bc2f-776ca78e69f4 tempest-VolumesTestJSON-42945583 tempest-VolumesTestJSON-42945583-project] Calling method '.version_select at 0x7f0192a24a60>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:02.546785 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_api:SELECT=3 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:57:02.548964 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_cell0:SELECT=3 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:57:02.552692 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_cell1:SELECT=3 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:57:02.553642 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_cell0:SELECT=3 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:57:02.554881 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-4b2ee78b-4ac4-4eb8-a6c0-0721180ffe54 tempest-VolumesNegativeTest-1109309633 tempest-VolumesNegativeTest-1109309633-project] Action: 'create', calling method: .version_select at 0x7f0192020820>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-140793906", "metadata": {"Type": "work"}}} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 12:57:02.587346 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-4b2ee78b-4ac4-4eb8-a6c0-0721180ffe54 tempest-VolumesNegativeTest-1109309633 tempest-VolumesNegativeTest-1109309633-project] Request method failure captured: Jun 17 12:57:02.587346 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 17 12:57:02.587346 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Accept: application/json Jun 17 12:57:02.587346 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Accept-Encoding: identity Jun 17 12:57:02.587346 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Connection: close Jun 17 12:57:02.587346 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Content-Length: 121 Jun 17 12:57:02.587346 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Content-Type: application/json Jun 17 12:57:02.587346 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Host: 10.222.0.48 Jun 17 12:57:02.587346 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Openstack-System-Scope: None Jun 17 12:57:02.587346 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: User-Agent: python-urllib3/1.26.9 Jun 17 12:57:02.587346 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Auth-Token: gAAAAABirHocZU-oC2LCspxodm1shq4ZTP2wXDHP5MY37ao0katc5oVLmjr6wruiwSbtZsk5gNildWDxK4BS5_LQbz-euFPwrLQWKSlVwAkFnKZmaJ6PIQhWkgfKYE09ZUg5wghkGzCIlmjsPITA85QOE5jB9cOnGQzE-B8zHm2fu1CuPWSj8Tw Jun 17 12:57:02.587346 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Domain-Id: None Jun 17 12:57:02.587346 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Domain-Name: None Jun 17 12:57:02.587346 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Identity-Status: Confirmed Jun 17 12:57:02.587346 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Is-Admin-Project: True Jun 17 12:57:02.587346 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Project-Domain-Id: default Jun 17 12:57:02.587346 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Project-Domain-Name: Default Jun 17 12:57:02.587346 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Project-Id: 23012b91a3274aef98d6e17feab67a02 Jun 17 12:57:02.587346 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Project-Name: tempest-VolumesNegativeTest-1109309633 Jun 17 12:57:02.587346 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Role: member,reader Jun 17 12:57:02.587346 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Roles: member,reader Jun 17 12:57:02.588865 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_23012b91a3274aef98d6e17feab67a02", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/23012b91a3274aef98d6e17feab67a02"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/23012b91a3274aef98d6e17feab67a02"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/23012b91a3274aef98d6e17feab67a02"}]}] Jun 17 12:57:02.588865 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Tenant: tempest-VolumesNegativeTest-1109309633 Jun 17 12:57:02.588865 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Tenant-Id: 23012b91a3274aef98d6e17feab67a02 Jun 17 12:57:02.588865 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Tenant-Name: tempest-VolumesNegativeTest-1109309633 Jun 17 12:57:02.588865 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-User: tempest-VolumesNegativeTest-1109309633-project Jun 17 12:57:02.588865 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-User-Domain-Id: default Jun 17 12:57:02.588865 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-User-Domain-Name: Default Jun 17 12:57:02.588865 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-User-Id: 165eda88af394c35bcd7e30534fb9c71 Jun 17 12:57:02.588865 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-User-Name: tempest-VolumesNegativeTest-1109309633-project Jun 17 12:57:02.588865 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Jun 17 12:57:02.588865 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-140793906", "metadata": {"Type": "work"}}} Jun 17 12:57:02.588865 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: method: Jun 17 12:57:02.588865 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 17 12:57:02.589763 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-140793906', 'metadata': {'Type': 'work'}}}} Jun 17 12:57:02.589763 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 12:57:02.589763 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 12:57:02.589763 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 17 12:57:02.589763 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 17 12:57:02.589763 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 17 12:57:02.589763 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise error Jun 17 12:57:02.589763 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jun 17 12:57:02.589763 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 12:57:02.589763 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 17 12:57:02.589763 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 17 12:57:02.589763 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 12:57:02.589763 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 17 12:57:02.589763 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi '#$%' Jun 17 12:57:02.589763 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 12:57:02.589763 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 12:57:02.589763 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 12:57:02.589763 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 12:57:02.589763 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 12:57:02.589763 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 12:57:02.589763 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 12:57:02.589763 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 12:57:02.591683 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 17 12:57:02.591683 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 17 12:57:02.591683 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 12:57:02.591683 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 12:57:02.591683 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 17 12:57:02.591683 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 17 12:57:02.591683 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 17 12:57:02.591683 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 17 12:57:02.591683 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 17 12:57:02.591683 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 17 12:57:02.591683 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 17 12:57:02.591683 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 12:57:02.591683 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 12:57:02.591683 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 12:57:02.591683 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 12:57:02.591683 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 12:57:02.591683 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 12:57:02.591683 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 17 12:57:02.591683 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 17 12:57:02.594630 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 17 12:57:02.594630 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 12:57:02.597143 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-4b2ee78b-4ac4-4eb8-a6c0-0721180ffe54 tempest-VolumesNegativeTest-1109309633 tempest-VolumesNegativeTest-1109309633-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117660) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 12:57:02.598991 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-4b2ee78b-4ac4-4eb8-a6c0-0721180ffe54 tempest-VolumesNegativeTest-1109309633 tempest-VolumesNegativeTest-1109309633-project] 10.222.0.48 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.436110 Jun 17 12:57:02.599926 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1/1] 10.222.0.48 () {60 vars in 1155 bytes} [Fri Jun 17 12:57:01 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1439 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 17 12:57:02.612833 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-0d974da6-3a54-4951-af0f-2f16aca81107 tempest-VolumesNegativeTest-1109309633 tempest-VolumesNegativeTest-1109309633-project] Action: 'create', calling method: .version_select at 0x7f0192033af0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1743695193", "metadata": {"Type": "work"}}} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 12:57:02.616495 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-0d974da6-3a54-4951-af0f-2f16aca81107 tempest-VolumesNegativeTest-1109309633 tempest-VolumesNegativeTest-1109309633-project] Request method failure captured: Jun 17 12:57:02.616495 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 17 12:57:02.616495 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Accept: application/json Jun 17 12:57:02.616495 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Accept-Encoding: identity Jun 17 12:57:02.616495 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Connection: close Jun 17 12:57:02.616495 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Content-Length: 120 Jun 17 12:57:02.616495 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Content-Type: application/json Jun 17 12:57:02.616495 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Host: 10.222.0.48 Jun 17 12:57:02.616495 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Openstack-System-Scope: None Jun 17 12:57:02.616495 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: User-Agent: python-urllib3/1.26.9 Jun 17 12:57:02.616495 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Auth-Token: gAAAAABirHocZU-oC2LCspxodm1shq4ZTP2wXDHP5MY37ao0katc5oVLmjr6wruiwSbtZsk5gNildWDxK4BS5_LQbz-euFPwrLQWKSlVwAkFnKZmaJ6PIQhWkgfKYE09ZUg5wghkGzCIlmjsPITA85QOE5jB9cOnGQzE-B8zHm2fu1CuPWSj8Tw Jun 17 12:57:02.616495 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Domain-Id: None Jun 17 12:57:02.616495 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Domain-Name: None Jun 17 12:57:02.616495 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Identity-Status: Confirmed Jun 17 12:57:02.616495 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Is-Admin-Project: True Jun 17 12:57:02.616495 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Project-Domain-Id: default Jun 17 12:57:02.616495 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Project-Domain-Name: Default Jun 17 12:57:02.616495 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Project-Id: 23012b91a3274aef98d6e17feab67a02 Jun 17 12:57:02.616495 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Project-Name: tempest-VolumesNegativeTest-1109309633 Jun 17 12:57:02.616495 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Role: member,reader Jun 17 12:57:02.616495 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Roles: member,reader Jun 17 12:57:02.617851 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_23012b91a3274aef98d6e17feab67a02", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/23012b91a3274aef98d6e17feab67a02"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/23012b91a3274aef98d6e17feab67a02"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/23012b91a3274aef98d6e17feab67a02"}]}] Jun 17 12:57:02.617851 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Tenant: tempest-VolumesNegativeTest-1109309633 Jun 17 12:57:02.617851 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Tenant-Id: 23012b91a3274aef98d6e17feab67a02 Jun 17 12:57:02.617851 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Tenant-Name: tempest-VolumesNegativeTest-1109309633 Jun 17 12:57:02.617851 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-User: tempest-VolumesNegativeTest-1109309633-project Jun 17 12:57:02.617851 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-User-Domain-Id: default Jun 17 12:57:02.617851 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-User-Domain-Name: Default Jun 17 12:57:02.617851 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-User-Id: 165eda88af394c35bcd7e30534fb9c71 Jun 17 12:57:02.617851 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-User-Name: tempest-VolumesNegativeTest-1109309633-project Jun 17 12:57:02.617851 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Jun 17 12:57:02.617851 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1743695193", "metadata": {"Type": "work"}}} Jun 17 12:57:02.617851 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: method: Jun 17 12:57:02.617851 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 17 12:57:02.618707 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1743695193', 'metadata': {'Type': 'work'}}}} Jun 17 12:57:02.618707 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 12:57:02.618707 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 12:57:02.618707 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 17 12:57:02.618707 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 17 12:57:02.618707 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 17 12:57:02.618707 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise error Jun 17 12:57:02.618707 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jun 17 12:57:02.618707 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 12:57:02.618707 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jun 17 12:57:02.618707 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 17 12:57:02.618707 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 12:57:02.618707 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 17 12:57:02.618707 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi '0' Jun 17 12:57:02.618707 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 12:57:02.618707 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 12:57:02.618707 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 12:57:02.618707 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 12:57:02.618707 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 12:57:02.618707 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 12:57:02.618707 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 12:57:02.618707 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 12:57:02.619976 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 17 12:57:02.619976 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 17 12:57:02.619976 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 12:57:02.619976 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 12:57:02.619976 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 17 12:57:02.619976 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 17 12:57:02.619976 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 17 12:57:02.619976 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 17 12:57:02.619976 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 17 12:57:02.619976 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 17 12:57:02.619976 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 17 12:57:02.619976 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 12:57:02.619976 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 12:57:02.619976 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 12:57:02.619976 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 12:57:02.619976 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 12:57:02.619976 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 12:57:02.619976 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 17 12:57:02.619976 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 17 12:57:02.625712 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 17 12:57:02.625712 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 12:57:02.625712 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-0d974da6-3a54-4951-af0f-2f16aca81107 tempest-VolumesNegativeTest-1109309633 tempest-VolumesNegativeTest-1109309633-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117660) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 12:57:02.625712 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-0d974da6-3a54-4951-af0f-2f16aca81107 tempest-VolumesNegativeTest-1109309633 tempest-VolumesNegativeTest-1109309633-project] 10.222.0.48 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.011806 Jun 17 12:57:02.625712 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 2/2] 10.222.0.48 () {60 vars in 1155 bytes} [Fri Jun 17 12:57:02 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 17 12:57:02.643330 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-ab4f4297-75b4-43c6-9328-df8a14febb06 tempest-VolumesNegativeTest-1109309633 tempest-VolumesNegativeTest-1109309633-project] Action: 'create', calling method: .version_select at 0x7f0192020b80>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-593034623", "metadata": {"Type": "work"}}} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 12:57:02.645588 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-ab4f4297-75b4-43c6-9328-df8a14febb06 tempest-VolumesNegativeTest-1109309633 tempest-VolumesNegativeTest-1109309633-project] Request method failure captured: Jun 17 12:57:02.645588 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 17 12:57:02.645588 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Accept: application/json Jun 17 12:57:02.645588 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Accept-Encoding: identity Jun 17 12:57:02.645588 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Connection: close Jun 17 12:57:02.645588 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Content-Length: 118 Jun 17 12:57:02.645588 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Content-Type: application/json Jun 17 12:57:02.645588 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Host: 10.222.0.48 Jun 17 12:57:02.645588 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Openstack-System-Scope: None Jun 17 12:57:02.645588 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: User-Agent: python-urllib3/1.26.9 Jun 17 12:57:02.645588 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Auth-Token: gAAAAABirHocZU-oC2LCspxodm1shq4ZTP2wXDHP5MY37ao0katc5oVLmjr6wruiwSbtZsk5gNildWDxK4BS5_LQbz-euFPwrLQWKSlVwAkFnKZmaJ6PIQhWkgfKYE09ZUg5wghkGzCIlmjsPITA85QOE5jB9cOnGQzE-B8zHm2fu1CuPWSj8Tw Jun 17 12:57:02.645588 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Domain-Id: None Jun 17 12:57:02.645588 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Domain-Name: None Jun 17 12:57:02.645588 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Identity-Status: Confirmed Jun 17 12:57:02.645588 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Is-Admin-Project: True Jun 17 12:57:02.645588 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Project-Domain-Id: default Jun 17 12:57:02.645588 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Project-Domain-Name: Default Jun 17 12:57:02.645588 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Project-Id: 23012b91a3274aef98d6e17feab67a02 Jun 17 12:57:02.645588 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Project-Name: tempest-VolumesNegativeTest-1109309633 Jun 17 12:57:02.645588 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Role: member,reader Jun 17 12:57:02.645588 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Roles: member,reader Jun 17 12:57:02.646935 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_23012b91a3274aef98d6e17feab67a02", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/23012b91a3274aef98d6e17feab67a02"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/23012b91a3274aef98d6e17feab67a02"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/23012b91a3274aef98d6e17feab67a02"}]}] Jun 17 12:57:02.646935 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Tenant: tempest-VolumesNegativeTest-1109309633 Jun 17 12:57:02.646935 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Tenant-Id: 23012b91a3274aef98d6e17feab67a02 Jun 17 12:57:02.646935 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Tenant-Name: tempest-VolumesNegativeTest-1109309633 Jun 17 12:57:02.646935 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-User: tempest-VolumesNegativeTest-1109309633-project Jun 17 12:57:02.646935 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-User-Domain-Id: default Jun 17 12:57:02.646935 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-User-Domain-Name: Default Jun 17 12:57:02.646935 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-User-Id: 165eda88af394c35bcd7e30534fb9c71 Jun 17 12:57:02.646935 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-User-Name: tempest-VolumesNegativeTest-1109309633-project Jun 17 12:57:02.646935 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Jun 17 12:57:02.646935 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-593034623", "metadata": {"Type": "work"}}} Jun 17 12:57:02.646935 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: method: Jun 17 12:57:02.646935 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 17 12:57:02.647747 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-593034623', 'metadata': {'Type': 'work'}}}} Jun 17 12:57:02.647747 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 12:57:02.647747 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 12:57:02.647747 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 17 12:57:02.647747 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 17 12:57:02.647747 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 17 12:57:02.647747 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise error Jun 17 12:57:02.647747 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jun 17 12:57:02.647747 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 12:57:02.647747 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 17 12:57:02.647747 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 17 12:57:02.647747 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 12:57:02.647747 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 17 12:57:02.647747 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi '' Jun 17 12:57:02.647747 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 12:57:02.647747 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 12:57:02.647747 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 12:57:02.647747 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 12:57:02.647747 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 12:57:02.647747 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 12:57:02.647747 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 12:57:02.647747 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 12:57:02.649031 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 17 12:57:02.649031 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 17 12:57:02.649031 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 12:57:02.649031 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 12:57:02.649031 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 17 12:57:02.649031 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 17 12:57:02.649031 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 17 12:57:02.649031 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 17 12:57:02.649031 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 17 12:57:02.649031 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 17 12:57:02.649031 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 17 12:57:02.649031 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 12:57:02.649031 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 12:57:02.649031 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 12:57:02.649031 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 12:57:02.649031 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 12:57:02.649031 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 12:57:02.649031 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 17 12:57:02.649031 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 17 12:57:02.652902 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 17 12:57:02.652902 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 12:57:02.652902 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-ab4f4297-75b4-43c6-9328-df8a14febb06 tempest-VolumesNegativeTest-1109309633 tempest-VolumesNegativeTest-1109309633-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117660) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 12:57:02.652902 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-ab4f4297-75b4-43c6-9328-df8a14febb06 tempest-VolumesNegativeTest-1109309633 tempest-VolumesNegativeTest-1109309633-project] 10.222.0.48 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.019144 Jun 17 12:57:02.652902 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 3/3] 10.222.0.48 () {60 vars in 1155 bytes} [Fri Jun 17 12:57:02 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 17 12:57:02.657093 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-556bc2b5-7891-41eb-9bd6-394dde3e56f1 tempest-VolumesNegativeTest-1109309633 tempest-VolumesNegativeTest-1109309633-project] Calling method '.version_select at 0x7f0191f49790>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:03.509995 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.wsgi [None req-556bc2b5-7891-41eb-9bd6-394dde3e56f1 tempest-VolumesNegativeTest-1109309633 tempest-VolumesNegativeTest-1109309633-project] HTTP exception thrown: Volume tempest-invalid-812029857 could not be found. Jun 17 12:57:03.514321 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-556bc2b5-7891-41eb-9bd6-394dde3e56f1 tempest-VolumesNegativeTest-1109309633 tempest-VolumesNegativeTest-1109309633-project] Request method failure captured: Jun 17 12:57:03.514321 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-812029857 HTTP/1.1 Jun 17 12:57:03.514321 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Accept: application/json Jun 17 12:57:03.514321 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Accept-Encoding: identity Jun 17 12:57:03.514321 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Connection: close Jun 17 12:57:03.514321 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Content-Length: 0 Jun 17 12:57:03.514321 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Content-Type: application/json Jun 17 12:57:03.514321 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Host: 10.222.0.48 Jun 17 12:57:03.514321 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Openstack-System-Scope: None Jun 17 12:57:03.514321 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: User-Agent: python-urllib3/1.26.9 Jun 17 12:57:03.514321 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Auth-Token: gAAAAABirHocZU-oC2LCspxodm1shq4ZTP2wXDHP5MY37ao0katc5oVLmjr6wruiwSbtZsk5gNildWDxK4BS5_LQbz-euFPwrLQWKSlVwAkFnKZmaJ6PIQhWkgfKYE09ZUg5wghkGzCIlmjsPITA85QOE5jB9cOnGQzE-B8zHm2fu1CuPWSj8Tw Jun 17 12:57:03.514321 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Domain-Id: None Jun 17 12:57:03.514321 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Domain-Name: None Jun 17 12:57:03.514321 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Identity-Status: Confirmed Jun 17 12:57:03.514321 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Is-Admin-Project: True Jun 17 12:57:03.514321 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Project-Domain-Id: default Jun 17 12:57:03.514321 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Project-Domain-Name: Default Jun 17 12:57:03.514321 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Project-Id: 23012b91a3274aef98d6e17feab67a02 Jun 17 12:57:03.514321 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Project-Name: tempest-VolumesNegativeTest-1109309633 Jun 17 12:57:03.514321 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Role: member,reader Jun 17 12:57:03.514321 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Roles: member,reader Jun 17 12:57:03.517253 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_23012b91a3274aef98d6e17feab67a02", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/23012b91a3274aef98d6e17feab67a02"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/23012b91a3274aef98d6e17feab67a02"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/23012b91a3274aef98d6e17feab67a02"}]}] Jun 17 12:57:03.517253 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Tenant: tempest-VolumesNegativeTest-1109309633 Jun 17 12:57:03.517253 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Tenant-Id: 23012b91a3274aef98d6e17feab67a02 Jun 17 12:57:03.517253 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Tenant-Name: tempest-VolumesNegativeTest-1109309633 Jun 17 12:57:03.517253 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-User: tempest-VolumesNegativeTest-1109309633-project Jun 17 12:57:03.517253 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-User-Domain-Id: default Jun 17 12:57:03.517253 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-User-Domain-Name: Default Jun 17 12:57:03.517253 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-User-Id: 165eda88af394c35bcd7e30534fb9c71 Jun 17 12:57:03.517253 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-User-Name: tempest-VolumesNegativeTest-1109309633-project Jun 17 12:57:03.517253 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: method: Jun 17 12:57:03.517253 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: exception: Volume tempest-invalid-812029857 could not be found. Jun 17 12:57:03.517253 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: action_args: {'id': 'tempest-invalid-812029857'} Jun 17 12:57:03.517253 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 12:57:03.518940 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 12:57:03.518940 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 12:57:03.518940 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 12:57:03.518940 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 17 12:57:03.518940 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 17 12:57:03.518940 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 17 12:57:03.518940 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 17 12:57:03.518940 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 17 12:57:03.518940 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 17 12:57:03.518940 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 17 12:57:03.518940 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 17 12:57:03.518940 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 12:57:03.518940 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 12:57:03.518940 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 12:57:03.518940 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 12:57:03.518940 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-812029857 could not be found. (HTTP 404) (Request-ID: req-e47c8a13-006f-4303-83cd-80115167bbfc) Jun 17 12:57:03.518940 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 12:57:03.518940 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 12:57:03.518940 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 12:57:03.521091 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 12:57:03.521091 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 17 12:57:03.521091 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 17 12:57:03.521091 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 12:57:03.521091 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 12:57:03.521091 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 17 12:57:03.521091 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 17 12:57:03.521091 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 17 12:57:03.521091 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 17 12:57:03.521091 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 12:57:03.521091 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 12:57:03.521091 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 17 12:57:03.521091 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 17 12:57:03.521091 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 17 12:57:03.521091 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 17 12:57:03.521091 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 17 12:57:03.521091 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 17 12:57:03.521091 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 17 12:57:03.521091 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 17 12:57:03.526985 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 12:57:03.526985 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 12:57:03.526985 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 12:57:03.526985 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 12:57:03.526985 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-812029857 could not be found. Jun 17 12:57:03.526985 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 12:57:03.526985 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 12:57:03.526985 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 12:57:03.526985 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 12:57:03.526985 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 12:57:03.526985 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 12:57:03.526985 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 12:57:03.526985 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 12:57:03.526985 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 17 12:57:03.526985 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 17 12:57:03.526985 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 12:57:03.526985 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 12:57:03.526985 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 17 12:57:03.526985 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 12:57:03.526985 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-812029857 could not be found. Jun 17 12:57:03.530696 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 12:57:03.530696 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 12:57:03.530696 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 12:57:03.530696 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 12:57:03.530696 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 12:57:03.530696 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 12:57:03.530696 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 12:57:03.530696 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 12:57:03.530696 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-812029857 could not be found. Jun 17 12:57:03.530696 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 12:57:03.530696 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-556bc2b5-7891-41eb-9bd6-394dde3e56f1 tempest-VolumesNegativeTest-1109309633 tempest-VolumesNegativeTest-1109309633-project] Returning 404 to user: Volume tempest-invalid-812029857 could not be found. {{(pid=117660) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 12:57:03.530696 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-556bc2b5-7891-41eb-9bd6-394dde3e56f1 tempest-VolumesNegativeTest-1109309633 tempest-VolumesNegativeTest-1109309633-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/tempest-invalid-812029857" status: 404 len: 98 microversion: 2.1 time: 0.865399 Jun 17 12:57:03.530696 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 4/4] 10.222.0.48 () {58 vars in 1214 bytes} [Fri Jun 17 12:57:02 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-812029857 => generated 98 bytes in 875 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jun 17 12:57:03.537991 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-21f06f1f-a603-4626-bc2f-776ca78e69f4 tempest-VolumesTestJSON-42945583 tempest-VolumesTestJSON-42945583-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/1a126db6-163a-4d69-bd6b-19ea8971f8df" status: 200 len: 351 microversion: 2.1 time: 1.573704 Jun 17 12:57:03.540388 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1/5] 10.222.0.48 () {58 vars in 1244 bytes} [Fri Jun 17 12:57:01 2022] GET /compute/v2.1/os-volumes/1a126db6-163a-4d69-bd6b-19ea8971f8df => generated 351 bytes in 1578 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:57:03.548957 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-f70c632b-156c-4cba-85be-7a685fb86c71 tempest-VolumesNegativeTest-1109309633 tempest-VolumesNegativeTest-1109309633-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.009881 Jun 17 12:57:03.561181 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 5/6] 10.222.0.48 () {58 vars in 1139 bytes} [Fri Jun 17 12:57:03 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 25 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 17 12:57:03.577498 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-83d9dfac-c6a2-4ab2-bbaf-a1a174c60ffc tempest-VolumesNegativeTest-1109309633 tempest-VolumesNegativeTest-1109309633-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.007549 Jun 17 12:57:03.581824 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 2/7] 10.222.0.48 () {58 vars in 1136 bytes} [Fri Jun 17 12:57:03 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 13 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 17 12:57:03.598494 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-8f6eda36-dae3-4c7a-bbef-52bc248e66bc tempest-VolumesNegativeTest-1109309633 tempest-VolumesNegativeTest-1109309633-project] Calling method '.version_select at 0x7f0191e78940>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:03.734884 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.wsgi [None req-8f6eda36-dae3-4c7a-bbef-52bc248e66bc tempest-VolumesNegativeTest-1109309633 tempest-VolumesNegativeTest-1109309633-project] HTTP exception thrown: Volume 4bdcfebf-ffa5-4680-b860-826ac389b59d could not be found. Jun 17 12:57:03.737301 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-8f6eda36-dae3-4c7a-bbef-52bc248e66bc tempest-VolumesNegativeTest-1109309633 tempest-VolumesNegativeTest-1109309633-project] Request method failure captured: Jun 17 12:57:03.737301 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: request: DELETE /compute/v2.1/os-volumes/4bdcfebf-ffa5-4680-b860-826ac389b59d HTTP/1.1 Jun 17 12:57:03.737301 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Accept: application/json Jun 17 12:57:03.737301 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Accept-Encoding: identity Jun 17 12:57:03.737301 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Connection: close Jun 17 12:57:03.737301 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Content-Length: 0 Jun 17 12:57:03.737301 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Content-Type: application/json Jun 17 12:57:03.737301 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Host: 10.222.0.48 Jun 17 12:57:03.737301 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Openstack-System-Scope: None Jun 17 12:57:03.737301 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: User-Agent: python-urllib3/1.26.9 Jun 17 12:57:03.737301 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Auth-Token: gAAAAABirHocZU-oC2LCspxodm1shq4ZTP2wXDHP5MY37ao0katc5oVLmjr6wruiwSbtZsk5gNildWDxK4BS5_LQbz-euFPwrLQWKSlVwAkFnKZmaJ6PIQhWkgfKYE09ZUg5wghkGzCIlmjsPITA85QOE5jB9cOnGQzE-B8zHm2fu1CuPWSj8Tw Jun 17 12:57:03.737301 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Domain-Id: None Jun 17 12:57:03.737301 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Domain-Name: None Jun 17 12:57:03.737301 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Identity-Status: Confirmed Jun 17 12:57:03.737301 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Is-Admin-Project: True Jun 17 12:57:03.737301 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Project-Domain-Id: default Jun 17 12:57:03.737301 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Project-Domain-Name: Default Jun 17 12:57:03.737301 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Project-Id: 23012b91a3274aef98d6e17feab67a02 Jun 17 12:57:03.737301 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Project-Name: tempest-VolumesNegativeTest-1109309633 Jun 17 12:57:03.737301 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Role: member,reader Jun 17 12:57:03.737301 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Roles: member,reader Jun 17 12:57:03.738789 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_23012b91a3274aef98d6e17feab67a02", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/23012b91a3274aef98d6e17feab67a02"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/23012b91a3274aef98d6e17feab67a02"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/23012b91a3274aef98d6e17feab67a02"}]}] Jun 17 12:57:03.738789 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Tenant: tempest-VolumesNegativeTest-1109309633 Jun 17 12:57:03.738789 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Tenant-Id: 23012b91a3274aef98d6e17feab67a02 Jun 17 12:57:03.738789 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Tenant-Name: tempest-VolumesNegativeTest-1109309633 Jun 17 12:57:03.738789 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-User: tempest-VolumesNegativeTest-1109309633-project Jun 17 12:57:03.738789 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-User-Domain-Id: default Jun 17 12:57:03.738789 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-User-Domain-Name: Default Jun 17 12:57:03.738789 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-User-Id: 165eda88af394c35bcd7e30534fb9c71 Jun 17 12:57:03.738789 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-User-Name: tempest-VolumesNegativeTest-1109309633-project Jun 17 12:57:03.738789 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: method: Jun 17 12:57:03.738789 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: exception: Volume 4bdcfebf-ffa5-4680-b860-826ac389b59d could not be found. Jun 17 12:57:03.738789 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: action_args: {'id': '4bdcfebf-ffa5-4680-b860-826ac389b59d'} Jun 17 12:57:03.738789 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 12:57:03.739758 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 12:57:03.739758 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 12:57:03.739758 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 12:57:03.739758 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 17 12:57:03.739758 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 17 12:57:03.739758 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 17 12:57:03.739758 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 17 12:57:03.739758 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 17 12:57:03.739758 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 17 12:57:03.739758 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 17 12:57:03.739758 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 17 12:57:03.739758 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 12:57:03.739758 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 12:57:03.739758 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 12:57:03.739758 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 12:57:03.739758 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4bdcfebf-ffa5-4680-b860-826ac389b59d could not be found. (HTTP 404) (Request-ID: req-863510ac-1d35-4820-b027-4b2bf6782f22) Jun 17 12:57:03.739758 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 12:57:03.739758 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 12:57:03.739758 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 12:57:03.741082 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 12:57:03.741082 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 17 12:57:03.741082 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 17 12:57:03.741082 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 12:57:03.741082 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 12:57:03.741082 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 17 12:57:03.741082 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 17 12:57:03.741082 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 17 12:57:03.741082 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 17 12:57:03.741082 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 12:57:03.741082 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 12:57:03.741082 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 17 12:57:03.741082 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 17 12:57:03.741082 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 17 12:57:03.741082 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 17 12:57:03.741082 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 17 12:57:03.741082 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 17 12:57:03.741082 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 17 12:57:03.741082 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 17 12:57:03.742264 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 12:57:03.742264 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 12:57:03.742264 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 12:57:03.742264 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 12:57:03.742264 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4bdcfebf-ffa5-4680-b860-826ac389b59d could not be found. Jun 17 12:57:03.742264 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 12:57:03.742264 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 12:57:03.742264 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 12:57:03.742264 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 12:57:03.742264 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 12:57:03.742264 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 12:57:03.742264 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 12:57:03.742264 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 12:57:03.742264 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 17 12:57:03.742264 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 17 12:57:03.742264 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 12:57:03.742264 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 12:57:03.742264 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 17 12:57:03.742264 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 12:57:03.743347 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4bdcfebf-ffa5-4680-b860-826ac389b59d could not be found. Jun 17 12:57:03.743347 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 12:57:03.743347 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 12:57:03.743347 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 12:57:03.743347 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 12:57:03.743347 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 12:57:03.743347 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 12:57:03.743347 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 12:57:03.743347 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 12:57:03.743347 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4bdcfebf-ffa5-4680-b860-826ac389b59d could not be found. Jun 17 12:57:03.743347 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 12:57:03.747388 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-8f6eda36-dae3-4c7a-bbef-52bc248e66bc tempest-VolumesNegativeTest-1109309633 tempest-VolumesNegativeTest-1109309633-project] Returning 404 to user: Volume 4bdcfebf-ffa5-4680-b860-826ac389b59d could not be found. {{(pid=117660) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 12:57:03.747388 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-8f6eda36-dae3-4c7a-bbef-52bc248e66bc tempest-VolumesNegativeTest-1109309633 tempest-VolumesNegativeTest-1109309633-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/4bdcfebf-ffa5-4680-b860-826ac389b59d" status: 404 len: 109 microversion: 2.1 time: 0.155870 Jun 17 12:57:03.747388 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 6/8] 10.222.0.48 () {58 vars in 1247 bytes} [Fri Jun 17 12:57:03 2022] DELETE /compute/v2.1/os-volumes/4bdcfebf-ffa5-4680-b860-826ac389b59d => generated 109 bytes in 157 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 12:57:03.757067 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-c71bba69-607c-4d61-9cac-b6d15cc68c42 tempest-VolumesNegativeTest-1109309633 tempest-VolumesNegativeTest-1109309633-project] Calling method '.version_select at 0x7f0191f2c940>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:03.856978 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.wsgi [None req-c71bba69-607c-4d61-9cac-b6d15cc68c42 tempest-VolumesNegativeTest-1109309633 tempest-VolumesNegativeTest-1109309633-project] HTTP exception thrown: Volume f196cc26-012a-4993-8a9e-96fe0a752d36 could not be found. Jun 17 12:57:03.863475 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-c71bba69-607c-4d61-9cac-b6d15cc68c42 tempest-VolumesNegativeTest-1109309633 tempest-VolumesNegativeTest-1109309633-project] Request method failure captured: Jun 17 12:57:03.863475 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: request: GET /compute/v2.1/os-volumes/f196cc26-012a-4993-8a9e-96fe0a752d36 HTTP/1.1 Jun 17 12:57:03.863475 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Accept: application/json Jun 17 12:57:03.863475 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Accept-Encoding: identity Jun 17 12:57:03.863475 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Connection: close Jun 17 12:57:03.863475 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Content-Length: 0 Jun 17 12:57:03.863475 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Content-Type: application/json Jun 17 12:57:03.863475 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Host: 10.222.0.48 Jun 17 12:57:03.863475 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Openstack-System-Scope: None Jun 17 12:57:03.863475 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: User-Agent: python-urllib3/1.26.9 Jun 17 12:57:03.863475 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Auth-Token: gAAAAABirHocZU-oC2LCspxodm1shq4ZTP2wXDHP5MY37ao0katc5oVLmjr6wruiwSbtZsk5gNildWDxK4BS5_LQbz-euFPwrLQWKSlVwAkFnKZmaJ6PIQhWkgfKYE09ZUg5wghkGzCIlmjsPITA85QOE5jB9cOnGQzE-B8zHm2fu1CuPWSj8Tw Jun 17 12:57:03.863475 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Domain-Id: None Jun 17 12:57:03.863475 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Domain-Name: None Jun 17 12:57:03.863475 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Identity-Status: Confirmed Jun 17 12:57:03.863475 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Is-Admin-Project: True Jun 17 12:57:03.863475 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Project-Domain-Id: default Jun 17 12:57:03.863475 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Project-Domain-Name: Default Jun 17 12:57:03.863475 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Project-Id: 23012b91a3274aef98d6e17feab67a02 Jun 17 12:57:03.863475 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Project-Name: tempest-VolumesNegativeTest-1109309633 Jun 17 12:57:03.863475 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Role: member,reader Jun 17 12:57:03.863475 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Roles: member,reader Jun 17 12:57:03.864940 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_23012b91a3274aef98d6e17feab67a02", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/23012b91a3274aef98d6e17feab67a02"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/23012b91a3274aef98d6e17feab67a02"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/23012b91a3274aef98d6e17feab67a02"}]}] Jun 17 12:57:03.864940 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Tenant: tempest-VolumesNegativeTest-1109309633 Jun 17 12:57:03.864940 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Tenant-Id: 23012b91a3274aef98d6e17feab67a02 Jun 17 12:57:03.864940 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Tenant-Name: tempest-VolumesNegativeTest-1109309633 Jun 17 12:57:03.864940 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User: tempest-VolumesNegativeTest-1109309633-project Jun 17 12:57:03.864940 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User-Domain-Id: default Jun 17 12:57:03.864940 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User-Domain-Name: Default Jun 17 12:57:03.864940 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User-Id: 165eda88af394c35bcd7e30534fb9c71 Jun 17 12:57:03.864940 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User-Name: tempest-VolumesNegativeTest-1109309633-project Jun 17 12:57:03.864940 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: method: Jun 17 12:57:03.864940 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: exception: Volume f196cc26-012a-4993-8a9e-96fe0a752d36 could not be found. Jun 17 12:57:03.864940 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: action_args: {'id': 'f196cc26-012a-4993-8a9e-96fe0a752d36'} Jun 17 12:57:03.864940 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 12:57:03.865748 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 12:57:03.865748 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 12:57:03.865748 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 12:57:03.865748 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 17 12:57:03.865748 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 17 12:57:03.865748 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 17 12:57:03.865748 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 17 12:57:03.865748 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 17 12:57:03.865748 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 17 12:57:03.865748 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 17 12:57:03.865748 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 17 12:57:03.865748 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 12:57:03.865748 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 12:57:03.865748 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 12:57:03.865748 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 12:57:03.865748 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f196cc26-012a-4993-8a9e-96fe0a752d36 could not be found. (HTTP 404) (Request-ID: req-4cf478f1-e079-44cf-b48a-4a47ed7fe692) Jun 17 12:57:03.865748 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 12:57:03.865748 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 12:57:03.865748 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 12:57:03.868208 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 12:57:03.868208 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 17 12:57:03.868208 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 17 12:57:03.868208 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 12:57:03.868208 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 12:57:03.868208 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 17 12:57:03.868208 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 17 12:57:03.868208 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 17 12:57:03.868208 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 17 12:57:03.868208 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 12:57:03.868208 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 12:57:03.868208 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 17 12:57:03.868208 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 17 12:57:03.868208 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 17 12:57:03.868208 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 17 12:57:03.868208 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 17 12:57:03.868208 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 17 12:57:03.868208 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 17 12:57:03.868208 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 17 12:57:03.871864 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 12:57:03.871864 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 12:57:03.871864 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 12:57:03.871864 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 12:57:03.871864 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f196cc26-012a-4993-8a9e-96fe0a752d36 could not be found. Jun 17 12:57:03.871864 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 12:57:03.871864 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 12:57:03.871864 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 12:57:03.871864 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 12:57:03.871864 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 12:57:03.871864 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 12:57:03.871864 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 12:57:03.871864 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 12:57:03.871864 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 17 12:57:03.871864 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 17 12:57:03.871864 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 12:57:03.871864 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 12:57:03.871864 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 17 12:57:03.871864 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 12:57:03.874634 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f196cc26-012a-4993-8a9e-96fe0a752d36 could not be found. Jun 17 12:57:03.874634 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 12:57:03.874634 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 12:57:03.874634 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 12:57:03.874634 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 12:57:03.874634 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 12:57:03.874634 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 12:57:03.874634 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 12:57:03.874634 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 12:57:03.874634 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f196cc26-012a-4993-8a9e-96fe0a752d36 could not be found. Jun 17 12:57:03.874634 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 12:57:03.878250 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-c71bba69-607c-4d61-9cac-b6d15cc68c42 tempest-VolumesNegativeTest-1109309633 tempest-VolumesNegativeTest-1109309633-project] Returning 404 to user: Volume f196cc26-012a-4993-8a9e-96fe0a752d36 could not be found. {{(pid=117659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 12:57:03.879614 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-c71bba69-607c-4d61-9cac-b6d15cc68c42 tempest-VolumesNegativeTest-1109309633 tempest-VolumesNegativeTest-1109309633-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/f196cc26-012a-4993-8a9e-96fe0a752d36" status: 404 len: 109 microversion: 2.1 time: 0.126812 Jun 17 12:57:03.891883 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 3/9] 10.222.0.48 () {58 vars in 1244 bytes} [Fri Jun 17 12:57:03 2022] GET /compute/v2.1/os-volumes/f196cc26-012a-4993-8a9e-96fe0a752d36 => generated 109 bytes in 140 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 12:57:05.336599 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-cfc815fd-6843-48af-bcde-7f185667c6ec tempest-VolumesTestJSON-42945583 tempest-VolumesTestJSON-42945583-project] Calling method '.version_select at 0x7f0191e783a0>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:05.482639 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-cfc815fd-6843-48af-bcde-7f185667c6ec tempest-VolumesTestJSON-42945583 tempest-VolumesTestJSON-42945583-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/1ccd30ba-9e8c-45d6-8eb9-9ee186ccbf70" status: 200 len: 351 microversion: 2.1 time: 0.192426 Jun 17 12:57:05.484725 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 7/10] 10.222.0.48 () {58 vars in 1244 bytes} [Fri Jun 17 12:57:05 2022] GET /compute/v2.1/os-volumes/1ccd30ba-9e8c-45d6-8eb9-9ee186ccbf70 => generated 351 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:57:08.173712 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-06d6a06f-8569-4b9b-8b68-c3a2d5a30069 tempest-VolumesTestJSON-42945583 tempest-VolumesTestJSON-42945583-project] Calling method '.version_select at 0x7f0191f2cc10>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:08.261449 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-06d6a06f-8569-4b9b-8b68-c3a2d5a30069 tempest-VolumesTestJSON-42945583 tempest-VolumesTestJSON-42945583-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/56247db8-5802-409c-a47d-3c7bfbff024e" status: 200 len: 351 microversion: 2.1 time: 0.092351 Jun 17 12:57:08.269440 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 4/11] 10.222.0.48 () {58 vars in 1244 bytes} [Fri Jun 17 12:57:08 2022] GET /compute/v2.1/os-volumes/56247db8-5802-409c-a47d-3c7bfbff024e => generated 351 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:57:08.276227 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-f2768864-a38b-4801-a4ba-cd2838825b49 tempest-VolumesTestJSON-42945583 tempest-VolumesTestJSON-42945583-project] Calling method '.version_select at 0x7f0191e8d4c0>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:08.555584 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-f2768864-a38b-4801-a4ba-cd2838825b49 tempest-VolumesTestJSON-42945583 tempest-VolumesTestJSON-42945583-project] 10.222.0.48 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.282840 Jun 17 12:57:08.556522 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 8/12] 10.222.0.48 () {58 vars in 1133 bytes} [Fri Jun 17 12:57:08 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:57:08.581373 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-40049711-e0ab-4918-a778-13d5e016ffba tempest-VolumesTestJSON-42945583 tempest-VolumesTestJSON-42945583-project] Calling method '.version_select at 0x7f0191ea8820>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:08.810381 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-40049711-e0ab-4918-a778-13d5e016ffba tempest-VolumesTestJSON-42945583 tempest-VolumesTestJSON-42945583-project] 10.222.0.48 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.234475 Jun 17 12:57:08.811464 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 5/13] 10.222.0.48 () {58 vars in 1148 bytes} [Fri Jun 17 12:57:08 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:57:08.834652 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-fe7724e1-1493-41fc-b548-7d1613eb0b93 tempest-VolumesTestJSON-42945583 tempest-VolumesTestJSON-42945583-project] Calling method '.version_select at 0x7f0191e78430>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:09.051891 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-fe7724e1-1493-41fc-b548-7d1613eb0b93 tempest-VolumesTestJSON-42945583 tempest-VolumesTestJSON-42945583-project] 10.222.0.48 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.225477 Jun 17 12:57:09.052459 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 9/14] 10.222.0.48 () {58 vars in 1133 bytes} [Fri Jun 17 12:57:08 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:57:09.079184 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-b0574059-8d57-49e3-8169-a565e473ff66 tempest-VolumesTestJSON-42945583 tempest-VolumesTestJSON-42945583-project] Calling method '.version_select at 0x7f0191e544c0>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:09.300922 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-b0574059-8d57-49e3-8169-a565e473ff66 tempest-VolumesTestJSON-42945583 tempest-VolumesTestJSON-42945583-project] 10.222.0.48 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.229637 Jun 17 12:57:09.303760 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 6/15] 10.222.0.48 () {58 vars in 1166 bytes} [Fri Jun 17 12:57:09 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:57:09.326356 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-26b49141-ff01-48dc-9e44-4e887f3a4130 tempest-VolumesTestJSON-42945583 tempest-VolumesTestJSON-42945583-project] Calling method '.version_select at 0x7f0191e8d430>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:09.451387 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-26b49141-ff01-48dc-9e44-4e887f3a4130 tempest-VolumesTestJSON-42945583 tempest-VolumesTestJSON-42945583-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.131115 Jun 17 12:57:09.452213 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 10/16] 10.222.0.48 () {58 vars in 1169 bytes} [Fri Jun 17 12:57:09 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:57:09.465374 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-f9919aa6-f0c1-45b2-b8fb-c421ee86861b tempest-VolumesTestJSON-42945583 tempest-VolumesTestJSON-42945583-project] Calling method '.version_select at 0x7f0191ea89d0>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:09.631857 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-f9919aa6-f0c1-45b2-b8fb-c421ee86861b tempest-VolumesTestJSON-42945583 tempest-VolumesTestJSON-42945583-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.171017 Jun 17 12:57:09.632808 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 7/17] 10.222.0.48 () {58 vars in 1154 bytes} [Fri Jun 17 12:57:09 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:57:09.645476 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-1cb6f556-1899-4f6f-b3c8-172d5f0094c1 tempest-VolumesTestJSON-42945583 tempest-VolumesTestJSON-42945583-project] Calling method '.version_select at 0x7f0191e1c790>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:09.897672 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-1cb6f556-1899-4f6f-b3c8-172d5f0094c1 tempest-VolumesTestJSON-42945583 tempest-VolumesTestJSON-42945583-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.256679 Jun 17 12:57:09.900394 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 11/18] 10.222.0.48 () {58 vars in 1187 bytes} [Fri Jun 17 12:57:09 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 12:57:09.916262 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-cc1e07f6-a90a-4bac-b9ba-fa07dcc52c0d tempest-VolumesTestJSON-42945583 tempest-VolumesTestJSON-42945583-project] Calling method '.version_select at 0x7f0191e54a60>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:10.117549 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-cc1e07f6-a90a-4bac-b9ba-fa07dcc52c0d tempest-VolumesTestJSON-42945583 tempest-VolumesTestJSON-42945583-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.208429 Jun 17 12:57:10.118387 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 8/19] 10.222.0.48 () {58 vars in 1154 bytes} [Fri Jun 17 12:57:09 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:57:18.558167 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-dd829ac9-f9c3-4cf3-823b-33236e1ca4ce tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Action: 'create', calling method: .version_select at 0x7f0191e1ca60>, body: {"keypair": {"name": "tempest-keypair-1301463028", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNnYzSdlct821s2SucY3AcJ2EU9v7ANnpJj0mqASfTueQWl9V0LTUT+s45xfgk/AYV+6uH51s06S+IyP0LKJK88q6VjnupAqzlwMDTPjrqu5PhbLviX5AegrVrn0bljYLQ=="}} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 12:57:18.672214 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.quota [None req-dd829ac9-f9c3-4cf3-823b-33236e1ca4ce tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Getting quotas for project 13a3f9864ad04941bc902febad84876d. Resources: {'key_pairs'} {{(pid=117660) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 12:57:18.692864 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.quota [None req-dd829ac9-f9c3-4cf3-823b-33236e1ca4ce tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Getting quotas for user 8bfbd9324f8040c496a83eb599ca80c0 and project 13a3f9864ad04941bc902febad84876d. Resources: {'key_pairs'} {{(pid=117660) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 12:57:18.822381 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-dd829ac9-f9c3-4cf3-823b-33236e1ca4ce tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.768605 Jun 17 12:57:18.827319 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 12/20] 10.222.0.48 () {60 vars in 1158 bytes} [Fri Jun 17 12:57:18 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:57:20.924552 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-2cb3b77d-71d3-4930-8762-de5314f11875 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Action: 'create', calling method: .version_select at 0x7f0191ea8d30>, body: {"keypair": {"name": "tempest-keypair-976867919", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMhL/o2fQh+bLBuwE6OkfHr8bOEQhc66X5PoHTZNzBIjpRvtkOH34ZeK83TpkiZh5f9ZYRDeAmORx9IGrr90SV4SIzW0Nd08f6ySCLYuPMk181OGRi9LMr11zRXAuDC74g=="}} {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 12:57:21.042107 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.quota [None req-2cb3b77d-71d3-4930-8762-de5314f11875 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Getting quotas for project c777f8f104af4d37a3b89ff9a57d2218. Resources: {'key_pairs'} {{(pid=117659) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 12:57:21.063915 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.quota [None req-2cb3b77d-71d3-4930-8762-de5314f11875 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Getting quotas for user 847c39439e874e68b72e07c311a53bec and project c777f8f104af4d37a3b89ff9a57d2218. Resources: {'key_pairs'} {{(pid=117659) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 12:57:21.219233 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-2cb3b77d-71d3-4930-8762-de5314f11875 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 1.137224 Jun 17 12:57:21.221397 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 9/21] 10.222.0.48 () {62 vars in 1199 bytes} [Fri Jun 17 12:57:20 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 1140 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 17 12:57:23.488636 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-17612563-5ec4-4cd9-ba20-215349f59702 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1305918178", "imageRef": "ccec3e37-1df8-4f10-a8f6-f97dfac54cf5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 12:57:23.753405 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.network.neutron [None req-17612563-5ec4-4cd9-ba20-215349f59702 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] validate_networks() for [('7be0f63f-8071-4d9e-ba66-cd0bb196b9c0', None, None, None, None, None)] {{(pid=117660) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 17 12:57:26.205013 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-32ebe97e-526b-4b43-942c-b64ef8944f01 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-332526395", "imageRef": "ccec3e37-1df8-4f10-a8f6-f97dfac54cf5", "flavorRef": "452", "networks": [{"uuid": "76185401-fe3a-47c6-9328-1baaf7b85e2b"}]}} {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 12:57:26.416955 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.network.neutron [None req-32ebe97e-526b-4b43-942c-b64ef8944f01 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] validate_networks() for [('76185401-fe3a-47c6-9328-1baaf7b85e2b', None, None, None, None, None)] {{(pid=117659) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 17 12:57:27.090402 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.virt.hardware [None req-17612563-5ec4-4cd9-ba20-215349f59702 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Flavor limits 0:0:0 {{(pid=117660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 17 12:57:27.091165 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.virt.hardware [None req-17612563-5ec4-4cd9-ba20-215349f59702 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Image limits 0:0:0 {{(pid=117660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 17 12:57:27.092298 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.virt.hardware [None req-17612563-5ec4-4cd9-ba20-215349f59702 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Flavor pref 0:0:0 {{(pid=117660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 17 12:57:27.093299 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.virt.hardware [None req-17612563-5ec4-4cd9-ba20-215349f59702 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Image pref 0:0:0 {{(pid=117660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 17 12:57:27.094209 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.virt.hardware [None req-17612563-5ec4-4cd9-ba20-215349f59702 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 17 12:57:27.199445 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-17612563-5ec4-4cd9-ba20-215349f59702 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:27.200241 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-17612563-5ec4-4cd9-ba20-215349f59702 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:27.201912 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-17612563-5ec4-4cd9-ba20-215349f59702 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:27.202673 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-17612563-5ec4-4cd9-ba20-215349f59702 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:27.404355 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.quota [None req-17612563-5ec4-4cd9-ba20-215349f59702 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Getting quotas for project 17ea6f9d80f345dbb3b2bf75e0138fd3. Resources: {'ram', 'cores', 'instances'} {{(pid=117660) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 12:57:27.446471 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.quota [None req-17612563-5ec4-4cd9-ba20-215349f59702 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Getting quotas for user b75243e37f2342c0a428d39e193e0d4b and project 17ea6f9d80f345dbb3b2bf75e0138fd3. Resources: {'ram', 'cores', 'instances'} {{(pid=117660) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 12:57:27.514284 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-17612563-5ec4-4cd9-ba20-215349f59702 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Going to run 1 instances... {{(pid=117660) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 17 12:57:27.530781 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-17612563-5ec4-4cd9-ba20-215349f59702 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 5db43a6d-a079-4e7c-948a-b2600a102f63] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ccec3e37-1df8-4f10-a8f6-f97dfac54cf5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117660) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 17 12:57:27.764001 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-17612563-5ec4-4cd9-ba20-215349f59702 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 5.334440 Jun 17 12:57:27.765335 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 13/22] 10.222.0.48 () {60 vars in 1146 bytes} [Fri Jun 17 12:57:22 2022] POST /compute/v2.1/servers => generated 383 bytes in 5339 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 17 12:57:27.782750 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-a3248b28-a142-45ac-a88e-b309fcd1e46e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:27.784831 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-a3248b28-a142-45ac-a88e-b309fcd1e46e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 5db43a6d-a079-4e7c-948a-b2600a102f63] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:28.023799 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-a3248b28-a142-45ac-a88e-b309fcd1e46e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:28.050539 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-a3248b28-a142-45ac-a88e-b309fcd1e46e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/5db43a6d-a079-4e7c-948a-b2600a102f63" status: 200 len: 1222 microversion: 2.1 time: 0.278441 Jun 17 12:57:28.054243 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 14/23] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:57:27 2022] GET /compute/v2.1/servers/5db43a6d-a079-4e7c-948a-b2600a102f63 => generated 1222 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:57:28.559753 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-9f3154de-e04b-45a8-9cce-a57d361cfba5 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-849285336", "imageRef": "ccec3e37-1df8-4f10-a8f6-f97dfac54cf5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 12:57:28.697095 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.network.neutron [None req-9f3154de-e04b-45a8-9cce-a57d361cfba5 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] validate_networks() for [('7be0f63f-8071-4d9e-ba66-cd0bb196b9c0', None, None, None, None, None)] {{(pid=117660) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 17 12:57:29.211168 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.virt.hardware [None req-32ebe97e-526b-4b43-942c-b64ef8944f01 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Flavor limits 0:0:0 {{(pid=117659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 17 12:57:29.212016 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.virt.hardware [None req-32ebe97e-526b-4b43-942c-b64ef8944f01 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Image limits 0:0:0 {{(pid=117659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 17 12:57:29.212535 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.virt.hardware [None req-32ebe97e-526b-4b43-942c-b64ef8944f01 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Flavor pref 0:0:0 {{(pid=117659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 17 12:57:29.212961 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.virt.hardware [None req-32ebe97e-526b-4b43-942c-b64ef8944f01 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Image pref 0:0:0 {{(pid=117659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 17 12:57:29.213393 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.virt.hardware [None req-32ebe97e-526b-4b43-942c-b64ef8944f01 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 17 12:57:29.226833 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-32ebe97e-526b-4b43-942c-b64ef8944f01 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:29.227975 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-32ebe97e-526b-4b43-942c-b64ef8944f01 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:29.229114 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-32ebe97e-526b-4b43-942c-b64ef8944f01 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:29.229907 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-32ebe97e-526b-4b43-942c-b64ef8944f01 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:29.282415 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.quota [None req-32ebe97e-526b-4b43-942c-b64ef8944f01 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Getting quotas for project 4c048fb2cf4e491980fb65a8e32b0fb2. Resources: {'ram', 'cores', 'instances'} {{(pid=117659) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 12:57:29.297831 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.quota [None req-32ebe97e-526b-4b43-942c-b64ef8944f01 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Getting quotas for user e2d0edf9b51d4370950f7ff503c324b8 and project 4c048fb2cf4e491980fb65a8e32b0fb2. Resources: {'ram', 'cores', 'instances'} {{(pid=117659) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 12:57:29.333127 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-32ebe97e-526b-4b43-942c-b64ef8944f01 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Going to run 1 instances... {{(pid=117659) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 17 12:57:29.347660 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-32ebe97e-526b-4b43-942c-b64ef8944f01 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] [instance: 73cb6bde-cad3-43ef-b361-62ff89b3544a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ccec3e37-1df8-4f10-a8f6-f97dfac54cf5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117659) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 17 12:57:29.544497 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-32ebe97e-526b-4b43-942c-b64ef8944f01 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.705133 Jun 17 12:57:29.545075 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 10/24] 10.222.0.48 () {60 vars in 1146 bytes} [Fri Jun 17 12:57:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 3709 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 17 12:57:29.561879 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-05cbe914-d913-4f52-b3dd-98dec71377d9 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:29.563623 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-05cbe914-d913-4f52-b3dd-98dec71377d9 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] [instance: 73cb6bde-cad3-43ef-b361-62ff89b3544a] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:29.808776 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-05cbe914-d913-4f52-b3dd-98dec71377d9 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d0edf9b51d4370950f7ff503c324b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c048fb2cf4e491980fb65a8e32b0fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:29.831904 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-05cbe914-d913-4f52-b3dd-98dec71377d9 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] 10.222.0.48 "GET /compute/v2.1/servers/73cb6bde-cad3-43ef-b361-62ff89b3544a" status: 200 len: 1214 microversion: 2.1 time: 0.278871 Jun 17 12:57:29.838630 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 11/25] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:57:29 2022] GET /compute/v2.1/servers/73cb6bde-cad3-43ef-b361-62ff89b3544a => generated 1214 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 12:57:29.862831 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-6a009be4-eb1d-4ce0-8f58-a266ad54b65c tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1588277104", "imageRef": "ccec3e37-1df8-4f10-a8f6-f97dfac54cf5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8a7eabf9-ca7c-4c05-b72a-f274cf4b5749"}], "security_groups": [{"name": "tempest-securitygroup--585065847"}], "key_name": "tempest-keypair-1301463028", "user_data": "}} {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 12:57:30.514879 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.network.neutron [None req-6a009be4-eb1d-4ce0-8f58-a266ad54b65c tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] validate_networks() for [('8a7eabf9-ca7c-4c05-b72a-f274cf4b5749', None, None, None, None, None)] {{(pid=117659) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 17 12:57:30.568853 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.virt.hardware [None req-9f3154de-e04b-45a8-9cce-a57d361cfba5 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Flavor limits 0:0:0 {{(pid=117660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 17 12:57:30.569856 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.virt.hardware [None req-9f3154de-e04b-45a8-9cce-a57d361cfba5 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Image limits 0:0:0 {{(pid=117660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 17 12:57:30.570837 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.virt.hardware [None req-9f3154de-e04b-45a8-9cce-a57d361cfba5 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Flavor pref 0:0:0 {{(pid=117660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 17 12:57:30.571463 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.virt.hardware [None req-9f3154de-e04b-45a8-9cce-a57d361cfba5 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Image pref 0:0:0 {{(pid=117660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 17 12:57:30.572172 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.virt.hardware [None req-9f3154de-e04b-45a8-9cce-a57d361cfba5 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 17 12:57:30.610203 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9f3154de-e04b-45a8-9cce-a57d361cfba5 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:30.610873 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9f3154de-e04b-45a8-9cce-a57d361cfba5 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:30.612445 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9f3154de-e04b-45a8-9cce-a57d361cfba5 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:30.613276 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9f3154de-e04b-45a8-9cce-a57d361cfba5 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:30.675165 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.quota [None req-9f3154de-e04b-45a8-9cce-a57d361cfba5 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Getting quotas for project 17ea6f9d80f345dbb3b2bf75e0138fd3. Resources: {'ram', 'cores', 'instances'} {{(pid=117660) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 12:57:30.683069 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.quota [None req-9f3154de-e04b-45a8-9cce-a57d361cfba5 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Getting quotas for user b75243e37f2342c0a428d39e193e0d4b and project 17ea6f9d80f345dbb3b2bf75e0138fd3. Resources: {'ram', 'cores', 'instances'} {{(pid=117660) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 12:57:30.793507 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-9f3154de-e04b-45a8-9cce-a57d361cfba5 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Going to run 1 instances... {{(pid=117660) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 17 12:57:30.797772 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-9f3154de-e04b-45a8-9cce-a57d361cfba5 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: cc3f5e1d-d03b-4fe4-b777-8aedac2761ce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ccec3e37-1df8-4f10-a8f6-f97dfac54cf5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117660) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 17 12:57:30.964539 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-9f3154de-e04b-45a8-9cce-a57d361cfba5 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.407614 Jun 17 12:57:30.968019 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 15/26] 10.222.0.48 () {60 vars in 1146 bytes} [Fri Jun 17 12:57:28 2022] POST /compute/v2.1/servers => generated 383 bytes in 2415 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 17 12:57:30.984970 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-88597940-1ab3-4206-a033-5b31f2371860 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1042333390", "imageRef": "ccec3e37-1df8-4f10-a8f6-f97dfac54cf5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4ea46af5-e03e-4c99-82a1-0dfaa30ad227"}], "security_groups": [{"name": "tempest-securitygroup--1825791951"}], "key_name": "tempest-keypair-976867919", "user_data": "}} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 12:57:31.929428 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.network.neutron [None req-88597940-1ab3-4206-a033-5b31f2371860 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] validate_networks() for [('4ea46af5-e03e-4c99-82a1-0dfaa30ad227', None, None, None, None, None)] {{(pid=117660) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 17 12:57:32.554746 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.virt.hardware [None req-6a009be4-eb1d-4ce0-8f58-a266ad54b65c tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Flavor limits 0:0:0 {{(pid=117659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 17 12:57:32.555266 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.virt.hardware [None req-6a009be4-eb1d-4ce0-8f58-a266ad54b65c tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Image limits 0:0:0 {{(pid=117659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 17 12:57:32.555647 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.virt.hardware [None req-6a009be4-eb1d-4ce0-8f58-a266ad54b65c tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Flavor pref 0:0:0 {{(pid=117659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 17 12:57:32.556032 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.virt.hardware [None req-6a009be4-eb1d-4ce0-8f58-a266ad54b65c tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Image pref 0:0:0 {{(pid=117659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 17 12:57:32.556444 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.virt.hardware [None req-6a009be4-eb1d-4ce0-8f58-a266ad54b65c tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 17 12:57:32.583595 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6a009be4-eb1d-4ce0-8f58-a266ad54b65c tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:32.584103 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6a009be4-eb1d-4ce0-8f58-a266ad54b65c tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:32.585068 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6a009be4-eb1d-4ce0-8f58-a266ad54b65c tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:32.585516 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6a009be4-eb1d-4ce0-8f58-a266ad54b65c tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:32.628738 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.quota [None req-6a009be4-eb1d-4ce0-8f58-a266ad54b65c tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Getting quotas for project 13a3f9864ad04941bc902febad84876d. Resources: {'ram', 'cores', 'instances'} {{(pid=117659) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 12:57:32.637796 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.quota [None req-6a009be4-eb1d-4ce0-8f58-a266ad54b65c tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Getting quotas for user 8bfbd9324f8040c496a83eb599ca80c0 and project 13a3f9864ad04941bc902febad84876d. Resources: {'ram', 'cores', 'instances'} {{(pid=117659) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 12:57:32.659953 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-6a009be4-eb1d-4ce0-8f58-a266ad54b65c tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Going to run 1 instances... {{(pid=117659) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 17 12:57:32.663202 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-6a009be4-eb1d-4ce0-8f58-a266ad54b65c tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ccec3e37-1df8-4f10-a8f6-f97dfac54cf5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117659) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 17 12:57:32.922440 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-6a009be4-eb1d-4ce0-8f58-a266ad54b65c tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 3.082052 Jun 17 12:57:32.933006 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 12/27] 10.222.0.48 () {60 vars in 1146 bytes} [Fri Jun 17 12:57:29 2022] POST /compute/v2.1/servers => generated 401 bytes in 3093 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 17 12:57:32.954018 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-69a376c3-105d-40ee-8cb9-8e6b814c9800 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:32.958931 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-69a376c3-105d-40ee-8cb9-8e6b814c9800 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] [instance: 73cb6bde-cad3-43ef-b361-62ff89b3544a] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:33.014986 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-69a376c3-105d-40ee-8cb9-8e6b814c9800 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:33.015943 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-69a376c3-105d-40ee-8cb9-8e6b814c9800 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:33.018077 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-69a376c3-105d-40ee-8cb9-8e6b814c9800 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:33.019061 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-69a376c3-105d-40ee-8cb9-8e6b814c9800 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:33.145966 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.virt.hardware [None req-88597940-1ab3-4206-a033-5b31f2371860 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Flavor limits 0:0:0 {{(pid=117660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 17 12:57:33.146908 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.virt.hardware [None req-88597940-1ab3-4206-a033-5b31f2371860 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Image limits 0:0:0 {{(pid=117660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 17 12:57:33.147841 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.virt.hardware [None req-88597940-1ab3-4206-a033-5b31f2371860 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Flavor pref 0:0:0 {{(pid=117660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 17 12:57:33.148641 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.virt.hardware [None req-88597940-1ab3-4206-a033-5b31f2371860 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Image pref 0:0:0 {{(pid=117660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 17 12:57:33.149667 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.virt.hardware [None req-88597940-1ab3-4206-a033-5b31f2371860 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 17 12:57:33.214735 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-88597940-1ab3-4206-a033-5b31f2371860 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:33.221831 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-88597940-1ab3-4206-a033-5b31f2371860 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:33.224656 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-88597940-1ab3-4206-a033-5b31f2371860 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:33.235744 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-88597940-1ab3-4206-a033-5b31f2371860 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:33.341877 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.quota [None req-88597940-1ab3-4206-a033-5b31f2371860 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Getting quotas for project c777f8f104af4d37a3b89ff9a57d2218. Resources: {'ram', 'cores', 'instances'} {{(pid=117660) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 12:57:33.361657 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.quota [None req-88597940-1ab3-4206-a033-5b31f2371860 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Getting quotas for user 847c39439e874e68b72e07c311a53bec and project c777f8f104af4d37a3b89ff9a57d2218. Resources: {'ram', 'cores', 'instances'} {{(pid=117660) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 12:57:33.456263 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-88597940-1ab3-4206-a033-5b31f2371860 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Going to run 1 instances... {{(pid=117660) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 17 12:57:33.463195 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-88597940-1ab3-4206-a033-5b31f2371860 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ccec3e37-1df8-4f10-a8f6-f97dfac54cf5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117660) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 17 12:57:33.508936 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-69a376c3-105d-40ee-8cb9-8e6b814c9800 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d0edf9b51d4370950f7ff503c324b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c048fb2cf4e491980fb65a8e32b0fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:33.579301 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-69a376c3-105d-40ee-8cb9-8e6b814c9800 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] 10.222.0.48 "GET /compute/v2.1/servers/73cb6bde-cad3-43ef-b361-62ff89b3544a" status: 200 len: 1266 microversion: 2.1 time: 0.641543 Jun 17 12:57:33.587784 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 13/28] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:57:32 2022] GET /compute/v2.1/servers/73cb6bde-cad3-43ef-b361-62ff89b3544a => generated 1266 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:57:33.595000 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-b5b0188c-aa47-4046-bf76-6e24f7a8017b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:33.612824 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-b5b0188c-aa47-4046-bf76-6e24f7a8017b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: cc3f5e1d-d03b-4fe4-b777-8aedac2761ce] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:33.646581 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b5b0188c-aa47-4046-bf76-6e24f7a8017b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:33.648369 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b5b0188c-aa47-4046-bf76-6e24f7a8017b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:33.656798 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b5b0188c-aa47-4046-bf76-6e24f7a8017b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:33.657386 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b5b0188c-aa47-4046-bf76-6e24f7a8017b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:33.707488 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-88597940-1ab3-4206-a033-5b31f2371860 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.735267 Jun 17 12:57:33.726116 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 16/29] 10.222.0.48 () {62 vars in 1187 bytes} [Fri Jun 17 12:57:30 2022] POST /compute/v2.1/servers => generated 402 bytes in 2757 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 17 12:57:33.748097 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-1f1dceb2-4ef1-41b2-91ba-6c7b4a215055 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:33.749445 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-1f1dceb2-4ef1-41b2-91ba-6c7b4a215055 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:34.500799 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-b5b0188c-aa47-4046-bf76-6e24f7a8017b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:34.521517 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-b5b0188c-aa47-4046-bf76-6e24f7a8017b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce" status: 200 len: 1273 microversion: 2.1 time: 0.932440 Jun 17 12:57:34.522973 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 14/30] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:57:33 2022] GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce => generated 1273 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:57:34.527087 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-1f1dceb2-4ef1-41b2-91ba-6c7b4a215055 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:34.537656 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-1f1dceb2-4ef1-41b2-91ba-6c7b4a215055 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1238 microversion: 2.1 time: 0.807494 Jun 17 12:57:34.550498 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 17/31] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:57:33 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1238 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:57:34.552034 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-aef8f0ed-354f-40b8-8a74-e78bd4950838 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:34.554949 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-aef8f0ed-354f-40b8-8a74-e78bd4950838 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:34.601182 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-f4431aa5-2e16-41e6-a648-895deb72dc63 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:34.602275 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-f4431aa5-2e16-41e6-a648-895deb72dc63 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] [instance: 73cb6bde-cad3-43ef-b361-62ff89b3544a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:34.616603 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f4431aa5-2e16-41e6-a648-895deb72dc63 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:34.621139 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f4431aa5-2e16-41e6-a648-895deb72dc63 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:34.622292 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f4431aa5-2e16-41e6-a648-895deb72dc63 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:34.624154 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f4431aa5-2e16-41e6-a648-895deb72dc63 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:34.851933 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-aef8f0ed-354f-40b8-8a74-e78bd4950838 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:34.864579 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-aef8f0ed-354f-40b8-8a74-e78bd4950838 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:34.876798 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-aef8f0ed-354f-40b8-8a74-e78bd4950838 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:34.881232 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-aef8f0ed-354f-40b8-8a74-e78bd4950838 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1281 microversion: 2.20 time: 0.355724 Jun 17 12:57:34.890929 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 15/32] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 12:57:34 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1281 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 12:57:35.477638 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-f4431aa5-2e16-41e6-a648-895deb72dc63 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d0edf9b51d4370950f7ff503c324b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c048fb2cf4e491980fb65a8e32b0fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:35.526839 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-f4431aa5-2e16-41e6-a648-895deb72dc63 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] 10.222.0.48 "GET /compute/v2.1/servers/73cb6bde-cad3-43ef-b361-62ff89b3544a" status: 200 len: 1272 microversion: 2.1 time: 0.923145 Jun 17 12:57:35.527412 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 18/33] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:57:34 2022] GET /compute/v2.1/servers/73cb6bde-cad3-43ef-b361-62ff89b3544a => generated 1272 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 12:57:35.544249 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-098b177e-0aa6-46ae-82ad-d01473530490 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:35.545306 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-098b177e-0aa6-46ae-82ad-d01473530490 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: cc3f5e1d-d03b-4fe4-b777-8aedac2761ce] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:35.558032 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-e2023cc8-f193-4401-8ea2-f0d6b05d8644 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:35.563783 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-098b177e-0aa6-46ae-82ad-d01473530490 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:35.564927 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-098b177e-0aa6-46ae-82ad-d01473530490 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:35.566556 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-e2023cc8-f193-4401-8ea2-f0d6b05d8644 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:35.567226 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-098b177e-0aa6-46ae-82ad-d01473530490 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:35.569582 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-098b177e-0aa6-46ae-82ad-d01473530490 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:35.604863 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e2023cc8-f193-4401-8ea2-f0d6b05d8644 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:35.605315 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e2023cc8-f193-4401-8ea2-f0d6b05d8644 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:35.617196 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e2023cc8-f193-4401-8ea2-f0d6b05d8644 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:35.617653 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e2023cc8-f193-4401-8ea2-f0d6b05d8644 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:36.414543 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-098b177e-0aa6-46ae-82ad-d01473530490 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:36.432383 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-098b177e-0aa6-46ae-82ad-d01473530490 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce" status: 200 len: 1279 microversion: 2.1 time: 0.884570 Jun 17 12:57:36.438851 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 16/34] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:57:35 2022] GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce => generated 1279 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:57:36.449782 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-1e48a870-1f47-4d54-9e86-b1e235c8e58f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:36.450729 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-1e48a870-1f47-4d54-9e86-b1e235c8e58f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:36.471839 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-1e48a870-1f47-4d54-9e86-b1e235c8e58f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:36.472295 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-1e48a870-1f47-4d54-9e86-b1e235c8e58f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:36.477706 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-1e48a870-1f47-4d54-9e86-b1e235c8e58f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:36.481182 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-1e48a870-1f47-4d54-9e86-b1e235c8e58f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:36.524826 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-e2023cc8-f193-4401-8ea2-f0d6b05d8644 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:36.540414 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-e2023cc8-f193-4401-8ea2-f0d6b05d8644 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1290 microversion: 2.1 time: 0.986768 Jun 17 12:57:36.552196 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 19/35] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:57:35 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1290 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:57:36.564612 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-74b79114-a893-4c55-9c42-bf61ed2d8096 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:36.565758 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-74b79114-a893-4c55-9c42-bf61ed2d8096 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] [instance: 73cb6bde-cad3-43ef-b361-62ff89b3544a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:36.580509 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-74b79114-a893-4c55-9c42-bf61ed2d8096 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:36.582594 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-74b79114-a893-4c55-9c42-bf61ed2d8096 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:36.585545 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-74b79114-a893-4c55-9c42-bf61ed2d8096 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:36.587249 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-74b79114-a893-4c55-9c42-bf61ed2d8096 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:36.707737 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-1e48a870-1f47-4d54-9e86-b1e235c8e58f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:36.718591 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-1e48a870-1f47-4d54-9e86-b1e235c8e58f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:36.732343 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-1e48a870-1f47-4d54-9e86-b1e235c8e58f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:36.734899 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-1e48a870-1f47-4d54-9e86-b1e235c8e58f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1333 microversion: 2.20 time: 0.294885 Jun 17 12:57:36.735928 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 17/36] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 12:57:36 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1333 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 12:57:36.827268 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-74b79114-a893-4c55-9c42-bf61ed2d8096 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d0edf9b51d4370950f7ff503c324b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c048fb2cf4e491980fb65a8e32b0fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:36.836155 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-74b79114-a893-4c55-9c42-bf61ed2d8096 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] 10.222.0.48 "GET /compute/v2.1/servers/73cb6bde-cad3-43ef-b361-62ff89b3544a" status: 200 len: 1272 microversion: 2.1 time: 0.282627 Jun 17 12:57:36.844584 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 20/37] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:57:36 2022] GET /compute/v2.1/servers/73cb6bde-cad3-43ef-b361-62ff89b3544a => generated 1272 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:57:37.455602 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-ec97a5a1-6991-4eef-8736-b4872ec03577 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:37.456637 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-ec97a5a1-6991-4eef-8736-b4872ec03577 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: cc3f5e1d-d03b-4fe4-b777-8aedac2761ce] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:37.465159 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ec97a5a1-6991-4eef-8736-b4872ec03577 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:37.476616 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ec97a5a1-6991-4eef-8736-b4872ec03577 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:37.483252 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ec97a5a1-6991-4eef-8736-b4872ec03577 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:37.488566 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ec97a5a1-6991-4eef-8736-b4872ec03577 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:37.563329 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-0f0a96ec-dba4-43b2-a549-2cb1d0019027 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:37.563940 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-0f0a96ec-dba4-43b2-a549-2cb1d0019027 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:37.577956 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0f0a96ec-dba4-43b2-a549-2cb1d0019027 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:37.580318 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0f0a96ec-dba4-43b2-a549-2cb1d0019027 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:37.581451 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0f0a96ec-dba4-43b2-a549-2cb1d0019027 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:37.582681 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0f0a96ec-dba4-43b2-a549-2cb1d0019027 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:38.386831 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-ec97a5a1-6991-4eef-8736-b4872ec03577 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:38.394888 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-0f0a96ec-dba4-43b2-a549-2cb1d0019027 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:38.401350 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-ec97a5a1-6991-4eef-8736-b4872ec03577 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce" status: 200 len: 1279 microversion: 2.1 time: 0.949702 Jun 17 12:57:38.406693 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-0f0a96ec-dba4-43b2-a549-2cb1d0019027 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1296 microversion: 2.1 time: 0.847392 Jun 17 12:57:38.423452 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 18/38] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:57:37 2022] GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce => generated 1279 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:57:38.425765 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 21/39] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:57:37 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1296 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:57:38.445927 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-863a4fe7-24b1-4c37-a9c5-5c1073949f71 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:38.448956 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-863a4fe7-24b1-4c37-a9c5-5c1073949f71 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] [instance: 73cb6bde-cad3-43ef-b361-62ff89b3544a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:38.458840 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-831552ce-460a-4717-8b4b-1f8ae4529987 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:38.463956 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-831552ce-460a-4717-8b4b-1f8ae4529987 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:38.482266 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-863a4fe7-24b1-4c37-a9c5-5c1073949f71 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:38.483194 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-863a4fe7-24b1-4c37-a9c5-5c1073949f71 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:38.484536 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-863a4fe7-24b1-4c37-a9c5-5c1073949f71 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:38.488497 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-863a4fe7-24b1-4c37-a9c5-5c1073949f71 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:38.506821 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-831552ce-460a-4717-8b4b-1f8ae4529987 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:38.509464 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-831552ce-460a-4717-8b4b-1f8ae4529987 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:38.512193 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-831552ce-460a-4717-8b4b-1f8ae4529987 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:38.515063 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-831552ce-460a-4717-8b4b-1f8ae4529987 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:38.854459 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-831552ce-460a-4717-8b4b-1f8ae4529987 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:38.879202 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-831552ce-460a-4717-8b4b-1f8ae4529987 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:38.885105 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-831552ce-460a-4717-8b4b-1f8ae4529987 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:38.895229 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-831552ce-460a-4717-8b4b-1f8ae4529987 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1339 microversion: 2.20 time: 0.463172 Jun 17 12:57:38.910795 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 19/40] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 12:57:38 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1339 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 12:57:39.380334 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-863a4fe7-24b1-4c37-a9c5-5c1073949f71 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d0edf9b51d4370950f7ff503c324b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c048fb2cf4e491980fb65a8e32b0fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:39.394263 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-863a4fe7-24b1-4c37-a9c5-5c1073949f71 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] 10.222.0.48 "GET /compute/v2.1/servers/73cb6bde-cad3-43ef-b361-62ff89b3544a" status: 200 len: 1272 microversion: 2.1 time: 0.966169 Jun 17 12:57:39.401959 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 22/41] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:57:38 2022] GET /compute/v2.1/servers/73cb6bde-cad3-43ef-b361-62ff89b3544a => generated 1272 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:57:39.429127 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-ff238c88-e1a8-45f1-b399-e5f94125210c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:39.430139 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-ff238c88-e1a8-45f1-b399-e5f94125210c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: cc3f5e1d-d03b-4fe4-b777-8aedac2761ce] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:39.433137 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-d3c47499-ed42-4761-a732-9afc943f9b35 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:39.434491 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-d3c47499-ed42-4761-a732-9afc943f9b35 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:39.444616 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ff238c88-e1a8-45f1-b399-e5f94125210c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:39.445312 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ff238c88-e1a8-45f1-b399-e5f94125210c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:39.448397 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d3c47499-ed42-4761-a732-9afc943f9b35 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:39.449151 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ff238c88-e1a8-45f1-b399-e5f94125210c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:39.449963 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ff238c88-e1a8-45f1-b399-e5f94125210c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:39.451460 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d3c47499-ed42-4761-a732-9afc943f9b35 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:39.459146 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d3c47499-ed42-4761-a732-9afc943f9b35 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:39.461278 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d3c47499-ed42-4761-a732-9afc943f9b35 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:40.196406 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-ff238c88-e1a8-45f1-b399-e5f94125210c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:40.210889 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-ff238c88-e1a8-45f1-b399-e5f94125210c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce" status: 200 len: 1279 microversion: 2.1 time: 0.789648 Jun 17 12:57:40.226455 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-d3c47499-ed42-4761-a732-9afc943f9b35 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:40.228936 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 20/42] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:57:39 2022] GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce => generated 1279 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:57:40.233566 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-d3c47499-ed42-4761-a732-9afc943f9b35 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1296 microversion: 2.1 time: 0.805107 Jun 17 12:57:40.239734 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-6a5fbb27-db76-45f2-83bf-2c6d7dbaf152 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:40.243874 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-6a5fbb27-db76-45f2-83bf-2c6d7dbaf152 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:40.254419 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 23/43] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:57:39 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1296 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 12:57:40.265775 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6a5fbb27-db76-45f2-83bf-2c6d7dbaf152 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:40.286904 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6a5fbb27-db76-45f2-83bf-2c6d7dbaf152 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:40.293513 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6a5fbb27-db76-45f2-83bf-2c6d7dbaf152 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:40.299917 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6a5fbb27-db76-45f2-83bf-2c6d7dbaf152 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:40.419192 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-fdcecc64-3e4f-4ca2-9ec7-6ac41c6ed895 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:40.420026 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-fdcecc64-3e4f-4ca2-9ec7-6ac41c6ed895 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] [instance: 73cb6bde-cad3-43ef-b361-62ff89b3544a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:40.447297 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fdcecc64-3e4f-4ca2-9ec7-6ac41c6ed895 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:40.448786 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fdcecc64-3e4f-4ca2-9ec7-6ac41c6ed895 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:40.460370 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fdcecc64-3e4f-4ca2-9ec7-6ac41c6ed895 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:40.463258 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fdcecc64-3e4f-4ca2-9ec7-6ac41c6ed895 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:40.895525 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-6a5fbb27-db76-45f2-83bf-2c6d7dbaf152 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:40.912656 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-6a5fbb27-db76-45f2-83bf-2c6d7dbaf152 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:40.922780 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-6a5fbb27-db76-45f2-83bf-2c6d7dbaf152 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:40.930650 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-6a5fbb27-db76-45f2-83bf-2c6d7dbaf152 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1339 microversion: 2.20 time: 0.696798 Jun 17 12:57:40.933558 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 21/44] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 12:57:40 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1339 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 12:57:41.164412 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-fdcecc64-3e4f-4ca2-9ec7-6ac41c6ed895 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d0edf9b51d4370950f7ff503c324b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c048fb2cf4e491980fb65a8e32b0fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:41.175328 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-fdcecc64-3e4f-4ca2-9ec7-6ac41c6ed895 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] 10.222.0.48 "GET /compute/v2.1/servers/73cb6bde-cad3-43ef-b361-62ff89b3544a" status: 200 len: 1272 microversion: 2.1 time: 0.760761 Jun 17 12:57:41.176232 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 24/45] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:57:40 2022] GET /compute/v2.1/servers/73cb6bde-cad3-43ef-b361-62ff89b3544a => generated 1272 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 12:57:41.254585 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-e67d8f15-c2c2-40c7-ad5d-4e168b06535e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:41.256017 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-d5d40b26-1d6d-48ad-9e30-bb72b2780600 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:41.256651 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-d5d40b26-1d6d-48ad-9e30-bb72b2780600 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:41.259329 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-e67d8f15-c2c2-40c7-ad5d-4e168b06535e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: cc3f5e1d-d03b-4fe4-b777-8aedac2761ce] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:41.266617 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d5d40b26-1d6d-48ad-9e30-bb72b2780600 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:41.267071 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d5d40b26-1d6d-48ad-9e30-bb72b2780600 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:41.267893 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d5d40b26-1d6d-48ad-9e30-bb72b2780600 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:41.279259 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d5d40b26-1d6d-48ad-9e30-bb72b2780600 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:41.293520 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e67d8f15-c2c2-40c7-ad5d-4e168b06535e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:41.297162 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e67d8f15-c2c2-40c7-ad5d-4e168b06535e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:41.299290 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e67d8f15-c2c2-40c7-ad5d-4e168b06535e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:41.303635 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e67d8f15-c2c2-40c7-ad5d-4e168b06535e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:41.671468 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-d5d40b26-1d6d-48ad-9e30-bb72b2780600 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:41.689778 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-d5d40b26-1d6d-48ad-9e30-bb72b2780600 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1296 microversion: 2.1 time: 0.437174 Jun 17 12:57:41.695578 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 25/46] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:57:41 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1296 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:57:41.954692 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-53e89190-8daa-4f57-aae9-3851a891a2b7 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:41.955285 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-53e89190-8daa-4f57-aae9-3851a891a2b7 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:41.974052 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-53e89190-8daa-4f57-aae9-3851a891a2b7 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:41.974539 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-53e89190-8daa-4f57-aae9-3851a891a2b7 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:41.975345 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-53e89190-8daa-4f57-aae9-3851a891a2b7 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:41.976264 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-53e89190-8daa-4f57-aae9-3851a891a2b7 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:42.602551 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_cell0:SELECT=4 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:57:42.782785 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-e67d8f15-c2c2-40c7-ad5d-4e168b06535e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:42.799480 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-e67d8f15-c2c2-40c7-ad5d-4e168b06535e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce" status: 200 len: 1321 microversion: 2.1 time: 1.567741 Jun 17 12:57:42.800582 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 22/47] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:57:41 2022] GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce => generated 1321 bytes in 1572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:57:42.827852 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-e603ee0e-75eb-4152-954a-a0b9ff915502 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:42.841502 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-e603ee0e-75eb-4152-954a-a0b9ff915502 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] [instance: 73cb6bde-cad3-43ef-b361-62ff89b3544a] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:42.872549 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e603ee0e-75eb-4152-954a-a0b9ff915502 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:42.872985 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e603ee0e-75eb-4152-954a-a0b9ff915502 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:42.874741 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e603ee0e-75eb-4152-954a-a0b9ff915502 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:42.877783 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e603ee0e-75eb-4152-954a-a0b9ff915502 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:43.288126 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell0:SELECT=6 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:57:43.360266 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-53e89190-8daa-4f57-aae9-3851a891a2b7 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:43.380752 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-53e89190-8daa-4f57-aae9-3851a891a2b7 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:43.388584 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-53e89190-8daa-4f57-aae9-3851a891a2b7 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:43.390822 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-53e89190-8daa-4f57-aae9-3851a891a2b7 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1407 microversion: 2.20 time: 1.439494 Jun 17 12:57:43.403598 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 26/48] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 12:57:41 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1407 bytes in 1453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 12:57:43.423802 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-80ec720a-d1f0-4c83-8936-0500ad79f3be tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:43.426080 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-80ec720a-d1f0-4c83-8936-0500ad79f3be tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:43.456217 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-80ec720a-d1f0-4c83-8936-0500ad79f3be tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:43.456692 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-80ec720a-d1f0-4c83-8936-0500ad79f3be tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:43.463630 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-80ec720a-d1f0-4c83-8936-0500ad79f3be tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:43.465192 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-80ec720a-d1f0-4c83-8936-0500ad79f3be tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:44.077746 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-e603ee0e-75eb-4152-954a-a0b9ff915502 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d0edf9b51d4370950f7ff503c324b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c048fb2cf4e491980fb65a8e32b0fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:44.090649 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-e603ee0e-75eb-4152-954a-a0b9ff915502 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] 10.222.0.48 "GET /compute/v2.1/servers/73cb6bde-cad3-43ef-b361-62ff89b3544a" status: 200 len: 1314 microversion: 2.1 time: 1.279897 Jun 17 12:57:44.100070 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 23/49] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:57:42 2022] GET /compute/v2.1/servers/73cb6bde-cad3-43ef-b361-62ff89b3544a => generated 1314 bytes in 1284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:57:44.107184 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-8e9dd14e-983a-405d-8576-0666c74a1ce1 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:44.112328 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-8e9dd14e-983a-405d-8576-0666c74a1ce1 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: cc3f5e1d-d03b-4fe4-b777-8aedac2761ce] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:44.130898 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-80ec720a-d1f0-4c83-8936-0500ad79f3be tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:44.177705 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8e9dd14e-983a-405d-8576-0666c74a1ce1 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:44.180756 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8e9dd14e-983a-405d-8576-0666c74a1ce1 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:44.182679 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-80ec720a-d1f0-4c83-8936-0500ad79f3be tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1296 microversion: 2.1 time: 0.774491 Jun 17 12:57:44.185576 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8e9dd14e-983a-405d-8576-0666c74a1ce1 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:44.188434 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8e9dd14e-983a-405d-8576-0666c74a1ce1 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:44.190184 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 27/50] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:57:43 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1296 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:57:44.420101 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [req-694ebc61-fd9f-453e-8646-1f06abb7aacc req-0bc93559-1008-44a4-9a2f-5955a6a13a73 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5db43a6d-a079-4e7c-948a-b2600a102f63", "tag": "510d5b97-81e2-401f-854a-3f165763e33d"}]} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 12:57:44.453383 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-694ebc61-fd9f-453e-8646-1f06abb7aacc req-0bc93559-1008-44a4-9a2f-5955a6a13a73 service nova] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:44.455423 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-694ebc61-fd9f-453e-8646-1f06abb7aacc req-0bc93559-1008-44a4-9a2f-5955a6a13a73 service nova] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:44.505178 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.compute.server_external_events [req-694ebc61-fd9f-453e-8646-1f06abb7aacc req-0bc93559-1008-44a4-9a2f-5955a6a13a73 service nova] Creating event network-changed:510d5b97-81e2-401f-854a-3f165763e33d for instance 5db43a6d-a079-4e7c-948a-b2600a102f63 on hv-cinder-83754 Jun 17 12:57:44.507338 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-694ebc61-fd9f-453e-8646-1f06abb7aacc req-0bc93559-1008-44a4-9a2f-5955a6a13a73 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117660) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 17 12:57:44.508942 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-18b8a3ae-08c0-4cb2-980b-e6a7a2af6e3a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:44.509577 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-18b8a3ae-08c0-4cb2-980b-e6a7a2af6e3a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:44.510615 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-18b8a3ae-08c0-4cb2-980b-e6a7a2af6e3a None None] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:44.511312 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-18b8a3ae-08c0-4cb2-980b-e6a7a2af6e3a None None] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:44.529969 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.compute.rpcapi [None req-18b8a3ae-08c0-4cb2-980b-e6a7a2af6e3a None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 17 12:57:44.531543 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-18b8a3ae-08c0-4cb2-980b-e6a7a2af6e3a None None] Releasing lock "compute-rpcapi-router" {{(pid=117660) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 17 12:57:44.539168 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell0:SELECT=26 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:57:44.581750 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-18b8a3ae-08c0-4cb2-980b-e6a7a2af6e3a None None] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.388414 Jun 17 12:57:44.587312 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 28/51] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 12:57:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:57:44.605866 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-28317827-7961-497d-82c9-06e587ffbe26 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:44.610146 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-28317827-7961-497d-82c9-06e587ffbe26 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:44.631056 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-28317827-7961-497d-82c9-06e587ffbe26 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:44.633417 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-28317827-7961-497d-82c9-06e587ffbe26 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:44.637681 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-28317827-7961-497d-82c9-06e587ffbe26 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:44.639432 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-28317827-7961-497d-82c9-06e587ffbe26 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:44.855905 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_cell0:SELECT=20 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:57:45.554191 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-8e9dd14e-983a-405d-8576-0666c74a1ce1 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:45.569615 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-8e9dd14e-983a-405d-8576-0666c74a1ce1 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce" status: 200 len: 1321 microversion: 2.1 time: 1.472235 Jun 17 12:57:45.570665 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 24/52] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:57:44 2022] GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce => generated 1321 bytes in 1476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:57:45.575912 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-081173cf-2b8b-4dd8-842d-452e795598d0 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:45.583745 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-081173cf-2b8b-4dd8-842d-452e795598d0 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] [instance: 73cb6bde-cad3-43ef-b361-62ff89b3544a] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:45.605421 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-081173cf-2b8b-4dd8-842d-452e795598d0 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:45.609848 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-081173cf-2b8b-4dd8-842d-452e795598d0 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:45.611165 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-081173cf-2b8b-4dd8-842d-452e795598d0 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:45.612723 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-081173cf-2b8b-4dd8-842d-452e795598d0 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:46.176978 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-28317827-7961-497d-82c9-06e587ffbe26 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:46.196135 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-28317827-7961-497d-82c9-06e587ffbe26 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:46.202226 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-28317827-7961-497d-82c9-06e587ffbe26 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:46.215571 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-28317827-7961-497d-82c9-06e587ffbe26 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1407 microversion: 2.20 time: 1.619518 Jun 17 12:57:46.216854 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 29/53] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 12:57:44 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1407 bytes in 1628 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 12:57:46.239251 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-d32d7d71-15dc-44a4-a41f-74e1f6eaf293 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:46.255453 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-d32d7d71-15dc-44a4-a41f-74e1f6eaf293 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:46.292738 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d32d7d71-15dc-44a4-a41f-74e1f6eaf293 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:46.297006 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d32d7d71-15dc-44a4-a41f-74e1f6eaf293 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:46.300461 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d32d7d71-15dc-44a4-a41f-74e1f6eaf293 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:46.304178 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d32d7d71-15dc-44a4-a41f-74e1f6eaf293 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:47.173418 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-081173cf-2b8b-4dd8-842d-452e795598d0 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d0edf9b51d4370950f7ff503c324b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c048fb2cf4e491980fb65a8e32b0fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:47.195641 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-081173cf-2b8b-4dd8-842d-452e795598d0 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] 10.222.0.48 "GET /compute/v2.1/servers/73cb6bde-cad3-43ef-b361-62ff89b3544a" status: 200 len: 1314 microversion: 2.1 time: 1.620707 Jun 17 12:57:47.211060 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 25/54] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:57:45 2022] GET /compute/v2.1/servers/73cb6bde-cad3-43ef-b361-62ff89b3544a => generated 1314 bytes in 1639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:57:47.216681 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-d32d7d71-15dc-44a4-a41f-74e1f6eaf293 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:47.235315 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-d32d7d71-15dc-44a4-a41f-74e1f6eaf293 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1363 microversion: 2.1 time: 1.006420 Jun 17 12:57:47.239419 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-ecbf1c38-4e33-4387-89e8-1a9e2286fab3 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:47.241038 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-ecbf1c38-4e33-4387-89e8-1a9e2286fab3 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: cc3f5e1d-d03b-4fe4-b777-8aedac2761ce] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:47.242548 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 30/55] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:57:46 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1363 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:57:47.265444 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ecbf1c38-4e33-4387-89e8-1a9e2286fab3 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:47.268129 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ecbf1c38-4e33-4387-89e8-1a9e2286fab3 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:47.270765 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ecbf1c38-4e33-4387-89e8-1a9e2286fab3 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:47.272655 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ecbf1c38-4e33-4387-89e8-1a9e2286fab3 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:47.277660 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [req-345427c9-f1fa-4feb-b17f-af0cf84594e3 req-f2f4cf13-8075-41f4-8729-8787757d0930 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8fdea98-917f-4c4d-aaba-d4f5df4622d6", "tag": "936c48d1-9e45-4b7e-9fa7-86ea87893b56"}]} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 12:57:47.312554 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-345427c9-f1fa-4feb-b17f-af0cf84594e3 req-f2f4cf13-8075-41f4-8729-8787757d0930 service nova] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:47.312554 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-345427c9-f1fa-4feb-b17f-af0cf84594e3 req-f2f4cf13-8075-41f4-8729-8787757d0930 service nova] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:47.360372 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.compute.server_external_events [req-345427c9-f1fa-4feb-b17f-af0cf84594e3 req-f2f4cf13-8075-41f4-8729-8787757d0930 service nova] Creating event network-changed:936c48d1-9e45-4b7e-9fa7-86ea87893b56 for instance c8fdea98-917f-4c4d-aaba-d4f5df4622d6 on hv-cinder-83754 Jun 17 12:57:47.370798 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [req-345427c9-f1fa-4feb-b17f-af0cf84594e3 req-f2f4cf13-8075-41f4-8729-8787757d0930 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113004 Jun 17 12:57:47.371604 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 31/56] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 12:57:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:57:47.381844 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-7220e7e6-ef69-4fe2-a3a4-d567c44ec631 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:47.382632 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-7220e7e6-ef69-4fe2-a3a4-d567c44ec631 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:47.386389 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:57:47.391198 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7220e7e6-ef69-4fe2-a3a4-d567c44ec631 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:47.391642 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7220e7e6-ef69-4fe2-a3a4-d567c44ec631 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:47.392778 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7220e7e6-ef69-4fe2-a3a4-d567c44ec631 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:47.393212 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7220e7e6-ef69-4fe2-a3a4-d567c44ec631 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:48.008190 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-ecbf1c38-4e33-4387-89e8-1a9e2286fab3 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:48.020036 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-ecbf1c38-4e33-4387-89e8-1a9e2286fab3 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce" status: 200 len: 1321 microversion: 2.1 time: 0.807063 Jun 17 12:57:48.021804 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 26/57] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:57:47 2022] GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce => generated 1321 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:57:48.111127 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-7220e7e6-ef69-4fe2-a3a4-d567c44ec631 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:48.126448 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=89 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:57:48.147671 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-7220e7e6-ef69-4fe2-a3a4-d567c44ec631 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:48.161378 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-7220e7e6-ef69-4fe2-a3a4-d567c44ec631 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:48.163179 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-7220e7e6-ef69-4fe2-a3a4-d567c44ec631 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1407 microversion: 2.20 time: 0.787010 Jun 17 12:57:48.164418 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 32/58] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 12:57:47 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1407 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 12:57:48.225829 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-245b0af2-b1d3-43a6-a99d-376cd4c7331d tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:48.226503 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-245b0af2-b1d3-43a6-a99d-376cd4c7331d tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] [instance: 73cb6bde-cad3-43ef-b361-62ff89b3544a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:48.234548 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-245b0af2-b1d3-43a6-a99d-376cd4c7331d tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:48.235346 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-245b0af2-b1d3-43a6-a99d-376cd4c7331d tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:48.236771 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-245b0af2-b1d3-43a6-a99d-376cd4c7331d tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:48.237376 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-245b0af2-b1d3-43a6-a99d-376cd4c7331d tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:48.247402 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [req-785a1e30-f40e-42d6-a175-c9bd018a419b req-03fd0a36-f21a-4ec9-b958-6e1176cf57a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73cb6bde-cad3-43ef-b361-62ff89b3544a", "tag": "ebd11c69-50dc-4ab5-8c90-8d32c0d1f010"}]} {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 12:57:48.277016 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [req-785a1e30-f40e-42d6-a175-c9bd018a419b req-03fd0a36-f21a-4ec9-b958-6e1176cf57a9 service nova] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:48.277991 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [req-785a1e30-f40e-42d6-a175-c9bd018a419b req-03fd0a36-f21a-4ec9-b958-6e1176cf57a9 service nova] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:48.326746 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.compute.server_external_events [req-785a1e30-f40e-42d6-a175-c9bd018a419b req-03fd0a36-f21a-4ec9-b958-6e1176cf57a9 service nova] Creating event network-changed:ebd11c69-50dc-4ab5-8c90-8d32c0d1f010 for instance 73cb6bde-cad3-43ef-b361-62ff89b3544a on hv-cinder-83754 Jun 17 12:57:48.327714 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [req-785a1e30-f40e-42d6-a175-c9bd018a419b req-03fd0a36-f21a-4ec9-b958-6e1176cf57a9 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117659) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 17 12:57:48.330566 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-1467fc0e-9ba7-49e8-ae7b-0acf14ad8fea None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:48.332235 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-1467fc0e-9ba7-49e8-ae7b-0acf14ad8fea None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:48.333737 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-1467fc0e-9ba7-49e8-ae7b-0acf14ad8fea None None] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:48.334493 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-1467fc0e-9ba7-49e8-ae7b-0acf14ad8fea None None] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:48.347197 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.compute.rpcapi [None req-1467fc0e-9ba7-49e8-ae7b-0acf14ad8fea None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 17 12:57:48.348488 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-1467fc0e-9ba7-49e8-ae7b-0acf14ad8fea None None] Releasing lock "compute-rpcapi-router" {{(pid=117659) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 17 12:57:48.372855 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-1467fc0e-9ba7-49e8-ae7b-0acf14ad8fea None None] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.218921 Jun 17 12:57:48.375091 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 27/59] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 12:57:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 12:57:48.383760 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-279fe86b-bf37-495f-b465-bae47da23f7b tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:48.385625 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-279fe86b-bf37-495f-b465-bae47da23f7b tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:48.399920 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-279fe86b-bf37-495f-b465-bae47da23f7b tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:48.401140 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-279fe86b-bf37-495f-b465-bae47da23f7b tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:48.403010 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-279fe86b-bf37-495f-b465-bae47da23f7b tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:48.403797 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-279fe86b-bf37-495f-b465-bae47da23f7b tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:48.558025 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-245b0af2-b1d3-43a6-a99d-376cd4c7331d tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d0edf9b51d4370950f7ff503c324b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c048fb2cf4e491980fb65a8e32b0fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:48.570113 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-245b0af2-b1d3-43a6-a99d-376cd4c7331d tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] 10.222.0.48 "GET /compute/v2.1/servers/73cb6bde-cad3-43ef-b361-62ff89b3544a" status: 200 len: 1314 microversion: 2.1 time: 0.348801 Jun 17 12:57:48.571487 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 33/60] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:57:48 2022] GET /compute/v2.1/servers/73cb6bde-cad3-43ef-b361-62ff89b3544a => generated 1314 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 12:57:48.648174 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-279fe86b-bf37-495f-b465-bae47da23f7b tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:48.660176 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-279fe86b-bf37-495f-b465-bae47da23f7b tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1363 microversion: 2.1 time: 0.283200 Jun 17 12:57:48.662166 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 28/61] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:57:48 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1363 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:57:49.038349 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-a6017379-a6f5-4cc1-83d9-56921763c47c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:49.039209 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-a6017379-a6f5-4cc1-83d9-56921763c47c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: cc3f5e1d-d03b-4fe4-b777-8aedac2761ce] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:49.046733 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a6017379-a6f5-4cc1-83d9-56921763c47c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:49.047196 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a6017379-a6f5-4cc1-83d9-56921763c47c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:49.048445 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a6017379-a6f5-4cc1-83d9-56921763c47c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:49.049081 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a6017379-a6f5-4cc1-83d9-56921763c47c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:49.183680 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-8688d768-0c9b-42aa-90c8-a9e49eaf5958 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:49.184699 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-8688d768-0c9b-42aa-90c8-a9e49eaf5958 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:49.193097 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8688d768-0c9b-42aa-90c8-a9e49eaf5958 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:49.193664 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8688d768-0c9b-42aa-90c8-a9e49eaf5958 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:49.194621 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8688d768-0c9b-42aa-90c8-a9e49eaf5958 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:49.195139 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8688d768-0c9b-42aa-90c8-a9e49eaf5958 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:49.263095 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-a6017379-a6f5-4cc1-83d9-56921763c47c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:49.271532 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-a6017379-a6f5-4cc1-83d9-56921763c47c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce" status: 200 len: 1321 microversion: 2.1 time: 0.237737 Jun 17 12:57:49.272372 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 34/62] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:57:49 2022] GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce => generated 1321 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:57:49.384198 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-8688d768-0c9b-42aa-90c8-a9e49eaf5958 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:49.402758 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-8688d768-0c9b-42aa-90c8-a9e49eaf5958 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:49.405633 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-8688d768-0c9b-42aa-90c8-a9e49eaf5958 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:49.407781 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-8688d768-0c9b-42aa-90c8-a9e49eaf5958 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1407 microversion: 2.20 time: 0.230370 Jun 17 12:57:49.417806 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 29/63] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 12:57:49 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1407 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 12:57:49.592793 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-4ce3a5c2-b120-4ce1-86d4-836bd7116743 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:49.594586 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-4ce3a5c2-b120-4ce1-86d4-836bd7116743 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] [instance: 73cb6bde-cad3-43ef-b361-62ff89b3544a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:49.605666 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4ce3a5c2-b120-4ce1-86d4-836bd7116743 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:49.606044 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4ce3a5c2-b120-4ce1-86d4-836bd7116743 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:49.607277 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4ce3a5c2-b120-4ce1-86d4-836bd7116743 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:49.607713 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4ce3a5c2-b120-4ce1-86d4-836bd7116743 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:49.677053 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-3f8898d8-78a9-420a-bc6a-9492f6785079 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:49.677981 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-3f8898d8-78a9-420a-bc6a-9492f6785079 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:49.685385 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-3f8898d8-78a9-420a-bc6a-9492f6785079 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:49.686377 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-3f8898d8-78a9-420a-bc6a-9492f6785079 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:49.687500 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-3f8898d8-78a9-420a-bc6a-9492f6785079 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:49.688141 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-3f8898d8-78a9-420a-bc6a-9492f6785079 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:49.693015 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_cell1:SELECT=100 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:57:49.818073 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-4ce3a5c2-b120-4ce1-86d4-836bd7116743 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d0edf9b51d4370950f7ff503c324b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c048fb2cf4e491980fb65a8e32b0fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:49.830924 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-4ce3a5c2-b120-4ce1-86d4-836bd7116743 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] 10.222.0.48 "GET /compute/v2.1/servers/73cb6bde-cad3-43ef-b361-62ff89b3544a" status: 200 len: 1314 microversion: 2.1 time: 0.243932 Jun 17 12:57:49.841757 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 35/64] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:57:49 2022] GET /compute/v2.1/servers/73cb6bde-cad3-43ef-b361-62ff89b3544a => generated 1314 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:57:49.872178 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-3f8898d8-78a9-420a-bc6a-9492f6785079 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:49.885478 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-3f8898d8-78a9-420a-bc6a-9492f6785079 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1363 microversion: 2.1 time: 0.212351 Jun 17 12:57:49.886318 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 30/65] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:57:49 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1363 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 12:57:50.291069 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-9892cb76-0a7e-47a3-8ed8-d095cb2aae48 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:50.291778 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-9892cb76-0a7e-47a3-8ed8-d095cb2aae48 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: cc3f5e1d-d03b-4fe4-b777-8aedac2761ce] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:50.298361 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9892cb76-0a7e-47a3-8ed8-d095cb2aae48 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:50.299023 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9892cb76-0a7e-47a3-8ed8-d095cb2aae48 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:50.300093 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9892cb76-0a7e-47a3-8ed8-d095cb2aae48 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:50.300684 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9892cb76-0a7e-47a3-8ed8-d095cb2aae48 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:50.404176 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [req-cfd88b47-4719-457b-ae9d-82aeceaec3b3 req-89654ea1-4afe-461e-9781-c093e749cde2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc3f5e1d-d03b-4fe4-b777-8aedac2761ce", "tag": "bf0807bd-3b46-453e-8c9b-d856e04fe896"}]} {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 12:57:50.408816 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=7 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:57:50.415592 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [req-cfd88b47-4719-457b-ae9d-82aeceaec3b3 req-89654ea1-4afe-461e-9781-c093e749cde2 service nova] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:50.415802 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [req-cfd88b47-4719-457b-ae9d-82aeceaec3b3 req-89654ea1-4afe-461e-9781-c093e749cde2 service nova] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:50.437732 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.compute.server_external_events [req-cfd88b47-4719-457b-ae9d-82aeceaec3b3 req-89654ea1-4afe-461e-9781-c093e749cde2 service nova] Creating event network-changed:bf0807bd-3b46-453e-8c9b-d856e04fe896 for instance cc3f5e1d-d03b-4fe4-b777-8aedac2761ce on hv-cinder-83754 Jun 17 12:57:50.447194 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [req-cfd88b47-4719-457b-ae9d-82aeceaec3b3 req-89654ea1-4afe-461e-9781-c093e749cde2 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047059 Jun 17 12:57:50.448116 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 31/66] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 12:57:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 12:57:50.453963 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-0a56a9d8-7c8c-41a0-8f87-2f498651c8ad tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:50.454543 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-0a56a9d8-7c8c-41a0-8f87-2f498651c8ad tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:50.461398 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0a56a9d8-7c8c-41a0-8f87-2f498651c8ad tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:50.461842 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0a56a9d8-7c8c-41a0-8f87-2f498651c8ad tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:50.462858 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0a56a9d8-7c8c-41a0-8f87-2f498651c8ad tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:50.463285 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0a56a9d8-7c8c-41a0-8f87-2f498651c8ad tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:50.500268 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-9892cb76-0a7e-47a3-8ed8-d095cb2aae48 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:50.519760 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-9892cb76-0a7e-47a3-8ed8-d095cb2aae48 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce" status: 200 len: 1321 microversion: 2.1 time: 0.234696 Jun 17 12:57:50.522159 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 36/67] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:57:50 2022] GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce => generated 1321 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:57:50.633190 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-0a56a9d8-7c8c-41a0-8f87-2f498651c8ad tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:50.642779 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-0a56a9d8-7c8c-41a0-8f87-2f498651c8ad tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:50.644404 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-0a56a9d8-7c8c-41a0-8f87-2f498651c8ad tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:50.645794 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-0a56a9d8-7c8c-41a0-8f87-2f498651c8ad tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1407 microversion: 2.20 time: 0.196558 Jun 17 12:57:50.646772 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 32/68] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 12:57:50 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1407 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 12:57:50.849096 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-7b63d10c-de1f-471f-b10c-d41f22ebfe58 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:50.849957 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-7b63d10c-de1f-471f-b10c-d41f22ebfe58 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] [instance: 73cb6bde-cad3-43ef-b361-62ff89b3544a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:50.856736 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7b63d10c-de1f-471f-b10c-d41f22ebfe58 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:50.857217 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7b63d10c-de1f-471f-b10c-d41f22ebfe58 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:50.858016 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7b63d10c-de1f-471f-b10c-d41f22ebfe58 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:50.858447 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7b63d10c-de1f-471f-b10c-d41f22ebfe58 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:50.904004 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-8ba80283-f9f0-41fc-a3ff-c47b8ef1e291 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:50.904596 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-8ba80283-f9f0-41fc-a3ff-c47b8ef1e291 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:50.911597 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8ba80283-f9f0-41fc-a3ff-c47b8ef1e291 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:50.912054 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8ba80283-f9f0-41fc-a3ff-c47b8ef1e291 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:50.912850 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8ba80283-f9f0-41fc-a3ff-c47b8ef1e291 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:50.913486 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8ba80283-f9f0-41fc-a3ff-c47b8ef1e291 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:51.115976 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-7b63d10c-de1f-471f-b10c-d41f22ebfe58 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d0edf9b51d4370950f7ff503c324b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c048fb2cf4e491980fb65a8e32b0fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:51.136490 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-7b63d10c-de1f-471f-b10c-d41f22ebfe58 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] 10.222.0.48 "GET /compute/v2.1/servers/73cb6bde-cad3-43ef-b361-62ff89b3544a" status: 200 len: 1314 microversion: 2.1 time: 0.290923 Jun 17 12:57:51.138338 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 37/69] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:57:50 2022] GET /compute/v2.1/servers/73cb6bde-cad3-43ef-b361-62ff89b3544a => generated 1314 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:57:51.143041 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-8ba80283-f9f0-41fc-a3ff-c47b8ef1e291 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:51.154672 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-8ba80283-f9f0-41fc-a3ff-c47b8ef1e291 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1363 microversion: 2.1 time: 0.254095 Jun 17 12:57:51.165031 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 33/70] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:57:50 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1363 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:57:51.540998 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-76f6087a-bee9-458d-877d-5b5ff328191b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:51.542052 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-76f6087a-bee9-458d-877d-5b5ff328191b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: cc3f5e1d-d03b-4fe4-b777-8aedac2761ce] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:51.550602 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-76f6087a-bee9-458d-877d-5b5ff328191b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:51.551052 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-76f6087a-bee9-458d-877d-5b5ff328191b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:51.551830 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-76f6087a-bee9-458d-877d-5b5ff328191b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:51.552268 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-76f6087a-bee9-458d-877d-5b5ff328191b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:51.664852 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-4bb998b2-ce07-470d-858d-bc5542436365 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:51.665477 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-4bb998b2-ce07-470d-858d-bc5542436365 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:51.673398 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4bb998b2-ce07-470d-858d-bc5542436365 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:51.674047 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4bb998b2-ce07-470d-858d-bc5542436365 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:51.674898 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4bb998b2-ce07-470d-858d-bc5542436365 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:51.675333 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4bb998b2-ce07-470d-858d-bc5542436365 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:51.756768 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-76f6087a-bee9-458d-877d-5b5ff328191b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:51.765509 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-76f6087a-bee9-458d-877d-5b5ff328191b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce" status: 200 len: 1321 microversion: 2.1 time: 0.229755 Jun 17 12:57:51.766122 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 38/71] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:57:51 2022] GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce => generated 1321 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:57:51.876926 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-4bb998b2-ce07-470d-858d-bc5542436365 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:51.885508 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-4bb998b2-ce07-470d-858d-bc5542436365 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:51.887179 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-4bb998b2-ce07-470d-858d-bc5542436365 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:51.888303 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-4bb998b2-ce07-470d-858d-bc5542436365 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1407 microversion: 2.20 time: 0.227760 Jun 17 12:57:51.888992 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 34/72] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 12:57:51 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1407 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 12:57:52.154470 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-96415c39-7868-4939-8816-e39ba3d133b8 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:52.155130 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-96415c39-7868-4939-8816-e39ba3d133b8 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] [instance: 73cb6bde-cad3-43ef-b361-62ff89b3544a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:52.161766 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-96415c39-7868-4939-8816-e39ba3d133b8 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:52.162269 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-96415c39-7868-4939-8816-e39ba3d133b8 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:52.163031 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-96415c39-7868-4939-8816-e39ba3d133b8 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:52.163452 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-96415c39-7868-4939-8816-e39ba3d133b8 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:52.175118 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-5ff94373-9015-4f0c-b79a-ed3c846e4c5c tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:52.176210 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-5ff94373-9015-4f0c-b79a-ed3c846e4c5c tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:52.184508 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-5ff94373-9015-4f0c-b79a-ed3c846e4c5c tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:52.185305 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-5ff94373-9015-4f0c-b79a-ed3c846e4c5c tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:52.187296 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-5ff94373-9015-4f0c-b79a-ed3c846e4c5c tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:52.188133 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-5ff94373-9015-4f0c-b79a-ed3c846e4c5c tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:52.372940 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-96415c39-7868-4939-8816-e39ba3d133b8 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d0edf9b51d4370950f7ff503c324b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c048fb2cf4e491980fb65a8e32b0fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:52.382237 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-96415c39-7868-4939-8816-e39ba3d133b8 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] 10.222.0.48 "GET /compute/v2.1/servers/73cb6bde-cad3-43ef-b361-62ff89b3544a" status: 200 len: 1314 microversion: 2.1 time: 0.231681 Jun 17 12:57:52.382836 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 39/73] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:57:52 2022] GET /compute/v2.1/servers/73cb6bde-cad3-43ef-b361-62ff89b3544a => generated 1314 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:57:52.391291 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-5ff94373-9015-4f0c-b79a-ed3c846e4c5c tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:52.398432 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-5ff94373-9015-4f0c-b79a-ed3c846e4c5c tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1363 microversion: 2.1 time: 0.228081 Jun 17 12:57:52.399042 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 35/74] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:57:52 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1363 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:57:52.785297 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-31b00c6e-94ab-4240-ab8d-570400480d3f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:52.787279 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-31b00c6e-94ab-4240-ab8d-570400480d3f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: cc3f5e1d-d03b-4fe4-b777-8aedac2761ce] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:52.796144 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-31b00c6e-94ab-4240-ab8d-570400480d3f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:52.797260 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-31b00c6e-94ab-4240-ab8d-570400480d3f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:52.798429 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-31b00c6e-94ab-4240-ab8d-570400480d3f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:52.799031 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-31b00c6e-94ab-4240-ab8d-570400480d3f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:52.909745 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-21649202-c9d8-43dc-8eca-db01badf08f0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:52.910364 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-21649202-c9d8-43dc-8eca-db01badf08f0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:52.928157 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-21649202-c9d8-43dc-8eca-db01badf08f0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:52.928604 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-21649202-c9d8-43dc-8eca-db01badf08f0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:52.929386 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-21649202-c9d8-43dc-8eca-db01badf08f0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:52.929816 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-21649202-c9d8-43dc-8eca-db01badf08f0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:52.995443 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-31b00c6e-94ab-4240-ab8d-570400480d3f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:53.009455 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-31b00c6e-94ab-4240-ab8d-570400480d3f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce" status: 200 len: 1321 microversion: 2.1 time: 0.229785 Jun 17 12:57:53.010025 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 40/75] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:57:52 2022] GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce => generated 1321 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:57:53.096001 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-21649202-c9d8-43dc-8eca-db01badf08f0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:53.104966 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-21649202-c9d8-43dc-8eca-db01badf08f0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:53.106638 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-21649202-c9d8-43dc-8eca-db01badf08f0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:53.107757 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-21649202-c9d8-43dc-8eca-db01badf08f0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1407 microversion: 2.20 time: 0.204583 Jun 17 12:57:53.108419 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 36/76] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 12:57:52 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1407 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 12:57:53.401464 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-d06b366b-3275-4fcd-9513-1a4ce4a9d52c tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:53.402144 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-d06b366b-3275-4fcd-9513-1a4ce4a9d52c tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] [instance: 73cb6bde-cad3-43ef-b361-62ff89b3544a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:53.408547 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d06b366b-3275-4fcd-9513-1a4ce4a9d52c tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:53.408988 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d06b366b-3275-4fcd-9513-1a4ce4a9d52c tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:53.409785 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d06b366b-3275-4fcd-9513-1a4ce4a9d52c tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:53.410239 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d06b366b-3275-4fcd-9513-1a4ce4a9d52c tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:53.417365 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-24cfbe9e-597f-4604-aed9-d479620709d0 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:53.418019 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-24cfbe9e-597f-4604-aed9-d479620709d0 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:53.427821 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-24cfbe9e-597f-4604-aed9-d479620709d0 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:53.428548 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-24cfbe9e-597f-4604-aed9-d479620709d0 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:53.429885 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-24cfbe9e-597f-4604-aed9-d479620709d0 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:53.430494 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-24cfbe9e-597f-4604-aed9-d479620709d0 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:53.664312 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-24cfbe9e-597f-4604-aed9-d479620709d0 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:53.667583 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-d06b366b-3275-4fcd-9513-1a4ce4a9d52c tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d0edf9b51d4370950f7ff503c324b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c048fb2cf4e491980fb65a8e32b0fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:53.673764 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-24cfbe9e-597f-4604-aed9-d479620709d0 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1363 microversion: 2.1 time: 0.261279 Jun 17 12:57:53.674387 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 37/77] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:57:53 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1363 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:57:53.676056 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-d06b366b-3275-4fcd-9513-1a4ce4a9d52c tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] 10.222.0.48 "GET /compute/v2.1/servers/73cb6bde-cad3-43ef-b361-62ff89b3544a" status: 200 len: 1314 microversion: 2.1 time: 0.278636 Jun 17 12:57:53.676709 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 41/78] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:57:53 2022] GET /compute/v2.1/servers/73cb6bde-cad3-43ef-b361-62ff89b3544a => generated 1314 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:57:54.033052 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-d4f9eedf-12d7-42df-9d8d-185c5658c6de tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:54.035063 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-d4f9eedf-12d7-42df-9d8d-185c5658c6de tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: cc3f5e1d-d03b-4fe4-b777-8aedac2761ce] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:54.043085 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d4f9eedf-12d7-42df-9d8d-185c5658c6de tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:54.043801 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d4f9eedf-12d7-42df-9d8d-185c5658c6de tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:54.045156 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d4f9eedf-12d7-42df-9d8d-185c5658c6de tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:54.045980 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d4f9eedf-12d7-42df-9d8d-185c5658c6de tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:54.128388 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-f982c2e0-b2c3-41f4-8a47-97b2cb7243b3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:54.129111 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-f982c2e0-b2c3-41f4-8a47-97b2cb7243b3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:54.152581 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f982c2e0-b2c3-41f4-8a47-97b2cb7243b3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:54.153243 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f982c2e0-b2c3-41f4-8a47-97b2cb7243b3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:54.154071 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f982c2e0-b2c3-41f4-8a47-97b2cb7243b3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:54.154452 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f982c2e0-b2c3-41f4-8a47-97b2cb7243b3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:54.247133 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-d4f9eedf-12d7-42df-9d8d-185c5658c6de tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:54.259545 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-d4f9eedf-12d7-42df-9d8d-185c5658c6de tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce" status: 200 len: 1321 microversion: 2.1 time: 0.231712 Jun 17 12:57:54.269715 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 38/79] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:57:54 2022] GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce => generated 1321 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:57:54.326796 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-f982c2e0-b2c3-41f4-8a47-97b2cb7243b3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:54.339671 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-f982c2e0-b2c3-41f4-8a47-97b2cb7243b3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:54.341869 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-f982c2e0-b2c3-41f4-8a47-97b2cb7243b3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:54.343861 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-f982c2e0-b2c3-41f4-8a47-97b2cb7243b3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1407 microversion: 2.20 time: 0.221262 Jun 17 12:57:54.371544 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 42/80] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 12:57:54 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1407 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 12:57:54.691254 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-669fc7cf-0060-4845-b2bd-ea7a2650df36 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:54.691974 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-669fc7cf-0060-4845-b2bd-ea7a2650df36 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:54.693080 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-d5e01e54-b343-41ac-bbaf-a64e10fa1148 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:54.693738 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-d5e01e54-b343-41ac-bbaf-a64e10fa1148 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] [instance: 73cb6bde-cad3-43ef-b361-62ff89b3544a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:54.695854 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell0:SELECT=2 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:57:54.699569 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-669fc7cf-0060-4845-b2bd-ea7a2650df36 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:54.700484 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-669fc7cf-0060-4845-b2bd-ea7a2650df36 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:54.701376 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-669fc7cf-0060-4845-b2bd-ea7a2650df36 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:54.701986 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-669fc7cf-0060-4845-b2bd-ea7a2650df36 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:54.702604 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d5e01e54-b343-41ac-bbaf-a64e10fa1148 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:54.703070 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d5e01e54-b343-41ac-bbaf-a64e10fa1148 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:54.703843 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d5e01e54-b343-41ac-bbaf-a64e10fa1148 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:54.704425 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d5e01e54-b343-41ac-bbaf-a64e10fa1148 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:54.917482 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-669fc7cf-0060-4845-b2bd-ea7a2650df36 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:54.921534 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-d5e01e54-b343-41ac-bbaf-a64e10fa1148 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d0edf9b51d4370950f7ff503c324b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c048fb2cf4e491980fb65a8e32b0fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:54.926535 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-669fc7cf-0060-4845-b2bd-ea7a2650df36 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1363 microversion: 2.1 time: 0.239496 Jun 17 12:57:54.927107 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 39/81] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:57:54 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1363 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 12:57:54.930279 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-d5e01e54-b343-41ac-bbaf-a64e10fa1148 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] 10.222.0.48 "GET /compute/v2.1/servers/73cb6bde-cad3-43ef-b361-62ff89b3544a" status: 200 len: 1314 microversion: 2.1 time: 0.241155 Jun 17 12:57:54.931022 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 43/82] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:57:54 2022] GET /compute/v2.1/servers/73cb6bde-cad3-43ef-b361-62ff89b3544a => generated 1314 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:57:55.277034 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-a269b4f1-7433-4d5f-977c-c454092c44cd tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:55.277654 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-a269b4f1-7433-4d5f-977c-c454092c44cd tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: cc3f5e1d-d03b-4fe4-b777-8aedac2761ce] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:55.285561 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a269b4f1-7433-4d5f-977c-c454092c44cd tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:55.286010 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a269b4f1-7433-4d5f-977c-c454092c44cd tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:55.286943 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a269b4f1-7433-4d5f-977c-c454092c44cd tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:55.287323 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a269b4f1-7433-4d5f-977c-c454092c44cd tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:55.391445 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-14520cdc-09ee-4a21-b3fd-26e1f3ce0db5 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:55.392788 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-14520cdc-09ee-4a21-b3fd-26e1f3ce0db5 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:55.399533 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-14520cdc-09ee-4a21-b3fd-26e1f3ce0db5 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:55.400242 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-14520cdc-09ee-4a21-b3fd-26e1f3ce0db5 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:55.401163 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-14520cdc-09ee-4a21-b3fd-26e1f3ce0db5 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:55.401755 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-14520cdc-09ee-4a21-b3fd-26e1f3ce0db5 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:55.434994 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-a269b4f1-7433-4d5f-977c-c454092c44cd tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:55.444454 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-a269b4f1-7433-4d5f-977c-c454092c44cd tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce" status: 200 len: 1321 microversion: 2.1 time: 0.171443 Jun 17 12:57:55.445074 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 40/83] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:57:55 2022] GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce => generated 1321 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:57:55.543373 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-14520cdc-09ee-4a21-b3fd-26e1f3ce0db5 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:55.553528 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-14520cdc-09ee-4a21-b3fd-26e1f3ce0db5 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:55.555612 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-14520cdc-09ee-4a21-b3fd-26e1f3ce0db5 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:55.556741 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-14520cdc-09ee-4a21-b3fd-26e1f3ce0db5 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1407 microversion: 2.20 time: 0.170112 Jun 17 12:57:55.566462 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 44/84] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 12:57:55 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1407 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 12:57:55.944414 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-83e4a9e8-2a87-41ea-9cf8-8372094bc345 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:55.945033 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-83e4a9e8-2a87-41ea-9cf8-8372094bc345 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:55.947349 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-820e7061-4abd-488e-b800-04e6bcf604de tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:55.947960 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-820e7061-4abd-488e-b800-04e6bcf604de tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] [instance: 73cb6bde-cad3-43ef-b361-62ff89b3544a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:55.951654 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-83e4a9e8-2a87-41ea-9cf8-8372094bc345 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:55.952190 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-83e4a9e8-2a87-41ea-9cf8-8372094bc345 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:55.953342 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-83e4a9e8-2a87-41ea-9cf8-8372094bc345 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:55.953729 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-83e4a9e8-2a87-41ea-9cf8-8372094bc345 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:55.955557 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-820e7061-4abd-488e-b800-04e6bcf604de tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:55.955992 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-820e7061-4abd-488e-b800-04e6bcf604de tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:55.956747 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-820e7061-4abd-488e-b800-04e6bcf604de tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:55.957153 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-820e7061-4abd-488e-b800-04e6bcf604de tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:56.158246 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-83e4a9e8-2a87-41ea-9cf8-8372094bc345 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:56.162594 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-820e7061-4abd-488e-b800-04e6bcf604de tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d0edf9b51d4370950f7ff503c324b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c048fb2cf4e491980fb65a8e32b0fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:56.166124 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-83e4a9e8-2a87-41ea-9cf8-8372094bc345 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1363 microversion: 2.1 time: 0.225613 Jun 17 12:57:56.166746 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 41/85] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:57:55 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1363 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:57:56.170540 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-820e7061-4abd-488e-b800-04e6bcf604de tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] 10.222.0.48 "GET /compute/v2.1/servers/73cb6bde-cad3-43ef-b361-62ff89b3544a" status: 200 len: 1314 microversion: 2.1 time: 0.227395 Jun 17 12:57:56.171216 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 45/86] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:57:55 2022] GET /compute/v2.1/servers/73cb6bde-cad3-43ef-b361-62ff89b3544a => generated 1314 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:57:56.462282 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-3af1873f-ad94-4148-a911-111438dfee18 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:56.462879 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-3af1873f-ad94-4148-a911-111438dfee18 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: cc3f5e1d-d03b-4fe4-b777-8aedac2761ce] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:56.470546 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-3af1873f-ad94-4148-a911-111438dfee18 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:56.470988 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-3af1873f-ad94-4148-a911-111438dfee18 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:56.471771 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-3af1873f-ad94-4148-a911-111438dfee18 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:56.472200 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-3af1873f-ad94-4148-a911-111438dfee18 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:56.576006 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-0b9873cb-093a-4126-b540-2c04516ad9b8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:56.576541 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-0b9873cb-093a-4126-b540-2c04516ad9b8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:56.583106 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0b9873cb-093a-4126-b540-2c04516ad9b8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:56.583549 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0b9873cb-093a-4126-b540-2c04516ad9b8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:56.584316 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0b9873cb-093a-4126-b540-2c04516ad9b8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:56.584749 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0b9873cb-093a-4126-b540-2c04516ad9b8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:56.607032 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-3af1873f-ad94-4148-a911-111438dfee18 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:56.621269 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-3af1873f-ad94-4148-a911-111438dfee18 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce" status: 200 len: 1321 microversion: 2.1 time: 0.162819 Jun 17 12:57:56.621956 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 42/87] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:57:56 2022] GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce => generated 1321 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:57:56.736969 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-0b9873cb-093a-4126-b540-2c04516ad9b8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:56.749634 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-0b9873cb-093a-4126-b540-2c04516ad9b8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:56.751814 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-0b9873cb-093a-4126-b540-2c04516ad9b8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:56.752933 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-0b9873cb-093a-4126-b540-2c04516ad9b8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1407 microversion: 2.20 time: 0.181057 Jun 17 12:57:56.753528 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 46/88] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 12:57:56 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1407 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 12:57:57.183061 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-85bda56d-468b-4490-9a20-dd8be9c5ed54 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:57.183805 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-85bda56d-468b-4490-9a20-dd8be9c5ed54 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:57.187590 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-ac073dc9-e64e-472c-a8e6-062c282a0a1a tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:57.188152 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-ac073dc9-e64e-472c-a8e6-062c282a0a1a tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] [instance: 73cb6bde-cad3-43ef-b361-62ff89b3544a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:57.195393 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-85bda56d-468b-4490-9a20-dd8be9c5ed54 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:57.195663 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ac073dc9-e64e-472c-a8e6-062c282a0a1a tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:57.195950 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ac073dc9-e64e-472c-a8e6-062c282a0a1a tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:57.196063 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-85bda56d-468b-4490-9a20-dd8be9c5ed54 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:57.196843 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ac073dc9-e64e-472c-a8e6-062c282a0a1a tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:57.197234 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ac073dc9-e64e-472c-a8e6-062c282a0a1a tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:57.197398 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-85bda56d-468b-4490-9a20-dd8be9c5ed54 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:57.197977 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-85bda56d-468b-4490-9a20-dd8be9c5ed54 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:57.416369 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-85bda56d-468b-4490-9a20-dd8be9c5ed54 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:57.421128 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-ac073dc9-e64e-472c-a8e6-062c282a0a1a tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d0edf9b51d4370950f7ff503c324b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c048fb2cf4e491980fb65a8e32b0fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:57.425255 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-85bda56d-468b-4490-9a20-dd8be9c5ed54 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1363 microversion: 2.1 time: 0.246475 Jun 17 12:57:57.426446 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 43/89] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:57:57 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1363 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:57:57.430762 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-ac073dc9-e64e-472c-a8e6-062c282a0a1a tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] 10.222.0.48 "GET /compute/v2.1/servers/73cb6bde-cad3-43ef-b361-62ff89b3544a" status: 200 len: 1314 microversion: 2.1 time: 0.247176 Jun 17 12:57:57.431467 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 47/90] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:57:57 2022] GET /compute/v2.1/servers/73cb6bde-cad3-43ef-b361-62ff89b3544a => generated 1314 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:57:57.639165 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-3f4d7b03-0277-4d71-bd0b-4c7cb9f88036 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:57.639877 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-3f4d7b03-0277-4d71-bd0b-4c7cb9f88036 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: cc3f5e1d-d03b-4fe4-b777-8aedac2761ce] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:57.648190 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-3f4d7b03-0277-4d71-bd0b-4c7cb9f88036 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:57.648650 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-3f4d7b03-0277-4d71-bd0b-4c7cb9f88036 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:57.649423 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-3f4d7b03-0277-4d71-bd0b-4c7cb9f88036 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:57.649927 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-3f4d7b03-0277-4d71-bd0b-4c7cb9f88036 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:57.777286 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-f2952455-1785-4f5a-b382-061c52c8ac1f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:57.777896 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-f2952455-1785-4f5a-b382-061c52c8ac1f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:57.784406 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f2952455-1785-4f5a-b382-061c52c8ac1f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:57.784854 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f2952455-1785-4f5a-b382-061c52c8ac1f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:57.785625 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f2952455-1785-4f5a-b382-061c52c8ac1f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:57.786053 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f2952455-1785-4f5a-b382-061c52c8ac1f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:57.803166 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-3f4d7b03-0277-4d71-bd0b-4c7cb9f88036 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:57.810896 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-3f4d7b03-0277-4d71-bd0b-4c7cb9f88036 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce" status: 200 len: 1321 microversion: 2.1 time: 0.175761 Jun 17 12:57:57.811503 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 44/91] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:57:57 2022] GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce => generated 1321 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:57:57.934269 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-f2952455-1785-4f5a-b382-061c52c8ac1f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:57.942969 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-f2952455-1785-4f5a-b382-061c52c8ac1f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:57.944553 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-f2952455-1785-4f5a-b382-061c52c8ac1f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:57.945693 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-f2952455-1785-4f5a-b382-061c52c8ac1f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1407 microversion: 2.20 time: 0.172494 Jun 17 12:57:57.946280 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 48/92] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 12:57:57 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1407 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 12:57:58.448486 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-78b3c648-45f3-407d-ba2a-18f0a4ed4ea0 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:58.449122 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-78b3c648-45f3-407d-ba2a-18f0a4ed4ea0 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:58.451039 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-acd86cd2-3e0c-40f6-945a-fd5590d817ec tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:58.451223 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_cell0:SELECT=2 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:57:58.451636 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-acd86cd2-3e0c-40f6-945a-fd5590d817ec tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] [instance: 73cb6bde-cad3-43ef-b361-62ff89b3544a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:58.459586 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-acd86cd2-3e0c-40f6-945a-fd5590d817ec tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:58.460025 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-acd86cd2-3e0c-40f6-945a-fd5590d817ec tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:58.460789 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-acd86cd2-3e0c-40f6-945a-fd5590d817ec tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:58.461208 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-acd86cd2-3e0c-40f6-945a-fd5590d817ec tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:58.464778 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-78b3c648-45f3-407d-ba2a-18f0a4ed4ea0 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:58.465230 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-78b3c648-45f3-407d-ba2a-18f0a4ed4ea0 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:58.465961 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-78b3c648-45f3-407d-ba2a-18f0a4ed4ea0 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:58.466433 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-78b3c648-45f3-407d-ba2a-18f0a4ed4ea0 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:58.484124 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=100 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:57:58.675603 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-acd86cd2-3e0c-40f6-945a-fd5590d817ec tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d0edf9b51d4370950f7ff503c324b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c048fb2cf4e491980fb65a8e32b0fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:58.681342 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-78b3c648-45f3-407d-ba2a-18f0a4ed4ea0 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:58.686720 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-acd86cd2-3e0c-40f6-945a-fd5590d817ec tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] 10.222.0.48 "GET /compute/v2.1/servers/73cb6bde-cad3-43ef-b361-62ff89b3544a" status: 200 len: 1314 microversion: 2.1 time: 0.239586 Jun 17 12:57:58.687570 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 49/93] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:57:58 2022] GET /compute/v2.1/servers/73cb6bde-cad3-43ef-b361-62ff89b3544a => generated 1314 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:57:58.700601 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-78b3c648-45f3-407d-ba2a-18f0a4ed4ea0 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1363 microversion: 2.1 time: 0.258306 Jun 17 12:57:58.700601 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 45/94] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:57:58 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1363 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:57:58.828902 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-e4bf1733-b17e-4816-87e0-002ec57e2301 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:58.829627 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-e4bf1733-b17e-4816-87e0-002ec57e2301 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: cc3f5e1d-d03b-4fe4-b777-8aedac2761ce] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:58.837671 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e4bf1733-b17e-4816-87e0-002ec57e2301 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:58.838242 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e4bf1733-b17e-4816-87e0-002ec57e2301 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:58.839241 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e4bf1733-b17e-4816-87e0-002ec57e2301 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:58.839787 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e4bf1733-b17e-4816-87e0-002ec57e2301 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:58.965157 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-fa1a0507-b45a-4370-b127-873176e390a7 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:58.965764 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-fa1a0507-b45a-4370-b127-873176e390a7 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:58.973305 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-fa1a0507-b45a-4370-b127-873176e390a7 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:58.973762 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-fa1a0507-b45a-4370-b127-873176e390a7 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:58.974555 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-fa1a0507-b45a-4370-b127-873176e390a7 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:58.974985 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-fa1a0507-b45a-4370-b127-873176e390a7 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:58.996242 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-e4bf1733-b17e-4816-87e0-002ec57e2301 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:59.007217 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-e4bf1733-b17e-4816-87e0-002ec57e2301 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce" status: 200 len: 1321 microversion: 2.1 time: 0.182436 Jun 17 12:57:59.007774 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 50/95] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:57:58 2022] GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce => generated 1321 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:57:59.130434 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-fa1a0507-b45a-4370-b127-873176e390a7 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:59.138568 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-fa1a0507-b45a-4370-b127-873176e390a7 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:59.140056 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-fa1a0507-b45a-4370-b127-873176e390a7 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:59.141358 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-fa1a0507-b45a-4370-b127-873176e390a7 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1407 microversion: 2.20 time: 0.180791 Jun 17 12:57:59.142072 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 46/96] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 12:57:58 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1407 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 12:57:59.709008 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-f34d9901-91fe-4791-b506-bfa15159f013 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:59.709642 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-f34d9901-91fe-4791-b506-bfa15159f013 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] [instance: 73cb6bde-cad3-43ef-b361-62ff89b3544a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:59.722484 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f34d9901-91fe-4791-b506-bfa15159f013 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:59.723125 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f34d9901-91fe-4791-b506-bfa15159f013 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:59.723252 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-da3d4183-8133-4056-a828-032149597574 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:57:59.723760 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-da3d4183-8133-4056-a828-032149597574 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:57:59.724196 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f34d9901-91fe-4791-b506-bfa15159f013 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:59.724755 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f34d9901-91fe-4791-b506-bfa15159f013 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:59.734951 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-da3d4183-8133-4056-a828-032149597574 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:59.735700 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-da3d4183-8133-4056-a828-032149597574 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:59.736603 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-da3d4183-8133-4056-a828-032149597574 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:57:59.737126 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-da3d4183-8133-4056-a828-032149597574 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:57:59.767077 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_cell1:SELECT=100 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:57:59.967141 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-f34d9901-91fe-4791-b506-bfa15159f013 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d0edf9b51d4370950f7ff503c324b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c048fb2cf4e491980fb65a8e32b0fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:59.974550 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-da3d4183-8133-4056-a828-032149597574 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:57:59.975921 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-f34d9901-91fe-4791-b506-bfa15159f013 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] 10.222.0.48 "GET /compute/v2.1/servers/73cb6bde-cad3-43ef-b361-62ff89b3544a" status: 200 len: 1314 microversion: 2.1 time: 0.274467 Jun 17 12:57:59.976523 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 51/97] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:57:59 2022] GET /compute/v2.1/servers/73cb6bde-cad3-43ef-b361-62ff89b3544a => generated 1314 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:57:59.982629 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-da3d4183-8133-4056-a828-032149597574 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1363 microversion: 2.1 time: 0.269069 Jun 17 12:57:59.983287 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 47/98] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:57:59 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1363 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 12:58:00.024792 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-3cbabb0c-8316-4893-9636-27a103151d7a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:58:00.025409 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-3cbabb0c-8316-4893-9636-27a103151d7a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: cc3f5e1d-d03b-4fe4-b777-8aedac2761ce] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:58:00.032114 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3cbabb0c-8316-4893-9636-27a103151d7a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:00.032543 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3cbabb0c-8316-4893-9636-27a103151d7a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:00.033308 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3cbabb0c-8316-4893-9636-27a103151d7a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:00.033736 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3cbabb0c-8316-4893-9636-27a103151d7a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:00.163075 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-a02d0456-4d9e-40ab-8453-f8f280ef3f4d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:58:00.163694 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-a02d0456-4d9e-40ab-8453-f8f280ef3f4d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:58:00.171469 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a02d0456-4d9e-40ab-8453-f8f280ef3f4d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:00.171958 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a02d0456-4d9e-40ab-8453-f8f280ef3f4d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:00.172893 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a02d0456-4d9e-40ab-8453-f8f280ef3f4d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:00.173328 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a02d0456-4d9e-40ab-8453-f8f280ef3f4d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:00.268272 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-3cbabb0c-8316-4893-9636-27a103151d7a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:00.277551 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-3cbabb0c-8316-4893-9636-27a103151d7a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce" status: 200 len: 1321 microversion: 2.1 time: 0.257453 Jun 17 12:58:00.278284 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 52/99] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:58:00 2022] GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce => generated 1321 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:58:00.452893 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-a02d0456-4d9e-40ab-8453-f8f280ef3f4d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:00.463110 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-a02d0456-4d9e-40ab-8453-f8f280ef3f4d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:00.464730 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-a02d0456-4d9e-40ab-8453-f8f280ef3f4d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:00.465901 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-a02d0456-4d9e-40ab-8453-f8f280ef3f4d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1407 microversion: 2.20 time: 0.307832 Jun 17 12:58:00.466494 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 48/100] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 12:58:00 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1407 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 12:58:01.000312 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-c355e404-a049-42f5-a3af-e77d094bc3a8 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:58:01.001414 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-c355e404-a049-42f5-a3af-e77d094bc3a8 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:58:01.003706 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-d475c357-6219-4a14-aff1-58e059302e66 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:58:01.004258 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-d475c357-6219-4a14-aff1-58e059302e66 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] [instance: 73cb6bde-cad3-43ef-b361-62ff89b3544a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:58:01.013140 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d475c357-6219-4a14-aff1-58e059302e66 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:01.013388 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c355e404-a049-42f5-a3af-e77d094bc3a8 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:01.013587 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d475c357-6219-4a14-aff1-58e059302e66 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:01.014394 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d475c357-6219-4a14-aff1-58e059302e66 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:01.014826 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d475c357-6219-4a14-aff1-58e059302e66 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:01.014991 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c355e404-a049-42f5-a3af-e77d094bc3a8 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:01.017850 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c355e404-a049-42f5-a3af-e77d094bc3a8 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:01.018971 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c355e404-a049-42f5-a3af-e77d094bc3a8 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:01.321620 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-c355e404-a049-42f5-a3af-e77d094bc3a8 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:01.326800 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-d475c357-6219-4a14-aff1-58e059302e66 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d0edf9b51d4370950f7ff503c324b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c048fb2cf4e491980fb65a8e32b0fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:01.347854 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-d475c357-6219-4a14-aff1-58e059302e66 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] 10.222.0.48 "GET /compute/v2.1/servers/73cb6bde-cad3-43ef-b361-62ff89b3544a" status: 200 len: 1314 microversion: 2.1 time: 0.356316 Jun 17 12:58:01.348472 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 53/101] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:58:00 2022] GET /compute/v2.1/servers/73cb6bde-cad3-43ef-b361-62ff89b3544a => generated 1314 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:58:01.372801 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-c355e404-a049-42f5-a3af-e77d094bc3a8 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1363 microversion: 2.1 time: 0.376755 Jun 17 12:58:01.378193 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 49/102] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:58:00 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1363 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 12:58:01.384268 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-e8656f3a-018b-4794-9c1c-e5e35dff0922 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:58:01.385360 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-e8656f3a-018b-4794-9c1c-e5e35dff0922 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: cc3f5e1d-d03b-4fe4-b777-8aedac2761ce] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:58:01.392715 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e8656f3a-018b-4794-9c1c-e5e35dff0922 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:01.393643 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e8656f3a-018b-4794-9c1c-e5e35dff0922 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:01.394758 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e8656f3a-018b-4794-9c1c-e5e35dff0922 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:01.395255 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e8656f3a-018b-4794-9c1c-e5e35dff0922 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:01.403909 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [req-e842f5c5-4e5e-497f-b5f7-bdf969b68547 req-12d50e2e-756c-40a2-848f-4adfb0ad488e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "748a3422-aeab-41c8-b051-df5f7d7ca509", "tag": "87583636-e590-4c87-87ad-1151137bd889"}]} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 12:58:01.417671 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-e842f5c5-4e5e-497f-b5f7-bdf969b68547 req-12d50e2e-756c-40a2-848f-4adfb0ad488e service nova] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:01.418626 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-e842f5c5-4e5e-497f-b5f7-bdf969b68547 req-12d50e2e-756c-40a2-848f-4adfb0ad488e service nova] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:01.439521 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.compute.server_external_events [req-e842f5c5-4e5e-497f-b5f7-bdf969b68547 req-12d50e2e-756c-40a2-848f-4adfb0ad488e service nova] Creating event network-changed:87583636-e590-4c87-87ad-1151137bd889 for instance 748a3422-aeab-41c8-b051-df5f7d7ca509 on hv-cinder-83754 Jun 17 12:58:01.444988 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [req-e842f5c5-4e5e-497f-b5f7-bdf969b68547 req-12d50e2e-756c-40a2-848f-4adfb0ad488e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075402 Jun 17 12:58:01.445605 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 54/103] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 12:58:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:58:01.485925 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-5534a9b2-2c38-4b1f-9f85-53528896a070 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:58:01.486818 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-5534a9b2-2c38-4b1f-9f85-53528896a070 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:58:01.496830 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5534a9b2-2c38-4b1f-9f85-53528896a070 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:01.497292 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5534a9b2-2c38-4b1f-9f85-53528896a070 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:01.498207 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5534a9b2-2c38-4b1f-9f85-53528896a070 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:01.498641 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5534a9b2-2c38-4b1f-9f85-53528896a070 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:01.600252 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-e8656f3a-018b-4794-9c1c-e5e35dff0922 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:01.608532 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-e8656f3a-018b-4794-9c1c-e5e35dff0922 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce" status: 200 len: 1321 microversion: 2.1 time: 0.228776 Jun 17 12:58:01.609161 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 50/104] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:58:01 2022] GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce => generated 1321 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:58:01.663316 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-5534a9b2-2c38-4b1f-9f85-53528896a070 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:01.671351 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-5534a9b2-2c38-4b1f-9f85-53528896a070 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:01.673659 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-5534a9b2-2c38-4b1f-9f85-53528896a070 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:01.674856 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-5534a9b2-2c38-4b1f-9f85-53528896a070 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1407 microversion: 2.20 time: 0.194418 Jun 17 12:58:01.675422 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 55/105] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 12:58:01 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1407 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 12:58:02.365303 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-d877377f-a01c-49bc-a405-c2a0732eb706 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:58:02.365932 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-d877377f-a01c-49bc-a405-c2a0732eb706 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] [instance: 73cb6bde-cad3-43ef-b361-62ff89b3544a] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:58:02.373503 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d877377f-a01c-49bc-a405-c2a0732eb706 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:02.373982 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d877377f-a01c-49bc-a405-c2a0732eb706 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:02.375269 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d877377f-a01c-49bc-a405-c2a0732eb706 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:02.375772 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d877377f-a01c-49bc-a405-c2a0732eb706 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:02.405358 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-0de252b2-ad7f-4734-9d70-730e410ef767 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:58:02.406553 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-0de252b2-ad7f-4734-9d70-730e410ef767 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:58:02.419577 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0de252b2-ad7f-4734-9d70-730e410ef767 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:02.420034 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0de252b2-ad7f-4734-9d70-730e410ef767 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:02.420954 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0de252b2-ad7f-4734-9d70-730e410ef767 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:02.421625 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0de252b2-ad7f-4734-9d70-730e410ef767 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:02.569713 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-d877377f-a01c-49bc-a405-c2a0732eb706 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d0edf9b51d4370950f7ff503c324b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c048fb2cf4e491980fb65a8e32b0fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:02.577536 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-d877377f-a01c-49bc-a405-c2a0732eb706 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] 10.222.0.48 "GET /compute/v2.1/servers/73cb6bde-cad3-43ef-b361-62ff89b3544a" status: 200 len: 1314 microversion: 2.1 time: 0.215946 Jun 17 12:58:02.578428 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 51/106] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:58:02 2022] GET /compute/v2.1/servers/73cb6bde-cad3-43ef-b361-62ff89b3544a => generated 1314 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:58:02.600112 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-0de252b2-ad7f-4734-9d70-730e410ef767 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:02.609057 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-0de252b2-ad7f-4734-9d70-730e410ef767 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1363 microversion: 2.1 time: 0.207466 Jun 17 12:58:02.609690 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 56/107] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:58:02 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1363 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:58:02.627196 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-389d921c-d195-4fea-b9cc-7de8ad5d3511 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:58:02.627877 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-389d921c-d195-4fea-b9cc-7de8ad5d3511 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: cc3f5e1d-d03b-4fe4-b777-8aedac2761ce] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:58:02.634758 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-389d921c-d195-4fea-b9cc-7de8ad5d3511 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:02.635213 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-389d921c-d195-4fea-b9cc-7de8ad5d3511 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:02.635999 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-389d921c-d195-4fea-b9cc-7de8ad5d3511 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:02.636441 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-389d921c-d195-4fea-b9cc-7de8ad5d3511 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:02.693434 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-9003d494-590f-4313-9fe5-893389d94267 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:58:02.694029 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-9003d494-590f-4313-9fe5-893389d94267 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:58:02.700915 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9003d494-590f-4313-9fe5-893389d94267 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:02.701459 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9003d494-590f-4313-9fe5-893389d94267 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:02.702883 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9003d494-590f-4313-9fe5-893389d94267 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:02.702883 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9003d494-590f-4313-9fe5-893389d94267 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:02.820911 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-389d921c-d195-4fea-b9cc-7de8ad5d3511 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:02.830556 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-389d921c-d195-4fea-b9cc-7de8ad5d3511 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce" status: 200 len: 1321 microversion: 2.1 time: 0.208055 Jun 17 12:58:02.831259 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 52/108] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:58:02 2022] GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce => generated 1321 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:58:02.868433 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-9003d494-590f-4313-9fe5-893389d94267 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:02.877244 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-9003d494-590f-4313-9fe5-893389d94267 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:02.878758 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-9003d494-590f-4313-9fe5-893389d94267 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:02.879866 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-9003d494-590f-4313-9fe5-893389d94267 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1407 microversion: 2.20 time: 0.190676 Jun 17 12:58:02.880425 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 57/109] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 12:58:02 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1407 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 12:58:03.594748 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-38519ec6-be0f-4651-9dca-cc62b6a3220d tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:58:03.595761 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-38519ec6-be0f-4651-9dca-cc62b6a3220d tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] [instance: 73cb6bde-cad3-43ef-b361-62ff89b3544a] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:58:03.601654 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-38519ec6-be0f-4651-9dca-cc62b6a3220d tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:03.602070 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-38519ec6-be0f-4651-9dca-cc62b6a3220d tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:03.602859 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-38519ec6-be0f-4651-9dca-cc62b6a3220d tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:03.603288 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-38519ec6-be0f-4651-9dca-cc62b6a3220d tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:03.626458 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-65962af2-709a-405f-a563-f855501f6d79 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:58:03.627831 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-65962af2-709a-405f-a563-f855501f6d79 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:58:03.637378 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-65962af2-709a-405f-a563-f855501f6d79 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:03.637790 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-65962af2-709a-405f-a563-f855501f6d79 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:03.638608 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-65962af2-709a-405f-a563-f855501f6d79 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:03.639034 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-65962af2-709a-405f-a563-f855501f6d79 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:03.792242 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-38519ec6-be0f-4651-9dca-cc62b6a3220d tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d0edf9b51d4370950f7ff503c324b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c048fb2cf4e491980fb65a8e32b0fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:03.801332 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-38519ec6-be0f-4651-9dca-cc62b6a3220d tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] 10.222.0.48 "GET /compute/v2.1/servers/73cb6bde-cad3-43ef-b361-62ff89b3544a" status: 200 len: 1314 microversion: 2.1 time: 0.210430 Jun 17 12:58:03.801926 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 53/110] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:58:03 2022] GET /compute/v2.1/servers/73cb6bde-cad3-43ef-b361-62ff89b3544a => generated 1314 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:58:03.823890 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-65962af2-709a-405f-a563-f855501f6d79 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:03.832761 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-65962af2-709a-405f-a563-f855501f6d79 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1363 microversion: 2.1 time: 0.210695 Jun 17 12:58:03.833327 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 58/111] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:58:03 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1363 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:58:03.847750 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-6b81270e-2557-40d0-a856-4829b254e5e0 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:58:03.848267 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-6b81270e-2557-40d0-a856-4829b254e5e0 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: cc3f5e1d-d03b-4fe4-b777-8aedac2761ce] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:58:03.855305 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6b81270e-2557-40d0-a856-4829b254e5e0 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:03.855544 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6b81270e-2557-40d0-a856-4829b254e5e0 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:03.856139 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6b81270e-2557-40d0-a856-4829b254e5e0 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:03.856571 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6b81270e-2557-40d0-a856-4829b254e5e0 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:03.898624 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-ebde2285-1588-4f8b-b75c-bbf865a9e36e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:58:03.899549 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-ebde2285-1588-4f8b-b75c-bbf865a9e36e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:58:03.906232 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ebde2285-1588-4f8b-b75c-bbf865a9e36e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:03.906817 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ebde2285-1588-4f8b-b75c-bbf865a9e36e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:03.908392 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ebde2285-1588-4f8b-b75c-bbf865a9e36e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:03.908392 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ebde2285-1588-4f8b-b75c-bbf865a9e36e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:04.047885 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-6b81270e-2557-40d0-a856-4829b254e5e0 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:04.056075 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-6b81270e-2557-40d0-a856-4829b254e5e0 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce" status: 200 len: 1321 microversion: 2.1 time: 0.212389 Jun 17 12:58:04.056864 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 54/112] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:58:03 2022] GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce => generated 1321 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:58:04.099133 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-ebde2285-1588-4f8b-b75c-bbf865a9e36e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:04.108975 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-ebde2285-1588-4f8b-b75c-bbf865a9e36e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:04.110946 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-ebde2285-1588-4f8b-b75c-bbf865a9e36e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:04.111915 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-ebde2285-1588-4f8b-b75c-bbf865a9e36e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1407 microversion: 2.20 time: 0.217243 Jun 17 12:58:04.112474 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 59/113] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 12:58:03 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1407 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 12:58:04.819037 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-0bfc3a5f-e7b7-44f3-8286-94f60c3b9b45 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:58:04.819631 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-0bfc3a5f-e7b7-44f3-8286-94f60c3b9b45 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] [instance: 73cb6bde-cad3-43ef-b361-62ff89b3544a] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:58:04.826118 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0bfc3a5f-e7b7-44f3-8286-94f60c3b9b45 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:04.826559 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0bfc3a5f-e7b7-44f3-8286-94f60c3b9b45 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:04.827318 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0bfc3a5f-e7b7-44f3-8286-94f60c3b9b45 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:04.827750 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0bfc3a5f-e7b7-44f3-8286-94f60c3b9b45 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:04.848946 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-aa547c52-8eea-4b97-895d-e47639653924 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:58:04.849533 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-aa547c52-8eea-4b97-895d-e47639653924 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:58:04.856263 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-aa547c52-8eea-4b97-895d-e47639653924 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:04.856989 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-aa547c52-8eea-4b97-895d-e47639653924 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:04.857767 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-aa547c52-8eea-4b97-895d-e47639653924 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:04.858193 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-aa547c52-8eea-4b97-895d-e47639653924 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:05.221836 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-0bfc3a5f-e7b7-44f3-8286-94f60c3b9b45 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d0edf9b51d4370950f7ff503c324b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c048fb2cf4e491980fb65a8e32b0fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:05.229597 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-0bfc3a5f-e7b7-44f3-8286-94f60c3b9b45 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] 10.222.0.48 "GET /compute/v2.1/servers/73cb6bde-cad3-43ef-b361-62ff89b3544a" status: 200 len: 1314 microversion: 2.1 time: 0.415004 Jun 17 12:58:05.230217 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 55/114] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:58:04 2022] GET /compute/v2.1/servers/73cb6bde-cad3-43ef-b361-62ff89b3544a => generated 1314 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:58:05.230381 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-aa547c52-8eea-4b97-895d-e47639653924 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:05.234902 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-9e1a10c3-b26d-47ec-953b-bae84108f1f0 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:58:05.235840 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-9e1a10c3-b26d-47ec-953b-bae84108f1f0 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: cc3f5e1d-d03b-4fe4-b777-8aedac2761ce] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:58:05.242814 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9e1a10c3-b26d-47ec-953b-bae84108f1f0 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:05.243255 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9e1a10c3-b26d-47ec-953b-bae84108f1f0 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:05.243670 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-aa547c52-8eea-4b97-895d-e47639653924 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1363 microversion: 2.1 time: 0.398478 Jun 17 12:58:05.244107 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9e1a10c3-b26d-47ec-953b-bae84108f1f0 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:05.244533 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9e1a10c3-b26d-47ec-953b-bae84108f1f0 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:05.244731 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 60/115] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:58:04 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1363 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:58:05.250442 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-d89772a2-1709-4a8c-9816-aacb0ff2b61d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:58:05.251056 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-d89772a2-1709-4a8c-9816-aacb0ff2b61d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:58:05.259526 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d89772a2-1709-4a8c-9816-aacb0ff2b61d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:05.260242 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d89772a2-1709-4a8c-9816-aacb0ff2b61d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:05.261489 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d89772a2-1709-4a8c-9816-aacb0ff2b61d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:05.262274 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d89772a2-1709-4a8c-9816-aacb0ff2b61d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:05.462480 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-9e1a10c3-b26d-47ec-953b-bae84108f1f0 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:05.470265 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-9e1a10c3-b26d-47ec-953b-bae84108f1f0 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce" status: 200 len: 1321 microversion: 2.1 time: 0.238801 Jun 17 12:58:05.471286 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 56/116] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:58:05 2022] GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce => generated 1321 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:58:05.474796 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-d89772a2-1709-4a8c-9816-aacb0ff2b61d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:05.483192 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-d89772a2-1709-4a8c-9816-aacb0ff2b61d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:05.484877 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-d89772a2-1709-4a8c-9816-aacb0ff2b61d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:05.486144 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-d89772a2-1709-4a8c-9816-aacb0ff2b61d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1407 microversion: 2.20 time: 0.240426 Jun 17 12:58:05.486670 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 61/117] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 12:58:05 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1407 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 12:58:06.248401 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-36644a5f-6f5e-4d50-8cae-b1e5a2e899a7 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:58:06.249048 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-36644a5f-6f5e-4d50-8cae-b1e5a2e899a7 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] [instance: 73cb6bde-cad3-43ef-b361-62ff89b3544a] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:58:06.257466 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-36644a5f-6f5e-4d50-8cae-b1e5a2e899a7 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:06.259980 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-36644a5f-6f5e-4d50-8cae-b1e5a2e899a7 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:06.259980 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-36644a5f-6f5e-4d50-8cae-b1e5a2e899a7 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:06.259980 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-36644a5f-6f5e-4d50-8cae-b1e5a2e899a7 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:06.267830 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-f687c258-60fb-4f4e-8974-3ecea31a41c7 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:58:06.270181 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-f687c258-60fb-4f4e-8974-3ecea31a41c7 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:58:06.280810 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f687c258-60fb-4f4e-8974-3ecea31a41c7 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:06.281664 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f687c258-60fb-4f4e-8974-3ecea31a41c7 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:06.283247 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f687c258-60fb-4f4e-8974-3ecea31a41c7 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:06.284230 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f687c258-60fb-4f4e-8974-3ecea31a41c7 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:06.509893 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-36644a5f-6f5e-4d50-8cae-b1e5a2e899a7 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d0edf9b51d4370950f7ff503c324b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c048fb2cf4e491980fb65a8e32b0fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:06.514641 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-f687c258-60fb-4f4e-8974-3ecea31a41c7 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:06.519272 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-36644a5f-6f5e-4d50-8cae-b1e5a2e899a7 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] 10.222.0.48 "GET /compute/v2.1/servers/73cb6bde-cad3-43ef-b361-62ff89b3544a" status: 200 len: 1314 microversion: 2.1 time: 0.275548 Jun 17 12:58:06.519873 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 57/118] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:58:06 2022] GET /compute/v2.1/servers/73cb6bde-cad3-43ef-b361-62ff89b3544a => generated 1314 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 12:58:06.523003 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-f687c258-60fb-4f4e-8974-3ecea31a41c7 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1363 microversion: 2.1 time: 0.262319 Jun 17 12:58:06.523582 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 62/119] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:58:06 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1363 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:58:06.528305 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-50e241d7-c1c5-4deb-8446-e671bd35e6c3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:58:06.528938 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-50e241d7-c1c5-4deb-8446-e671bd35e6c3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:58:06.533717 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-0117b045-be38-4a80-bffe-1bbd17bd66f7 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:58:06.534370 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-0117b045-be38-4a80-bffe-1bbd17bd66f7 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: cc3f5e1d-d03b-4fe4-b777-8aedac2761ce] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:58:06.535455 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-50e241d7-c1c5-4deb-8446-e671bd35e6c3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:06.535904 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-50e241d7-c1c5-4deb-8446-e671bd35e6c3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:06.536665 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-50e241d7-c1c5-4deb-8446-e671bd35e6c3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:06.537080 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-50e241d7-c1c5-4deb-8446-e671bd35e6c3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:06.540894 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0117b045-be38-4a80-bffe-1bbd17bd66f7 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:06.541353 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0117b045-be38-4a80-bffe-1bbd17bd66f7 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:06.542151 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0117b045-be38-4a80-bffe-1bbd17bd66f7 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:06.542589 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0117b045-be38-4a80-bffe-1bbd17bd66f7 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:06.774525 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-50e241d7-c1c5-4deb-8446-e671bd35e6c3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:06.779575 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-0117b045-be38-4a80-bffe-1bbd17bd66f7 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:06.792068 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-0117b045-be38-4a80-bffe-1bbd17bd66f7 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce" status: 200 len: 1321 microversion: 2.1 time: 0.271124 Jun 17 12:58:06.793352 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 58/120] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:58:06 2022] GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce => generated 1321 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:58:06.795400 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-50e241d7-c1c5-4deb-8446-e671bd35e6c3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:06.797116 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-50e241d7-c1c5-4deb-8446-e671bd35e6c3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:06.798503 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-50e241d7-c1c5-4deb-8446-e671bd35e6c3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1407 microversion: 2.20 time: 0.273676 Jun 17 12:58:06.799693 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 63/121] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 12:58:06 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1407 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 12:58:07.538609 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-4458b514-187e-4a3b-8975-3e436af7f892 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:58:07.539774 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-4458b514-187e-4a3b-8975-3e436af7f892 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] [instance: 73cb6bde-cad3-43ef-b361-62ff89b3544a] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:58:07.546416 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4458b514-187e-4a3b-8975-3e436af7f892 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:07.546993 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-149f1b9b-4fca-4344-a953-6206334f2aa1 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:58:07.547792 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4458b514-187e-4a3b-8975-3e436af7f892 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:07.548258 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-149f1b9b-4fca-4344-a953-6206334f2aa1 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:58:07.548996 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4458b514-187e-4a3b-8975-3e436af7f892 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:07.549616 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4458b514-187e-4a3b-8975-3e436af7f892 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:07.559823 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-149f1b9b-4fca-4344-a953-6206334f2aa1 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:07.560661 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-149f1b9b-4fca-4344-a953-6206334f2aa1 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:07.561949 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-149f1b9b-4fca-4344-a953-6206334f2aa1 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:07.562872 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-149f1b9b-4fca-4344-a953-6206334f2aa1 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:07.807346 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-4458b514-187e-4a3b-8975-3e436af7f892 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d0edf9b51d4370950f7ff503c324b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c048fb2cf4e491980fb65a8e32b0fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:07.816531 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-4458b514-187e-4a3b-8975-3e436af7f892 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] 10.222.0.48 "GET /compute/v2.1/servers/73cb6bde-cad3-43ef-b361-62ff89b3544a" status: 200 len: 1314 microversion: 2.1 time: 0.283504 Jun 17 12:58:07.819854 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 59/122] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:58:07 2022] GET /compute/v2.1/servers/73cb6bde-cad3-43ef-b361-62ff89b3544a => generated 1314 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:58:07.826663 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-149f1b9b-4fca-4344-a953-6206334f2aa1 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:07.827287 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-a27286b3-6b50-4929-abcf-9b82bbb8b1eb tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:58:07.827913 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-a27286b3-6b50-4929-abcf-9b82bbb8b1eb tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: cc3f5e1d-d03b-4fe4-b777-8aedac2761ce] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:58:07.834640 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a27286b3-6b50-4929-abcf-9b82bbb8b1eb tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:07.835322 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a27286b3-6b50-4929-abcf-9b82bbb8b1eb tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:07.836273 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a27286b3-6b50-4929-abcf-9b82bbb8b1eb tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:07.836746 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-149f1b9b-4fca-4344-a953-6206334f2aa1 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1363 microversion: 2.1 time: 0.300410 Jun 17 12:58:07.837019 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a27286b3-6b50-4929-abcf-9b82bbb8b1eb tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:07.837347 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 64/123] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:58:07 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1363 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:58:07.854356 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-b301b126-4838-4587-8034-e44a3f79fc7c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:58:07.855181 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-b301b126-4838-4587-8034-e44a3f79fc7c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:58:07.862342 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b301b126-4838-4587-8034-e44a3f79fc7c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:07.862789 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b301b126-4838-4587-8034-e44a3f79fc7c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:07.863561 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b301b126-4838-4587-8034-e44a3f79fc7c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:07.863989 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b301b126-4838-4587-8034-e44a3f79fc7c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:08.085791 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-b301b126-4838-4587-8034-e44a3f79fc7c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:08.105737 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-b301b126-4838-4587-8034-e44a3f79fc7c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:08.107236 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-b301b126-4838-4587-8034-e44a3f79fc7c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:08.109441 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-b301b126-4838-4587-8034-e44a3f79fc7c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1407 microversion: 2.20 time: 0.270356 Jun 17 12:58:08.121530 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 65/124] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 12:58:07 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1407 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 12:58:08.124005 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-a27286b3-6b50-4929-abcf-9b82bbb8b1eb tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:08.138405 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-a27286b3-6b50-4929-abcf-9b82bbb8b1eb tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce" status: 200 len: 1321 microversion: 2.1 time: 0.317135 Jun 17 12:58:08.139644 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 60/125] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:58:07 2022] GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce => generated 1321 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:58:08.838727 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-2ad5a5ea-a464-4cc0-b989-493faee9213d tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:58:08.840280 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-2ad5a5ea-a464-4cc0-b989-493faee9213d tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] [instance: 73cb6bde-cad3-43ef-b361-62ff89b3544a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:58:08.857624 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2ad5a5ea-a464-4cc0-b989-493faee9213d tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:08.860589 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2ad5a5ea-a464-4cc0-b989-493faee9213d tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:08.863039 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-6979280f-bfce-415e-955b-f57905f5cbcf tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:58:08.863868 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2ad5a5ea-a464-4cc0-b989-493faee9213d tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:08.864157 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2ad5a5ea-a464-4cc0-b989-493faee9213d tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:08.865593 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-6979280f-bfce-415e-955b-f57905f5cbcf tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:58:08.878745 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6979280f-bfce-415e-955b-f57905f5cbcf tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:08.880222 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6979280f-bfce-415e-955b-f57905f5cbcf tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:08.882047 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6979280f-bfce-415e-955b-f57905f5cbcf tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:08.883625 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6979280f-bfce-415e-955b-f57905f5cbcf tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:09.620475 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-6979280f-bfce-415e-955b-f57905f5cbcf tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:09.631689 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-6979280f-bfce-415e-955b-f57905f5cbcf tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1363 microversion: 2.1 time: 0.779570 Jun 17 12:58:09.632832 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 61/126] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:58:08 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1363 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:58:09.638513 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-e31a7d87-bdb3-4991-a533-2a154a496ddc tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:58:09.639629 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-e31a7d87-bdb3-4991-a533-2a154a496ddc tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:58:09.647296 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e31a7d87-bdb3-4991-a533-2a154a496ddc tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:09.647738 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e31a7d87-bdb3-4991-a533-2a154a496ddc tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:09.648554 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e31a7d87-bdb3-4991-a533-2a154a496ddc tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:09.649029 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e31a7d87-bdb3-4991-a533-2a154a496ddc tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:09.755901 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-2ad5a5ea-a464-4cc0-b989-493faee9213d tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d0edf9b51d4370950f7ff503c324b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c048fb2cf4e491980fb65a8e32b0fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:09.763039 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=100 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:58:09.768170 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-2ad5a5ea-a464-4cc0-b989-493faee9213d tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] 10.222.0.48 "GET /compute/v2.1/servers/73cb6bde-cad3-43ef-b361-62ff89b3544a" status: 200 len: 1314 microversion: 2.1 time: 0.937193 Jun 17 12:58:09.772039 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 66/127] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:58:08 2022] GET /compute/v2.1/servers/73cb6bde-cad3-43ef-b361-62ff89b3544a => generated 1314 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:58:09.789295 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-5c4d6e25-8182-4810-9401-51c5d7d11bdd tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:58:09.793431 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-5c4d6e25-8182-4810-9401-51c5d7d11bdd tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: cc3f5e1d-d03b-4fe4-b777-8aedac2761ce] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:58:09.814680 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5c4d6e25-8182-4810-9401-51c5d7d11bdd tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:09.815219 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5c4d6e25-8182-4810-9401-51c5d7d11bdd tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:09.816321 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5c4d6e25-8182-4810-9401-51c5d7d11bdd tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:09.816834 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5c4d6e25-8182-4810-9401-51c5d7d11bdd tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:10.470594 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-5c4d6e25-8182-4810-9401-51c5d7d11bdd tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:10.478447 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-5c4d6e25-8182-4810-9401-51c5d7d11bdd tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce" status: 200 len: 1321 microversion: 2.1 time: 0.703970 Jun 17 12:58:10.479068 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 67/128] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:58:09 2022] GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce => generated 1321 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:58:10.482814 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-e31a7d87-bdb3-4991-a533-2a154a496ddc tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:10.494333 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-e31a7d87-bdb3-4991-a533-2a154a496ddc tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:10.496617 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-e31a7d87-bdb3-4991-a533-2a154a496ddc tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:10.498065 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-e31a7d87-bdb3-4991-a533-2a154a496ddc tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1407 microversion: 2.20 time: 0.863777 Jun 17 12:58:10.498689 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 62/129] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 12:58:09 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1407 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 12:58:10.648873 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-39ca384a-002f-49f6-9d50-f64cd1748409 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:58:10.649478 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-39ca384a-002f-49f6-9d50-f64cd1748409 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:58:10.658044 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-39ca384a-002f-49f6-9d50-f64cd1748409 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:10.658587 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-39ca384a-002f-49f6-9d50-f64cd1748409 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:10.659587 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-39ca384a-002f-49f6-9d50-f64cd1748409 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:10.659992 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-39ca384a-002f-49f6-9d50-f64cd1748409 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:10.793340 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-48734dcc-82af-4127-9f48-dcb4ad9492b4 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:58:10.794281 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-48734dcc-82af-4127-9f48-dcb4ad9492b4 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] [instance: 73cb6bde-cad3-43ef-b361-62ff89b3544a] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:58:10.807132 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-48734dcc-82af-4127-9f48-dcb4ad9492b4 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:10.807766 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-48734dcc-82af-4127-9f48-dcb4ad9492b4 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:10.808972 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-48734dcc-82af-4127-9f48-dcb4ad9492b4 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:10.809543 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-48734dcc-82af-4127-9f48-dcb4ad9492b4 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:10.923500 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-39ca384a-002f-49f6-9d50-f64cd1748409 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:10.935666 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-39ca384a-002f-49f6-9d50-f64cd1748409 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1363 microversion: 2.1 time: 0.287605 Jun 17 12:58:10.936458 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 68/130] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:58:10 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1363 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:58:11.006517 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-48734dcc-82af-4127-9f48-dcb4ad9492b4 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d0edf9b51d4370950f7ff503c324b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c048fb2cf4e491980fb65a8e32b0fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:11.015924 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-48734dcc-82af-4127-9f48-dcb4ad9492b4 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] 10.222.0.48 "GET /compute/v2.1/servers/73cb6bde-cad3-43ef-b361-62ff89b3544a" status: 200 len: 1314 microversion: 2.1 time: 0.227631 Jun 17 12:58:11.017373 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 63/131] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:58:10 2022] GET /compute/v2.1/servers/73cb6bde-cad3-43ef-b361-62ff89b3544a => generated 1314 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 12:58:11.497418 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-3693fb6b-1f36-4e26-87f8-b2b3149cd5e0 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:58:11.499066 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-3693fb6b-1f36-4e26-87f8-b2b3149cd5e0 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: cc3f5e1d-d03b-4fe4-b777-8aedac2761ce] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:58:11.511973 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3693fb6b-1f36-4e26-87f8-b2b3149cd5e0 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:11.513842 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3693fb6b-1f36-4e26-87f8-b2b3149cd5e0 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:11.513842 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3693fb6b-1f36-4e26-87f8-b2b3149cd5e0 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:11.513842 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3693fb6b-1f36-4e26-87f8-b2b3149cd5e0 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:11.519630 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-07e430b6-d65b-4658-ad4c-642b061f8b3f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:58:11.520247 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-07e430b6-d65b-4658-ad4c-642b061f8b3f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:58:11.531520 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-07e430b6-d65b-4658-ad4c-642b061f8b3f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:11.531954 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-07e430b6-d65b-4658-ad4c-642b061f8b3f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:11.532836 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-07e430b6-d65b-4658-ad4c-642b061f8b3f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:11.533268 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-07e430b6-d65b-4658-ad4c-642b061f8b3f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:11.537659 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_cell1:SELECT=100 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:58:11.745513 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-07e430b6-d65b-4658-ad4c-642b061f8b3f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:11.763257 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-07e430b6-d65b-4658-ad4c-642b061f8b3f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:11.765216 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-07e430b6-d65b-4658-ad4c-642b061f8b3f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:11.766409 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-07e430b6-d65b-4658-ad4c-642b061f8b3f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1407 microversion: 2.20 time: 0.251242 Jun 17 12:58:11.772669 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 64/132] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 12:58:11 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1407 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 12:58:11.780703 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-3693fb6b-1f36-4e26-87f8-b2b3149cd5e0 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:11.811351 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-3693fb6b-1f36-4e26-87f8-b2b3149cd5e0 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce" status: 200 len: 1321 microversion: 2.1 time: 0.319335 Jun 17 12:58:11.812298 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 69/133] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:58:11 2022] GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce => generated 1321 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:58:11.956708 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-6f768e14-ea51-4c7d-b1a4-6121ee89ec80 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:58:11.957307 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-6f768e14-ea51-4c7d-b1a4-6121ee89ec80 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:58:11.973364 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6f768e14-ea51-4c7d-b1a4-6121ee89ec80 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:11.973896 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6f768e14-ea51-4c7d-b1a4-6121ee89ec80 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:11.974835 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6f768e14-ea51-4c7d-b1a4-6121ee89ec80 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:11.975275 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6f768e14-ea51-4c7d-b1a4-6121ee89ec80 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:12.034351 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-136e1f91-463e-4261-98f3-0ab19ef358e1 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:58:12.035057 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-136e1f91-463e-4261-98f3-0ab19ef358e1 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] [instance: 73cb6bde-cad3-43ef-b361-62ff89b3544a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:58:12.048543 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-136e1f91-463e-4261-98f3-0ab19ef358e1 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:12.055223 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-136e1f91-463e-4261-98f3-0ab19ef358e1 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:12.057987 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-136e1f91-463e-4261-98f3-0ab19ef358e1 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:12.061406 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-136e1f91-463e-4261-98f3-0ab19ef358e1 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:12.239336 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-6f768e14-ea51-4c7d-b1a4-6121ee89ec80 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:12.254356 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-6f768e14-ea51-4c7d-b1a4-6121ee89ec80 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1363 microversion: 2.1 time: 0.301407 Jun 17 12:58:12.255124 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 65/134] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:58:11 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1363 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:58:12.302843 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-136e1f91-463e-4261-98f3-0ab19ef358e1 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d0edf9b51d4370950f7ff503c324b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c048fb2cf4e491980fb65a8e32b0fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:12.321788 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-136e1f91-463e-4261-98f3-0ab19ef358e1 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] 10.222.0.48 "GET /compute/v2.1/servers/73cb6bde-cad3-43ef-b361-62ff89b3544a" status: 200 len: 1314 microversion: 2.1 time: 0.292645 Jun 17 12:58:12.322871 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 70/135] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:58:12 2022] GET /compute/v2.1/servers/73cb6bde-cad3-43ef-b361-62ff89b3544a => generated 1314 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:58:12.788133 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-dee034d4-de24-4884-8b02-88fe8d523629 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:58:12.788788 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-dee034d4-de24-4884-8b02-88fe8d523629 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:58:12.802584 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dee034d4-de24-4884-8b02-88fe8d523629 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:12.804032 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dee034d4-de24-4884-8b02-88fe8d523629 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:12.804824 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dee034d4-de24-4884-8b02-88fe8d523629 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:12.805256 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dee034d4-de24-4884-8b02-88fe8d523629 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:13.035777 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [req-0510e2d6-fd0a-46d1-bdbf-4f78dd6ae3f3 req-5a2740b4-b3fc-4089-ae69-6a09f213a676 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5db43a6d-a079-4e7c-948a-b2600a102f63", "name": "network-vif-plugged", "status": "completed", "tag": "510d5b97-81e2-401f-854a-3f165763e33d"}]} {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 12:58:13.060350 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [req-0510e2d6-fd0a-46d1-bdbf-4f78dd6ae3f3 req-5a2740b4-b3fc-4089-ae69-6a09f213a676 service nova] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:13.062121 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [req-0510e2d6-fd0a-46d1-bdbf-4f78dd6ae3f3 req-5a2740b4-b3fc-4089-ae69-6a09f213a676 service nova] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:13.096832 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.compute.server_external_events [req-0510e2d6-fd0a-46d1-bdbf-4f78dd6ae3f3 req-5a2740b4-b3fc-4089-ae69-6a09f213a676 service nova] Creating event network-vif-plugged:510d5b97-81e2-401f-854a-3f165763e33d for instance 5db43a6d-a079-4e7c-948a-b2600a102f63 on hv-cinder-83754 Jun 17 12:58:13.113040 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [req-0510e2d6-fd0a-46d1-bdbf-4f78dd6ae3f3 req-5a2740b4-b3fc-4089-ae69-6a09f213a676 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.756670 Jun 17 12:58:13.114134 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 66/136] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 12:58:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:58:13.126733 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-b97880a3-3ebd-432c-8ffd-1cf3f6e67055 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:58:13.131001 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-b97880a3-3ebd-432c-8ffd-1cf3f6e67055 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: cc3f5e1d-d03b-4fe4-b777-8aedac2761ce] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:58:13.151763 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b97880a3-3ebd-432c-8ffd-1cf3f6e67055 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:13.153604 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b97880a3-3ebd-432c-8ffd-1cf3f6e67055 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:13.159604 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b97880a3-3ebd-432c-8ffd-1cf3f6e67055 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:13.162065 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b97880a3-3ebd-432c-8ffd-1cf3f6e67055 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:13.263262 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-dee034d4-de24-4884-8b02-88fe8d523629 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:13.279211 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-dee034d4-de24-4884-8b02-88fe8d523629 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:13.280944 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-dee034d4-de24-4884-8b02-88fe8d523629 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:13.282689 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-dee034d4-de24-4884-8b02-88fe8d523629 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1407 microversion: 2.20 time: 0.499977 Jun 17 12:58:13.302134 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 71/137] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 12:58:12 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1407 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 12:58:13.308003 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-fd86ea49-430f-4d69-a286-b74071d4a35e tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:58:13.308811 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-fd86ea49-430f-4d69-a286-b74071d4a35e tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:58:13.331526 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fd86ea49-430f-4d69-a286-b74071d4a35e tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:13.331984 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fd86ea49-430f-4d69-a286-b74071d4a35e tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:13.332765 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fd86ea49-430f-4d69-a286-b74071d4a35e tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:13.333192 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fd86ea49-430f-4d69-a286-b74071d4a35e tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:13.960770 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-fd86ea49-430f-4d69-a286-b74071d4a35e tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:13.965625 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-b97880a3-3ebd-432c-8ffd-1cf3f6e67055 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:13.976445 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-fd86ea49-430f-4d69-a286-b74071d4a35e tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1363 microversion: 2.1 time: 0.673068 Jun 17 12:58:13.986628 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-b97880a3-3ebd-432c-8ffd-1cf3f6e67055 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce" status: 200 len: 1321 microversion: 2.1 time: 0.862830 Jun 17 12:58:13.986628 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 67/138] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:58:13 2022] GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce => generated 1321 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:58:13.987369 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 72/139] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:58:13 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1363 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:58:14.003509 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-7d305c12-3874-445b-bc54-262986d5c74f tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:58:14.004541 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-7d305c12-3874-445b-bc54-262986d5c74f tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] [instance: 73cb6bde-cad3-43ef-b361-62ff89b3544a] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:58:14.020922 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7d305c12-3874-445b-bc54-262986d5c74f tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:14.023166 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7d305c12-3874-445b-bc54-262986d5c74f tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:14.025859 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7d305c12-3874-445b-bc54-262986d5c74f tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:14.027057 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7d305c12-3874-445b-bc54-262986d5c74f tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:14.301664 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-d7c503f3-bdea-4981-a4d8-14168216516b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:58:14.302320 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-d7c503f3-bdea-4981-a4d8-14168216516b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:58:14.317368 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d7c503f3-bdea-4981-a4d8-14168216516b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:14.317687 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d7c503f3-bdea-4981-a4d8-14168216516b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:14.318721 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d7c503f3-bdea-4981-a4d8-14168216516b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:14.319486 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d7c503f3-bdea-4981-a4d8-14168216516b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:14.687293 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-7d305c12-3874-445b-bc54-262986d5c74f tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d0edf9b51d4370950f7ff503c324b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c048fb2cf4e491980fb65a8e32b0fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:14.695903 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-7d305c12-3874-445b-bc54-262986d5c74f tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] 10.222.0.48 "GET /compute/v2.1/servers/73cb6bde-cad3-43ef-b361-62ff89b3544a" status: 200 len: 1314 microversion: 2.1 time: 0.702477 Jun 17 12:58:14.696504 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 68/140] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:58:13 2022] GET /compute/v2.1/servers/73cb6bde-cad3-43ef-b361-62ff89b3544a => generated 1314 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:58:14.881515 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-d7c503f3-bdea-4981-a4d8-14168216516b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:14.890454 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-d7c503f3-bdea-4981-a4d8-14168216516b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:14.895100 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-d7c503f3-bdea-4981-a4d8-14168216516b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:14.897808 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-d7c503f3-bdea-4981-a4d8-14168216516b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1407 microversion: 2.20 time: 0.600880 Jun 17 12:58:14.910973 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 73/141] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 12:58:14 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1407 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 12:58:14.995041 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-a8373dee-097a-48ec-b95a-55e8352f8385 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:58:14.996009 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-a8373dee-097a-48ec-b95a-55e8352f8385 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:58:15.000275 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-11e1d7d9-8ca0-488d-a54f-bc32fd2e93d2 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:58:15.000887 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-11e1d7d9-8ca0-488d-a54f-bc32fd2e93d2 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: cc3f5e1d-d03b-4fe4-b777-8aedac2761ce] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:58:15.005857 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a8373dee-097a-48ec-b95a-55e8352f8385 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:15.006330 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a8373dee-097a-48ec-b95a-55e8352f8385 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:15.008295 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a8373dee-097a-48ec-b95a-55e8352f8385 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:15.008741 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a8373dee-097a-48ec-b95a-55e8352f8385 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:15.012665 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-11e1d7d9-8ca0-488d-a54f-bc32fd2e93d2 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:15.013218 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-11e1d7d9-8ca0-488d-a54f-bc32fd2e93d2 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:15.014000 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-11e1d7d9-8ca0-488d-a54f-bc32fd2e93d2 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:15.014447 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-11e1d7d9-8ca0-488d-a54f-bc32fd2e93d2 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:15.338441 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-11e1d7d9-8ca0-488d-a54f-bc32fd2e93d2 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:15.346197 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-11e1d7d9-8ca0-488d-a54f-bc32fd2e93d2 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce" status: 200 len: 1321 microversion: 2.1 time: 0.350157 Jun 17 12:58:15.356462 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 74/142] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:58:14 2022] GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce => generated 1321 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:58:15.377776 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-a8373dee-097a-48ec-b95a-55e8352f8385 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:15.386574 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-a8373dee-097a-48ec-b95a-55e8352f8385 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1363 microversion: 2.1 time: 0.395601 Jun 17 12:58:15.397394 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 69/143] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:58:14 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1363 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:58:15.713382 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-56d69012-4e74-4377-963e-cefbf73a16d5 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:58:15.714443 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-56d69012-4e74-4377-963e-cefbf73a16d5 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] [instance: 73cb6bde-cad3-43ef-b361-62ff89b3544a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:58:15.721067 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-56d69012-4e74-4377-963e-cefbf73a16d5 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:15.721505 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-56d69012-4e74-4377-963e-cefbf73a16d5 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:15.722306 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-56d69012-4e74-4377-963e-cefbf73a16d5 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:15.722738 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-56d69012-4e74-4377-963e-cefbf73a16d5 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:15.916498 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-b1d23b3f-6d7d-4365-b988-125195f1aafb tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:58:15.917114 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-b1d23b3f-6d7d-4365-b988-125195f1aafb tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:58:15.924005 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b1d23b3f-6d7d-4365-b988-125195f1aafb tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:15.924618 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b1d23b3f-6d7d-4365-b988-125195f1aafb tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:15.925516 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b1d23b3f-6d7d-4365-b988-125195f1aafb tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:15.926579 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b1d23b3f-6d7d-4365-b988-125195f1aafb tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:16.069181 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-56d69012-4e74-4377-963e-cefbf73a16d5 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d0edf9b51d4370950f7ff503c324b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c048fb2cf4e491980fb65a8e32b0fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:16.097287 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-56d69012-4e74-4377-963e-cefbf73a16d5 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] 10.222.0.48 "GET /compute/v2.1/servers/73cb6bde-cad3-43ef-b361-62ff89b3544a" status: 200 len: 1314 microversion: 2.1 time: 0.385197 Jun 17 12:58:16.106895 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 75/144] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:58:15 2022] GET /compute/v2.1/servers/73cb6bde-cad3-43ef-b361-62ff89b3544a => generated 1314 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:58:16.115617 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [req-33b9eef0-3496-49e2-a8c2-574019a91aee req-2cdd4d84-b21f-4e19-8df9-53ad64980d6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc3f5e1d-d03b-4fe4-b777-8aedac2761ce", "name": "network-vif-plugged", "status": "completed", "tag": "bf0807bd-3b46-453e-8c9b-d856e04fe896"}]} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 12:58:16.142371 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-33b9eef0-3496-49e2-a8c2-574019a91aee req-2cdd4d84-b21f-4e19-8df9-53ad64980d6e service nova] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:16.148057 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-33b9eef0-3496-49e2-a8c2-574019a91aee req-2cdd4d84-b21f-4e19-8df9-53ad64980d6e service nova] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:16.182146 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.compute.server_external_events [req-33b9eef0-3496-49e2-a8c2-574019a91aee req-2cdd4d84-b21f-4e19-8df9-53ad64980d6e service nova] Creating event network-vif-plugged:bf0807bd-3b46-453e-8c9b-d856e04fe896 for instance cc3f5e1d-d03b-4fe4-b777-8aedac2761ce on hv-cinder-83754 Jun 17 12:58:16.198246 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [req-33b9eef0-3496-49e2-a8c2-574019a91aee req-2cdd4d84-b21f-4e19-8df9-53ad64980d6e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097480 Jun 17 12:58:16.200112 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 76/145] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 12:58:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:58:16.221571 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-b1d23b3f-6d7d-4365-b988-125195f1aafb tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:16.236473 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-b1d23b3f-6d7d-4365-b988-125195f1aafb tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:16.238388 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-b1d23b3f-6d7d-4365-b988-125195f1aafb tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:16.239803 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-b1d23b3f-6d7d-4365-b988-125195f1aafb tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1407 microversion: 2.20 time: 0.327649 Jun 17 12:58:16.254158 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 70/146] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 12:58:15 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1407 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 12:58:16.364506 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-b67ff77b-65fb-4332-af9f-5f81afc11b2d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:58:16.365445 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-b67ff77b-65fb-4332-af9f-5f81afc11b2d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: cc3f5e1d-d03b-4fe4-b777-8aedac2761ce] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:58:16.393282 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b67ff77b-65fb-4332-af9f-5f81afc11b2d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:16.404533 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-ff2b6c8a-b0b6-47f5-a49d-f9196ccd5e14 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:58:16.405399 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-ff2b6c8a-b0b6-47f5-a49d-f9196ccd5e14 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:58:16.408494 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b67ff77b-65fb-4332-af9f-5f81afc11b2d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:16.409406 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b67ff77b-65fb-4332-af9f-5f81afc11b2d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:16.409841 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b67ff77b-65fb-4332-af9f-5f81afc11b2d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:16.412411 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ff2b6c8a-b0b6-47f5-a49d-f9196ccd5e14 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:16.412972 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ff2b6c8a-b0b6-47f5-a49d-f9196ccd5e14 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:16.414209 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ff2b6c8a-b0b6-47f5-a49d-f9196ccd5e14 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:16.414987 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ff2b6c8a-b0b6-47f5-a49d-f9196ccd5e14 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:16.835813 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-ff2b6c8a-b0b6-47f5-a49d-f9196ccd5e14 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:16.844872 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-b67ff77b-65fb-4332-af9f-5f81afc11b2d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:16.865053 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-b67ff77b-65fb-4332-af9f-5f81afc11b2d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce" status: 200 len: 1321 microversion: 2.1 time: 0.505346 Jun 17 12:58:16.866232 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-ff2b6c8a-b0b6-47f5-a49d-f9196ccd5e14 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1363 microversion: 2.1 time: 0.466090 Jun 17 12:58:16.868288 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 77/147] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:58:16 2022] GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce => generated 1321 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 12:58:16.868863 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 71/148] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:58:16 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1363 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:58:17.123081 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-7a6d4996-6aa6-444b-9f8d-9b4fcf51702b tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:58:17.124068 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-7a6d4996-6aa6-444b-9f8d-9b4fcf51702b tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] [instance: 73cb6bde-cad3-43ef-b361-62ff89b3544a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:58:17.154917 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7a6d4996-6aa6-444b-9f8d-9b4fcf51702b tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:17.155492 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7a6d4996-6aa6-444b-9f8d-9b4fcf51702b tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:17.156314 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7a6d4996-6aa6-444b-9f8d-9b4fcf51702b tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:17.156761 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7a6d4996-6aa6-444b-9f8d-9b4fcf51702b tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:17.262530 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-620aa70c-abb7-4728-beba-2369e04354dc tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:58:17.263385 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-620aa70c-abb7-4728-beba-2369e04354dc tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:58:17.275720 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-620aa70c-abb7-4728-beba-2369e04354dc tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:17.276130 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-620aa70c-abb7-4728-beba-2369e04354dc tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:17.277003 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-620aa70c-abb7-4728-beba-2369e04354dc tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:17.277462 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-620aa70c-abb7-4728-beba-2369e04354dc tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:17.441127 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-7a6d4996-6aa6-444b-9f8d-9b4fcf51702b tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d0edf9b51d4370950f7ff503c324b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c048fb2cf4e491980fb65a8e32b0fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:17.449178 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-7a6d4996-6aa6-444b-9f8d-9b4fcf51702b tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] 10.222.0.48 "GET /compute/v2.1/servers/73cb6bde-cad3-43ef-b361-62ff89b3544a" status: 200 len: 1314 microversion: 2.1 time: 0.334949 Jun 17 12:58:17.449766 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 78/149] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:58:17 2022] GET /compute/v2.1/servers/73cb6bde-cad3-43ef-b361-62ff89b3544a => generated 1314 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:58:17.502472 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-620aa70c-abb7-4728-beba-2369e04354dc tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:17.511986 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-620aa70c-abb7-4728-beba-2369e04354dc tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:17.518294 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-620aa70c-abb7-4728-beba-2369e04354dc tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:17.519648 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-620aa70c-abb7-4728-beba-2369e04354dc tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1407 microversion: 2.20 time: 0.262734 Jun 17 12:58:17.520388 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 72/150] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 12:58:17 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1407 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 12:58:17.893508 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-33462739-a0c8-4f56-9208-d6906b6dc4e4 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:58:17.893855 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-33462739-a0c8-4f56-9208-d6906b6dc4e4 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:58:17.899313 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-4ab348d6-425a-4cfd-909e-a4851a68d445 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:58:17.899922 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-4ab348d6-425a-4cfd-909e-a4851a68d445 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: cc3f5e1d-d03b-4fe4-b777-8aedac2761ce] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:58:17.903864 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_api:SELECT=93 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:58:17.911359 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4ab348d6-425a-4cfd-909e-a4851a68d445 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:17.911803 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4ab348d6-425a-4cfd-909e-a4851a68d445 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:17.912695 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4ab348d6-425a-4cfd-909e-a4851a68d445 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:17.913036 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4ab348d6-425a-4cfd-909e-a4851a68d445 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:17.918747 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-33462739-a0c8-4f56-9208-d6906b6dc4e4 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:17.919695 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-33462739-a0c8-4f56-9208-d6906b6dc4e4 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:17.920675 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-33462739-a0c8-4f56-9208-d6906b6dc4e4 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:17.921308 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-33462739-a0c8-4f56-9208-d6906b6dc4e4 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:18.156139 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-33462739-a0c8-4f56-9208-d6906b6dc4e4 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:18.166424 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-33462739-a0c8-4f56-9208-d6906b6dc4e4 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1363 microversion: 2.1 time: 0.277448 Jun 17 12:58:18.167683 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 79/151] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:58:17 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1363 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:58:18.208832 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-4ab348d6-425a-4cfd-909e-a4851a68d445 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:18.217926 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-4ab348d6-425a-4cfd-909e-a4851a68d445 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce" status: 200 len: 1321 microversion: 2.1 time: 0.322539 Jun 17 12:58:18.218586 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 73/152] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:58:17 2022] GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce => generated 1321 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:58:18.467133 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-4189682f-ea0b-4599-a922-46b191c89653 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:58:18.467954 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-4189682f-ea0b-4599-a922-46b191c89653 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] [instance: 73cb6bde-cad3-43ef-b361-62ff89b3544a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:58:18.475770 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4189682f-ea0b-4599-a922-46b191c89653 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:18.476209 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4189682f-ea0b-4599-a922-46b191c89653 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:18.477143 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4189682f-ea0b-4599-a922-46b191c89653 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:18.477724 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4189682f-ea0b-4599-a922-46b191c89653 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:18.539092 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-a765bb62-7cc7-4605-a25e-fd38ebfb4de8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:58:18.540443 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-a765bb62-7cc7-4605-a25e-fd38ebfb4de8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:58:18.550744 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a765bb62-7cc7-4605-a25e-fd38ebfb4de8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:18.553534 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a765bb62-7cc7-4605-a25e-fd38ebfb4de8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:18.558436 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a765bb62-7cc7-4605-a25e-fd38ebfb4de8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:18.559189 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a765bb62-7cc7-4605-a25e-fd38ebfb4de8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:18.787418 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-4189682f-ea0b-4599-a922-46b191c89653 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d0edf9b51d4370950f7ff503c324b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c048fb2cf4e491980fb65a8e32b0fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:18.807412 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-4189682f-ea0b-4599-a922-46b191c89653 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] 10.222.0.48 "GET /compute/v2.1/servers/73cb6bde-cad3-43ef-b361-62ff89b3544a" status: 200 len: 1314 microversion: 2.1 time: 0.343363 Jun 17 12:58:18.808273 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 80/153] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:58:18 2022] GET /compute/v2.1/servers/73cb6bde-cad3-43ef-b361-62ff89b3544a => generated 1314 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:58:18.973150 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-a765bb62-7cc7-4605-a25e-fd38ebfb4de8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:18.989137 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-a765bb62-7cc7-4605-a25e-fd38ebfb4de8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:18.995542 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-a765bb62-7cc7-4605-a25e-fd38ebfb4de8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:18.997867 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-a765bb62-7cc7-4605-a25e-fd38ebfb4de8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1407 microversion: 2.20 time: 0.463449 Jun 17 12:58:19.002660 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 74/154] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 12:58:18 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1407 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 12:58:19.187501 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-7219ad48-f81c-419a-b0cc-e8f3939baf62 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:58:19.188593 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-7219ad48-f81c-419a-b0cc-e8f3939baf62 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:58:19.201022 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7219ad48-f81c-419a-b0cc-e8f3939baf62 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:19.201946 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7219ad48-f81c-419a-b0cc-e8f3939baf62 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:19.203413 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7219ad48-f81c-419a-b0cc-e8f3939baf62 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:19.204349 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7219ad48-f81c-419a-b0cc-e8f3939baf62 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:19.234676 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-86da651f-a856-4a7b-b68e-34b7486543dd tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:58:19.235331 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-86da651f-a856-4a7b-b68e-34b7486543dd tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: cc3f5e1d-d03b-4fe4-b777-8aedac2761ce] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:58:19.246600 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-86da651f-a856-4a7b-b68e-34b7486543dd tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:19.247054 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-86da651f-a856-4a7b-b68e-34b7486543dd tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:19.250017 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-86da651f-a856-4a7b-b68e-34b7486543dd tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:19.252715 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-86da651f-a856-4a7b-b68e-34b7486543dd tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:19.479783 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-7219ad48-f81c-419a-b0cc-e8f3939baf62 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:19.491082 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-86da651f-a856-4a7b-b68e-34b7486543dd tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:19.494346 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-7219ad48-f81c-419a-b0cc-e8f3939baf62 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1363 microversion: 2.1 time: 0.314211 Jun 17 12:58:19.495772 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 81/155] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:58:19 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1363 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:58:19.500013 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-86da651f-a856-4a7b-b68e-34b7486543dd tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce" status: 200 len: 1321 microversion: 2.1 time: 0.268708 Jun 17 12:58:19.501284 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 75/156] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:58:19 2022] GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce => generated 1321 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 12:58:19.825956 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-4a494cc9-acf2-4f44-a324-135cd0b1fd63 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:58:19.826734 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-4a494cc9-acf2-4f44-a324-135cd0b1fd63 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] [instance: 73cb6bde-cad3-43ef-b361-62ff89b3544a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:58:19.833321 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4a494cc9-acf2-4f44-a324-135cd0b1fd63 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:19.833758 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4a494cc9-acf2-4f44-a324-135cd0b1fd63 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:19.834558 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4a494cc9-acf2-4f44-a324-135cd0b1fd63 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:19.835060 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4a494cc9-acf2-4f44-a324-135cd0b1fd63 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:20.015290 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-4a494cc9-acf2-4f44-a324-135cd0b1fd63 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d0edf9b51d4370950f7ff503c324b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c048fb2cf4e491980fb65a8e32b0fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:20.026118 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-a8b632b2-91d1-47b7-944b-ba5ecf43f381 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:58:20.026811 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-a8b632b2-91d1-47b7-944b-ba5ecf43f381 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:58:20.038108 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-4a494cc9-acf2-4f44-a324-135cd0b1fd63 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] 10.222.0.48 "GET /compute/v2.1/servers/73cb6bde-cad3-43ef-b361-62ff89b3544a" status: 200 len: 1314 microversion: 2.1 time: 0.215840 Jun 17 12:58:20.043012 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 82/157] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:58:19 2022] GET /compute/v2.1/servers/73cb6bde-cad3-43ef-b361-62ff89b3544a => generated 1314 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:58:20.044275 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a8b632b2-91d1-47b7-944b-ba5ecf43f381 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:20.044742 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a8b632b2-91d1-47b7-944b-ba5ecf43f381 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:20.045611 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a8b632b2-91d1-47b7-944b-ba5ecf43f381 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:20.046440 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a8b632b2-91d1-47b7-944b-ba5ecf43f381 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:20.228603 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-a8b632b2-91d1-47b7-944b-ba5ecf43f381 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:20.239215 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-a8b632b2-91d1-47b7-944b-ba5ecf43f381 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:20.241572 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-a8b632b2-91d1-47b7-944b-ba5ecf43f381 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:20.242824 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-a8b632b2-91d1-47b7-944b-ba5ecf43f381 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1407 microversion: 2.20 time: 0.221344 Jun 17 12:58:20.254421 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 76/158] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 12:58:20 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1407 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 12:58:20.516467 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-5b6bb5fb-23cf-43b7-a64c-1d41eaf95e43 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:58:20.517688 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-5b6bb5fb-23cf-43b7-a64c-1d41eaf95e43 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:58:20.517967 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-049a396f-3f4b-41a0-a0a1-b1846e324b58 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:58:20.518702 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-049a396f-3f4b-41a0-a0a1-b1846e324b58 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: cc3f5e1d-d03b-4fe4-b777-8aedac2761ce] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:58:20.522234 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_api:SELECT=92 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:58:20.526176 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5b6bb5fb-23cf-43b7-a64c-1d41eaf95e43 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:20.526620 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5b6bb5fb-23cf-43b7-a64c-1d41eaf95e43 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:20.527549 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5b6bb5fb-23cf-43b7-a64c-1d41eaf95e43 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:20.528514 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5b6bb5fb-23cf-43b7-a64c-1d41eaf95e43 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:20.536427 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-049a396f-3f4b-41a0-a0a1-b1846e324b58 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:20.536427 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-049a396f-3f4b-41a0-a0a1-b1846e324b58 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:20.538316 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-049a396f-3f4b-41a0-a0a1-b1846e324b58 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:20.540588 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-049a396f-3f4b-41a0-a0a1-b1846e324b58 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:20.756212 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-5b6bb5fb-23cf-43b7-a64c-1d41eaf95e43 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:20.765412 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-5b6bb5fb-23cf-43b7-a64c-1d41eaf95e43 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1363 microversion: 2.1 time: 0.256667 Jun 17 12:58:20.768888 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 83/159] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:58:20 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1363 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:58:20.774216 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [req-cb321fcd-0aa2-407d-b553-fcc65c607ded req-13f50180-bc90-4813-bce0-8ce69e01874c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "748a3422-aeab-41c8-b051-df5f7d7ca509", "name": "network-vif-plugged", "status": "completed", "tag": "87583636-e590-4c87-87ad-1151137bd889"}]} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 12:58:20.796936 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-cb321fcd-0aa2-407d-b553-fcc65c607ded req-13f50180-bc90-4813-bce0-8ce69e01874c service nova] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:20.797678 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-cb321fcd-0aa2-407d-b553-fcc65c607ded req-13f50180-bc90-4813-bce0-8ce69e01874c service nova] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:20.803708 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=100 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:58:20.814849 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.compute.server_external_events [req-cb321fcd-0aa2-407d-b553-fcc65c607ded req-13f50180-bc90-4813-bce0-8ce69e01874c service nova] Creating event network-vif-plugged:87583636-e590-4c87-87ad-1151137bd889 for instance 748a3422-aeab-41c8-b051-df5f7d7ca509 on hv-cinder-83754 Jun 17 12:58:20.820562 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [req-cb321fcd-0aa2-407d-b553-fcc65c607ded req-13f50180-bc90-4813-bce0-8ce69e01874c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050305 Jun 17 12:58:20.821539 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 84/160] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 12:58:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:58:20.849979 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-049a396f-3f4b-41a0-a0a1-b1846e324b58 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:20.861831 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-049a396f-3f4b-41a0-a0a1-b1846e324b58 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce" status: 200 len: 1321 microversion: 2.1 time: 0.348595 Jun 17 12:58:20.862900 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 77/161] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:58:20 2022] GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce => generated 1321 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:58:21.060606 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-9169e331-3be7-4d2e-a019-f3df344c36c3 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:58:21.061837 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-9169e331-3be7-4d2e-a019-f3df344c36c3 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] [instance: 73cb6bde-cad3-43ef-b361-62ff89b3544a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:58:21.070936 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9169e331-3be7-4d2e-a019-f3df344c36c3 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:21.071542 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9169e331-3be7-4d2e-a019-f3df344c36c3 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:21.072652 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9169e331-3be7-4d2e-a019-f3df344c36c3 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:21.074042 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9169e331-3be7-4d2e-a019-f3df344c36c3 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:21.261691 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-c7e928ea-58d5-4e17-820f-5e700eb40ba6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:58:21.263522 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-c7e928ea-58d5-4e17-820f-5e700eb40ba6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:58:21.271729 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c7e928ea-58d5-4e17-820f-5e700eb40ba6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:21.272390 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c7e928ea-58d5-4e17-820f-5e700eb40ba6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:21.273674 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c7e928ea-58d5-4e17-820f-5e700eb40ba6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:21.274372 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c7e928ea-58d5-4e17-820f-5e700eb40ba6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:21.280884 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-9169e331-3be7-4d2e-a019-f3df344c36c3 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d0edf9b51d4370950f7ff503c324b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c048fb2cf4e491980fb65a8e32b0fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:21.292441 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-9169e331-3be7-4d2e-a019-f3df344c36c3 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] 10.222.0.48 "GET /compute/v2.1/servers/73cb6bde-cad3-43ef-b361-62ff89b3544a" status: 200 len: 1314 microversion: 2.1 time: 0.236553 Jun 17 12:58:21.293048 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 85/162] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:58:21 2022] GET /compute/v2.1/servers/73cb6bde-cad3-43ef-b361-62ff89b3544a => generated 1314 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:58:21.512839 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-c7e928ea-58d5-4e17-820f-5e700eb40ba6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:21.521611 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-c7e928ea-58d5-4e17-820f-5e700eb40ba6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:21.523452 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-c7e928ea-58d5-4e17-820f-5e700eb40ba6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:21.525038 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-c7e928ea-58d5-4e17-820f-5e700eb40ba6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1407 microversion: 2.20 time: 0.267256 Jun 17 12:58:21.525726 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 78/163] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 12:58:21 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1407 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 12:58:21.785553 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-7a5cc933-6ebe-44ca-b7a2-ce81d55bc887 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:58:21.786750 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-7a5cc933-6ebe-44ca-b7a2-ce81d55bc887 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:58:21.793040 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7a5cc933-6ebe-44ca-b7a2-ce81d55bc887 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:21.793478 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7a5cc933-6ebe-44ca-b7a2-ce81d55bc887 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:21.794269 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7a5cc933-6ebe-44ca-b7a2-ce81d55bc887 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:21.794721 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7a5cc933-6ebe-44ca-b7a2-ce81d55bc887 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:21.881316 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-e7d320ad-9c18-4b5b-b2f2-cda344cf5332 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:58:21.882327 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-e7d320ad-9c18-4b5b-b2f2-cda344cf5332 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: cc3f5e1d-d03b-4fe4-b777-8aedac2761ce] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:58:21.896441 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e7d320ad-9c18-4b5b-b2f2-cda344cf5332 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:21.897271 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e7d320ad-9c18-4b5b-b2f2-cda344cf5332 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:21.898390 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e7d320ad-9c18-4b5b-b2f2-cda344cf5332 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:21.901218 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e7d320ad-9c18-4b5b-b2f2-cda344cf5332 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:21.959764 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-7a5cc933-6ebe-44ca-b7a2-ce81d55bc887 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:21.971370 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-7a5cc933-6ebe-44ca-b7a2-ce81d55bc887 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1363 microversion: 2.1 time: 0.189846 Jun 17 12:58:21.972366 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 86/164] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:58:21 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1363 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 12:58:22.099718 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-e7d320ad-9c18-4b5b-b2f2-cda344cf5332 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:22.112930 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-e7d320ad-9c18-4b5b-b2f2-cda344cf5332 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce" status: 200 len: 1321 microversion: 2.1 time: 0.235953 Jun 17 12:58:22.114104 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 79/165] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:58:21 2022] GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce => generated 1321 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 12:58:22.315031 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-dd133d18-808f-4c55-9bb0-4c5b907ee40a tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:58:22.315738 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-dd133d18-808f-4c55-9bb0-4c5b907ee40a tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] [instance: 73cb6bde-cad3-43ef-b361-62ff89b3544a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:58:22.335211 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dd133d18-808f-4c55-9bb0-4c5b907ee40a tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:22.335211 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dd133d18-808f-4c55-9bb0-4c5b907ee40a tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:22.335211 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dd133d18-808f-4c55-9bb0-4c5b907ee40a tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:22.335211 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dd133d18-808f-4c55-9bb0-4c5b907ee40a tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:22.545178 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-00b1dd23-c268-42c3-a2c3-c962d8c601be tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:58:22.546426 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-00b1dd23-c268-42c3-a2c3-c962d8c601be tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:58:22.561044 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-00b1dd23-c268-42c3-a2c3-c962d8c601be tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:22.563124 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-00b1dd23-c268-42c3-a2c3-c962d8c601be tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:22.565610 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-00b1dd23-c268-42c3-a2c3-c962d8c601be tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:22.566339 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-00b1dd23-c268-42c3-a2c3-c962d8c601be tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:22.809277 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-dd133d18-808f-4c55-9bb0-4c5b907ee40a tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d0edf9b51d4370950f7ff503c324b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c048fb2cf4e491980fb65a8e32b0fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:22.848666 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-dd133d18-808f-4c55-9bb0-4c5b907ee40a tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] 10.222.0.48 "GET /compute/v2.1/servers/73cb6bde-cad3-43ef-b361-62ff89b3544a" status: 200 len: 1314 microversion: 2.1 time: 0.518700 Jun 17 12:58:22.849932 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 87/166] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:58:22 2022] GET /compute/v2.1/servers/73cb6bde-cad3-43ef-b361-62ff89b3544a => generated 1314 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:58:22.933967 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [req-e608f1a1-683f-4d21-a2bd-6f780e771089 req-602a6859-71c0-4a8f-84c3-a051b7ef0d7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8fdea98-917f-4c4d-aaba-d4f5df4622d6", "name": "network-vif-plugged", "status": "completed", "tag": "936c48d1-9e45-4b7e-9fa7-86ea87893b56"}]} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 12:58:22.959522 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-e608f1a1-683f-4d21-a2bd-6f780e771089 req-602a6859-71c0-4a8f-84c3-a051b7ef0d7b service nova] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:22.960607 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-e608f1a1-683f-4d21-a2bd-6f780e771089 req-602a6859-71c0-4a8f-84c3-a051b7ef0d7b service nova] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:22.986619 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.compute.server_external_events [req-e608f1a1-683f-4d21-a2bd-6f780e771089 req-602a6859-71c0-4a8f-84c3-a051b7ef0d7b service nova] Creating event network-vif-plugged:936c48d1-9e45-4b7e-9fa7-86ea87893b56 for instance c8fdea98-917f-4c4d-aaba-d4f5df4622d6 on hv-cinder-83754 Jun 17 12:58:22.997283 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [req-e608f1a1-683f-4d21-a2bd-6f780e771089 req-602a6859-71c0-4a8f-84c3-a051b7ef0d7b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071388 Jun 17 12:58:23.001396 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 88/167] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 12:58:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:58:23.030490 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-2ec8f1d3-8f25-4c0b-a131-e2214771f5f8 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:58:23.033193 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-2ec8f1d3-8f25-4c0b-a131-e2214771f5f8 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:58:23.047008 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-00b1dd23-c268-42c3-a2c3-c962d8c601be tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:23.061489 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2ec8f1d3-8f25-4c0b-a131-e2214771f5f8 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:23.061829 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-00b1dd23-c268-42c3-a2c3-c962d8c601be tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:23.061971 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2ec8f1d3-8f25-4c0b-a131-e2214771f5f8 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:23.062745 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2ec8f1d3-8f25-4c0b-a131-e2214771f5f8 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:23.063190 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2ec8f1d3-8f25-4c0b-a131-e2214771f5f8 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:23.064761 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-00b1dd23-c268-42c3-a2c3-c962d8c601be tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:23.066581 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-00b1dd23-c268-42c3-a2c3-c962d8c601be tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1407 microversion: 2.20 time: 0.526356 Jun 17 12:58:23.079604 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 80/168] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 12:58:22 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1407 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 12:58:23.135657 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-9d1a5ef6-a8f4-4170-aa29-9a124e19a9eb tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:58:23.136414 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-9d1a5ef6-a8f4-4170-aa29-9a124e19a9eb tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: cc3f5e1d-d03b-4fe4-b777-8aedac2761ce] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:58:23.145361 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9d1a5ef6-a8f4-4170-aa29-9a124e19a9eb tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:23.146037 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9d1a5ef6-a8f4-4170-aa29-9a124e19a9eb tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:23.148042 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9d1a5ef6-a8f4-4170-aa29-9a124e19a9eb tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:23.149830 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9d1a5ef6-a8f4-4170-aa29-9a124e19a9eb tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:23.174505 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_cell1:SELECT=100 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:58:23.334805 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-2ec8f1d3-8f25-4c0b-a131-e2214771f5f8 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:23.343029 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-2ec8f1d3-8f25-4c0b-a131-e2214771f5f8 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1363 microversion: 2.1 time: 0.337508 Jun 17 12:58:23.344156 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 89/169] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:58:23 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1363 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:58:23.397029 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-9d1a5ef6-a8f4-4170-aa29-9a124e19a9eb tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:23.411164 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-9d1a5ef6-a8f4-4170-aa29-9a124e19a9eb tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce" status: 200 len: 1321 microversion: 2.1 time: 0.280579 Jun 17 12:58:23.426466 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 81/170] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:58:23 2022] GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce => generated 1321 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:58:23.867234 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-8afd8318-3b79-4f7b-981f-3d83146b3aca tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:58:23.868379 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-8afd8318-3b79-4f7b-981f-3d83146b3aca tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] [instance: 73cb6bde-cad3-43ef-b361-62ff89b3544a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:58:23.875207 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8afd8318-3b79-4f7b-981f-3d83146b3aca tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:23.875920 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8afd8318-3b79-4f7b-981f-3d83146b3aca tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:23.877715 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8afd8318-3b79-4f7b-981f-3d83146b3aca tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:23.878626 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8afd8318-3b79-4f7b-981f-3d83146b3aca tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:24.090719 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-34f563ae-8d8b-4bde-87d3-1d93fbae295c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:58:24.092209 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-34f563ae-8d8b-4bde-87d3-1d93fbae295c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:58:24.102802 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-34f563ae-8d8b-4bde-87d3-1d93fbae295c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:24.103748 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-34f563ae-8d8b-4bde-87d3-1d93fbae295c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:24.104223 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-8afd8318-3b79-4f7b-981f-3d83146b3aca tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d0edf9b51d4370950f7ff503c324b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c048fb2cf4e491980fb65a8e32b0fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:24.105399 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-34f563ae-8d8b-4bde-87d3-1d93fbae295c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:24.105980 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-34f563ae-8d8b-4bde-87d3-1d93fbae295c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:24.125600 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-8afd8318-3b79-4f7b-981f-3d83146b3aca tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] 10.222.0.48 "GET /compute/v2.1/servers/73cb6bde-cad3-43ef-b361-62ff89b3544a" status: 200 len: 1314 microversion: 2.1 time: 0.257071 Jun 17 12:58:24.127673 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 90/171] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:58:23 2022] GET /compute/v2.1/servers/73cb6bde-cad3-43ef-b361-62ff89b3544a => generated 1314 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:58:24.346276 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-34f563ae-8d8b-4bde-87d3-1d93fbae295c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:24.370842 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-730ecc74-9e6c-43c5-806a-818ed99bea7a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:58:24.372019 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-730ecc74-9e6c-43c5-806a-818ed99bea7a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:58:24.405849 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-34f563ae-8d8b-4bde-87d3-1d93fbae295c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:24.413071 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-730ecc74-9e6c-43c5-806a-818ed99bea7a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:24.414124 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-730ecc74-9e6c-43c5-806a-818ed99bea7a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:24.423382 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-34f563ae-8d8b-4bde-87d3-1d93fbae295c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:24.426469 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-34f563ae-8d8b-4bde-87d3-1d93fbae295c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1407 microversion: 2.20 time: 0.342415 Jun 17 12:58:24.427057 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 82/172] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 12:58:24 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1407 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 12:58:24.428341 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-730ecc74-9e6c-43c5-806a-818ed99bea7a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:24.429060 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-730ecc74-9e6c-43c5-806a-818ed99bea7a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:24.442178 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-b38dc6d4-d49e-442f-8c2f-461b41ac8992 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:58:24.442978 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-b38dc6d4-d49e-442f-8c2f-461b41ac8992 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: cc3f5e1d-d03b-4fe4-b777-8aedac2761ce] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:58:24.450681 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b38dc6d4-d49e-442f-8c2f-461b41ac8992 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:24.450938 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b38dc6d4-d49e-442f-8c2f-461b41ac8992 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:24.451867 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b38dc6d4-d49e-442f-8c2f-461b41ac8992 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:24.452446 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b38dc6d4-d49e-442f-8c2f-461b41ac8992 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:24.721616 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-b38dc6d4-d49e-442f-8c2f-461b41ac8992 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:24.724827 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-730ecc74-9e6c-43c5-806a-818ed99bea7a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:24.734804 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-730ecc74-9e6c-43c5-806a-818ed99bea7a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1363 microversion: 2.1 time: 0.371006 Jun 17 12:58:24.735501 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 91/173] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:58:24 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1363 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:58:24.747883 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-b38dc6d4-d49e-442f-8c2f-461b41ac8992 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce" status: 200 len: 1321 microversion: 2.1 time: 0.313130 Jun 17 12:58:24.748483 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 83/174] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:58:24 2022] GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce => generated 1321 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:58:25.156610 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-e27bbd37-41ae-4598-962e-141f15c32f13 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:58:25.157743 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-e27bbd37-41ae-4598-962e-141f15c32f13 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] [instance: 73cb6bde-cad3-43ef-b361-62ff89b3544a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:58:25.169071 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e27bbd37-41ae-4598-962e-141f15c32f13 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:25.169778 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e27bbd37-41ae-4598-962e-141f15c32f13 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:25.171131 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e27bbd37-41ae-4598-962e-141f15c32f13 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:25.172165 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e27bbd37-41ae-4598-962e-141f15c32f13 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:25.403772 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-e27bbd37-41ae-4598-962e-141f15c32f13 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d0edf9b51d4370950f7ff503c324b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c048fb2cf4e491980fb65a8e32b0fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:25.414046 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-e27bbd37-41ae-4598-962e-141f15c32f13 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] 10.222.0.48 "GET /compute/v2.1/servers/73cb6bde-cad3-43ef-b361-62ff89b3544a" status: 200 len: 1314 microversion: 2.1 time: 0.264338 Jun 17 12:58:25.414974 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 92/175] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:58:25 2022] GET /compute/v2.1/servers/73cb6bde-cad3-43ef-b361-62ff89b3544a => generated 1314 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:58:25.459845 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-2bd29f11-b3a1-4190-8dcc-c99826a7759b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:58:25.460840 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-2bd29f11-b3a1-4190-8dcc-c99826a7759b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:58:25.472538 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2bd29f11-b3a1-4190-8dcc-c99826a7759b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:25.473701 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2bd29f11-b3a1-4190-8dcc-c99826a7759b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:25.475125 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2bd29f11-b3a1-4190-8dcc-c99826a7759b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:25.476108 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2bd29f11-b3a1-4190-8dcc-c99826a7759b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:25.721257 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-2bd29f11-b3a1-4190-8dcc-c99826a7759b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:25.738706 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-2bd29f11-b3a1-4190-8dcc-c99826a7759b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:25.740925 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-2bd29f11-b3a1-4190-8dcc-c99826a7759b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:25.742944 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-2bd29f11-b3a1-4190-8dcc-c99826a7759b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1407 microversion: 2.20 time: 0.290784 Jun 17 12:58:25.743989 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 84/176] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 12:58:25 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1407 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 12:58:25.754004 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-141560be-dc6d-47d2-abb4-e3676901b980 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:58:25.754961 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-141560be-dc6d-47d2-abb4-e3676901b980 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:58:25.762005 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-141560be-dc6d-47d2-abb4-e3676901b980 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:25.762872 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-141560be-dc6d-47d2-abb4-e3676901b980 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:25.763832 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-141560be-dc6d-47d2-abb4-e3676901b980 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:25.764437 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-141560be-dc6d-47d2-abb4-e3676901b980 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:25.777085 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-bf225f72-a671-4c9c-b953-2b66eb26ba90 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:58:25.779382 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-bf225f72-a671-4c9c-b953-2b66eb26ba90 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: cc3f5e1d-d03b-4fe4-b777-8aedac2761ce] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:58:25.793087 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-bf225f72-a671-4c9c-b953-2b66eb26ba90 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:25.794387 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-bf225f72-a671-4c9c-b953-2b66eb26ba90 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:25.795580 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-bf225f72-a671-4c9c-b953-2b66eb26ba90 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:25.796287 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-bf225f72-a671-4c9c-b953-2b66eb26ba90 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:26.104569 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-141560be-dc6d-47d2-abb4-e3676901b980 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:26.116355 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-141560be-dc6d-47d2-abb4-e3676901b980 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1363 microversion: 2.1 time: 0.367009 Jun 17 12:58:26.117984 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 93/177] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:58:25 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1363 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 12:58:26.144219 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-bf225f72-a671-4c9c-b953-2b66eb26ba90 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:26.154817 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-bf225f72-a671-4c9c-b953-2b66eb26ba90 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce" status: 200 len: 1321 microversion: 2.1 time: 0.388066 Jun 17 12:58:26.156175 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 85/178] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:58:25 2022] GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce => generated 1321 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:58:26.434442 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-1425565c-5f51-4e94-8182-15d84a93a4c3 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:58:26.436152 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-1425565c-5f51-4e94-8182-15d84a93a4c3 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] [instance: 73cb6bde-cad3-43ef-b361-62ff89b3544a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:58:26.445137 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1425565c-5f51-4e94-8182-15d84a93a4c3 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:26.446181 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1425565c-5f51-4e94-8182-15d84a93a4c3 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:26.446986 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1425565c-5f51-4e94-8182-15d84a93a4c3 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:26.447424 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1425565c-5f51-4e94-8182-15d84a93a4c3 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:26.740374 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-1425565c-5f51-4e94-8182-15d84a93a4c3 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d0edf9b51d4370950f7ff503c324b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c048fb2cf4e491980fb65a8e32b0fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:26.753801 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-1425565c-5f51-4e94-8182-15d84a93a4c3 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] 10.222.0.48 "GET /compute/v2.1/servers/73cb6bde-cad3-43ef-b361-62ff89b3544a" status: 200 len: 1314 microversion: 2.1 time: 0.323087 Jun 17 12:58:26.755050 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 94/179] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:58:26 2022] GET /compute/v2.1/servers/73cb6bde-cad3-43ef-b361-62ff89b3544a => generated 1314 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 12:58:26.780166 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-f3421822-c5c0-44d0-8efc-d7f184198c88 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:58:26.781089 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-f3421822-c5c0-44d0-8efc-d7f184198c88 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:58:26.788424 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f3421822-c5c0-44d0-8efc-d7f184198c88 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:26.789109 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f3421822-c5c0-44d0-8efc-d7f184198c88 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:26.790124 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f3421822-c5c0-44d0-8efc-d7f184198c88 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:26.790810 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f3421822-c5c0-44d0-8efc-d7f184198c88 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:26.978598 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-f3421822-c5c0-44d0-8efc-d7f184198c88 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:26.995031 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-f3421822-c5c0-44d0-8efc-d7f184198c88 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:26.998674 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-f3421822-c5c0-44d0-8efc-d7f184198c88 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:27.001775 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-f3421822-c5c0-44d0-8efc-d7f184198c88 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1407 microversion: 2.20 time: 0.227801 Jun 17 12:58:27.003349 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 86/180] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 12:58:26 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1407 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 12:58:27.150575 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-ad584dfa-4c88-4469-9f01-380e788bb7ce tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:58:27.152149 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-ad584dfa-4c88-4469-9f01-380e788bb7ce tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:58:27.175792 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ad584dfa-4c88-4469-9f01-380e788bb7ce tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:27.176820 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ad584dfa-4c88-4469-9f01-380e788bb7ce tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:27.178521 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ad584dfa-4c88-4469-9f01-380e788bb7ce tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:27.179928 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ad584dfa-4c88-4469-9f01-380e788bb7ce tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:27.183268 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-addfe63a-9c95-469d-91e7-9e6d90e9be7d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:58:27.186579 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-addfe63a-9c95-469d-91e7-9e6d90e9be7d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: cc3f5e1d-d03b-4fe4-b777-8aedac2761ce] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:58:27.203639 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-addfe63a-9c95-469d-91e7-9e6d90e9be7d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:27.207020 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-addfe63a-9c95-469d-91e7-9e6d90e9be7d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:27.208223 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-addfe63a-9c95-469d-91e7-9e6d90e9be7d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:27.211051 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-addfe63a-9c95-469d-91e7-9e6d90e9be7d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:27.633615 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-ad584dfa-4c88-4469-9f01-380e788bb7ce tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:27.645798 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-addfe63a-9c95-469d-91e7-9e6d90e9be7d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:27.667607 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-addfe63a-9c95-469d-91e7-9e6d90e9be7d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce" status: 200 len: 1321 microversion: 2.1 time: 0.494272 Jun 17 12:58:27.668223 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 87/181] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:58:27 2022] GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce => generated 1321 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 12:58:27.671279 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-ad584dfa-4c88-4469-9f01-380e788bb7ce tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1363 microversion: 2.1 time: 0.530924 Jun 17 12:58:27.686822 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 95/182] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:58:27 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1363 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:58:27.773874 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-510532f1-a511-4513-bbe8-888a332ae20b tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:58:27.774950 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-510532f1-a511-4513-bbe8-888a332ae20b tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] [instance: 73cb6bde-cad3-43ef-b361-62ff89b3544a] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:58:27.782366 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-510532f1-a511-4513-bbe8-888a332ae20b tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:27.783850 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-510532f1-a511-4513-bbe8-888a332ae20b tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:27.784715 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-510532f1-a511-4513-bbe8-888a332ae20b tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:27.785212 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-510532f1-a511-4513-bbe8-888a332ae20b tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:28.004262 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-510532f1-a511-4513-bbe8-888a332ae20b tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d0edf9b51d4370950f7ff503c324b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c048fb2cf4e491980fb65a8e32b0fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:28.015328 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-510532f1-a511-4513-bbe8-888a332ae20b tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] 10.222.0.48 "GET /compute/v2.1/servers/73cb6bde-cad3-43ef-b361-62ff89b3544a" status: 200 len: 1314 microversion: 2.1 time: 0.245671 Jun 17 12:58:28.016472 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 88/183] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:58:27 2022] GET /compute/v2.1/servers/73cb6bde-cad3-43ef-b361-62ff89b3544a => generated 1314 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:58:28.034487 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-0364a191-62af-4c77-89c0-acf65660dfd1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:58:28.035346 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-0364a191-62af-4c77-89c0-acf65660dfd1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:58:28.044217 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0364a191-62af-4c77-89c0-acf65660dfd1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:28.045069 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0364a191-62af-4c77-89c0-acf65660dfd1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:28.046154 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0364a191-62af-4c77-89c0-acf65660dfd1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:28.046757 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0364a191-62af-4c77-89c0-acf65660dfd1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:28.245918 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-0364a191-62af-4c77-89c0-acf65660dfd1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:28.259385 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-0364a191-62af-4c77-89c0-acf65660dfd1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:28.263023 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-0364a191-62af-4c77-89c0-acf65660dfd1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:28.265238 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-0364a191-62af-4c77-89c0-acf65660dfd1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1407 microversion: 2.20 time: 0.235366 Jun 17 12:58:28.272398 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 96/184] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 12:58:28 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1407 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 12:58:28.692422 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-aefebf1d-9012-42fe-8eab-cfc55473447e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:58:28.694752 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-aefebf1d-9012-42fe-8eab-cfc55473447e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: cc3f5e1d-d03b-4fe4-b777-8aedac2761ce] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:58:28.709142 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-aefebf1d-9012-42fe-8eab-cfc55473447e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:28.709929 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-60536028-67d5-4cae-9802-0fb115fcca00 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:58:28.711386 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-aefebf1d-9012-42fe-8eab-cfc55473447e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:28.713182 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-aefebf1d-9012-42fe-8eab-cfc55473447e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:28.714188 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-60536028-67d5-4cae-9802-0fb115fcca00 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:58:28.714612 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-aefebf1d-9012-42fe-8eab-cfc55473447e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:28.737832 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-60536028-67d5-4cae-9802-0fb115fcca00 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:28.739709 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-60536028-67d5-4cae-9802-0fb115fcca00 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:28.741861 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-60536028-67d5-4cae-9802-0fb115fcca00 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:28.743480 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-60536028-67d5-4cae-9802-0fb115fcca00 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:29.294858 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-aefebf1d-9012-42fe-8eab-cfc55473447e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:29.325683 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-aefebf1d-9012-42fe-8eab-cfc55473447e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce" status: 200 len: 1321 microversion: 2.1 time: 0.643627 Jun 17 12:58:29.340636 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 89/185] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:58:28 2022] GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce => generated 1321 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:58:29.349820 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-b140e433-9ff9-4b3e-84a7-9910c0ce5977 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:58:29.350902 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-b140e433-9ff9-4b3e-84a7-9910c0ce5977 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] [instance: 73cb6bde-cad3-43ef-b361-62ff89b3544a] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:58:29.353913 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-60536028-67d5-4cae-9802-0fb115fcca00 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:29.364820 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-60536028-67d5-4cae-9802-0fb115fcca00 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1363 microversion: 2.1 time: 0.671630 Jun 17 12:58:29.365945 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 97/186] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:58:28 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1363 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:58:29.368622 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b140e433-9ff9-4b3e-84a7-9910c0ce5977 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:29.369635 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b140e433-9ff9-4b3e-84a7-9910c0ce5977 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:29.371166 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b140e433-9ff9-4b3e-84a7-9910c0ce5977 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:29.371942 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b140e433-9ff9-4b3e-84a7-9910c0ce5977 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:29.373405 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [req-9a00fcfd-d039-4a5e-af7b-871758e8b295 req-d07ed7d3-6490-4df8-9174-eaf0aad443f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73cb6bde-cad3-43ef-b361-62ff89b3544a", "name": "network-vif-plugged", "status": "completed", "tag": "ebd11c69-50dc-4ab5-8c90-8d32c0d1f010"}]} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 12:58:29.391466 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-9a00fcfd-d039-4a5e-af7b-871758e8b295 req-d07ed7d3-6490-4df8-9174-eaf0aad443f6 service nova] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:29.394169 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-9a00fcfd-d039-4a5e-af7b-871758e8b295 req-d07ed7d3-6490-4df8-9174-eaf0aad443f6 service nova] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:29.415779 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.compute.server_external_events [req-9a00fcfd-d039-4a5e-af7b-871758e8b295 req-d07ed7d3-6490-4df8-9174-eaf0aad443f6 service nova] Creating event network-vif-plugged:ebd11c69-50dc-4ab5-8c90-8d32c0d1f010 for instance 73cb6bde-cad3-43ef-b361-62ff89b3544a on hv-cinder-83754 Jun 17 12:58:29.425618 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [req-9a00fcfd-d039-4a5e-af7b-871758e8b295 req-d07ed7d3-6490-4df8-9174-eaf0aad443f6 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057693 Jun 17 12:58:29.427634 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 98/187] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 12:58:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:58:29.436399 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-117dbc8e-9ed5-4a2d-ae6c-f049aec68365 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:58:29.437670 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-117dbc8e-9ed5-4a2d-ae6c-f049aec68365 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:58:29.448883 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-117dbc8e-9ed5-4a2d-ae6c-f049aec68365 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:29.449609 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-117dbc8e-9ed5-4a2d-ae6c-f049aec68365 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:29.451151 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-117dbc8e-9ed5-4a2d-ae6c-f049aec68365 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:29.451870 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-117dbc8e-9ed5-4a2d-ae6c-f049aec68365 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:29.869191 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-b140e433-9ff9-4b3e-84a7-9910c0ce5977 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d0edf9b51d4370950f7ff503c324b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c048fb2cf4e491980fb65a8e32b0fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:29.881146 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-b140e433-9ff9-4b3e-84a7-9910c0ce5977 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] 10.222.0.48 "GET /compute/v2.1/servers/73cb6bde-cad3-43ef-b361-62ff89b3544a" status: 200 len: 1314 microversion: 2.1 time: 0.537860 Jun 17 12:58:29.882151 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 90/188] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:58:29 2022] GET /compute/v2.1/servers/73cb6bde-cad3-43ef-b361-62ff89b3544a => generated 1314 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:58:29.914743 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-117dbc8e-9ed5-4a2d-ae6c-f049aec68365 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:29.934974 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-117dbc8e-9ed5-4a2d-ae6c-f049aec68365 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:29.939092 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-117dbc8e-9ed5-4a2d-ae6c-f049aec68365 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:29.942504 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-117dbc8e-9ed5-4a2d-ae6c-f049aec68365 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1407 microversion: 2.20 time: 0.513184 Jun 17 12:58:29.948424 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 99/189] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 12:58:29 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1407 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 12:58:30.348757 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-05f41b12-f911-4bc3-bd01-52b7df8843bd tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:58:30.362024 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-05f41b12-f911-4bc3-bd01-52b7df8843bd tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: cc3f5e1d-d03b-4fe4-b777-8aedac2761ce] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:58:30.368360 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-05f41b12-f911-4bc3-bd01-52b7df8843bd tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:30.369167 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-05f41b12-f911-4bc3-bd01-52b7df8843bd tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:30.370290 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-05f41b12-f911-4bc3-bd01-52b7df8843bd tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:30.370967 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-05f41b12-f911-4bc3-bd01-52b7df8843bd tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:30.407042 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-ba8e042c-510d-482f-bd1b-0f8f2dcfb2b1 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:58:30.411558 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-ba8e042c-510d-482f-bd1b-0f8f2dcfb2b1 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:58:30.441950 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ba8e042c-510d-482f-bd1b-0f8f2dcfb2b1 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:30.447178 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ba8e042c-510d-482f-bd1b-0f8f2dcfb2b1 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:30.447178 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ba8e042c-510d-482f-bd1b-0f8f2dcfb2b1 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:30.447178 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ba8e042c-510d-482f-bd1b-0f8f2dcfb2b1 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:31.012260 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-05f41b12-f911-4bc3-bd01-52b7df8843bd tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:31.023450 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-05f41b12-f911-4bc3-bd01-52b7df8843bd tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce" status: 200 len: 1321 microversion: 2.1 time: 0.679914 Jun 17 12:58:31.034583 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-ba8e042c-510d-482f-bd1b-0f8f2dcfb2b1 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:31.035877 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 91/190] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:58:30 2022] GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce => generated 1321 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 12:58:31.041577 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-aadd7351-4fcd-45ea-855a-972a8d0aea42 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:58:31.042559 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-aadd7351-4fcd-45ea-855a-972a8d0aea42 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] [instance: 73cb6bde-cad3-43ef-b361-62ff89b3544a] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:58:31.049752 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-aadd7351-4fcd-45ea-855a-972a8d0aea42 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:31.050621 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-aadd7351-4fcd-45ea-855a-972a8d0aea42 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:31.051227 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-ba8e042c-510d-482f-bd1b-0f8f2dcfb2b1 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1549 microversion: 2.1 time: 0.657745 Jun 17 12:58:31.052162 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-aadd7351-4fcd-45ea-855a-972a8d0aea42 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:31.053023 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-aadd7351-4fcd-45ea-855a-972a8d0aea42 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:31.061238 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 100/191] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:58:30 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1549 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:58:31.075799 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-fd3561bc-d1b4-435e-9ebc-15df4023e694 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:58:31.079495 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-fd3561bc-d1b4-435e-9ebc-15df4023e694 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:58:31.089955 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fd3561bc-d1b4-435e-9ebc-15df4023e694 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:31.090579 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fd3561bc-d1b4-435e-9ebc-15df4023e694 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:31.091633 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fd3561bc-d1b4-435e-9ebc-15df4023e694 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:31.092246 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fd3561bc-d1b4-435e-9ebc-15df4023e694 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:31.583436 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-fd3561bc-d1b4-435e-9ebc-15df4023e694 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:31.602937 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-fd3561bc-d1b4-435e-9ebc-15df4023e694 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:31.608383 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-fd3561bc-d1b4-435e-9ebc-15df4023e694 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:31.611392 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-fd3561bc-d1b4-435e-9ebc-15df4023e694 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1407 microversion: 2.20 time: 0.548679 Jun 17 12:58:31.612284 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 101/192] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 12:58:31 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1407 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 12:58:31.622355 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-4cd5881f-9307-48cb-9740-89f0bb831cfc tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:58:31.622355 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-4cd5881f-9307-48cb-9740-89f0bb831cfc tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:58:31.641441 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4cd5881f-9307-48cb-9740-89f0bb831cfc tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:31.642600 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4cd5881f-9307-48cb-9740-89f0bb831cfc tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:31.644676 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4cd5881f-9307-48cb-9740-89f0bb831cfc tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:31.645321 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4cd5881f-9307-48cb-9740-89f0bb831cfc tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:31.665268 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-aadd7351-4fcd-45ea-855a-972a8d0aea42 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d0edf9b51d4370950f7ff503c324b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c048fb2cf4e491980fb65a8e32b0fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:31.689274 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-aadd7351-4fcd-45ea-855a-972a8d0aea42 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] 10.222.0.48 "GET /compute/v2.1/servers/73cb6bde-cad3-43ef-b361-62ff89b3544a" status: 200 len: 1314 microversion: 2.1 time: 0.648218 Jun 17 12:58:31.691911 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 92/193] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:58:31 2022] GET /compute/v2.1/servers/73cb6bde-cad3-43ef-b361-62ff89b3544a => generated 1314 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:58:31.865405 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-4cd5881f-9307-48cb-9740-89f0bb831cfc tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.251182 Jun 17 12:58:31.866684 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 102/194] 10.222.0.48 () {58 vars in 1274 bytes} [Fri Jun 17 12:58:31 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-interface => generated 284 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:58:32.049023 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-946faadf-8661-400b-a5eb-0f2c7e610e1a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:58:32.051602 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-946faadf-8661-400b-a5eb-0f2c7e610e1a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: cc3f5e1d-d03b-4fe4-b777-8aedac2761ce] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:58:32.080406 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-946faadf-8661-400b-a5eb-0f2c7e610e1a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:32.082534 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-946faadf-8661-400b-a5eb-0f2c7e610e1a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:32.084138 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-946faadf-8661-400b-a5eb-0f2c7e610e1a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:32.085126 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-946faadf-8661-400b-a5eb-0f2c7e610e1a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:32.615808 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-946faadf-8661-400b-a5eb-0f2c7e610e1a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:32.636776 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-946faadf-8661-400b-a5eb-0f2c7e610e1a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce" status: 200 len: 1514 microversion: 2.1 time: 0.595515 Jun 17 12:58:32.636776 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 93/195] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:58:32 2022] GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce => generated 1514 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:58:32.662261 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-b66de769-36d7-4bc7-a4b1-db93dd4e7528 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:58:32.664447 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-b66de769-36d7-4bc7-a4b1-db93dd4e7528 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:58:32.701620 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-ea44475d-3e0c-4c97-b196-31a9b430e1b2 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 12:58:32.708628 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-ea44475d-3e0c-4c97-b196-31a9b430e1b2 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: cc3f5e1d-d03b-4fe4-b777-8aedac2761ce] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:58:32.716002 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b66de769-36d7-4bc7-a4b1-db93dd4e7528 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:32.720472 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b66de769-36d7-4bc7-a4b1-db93dd4e7528 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:32.726816 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b66de769-36d7-4bc7-a4b1-db93dd4e7528 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:32.730939 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b66de769-36d7-4bc7-a4b1-db93dd4e7528 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:32.742854 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ea44475d-3e0c-4c97-b196-31a9b430e1b2 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:32.745945 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ea44475d-3e0c-4c97-b196-31a9b430e1b2 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:32.754946 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ea44475d-3e0c-4c97-b196-31a9b430e1b2 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:32.756865 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ea44475d-3e0c-4c97-b196-31a9b430e1b2 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:32.809408 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=100 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:58:32.958194 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.objects.instance [None req-ea44475d-3e0c-4c97-b196-31a9b430e1b2 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lazy-loading 'flavor' on Instance uuid cc3f5e1d-d03b-4fe4-b777-8aedac2761ce {{(pid=117659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 12:58:33.368425 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-ea44475d-3e0c-4c97-b196-31a9b430e1b2 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "POST /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce/action" status: 200 len: 32 microversion: 2.1 time: 0.705273 Jun 17 12:58:33.369531 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 94/196] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Jun 17 12:58:32 2022] POST /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce/action => generated 32 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 17 12:58:33.398491 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-528b822a-4ba5-4744-a32e-a83e6abb1567 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:58:33.400286 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-528b822a-4ba5-4744-a32e-a83e6abb1567 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] [instance: 73cb6bde-cad3-43ef-b361-62ff89b3544a] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:58:33.416557 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-528b822a-4ba5-4744-a32e-a83e6abb1567 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:33.418044 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-528b822a-4ba5-4744-a32e-a83e6abb1567 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:33.420177 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-528b822a-4ba5-4744-a32e-a83e6abb1567 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:33.421181 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-528b822a-4ba5-4744-a32e-a83e6abb1567 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:33.483968 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-b66de769-36d7-4bc7-a4b1-db93dd4e7528 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:33.506782 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-b66de769-36d7-4bc7-a4b1-db93dd4e7528 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:33.508692 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-b66de769-36d7-4bc7-a4b1-db93dd4e7528 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:33.516433 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-b66de769-36d7-4bc7-a4b1-db93dd4e7528 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1600 microversion: 2.20 time: 0.877988 Jun 17 12:58:33.517521 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 103/197] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 12:58:32 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1600 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 12:58:33.526660 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-252f1966-55ee-461c-b52e-986d15c8346c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:58:33.533201 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-252f1966-55ee-461c-b52e-986d15c8346c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: cc3f5e1d-d03b-4fe4-b777-8aedac2761ce] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:58:33.549770 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-252f1966-55ee-461c-b52e-986d15c8346c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:33.554054 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-252f1966-55ee-461c-b52e-986d15c8346c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:33.556002 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-252f1966-55ee-461c-b52e-986d15c8346c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:33.559758 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-252f1966-55ee-461c-b52e-986d15c8346c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:34.479502 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-528b822a-4ba5-4744-a32e-a83e6abb1567 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d0edf9b51d4370950f7ff503c324b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c048fb2cf4e491980fb65a8e32b0fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:34.511157 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-528b822a-4ba5-4744-a32e-a83e6abb1567 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] 10.222.0.48 "GET /compute/v2.1/servers/73cb6bde-cad3-43ef-b361-62ff89b3544a" status: 200 len: 1314 microversion: 2.1 time: 1.136670 Jun 17 12:58:34.522806 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 95/198] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:58:33 2022] GET /compute/v2.1/servers/73cb6bde-cad3-43ef-b361-62ff89b3544a => generated 1314 bytes in 1141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:58:34.535655 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-f2c4c804-2066-4462-a583-254bd0751f34 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:58:34.537122 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-f2c4c804-2066-4462-a583-254bd0751f34 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:58:34.561849 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-252f1966-55ee-461c-b52e-986d15c8346c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:34.562863 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f2c4c804-2066-4462-a583-254bd0751f34 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:34.563764 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f2c4c804-2066-4462-a583-254bd0751f34 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:34.564527 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f2c4c804-2066-4462-a583-254bd0751f34 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:34.565241 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f2c4c804-2066-4462-a583-254bd0751f34 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:34.577659 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-252f1966-55ee-461c-b52e-986d15c8346c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce" status: 200 len: 1520 microversion: 2.1 time: 1.054066 Jun 17 12:58:34.582850 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:58:34.583420 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 104/199] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:58:33 2022] GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce => generated 1520 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:58:35.009417 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-f2c4c804-2066-4462-a583-254bd0751f34 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.495207 Jun 17 12:58:35.010743 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 96/200] 10.222.0.48 () {60 vars in 1315 bytes} [Fri Jun 17 12:58:34 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-interface => generated 285 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 12:58:35.556376 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-399d08ca-17e5-4195-b193-63fb2b062200 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:58:35.558314 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-399d08ca-17e5-4195-b193-63fb2b062200 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] [instance: 73cb6bde-cad3-43ef-b361-62ff89b3544a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:58:35.572902 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-399d08ca-17e5-4195-b193-63fb2b062200 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:35.574516 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-399d08ca-17e5-4195-b193-63fb2b062200 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:35.576971 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-399d08ca-17e5-4195-b193-63fb2b062200 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:35.578216 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-399d08ca-17e5-4195-b193-63fb2b062200 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:35.607122 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-32325b61-5c60-4be6-b5e8-1afd9a970428 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:58:35.609295 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-32325b61-5c60-4be6-b5e8-1afd9a970428 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: cc3f5e1d-d03b-4fe4-b777-8aedac2761ce] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:58:35.628349 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-32325b61-5c60-4be6-b5e8-1afd9a970428 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:35.639602 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-32325b61-5c60-4be6-b5e8-1afd9a970428 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:35.641173 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-32325b61-5c60-4be6-b5e8-1afd9a970428 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:35.642159 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-32325b61-5c60-4be6-b5e8-1afd9a970428 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:36.449820 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-32325b61-5c60-4be6-b5e8-1afd9a970428 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:36.461129 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-32325b61-5c60-4be6-b5e8-1afd9a970428 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce" status: 200 len: 1520 microversion: 2.1 time: 0.860606 Jun 17 12:58:36.476108 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 97/201] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:58:35 2022] GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce => generated 1520 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:58:36.481448 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [req-de71d133-25b7-473a-8d29-62e0d7b59743 req-cfc20b07-831c-45b7-bed4-c05887717cb8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "748a3422-aeab-41c8-b051-df5f7d7ca509", "tag": "87583636-e590-4c87-87ad-1151137bd889"}]} {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 12:58:36.511699 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [req-de71d133-25b7-473a-8d29-62e0d7b59743 req-cfc20b07-831c-45b7-bed4-c05887717cb8 service nova] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:36.514586 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [req-de71d133-25b7-473a-8d29-62e0d7b59743 req-cfc20b07-831c-45b7-bed4-c05887717cb8 service nova] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:36.521837 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-399d08ca-17e5-4195-b193-63fb2b062200 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d0edf9b51d4370950f7ff503c324b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c048fb2cf4e491980fb65a8e32b0fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:36.535538 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-399d08ca-17e5-4195-b193-63fb2b062200 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] 10.222.0.48 "GET /compute/v2.1/servers/73cb6bde-cad3-43ef-b361-62ff89b3544a" status: 200 len: 1501 microversion: 2.1 time: 0.999606 Jun 17 12:58:36.543002 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 105/202] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:58:35 2022] GET /compute/v2.1/servers/73cb6bde-cad3-43ef-b361-62ff89b3544a => generated 1501 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:58:36.551736 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.compute.server_external_events [req-de71d133-25b7-473a-8d29-62e0d7b59743 req-cfc20b07-831c-45b7-bed4-c05887717cb8 service nova] Creating event network-changed:87583636-e590-4c87-87ad-1151137bd889 for instance 748a3422-aeab-41c8-b051-df5f7d7ca509 on hv-cinder-83754 Jun 17 12:58:36.558626 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [req-de71d133-25b7-473a-8d29-62e0d7b59743 req-cfc20b07-831c-45b7-bed4-c05887717cb8 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080773 Jun 17 12:58:36.559849 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 98/203] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 12:58:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:58:37.484225 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-606721a4-58d7-4c4b-a9e8-fd27d07493f5 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:58:37.485605 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-606721a4-58d7-4c4b-a9e8-fd27d07493f5 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: cc3f5e1d-d03b-4fe4-b777-8aedac2761ce] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:58:37.496114 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-606721a4-58d7-4c4b-a9e8-fd27d07493f5 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:37.501202 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-606721a4-58d7-4c4b-a9e8-fd27d07493f5 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:37.506517 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-606721a4-58d7-4c4b-a9e8-fd27d07493f5 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:37.507752 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-606721a4-58d7-4c4b-a9e8-fd27d07493f5 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:38.168969 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-606721a4-58d7-4c4b-a9e8-fd27d07493f5 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:38.197593 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-606721a4-58d7-4c4b-a9e8-fd27d07493f5 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce" status: 200 len: 1520 microversion: 2.1 time: 0.718594 Jun 17 12:58:38.198622 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 106/204] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:58:37 2022] GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce => generated 1520 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 12:58:38.522745 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-6fdabefa-fa51-4af4-a7e8-9ac48dc584d1 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "14454916-1ead-4cad-b1ea-2935d388a54e"}} {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 12:58:38.523945 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-6fdabefa-fa51-4af4-a7e8-9ac48dc584d1 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] [instance: 73cb6bde-cad3-43ef-b361-62ff89b3544a] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:58:38.540444 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6fdabefa-fa51-4af4-a7e8-9ac48dc584d1 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:38.541192 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6fdabefa-fa51-4af4-a7e8-9ac48dc584d1 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:38.542626 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6fdabefa-fa51-4af4-a7e8-9ac48dc584d1 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:38.543063 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6fdabefa-fa51-4af4-a7e8-9ac48dc584d1 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:39.224641 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-6fdabefa-fa51-4af4-a7e8-9ac48dc584d1 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] 10.222.0.48 "POST /compute/v2.1/servers/73cb6bde-cad3-43ef-b361-62ff89b3544a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.705443 Jun 17 12:58:39.229642 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-48abac06-2e1b-4862-9a07-dab8aa351b63 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:58:39.230541 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-48abac06-2e1b-4862-9a07-dab8aa351b63 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: cc3f5e1d-d03b-4fe4-b777-8aedac2761ce] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:58:39.237662 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 99/205] 10.222.0.48 () {60 vars in 1322 bytes} [Fri Jun 17 12:58:38 2022] POST /compute/v2.1/servers/73cb6bde-cad3-43ef-b361-62ff89b3544a/os-volume_attachments => generated 194 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 12:58:39.255400 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-48abac06-2e1b-4862-9a07-dab8aa351b63 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:39.255883 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-48abac06-2e1b-4862-9a07-dab8aa351b63 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:39.258881 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-48abac06-2e1b-4862-9a07-dab8aa351b63 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:39.259403 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-48abac06-2e1b-4862-9a07-dab8aa351b63 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:39.325821 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [req-c01a4c85-92f3-413a-b040-66668d89815e req-8e8247d3-649b-4728-a8b5-da66b445088d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8fdea98-917f-4c4d-aaba-d4f5df4622d6", "tag": "936c48d1-9e45-4b7e-9fa7-86ea87893b56"}]} {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 12:58:39.363231 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [req-c01a4c85-92f3-413a-b040-66668d89815e req-8e8247d3-649b-4728-a8b5-da66b445088d service nova] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:39.363669 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [req-c01a4c85-92f3-413a-b040-66668d89815e req-8e8247d3-649b-4728-a8b5-da66b445088d service nova] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:39.388687 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.compute.server_external_events [req-c01a4c85-92f3-413a-b040-66668d89815e req-8e8247d3-649b-4728-a8b5-da66b445088d service nova] Creating event network-changed:936c48d1-9e45-4b7e-9fa7-86ea87893b56 for instance c8fdea98-917f-4c4d-aaba-d4f5df4622d6 on hv-cinder-83754 Jun 17 12:58:39.401311 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [req-c01a4c85-92f3-413a-b040-66668d89815e req-8e8247d3-649b-4728-a8b5-da66b445088d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097952 Jun 17 12:58:39.408357 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 100/206] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 12:58:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:58:39.623800 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-48abac06-2e1b-4862-9a07-dab8aa351b63 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:39.637153 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-48abac06-2e1b-4862-9a07-dab8aa351b63 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce" status: 200 len: 1520 microversion: 2.1 time: 0.412300 Jun 17 12:58:39.641119 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 107/207] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:58:39 2022] GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce => generated 1520 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 12:58:40.680823 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-c1deda6e-8135-4258-8d11-45ffd9ff4b06 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:58:40.682129 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-c1deda6e-8135-4258-8d11-45ffd9ff4b06 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: cc3f5e1d-d03b-4fe4-b777-8aedac2761ce] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:58:40.721549 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c1deda6e-8135-4258-8d11-45ffd9ff4b06 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:40.722246 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c1deda6e-8135-4258-8d11-45ffd9ff4b06 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:40.723601 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c1deda6e-8135-4258-8d11-45ffd9ff4b06 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:40.724365 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c1deda6e-8135-4258-8d11-45ffd9ff4b06 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:41.356821 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-c1deda6e-8135-4258-8d11-45ffd9ff4b06 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:41.379767 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-c1deda6e-8135-4258-8d11-45ffd9ff4b06 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce" status: 200 len: 1520 microversion: 2.1 time: 0.719896 Jun 17 12:58:41.400854 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 101/208] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:58:40 2022] GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce => generated 1520 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:58:42.404370 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-8d0c4fe3-ac22-4eed-ae5d-c9b87b54690c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:58:42.404990 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-8d0c4fe3-ac22-4eed-ae5d-c9b87b54690c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: cc3f5e1d-d03b-4fe4-b777-8aedac2761ce] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:58:42.413880 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8d0c4fe3-ac22-4eed-ae5d-c9b87b54690c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:42.414674 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8d0c4fe3-ac22-4eed-ae5d-c9b87b54690c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:42.415652 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8d0c4fe3-ac22-4eed-ae5d-c9b87b54690c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:42.416317 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8d0c4fe3-ac22-4eed-ae5d-c9b87b54690c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:42.785026 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-8d0c4fe3-ac22-4eed-ae5d-c9b87b54690c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:42.797568 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-8d0c4fe3-ac22-4eed-ae5d-c9b87b54690c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce" status: 200 len: 1520 microversion: 2.1 time: 0.397583 Jun 17 12:58:42.810294 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 108/209] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:58:42 2022] GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce => generated 1520 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:58:43.817915 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-a792d446-3d13-4eae-be1e-3b930a9363d5 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:58:43.819307 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-a792d446-3d13-4eae-be1e-3b930a9363d5 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: cc3f5e1d-d03b-4fe4-b777-8aedac2761ce] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:58:43.839685 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a792d446-3d13-4eae-be1e-3b930a9363d5 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:43.840501 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a792d446-3d13-4eae-be1e-3b930a9363d5 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:43.841780 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a792d446-3d13-4eae-be1e-3b930a9363d5 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:43.843130 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a792d446-3d13-4eae-be1e-3b930a9363d5 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:44.149261 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-a792d446-3d13-4eae-be1e-3b930a9363d5 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:44.162305 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-a792d446-3d13-4eae-be1e-3b930a9363d5 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce" status: 200 len: 1520 microversion: 2.1 time: 0.350264 Jun 17 12:58:44.163093 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 102/210] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:58:43 2022] GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce => generated 1520 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:58:45.193049 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-891fd4be-c5e6-4499-9ed9-81d88c274a27 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:58:45.193802 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-891fd4be-c5e6-4499-9ed9-81d88c274a27 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: cc3f5e1d-d03b-4fe4-b777-8aedac2761ce] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:58:45.204343 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-891fd4be-c5e6-4499-9ed9-81d88c274a27 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:45.205237 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-891fd4be-c5e6-4499-9ed9-81d88c274a27 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:45.206682 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-891fd4be-c5e6-4499-9ed9-81d88c274a27 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:45.207284 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-891fd4be-c5e6-4499-9ed9-81d88c274a27 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:45.380894 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-891fd4be-c5e6-4499-9ed9-81d88c274a27 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:45.390925 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-891fd4be-c5e6-4499-9ed9-81d88c274a27 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce" status: 200 len: 1520 microversion: 2.1 time: 0.206504 Jun 17 12:58:45.394922 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 109/211] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:58:45 2022] GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce => generated 1520 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:58:46.410944 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-15c5a81d-3078-4761-8344-089279fdd861 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:58:46.412768 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-15c5a81d-3078-4761-8344-089279fdd861 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: cc3f5e1d-d03b-4fe4-b777-8aedac2761ce] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:58:46.441555 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-15c5a81d-3078-4761-8344-089279fdd861 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:46.441555 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-15c5a81d-3078-4761-8344-089279fdd861 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:46.451337 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-15c5a81d-3078-4761-8344-089279fdd861 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:46.452202 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-15c5a81d-3078-4761-8344-089279fdd861 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:46.836272 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-15c5a81d-3078-4761-8344-089279fdd861 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:46.847772 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-15c5a81d-3078-4761-8344-089279fdd861 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce" status: 200 len: 1520 microversion: 2.1 time: 0.443113 Jun 17 12:58:46.858117 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 103/212] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:58:46 2022] GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce => generated 1520 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 12:58:47.866969 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-80930b5b-2000-4008-838c-44857c7d7898 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:58:47.867772 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-80930b5b-2000-4008-838c-44857c7d7898 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: cc3f5e1d-d03b-4fe4-b777-8aedac2761ce] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:58:47.881280 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-80930b5b-2000-4008-838c-44857c7d7898 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:47.882697 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-80930b5b-2000-4008-838c-44857c7d7898 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:47.885115 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-80930b5b-2000-4008-838c-44857c7d7898 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:47.885804 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-80930b5b-2000-4008-838c-44857c7d7898 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:48.181747 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-80930b5b-2000-4008-838c-44857c7d7898 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:48.194585 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-80930b5b-2000-4008-838c-44857c7d7898 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce" status: 200 len: 1520 microversion: 2.1 time: 0.333244 Jun 17 12:58:48.195542 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 110/213] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:58:47 2022] GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce => generated 1520 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:58:49.222660 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-34f072d8-a034-4a89-ab6c-d6a37d364594 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:58:49.223713 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-34f072d8-a034-4a89-ab6c-d6a37d364594 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: cc3f5e1d-d03b-4fe4-b777-8aedac2761ce] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:58:49.253928 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-34f072d8-a034-4a89-ab6c-d6a37d364594 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:49.259379 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-34f072d8-a034-4a89-ab6c-d6a37d364594 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:49.262026 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-34f072d8-a034-4a89-ab6c-d6a37d364594 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:49.263541 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-34f072d8-a034-4a89-ab6c-d6a37d364594 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:49.728635 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-34f072d8-a034-4a89-ab6c-d6a37d364594 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:49.760469 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-34f072d8-a034-4a89-ab6c-d6a37d364594 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce" status: 200 len: 1520 microversion: 2.1 time: 0.546630 Jun 17 12:58:49.771365 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 104/214] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:58:49 2022] GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce => generated 1520 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:58:50.053569 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-431798df-02ff-48e8-9b66-f36411103661 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:58:50.059140 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-431798df-02ff-48e8-9b66-f36411103661 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] [instance: 73cb6bde-cad3-43ef-b361-62ff89b3544a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:58:50.070239 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_api:SELECT=64 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:58:50.093785 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-431798df-02ff-48e8-9b66-f36411103661 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:50.098767 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-431798df-02ff-48e8-9b66-f36411103661 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:50.100159 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-431798df-02ff-48e8-9b66-f36411103661 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:50.101331 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-431798df-02ff-48e8-9b66-f36411103661 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:50.159779 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-431798df-02ff-48e8-9b66-f36411103661 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] [instance: 73cb6bde-cad3-43ef-b361-62ff89b3544a] Going to try to terminate instance {{(pid=117660) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 17 12:58:50.467582 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-431798df-02ff-48e8-9b66-f36411103661 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] 10.222.0.48 "DELETE /compute/v2.1/servers/73cb6bde-cad3-43ef-b361-62ff89b3544a" status: 204 len: 0 microversion: 2.1 time: 0.423840 Jun 17 12:58:50.468222 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 111/215] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Jun 17 12:58:50 2022] DELETE /compute/v2.1/servers/73cb6bde-cad3-43ef-b361-62ff89b3544a => generated 0 bytes in 426 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 17 12:58:50.486472 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-828329a2-60a7-43f7-9fca-4cae7615489e tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:58:50.495502 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-828329a2-60a7-43f7-9fca-4cae7615489e tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] [instance: 73cb6bde-cad3-43ef-b361-62ff89b3544a] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:58:50.527980 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-828329a2-60a7-43f7-9fca-4cae7615489e tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:50.528446 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-828329a2-60a7-43f7-9fca-4cae7615489e tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:50.538013 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-828329a2-60a7-43f7-9fca-4cae7615489e tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:50.541804 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-828329a2-60a7-43f7-9fca-4cae7615489e tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:50.800637 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-06102305-dce1-4463-b030-9ae92e000ff0 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:58:50.802138 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-06102305-dce1-4463-b030-9ae92e000ff0 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: cc3f5e1d-d03b-4fe4-b777-8aedac2761ce] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:58:50.819927 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-06102305-dce1-4463-b030-9ae92e000ff0 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:50.820375 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-06102305-dce1-4463-b030-9ae92e000ff0 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:50.821150 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-06102305-dce1-4463-b030-9ae92e000ff0 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:50.827788 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-06102305-dce1-4463-b030-9ae92e000ff0 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:51.023211 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-828329a2-60a7-43f7-9fca-4cae7615489e tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d0edf9b51d4370950f7ff503c324b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c048fb2cf4e491980fb65a8e32b0fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:51.040021 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-828329a2-60a7-43f7-9fca-4cae7615489e tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] 10.222.0.48 "GET /compute/v2.1/servers/73cb6bde-cad3-43ef-b361-62ff89b3544a" status: 200 len: 1553 microversion: 2.1 time: 0.565011 Jun 17 12:58:51.041456 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 105/216] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:58:50 2022] GET /compute/v2.1/servers/73cb6bde-cad3-43ef-b361-62ff89b3544a => generated 1553 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:58:51.342500 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-06102305-dce1-4463-b030-9ae92e000ff0 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:51.356585 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-06102305-dce1-4463-b030-9ae92e000ff0 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce" status: 200 len: 1520 microversion: 2.1 time: 0.558754 Jun 17 12:58:51.360601 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 112/217] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:58:50 2022] GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce => generated 1520 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 12:58:52.088417 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-8b41a4f0-c1b2-4108-9a23-0413bc1552b6 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:58:52.090598 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-8b41a4f0-c1b2-4108-9a23-0413bc1552b6 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] [instance: 73cb6bde-cad3-43ef-b361-62ff89b3544a] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:58:52.104732 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_api:SELECT=58 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:58:52.117116 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8b41a4f0-c1b2-4108-9a23-0413bc1552b6 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:52.117816 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8b41a4f0-c1b2-4108-9a23-0413bc1552b6 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:52.119122 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8b41a4f0-c1b2-4108-9a23-0413bc1552b6 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:52.119828 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8b41a4f0-c1b2-4108-9a23-0413bc1552b6 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:52.380360 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-ed3ab9e9-bcc2-400f-9fda-bbf4a585c087 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:58:52.387705 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-ed3ab9e9-bcc2-400f-9fda-bbf4a585c087 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: cc3f5e1d-d03b-4fe4-b777-8aedac2761ce] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:58:52.408930 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ed3ab9e9-bcc2-400f-9fda-bbf4a585c087 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:52.416557 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ed3ab9e9-bcc2-400f-9fda-bbf4a585c087 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:52.428222 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ed3ab9e9-bcc2-400f-9fda-bbf4a585c087 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:52.432417 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ed3ab9e9-bcc2-400f-9fda-bbf4a585c087 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:52.898713 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-8b41a4f0-c1b2-4108-9a23-0413bc1552b6 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d0edf9b51d4370950f7ff503c324b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c048fb2cf4e491980fb65a8e32b0fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:52.922768 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-8b41a4f0-c1b2-4108-9a23-0413bc1552b6 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] 10.222.0.48 "GET /compute/v2.1/servers/73cb6bde-cad3-43ef-b361-62ff89b3544a" status: 200 len: 1553 microversion: 2.1 time: 0.841249 Jun 17 12:58:52.930791 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 106/218] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:58:52 2022] GET /compute/v2.1/servers/73cb6bde-cad3-43ef-b361-62ff89b3544a => generated 1553 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:58:52.954793 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-ed3ab9e9-bcc2-400f-9fda-bbf4a585c087 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:52.984009 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-ed3ab9e9-bcc2-400f-9fda-bbf4a585c087 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce" status: 200 len: 1520 microversion: 2.1 time: 0.613660 Jun 17 12:58:52.985801 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 113/219] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:58:52 2022] GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce => generated 1520 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:58:53.864978 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-1e5eb877-ec39-465f-b6b2-c98305b0fb0c tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Action: 'create', calling method: .version_select at 0x7f0190259310>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-892142400", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCO/rKfiFb9QvoO3xC4UQkdFGeEpbOJEL0avPz08EOPWtmIv358faEh/h+MfNesywKIMUYQLB9hgmnAgnHcyvuZEbv4BzCvFLyWG6yoVhKz0QUo7sPdy28GObJ2/KTK/rQ=="}} {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 12:58:53.883384 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.quota [None req-1e5eb877-ec39-465f-b6b2-c98305b0fb0c tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Getting quotas for project 73bf442df39b4f5cbc18f571a0596f10. Resources: {'key_pairs'} {{(pid=117659) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 12:58:53.894705 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.quota [None req-1e5eb877-ec39-465f-b6b2-c98305b0fb0c tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Getting quotas for user 18195083037046bd99166f68690c3dce and project 73bf442df39b4f5cbc18f571a0596f10. Resources: {'key_pairs'} {{(pid=117659) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 12:58:53.931127 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-1e5eb877-ec39-465f-b6b2-c98305b0fb0c tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.391211 Jun 17 12:58:53.932928 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 107/220] 10.222.0.48 () {60 vars in 1158 bytes} [Fri Jun 17 12:58:53 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:58:53.953742 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-e1b51d73-8f8c-4f26-8f91-4a535a35e16b tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:58:53.954606 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-e1b51d73-8f8c-4f26-8f91-4a535a35e16b tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] [instance: 73cb6bde-cad3-43ef-b361-62ff89b3544a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:58:53.961772 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e1b51d73-8f8c-4f26-8f91-4a535a35e16b tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:53.962256 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e1b51d73-8f8c-4f26-8f91-4a535a35e16b tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:53.963054 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e1b51d73-8f8c-4f26-8f91-4a535a35e16b tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:53.963533 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e1b51d73-8f8c-4f26-8f91-4a535a35e16b tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:54.006929 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-6b223db1-77ba-4514-b3b5-a59ddc6ec219 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:58:54.007874 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-6b223db1-77ba-4514-b3b5-a59ddc6ec219 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: cc3f5e1d-d03b-4fe4-b777-8aedac2761ce] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:58:54.028745 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6b223db1-77ba-4514-b3b5-a59ddc6ec219 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:54.029967 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6b223db1-77ba-4514-b3b5-a59ddc6ec219 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:54.032338 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6b223db1-77ba-4514-b3b5-a59ddc6ec219 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:54.033712 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6b223db1-77ba-4514-b3b5-a59ddc6ec219 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:54.429199 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-e1b51d73-8f8c-4f26-8f91-4a535a35e16b tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d0edf9b51d4370950f7ff503c324b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c048fb2cf4e491980fb65a8e32b0fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:54.461049 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-6b223db1-77ba-4514-b3b5-a59ddc6ec219 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:54.461725 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-e1b51d73-8f8c-4f26-8f91-4a535a35e16b tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] 10.222.0.48 "GET /compute/v2.1/servers/73cb6bde-cad3-43ef-b361-62ff89b3544a" status: 200 len: 1553 microversion: 2.1 time: 0.513053 Jun 17 12:58:54.462365 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 114/221] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:58:53 2022] GET /compute/v2.1/servers/73cb6bde-cad3-43ef-b361-62ff89b3544a => generated 1553 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:58:54.475618 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-6b223db1-77ba-4514-b3b5-a59ddc6ec219 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce" status: 200 len: 1520 microversion: 2.1 time: 0.477537 Jun 17 12:58:54.486213 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 108/222] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:58:53 2022] GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce => generated 1520 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:58:54.663746 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [req-b6a468f3-e496-4ade-98e6-1c9cf52d94dd req-46d071d4-47bf-4448-b73f-6e409330ecec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73cb6bde-cad3-43ef-b361-62ff89b3544a", "name": "network-vif-deleted", "tag": "ebd11c69-50dc-4ab5-8c90-8d32c0d1f010"}]} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 12:58:54.686147 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-b6a468f3-e496-4ade-98e6-1c9cf52d94dd req-46d071d4-47bf-4448-b73f-6e409330ecec service nova] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:54.688955 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-b6a468f3-e496-4ade-98e6-1c9cf52d94dd req-46d071d4-47bf-4448-b73f-6e409330ecec service nova] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:54.720325 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.compute.server_external_events [req-b6a468f3-e496-4ade-98e6-1c9cf52d94dd req-46d071d4-47bf-4448-b73f-6e409330ecec service nova] Creating event network-vif-deleted:ebd11c69-50dc-4ab5-8c90-8d32c0d1f010 for instance 73cb6bde-cad3-43ef-b361-62ff89b3544a on hv-cinder-83754 Jun 17 12:58:54.744281 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [req-b6a468f3-e496-4ade-98e6-1c9cf52d94dd req-46d071d4-47bf-4448-b73f-6e409330ecec service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086387 Jun 17 12:58:54.745492 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 115/223] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 12:58:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:58:55.486119 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-0ec5b1d5-a307-48b1-8b8a-cf1a7cfac771 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:58:55.486818 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-0ec5b1d5-a307-48b1-8b8a-cf1a7cfac771 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] [instance: 73cb6bde-cad3-43ef-b361-62ff89b3544a] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:58:55.503412 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-7f317d30-0ad0-4289-86fd-af5cc2099cdc tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:58:55.504309 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-7f317d30-0ad0-4289-86fd-af5cc2099cdc tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: cc3f5e1d-d03b-4fe4-b777-8aedac2761ce] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:58:55.522532 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0ec5b1d5-a307-48b1-8b8a-cf1a7cfac771 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:55.523945 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0ec5b1d5-a307-48b1-8b8a-cf1a7cfac771 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:55.524620 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7f317d30-0ad0-4289-86fd-af5cc2099cdc tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:55.525257 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7f317d30-0ad0-4289-86fd-af5cc2099cdc tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:55.528022 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0ec5b1d5-a307-48b1-8b8a-cf1a7cfac771 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:55.528289 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7f317d30-0ad0-4289-86fd-af5cc2099cdc tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:55.528551 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7f317d30-0ad0-4289-86fd-af5cc2099cdc tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:55.528796 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0ec5b1d5-a307-48b1-8b8a-cf1a7cfac771 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:55.705610 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-0ec5b1d5-a307-48b1-8b8a-cf1a7cfac771 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d0edf9b51d4370950f7ff503c324b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c048fb2cf4e491980fb65a8e32b0fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:55.726355 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-0ec5b1d5-a307-48b1-8b8a-cf1a7cfac771 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] 10.222.0.48 "GET /compute/v2.1/servers/73cb6bde-cad3-43ef-b361-62ff89b3544a" status: 200 len: 1345 microversion: 2.1 time: 0.249107 Jun 17 12:58:55.727622 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 109/224] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:58:55 2022] GET /compute/v2.1/servers/73cb6bde-cad3-43ef-b361-62ff89b3544a => generated 1345 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 12:58:55.884731 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-7f317d30-0ad0-4289-86fd-af5cc2099cdc tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:55.895562 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-7f317d30-0ad0-4289-86fd-af5cc2099cdc tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce" status: 200 len: 1520 microversion: 2.1 time: 0.397392 Jun 17 12:58:55.896045 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 116/225] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:58:55 2022] GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce => generated 1520 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 12:58:56.745599 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-cc62fae3-ca97-4994-9e82-ef1778c987c9 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:58:56.747341 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-cc62fae3-ca97-4994-9e82-ef1778c987c9 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] [instance: 73cb6bde-cad3-43ef-b361-62ff89b3544a] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:58:56.764360 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-cc62fae3-ca97-4994-9e82-ef1778c987c9 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:56.765023 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-cc62fae3-ca97-4994-9e82-ef1778c987c9 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:56.766280 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-cc62fae3-ca97-4994-9e82-ef1778c987c9 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:56.766787 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-cc62fae3-ca97-4994-9e82-ef1778c987c9 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:56.785169 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.wsgi [None req-cc62fae3-ca97-4994-9e82-ef1778c987c9 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] HTTP exception thrown: Instance 73cb6bde-cad3-43ef-b361-62ff89b3544a could not be found. Jun 17 12:58:56.791007 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-cc62fae3-ca97-4994-9e82-ef1778c987c9 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Request method failure captured: Jun 17 12:58:56.791007 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: request: GET /compute/v2.1/servers/73cb6bde-cad3-43ef-b361-62ff89b3544a HTTP/1.1 Jun 17 12:58:56.791007 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Accept: application/json Jun 17 12:58:56.791007 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Accept-Encoding: identity Jun 17 12:58:56.791007 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Connection: close Jun 17 12:58:56.791007 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Content-Length: 0 Jun 17 12:58:56.791007 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Content-Type: application/json Jun 17 12:58:56.791007 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Host: 10.222.0.48 Jun 17 12:58:56.791007 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Openstack-System-Scope: None Jun 17 12:58:56.791007 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: User-Agent: python-urllib3/1.26.9 Jun 17 12:58:56.791007 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Auth-Token: gAAAAABirHo1cMP6I0bqLGlyvysuvRBOW7vO5EyaOF1TqmIGy9qsnHHTDUXR4wH3uw5U80N1uecYmMI7iBJJu05dKjYPk-hn_yS5y_VYcI_yUyOXoTMlaM1DLSgaszWocEGx8X2HweABN9ZlfvR9RV2vh9MEKLMVp90zOjE3ASqXxFM6xdn_pco Jun 17 12:58:56.791007 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Domain-Id: None Jun 17 12:58:56.791007 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Domain-Name: None Jun 17 12:58:56.791007 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Identity-Status: Confirmed Jun 17 12:58:56.791007 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Is-Admin-Project: True Jun 17 12:58:56.791007 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Project-Domain-Id: default Jun 17 12:58:56.791007 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Project-Domain-Name: Default Jun 17 12:58:56.791007 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Project-Id: 4c048fb2cf4e491980fb65a8e32b0fb2 Jun 17 12:58:56.791007 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Project-Name: tempest-DeleteServersTestJSON-367009746 Jun 17 12:58:56.791007 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Role: member,reader Jun 17 12:58:56.791007 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Roles: member,reader Jun 17 12:58:56.793725 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_4c048fb2cf4e491980fb65a8e32b0fb2", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4c048fb2cf4e491980fb65a8e32b0fb2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4c048fb2cf4e491980fb65a8e32b0fb2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/4c048fb2cf4e491980fb65a8e32b0fb2"}]}] Jun 17 12:58:56.793725 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Tenant: tempest-DeleteServersTestJSON-367009746 Jun 17 12:58:56.793725 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Tenant-Id: 4c048fb2cf4e491980fb65a8e32b0fb2 Jun 17 12:58:56.793725 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Tenant-Name: tempest-DeleteServersTestJSON-367009746 Jun 17 12:58:56.793725 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User: tempest-DeleteServersTestJSON-367009746-project Jun 17 12:58:56.793725 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User-Domain-Id: default Jun 17 12:58:56.793725 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User-Domain-Name: Default Jun 17 12:58:56.793725 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User-Id: e2d0edf9b51d4370950f7ff503c324b8 Jun 17 12:58:56.793725 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User-Name: tempest-DeleteServersTestJSON-367009746-project Jun 17 12:58:56.793725 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: method: > Jun 17 12:58:56.793725 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: exception: Instance 73cb6bde-cad3-43ef-b361-62ff89b3544a could not be found. Jun 17 12:58:56.793725 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: action_args: {'id': '73cb6bde-cad3-43ef-b361-62ff89b3544a'} Jun 17 12:58:56.796041 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 12:58:56.796041 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 12:58:56.796041 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 12:58:56.796041 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 12:58:56.796041 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 12:58:56.796041 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 12:58:56.796041 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 12:58:56.796041 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 12:58:56.796041 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 12:58:56.796041 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 12:58:56.796041 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73cb6bde-cad3-43ef-b361-62ff89b3544a could not be found. Jun 17 12:58:56.796041 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 12:58:56.796041 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 12:58:56.796041 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 12:58:56.796041 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 12:58:56.796041 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 12:58:56.796041 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 12:58:56.796041 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 12:58:56.796041 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 12:58:56.796041 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 12:58:56.798877 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 12:58:56.798877 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 12:58:56.798877 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 12:58:56.798877 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 12:58:56.798877 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 12:58:56.798877 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 12:58:56.798877 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 12:58:56.798877 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73cb6bde-cad3-43ef-b361-62ff89b3544a could not be found. Jun 17 12:58:56.798877 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 12:58:56.798877 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 12:58:56.798877 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 12:58:56.798877 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 12:58:56.798877 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 12:58:56.798877 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 12:58:56.798877 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 12:58:56.798877 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 12:58:56.798877 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73cb6bde-cad3-43ef-b361-62ff89b3544a could not be found. Jun 17 12:58:56.798877 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 12:58:56.804525 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-cc62fae3-ca97-4994-9e82-ef1778c987c9 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Returning 404 to user: Instance 73cb6bde-cad3-43ef-b361-62ff89b3544a could not be found. {{(pid=117659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 12:58:56.804525 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-cc62fae3-ca97-4994-9e82-ef1778c987c9 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] 10.222.0.48 "GET /compute/v2.1/servers/73cb6bde-cad3-43ef-b361-62ff89b3544a" status: 404 len: 111 microversion: 2.1 time: 0.054190 Jun 17 12:58:56.804525 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 110/226] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:58:56 2022] GET /compute/v2.1/servers/73cb6bde-cad3-43ef-b361-62ff89b3544a => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 17 12:58:56.913721 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-e64590c6-20f6-4096-9030-8003b1306d1c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:58:56.914911 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-e64590c6-20f6-4096-9030-8003b1306d1c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: cc3f5e1d-d03b-4fe4-b777-8aedac2761ce] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:58:56.943775 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-80f53b3b-325f-4608-b6d9-84e9c818522a tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:58:56.944591 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-80f53b3b-325f-4608-b6d9-84e9c818522a tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] [instance: 73cb6bde-cad3-43ef-b361-62ff89b3544a] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:58:56.950652 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e64590c6-20f6-4096-9030-8003b1306d1c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:56.951099 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e64590c6-20f6-4096-9030-8003b1306d1c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:56.951618 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-80f53b3b-325f-4608-b6d9-84e9c818522a tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:56.952274 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-80f53b3b-325f-4608-b6d9-84e9c818522a tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:56.952676 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e64590c6-20f6-4096-9030-8003b1306d1c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:56.953119 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e64590c6-20f6-4096-9030-8003b1306d1c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:56.953529 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-80f53b3b-325f-4608-b6d9-84e9c818522a tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:56.954315 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-80f53b3b-325f-4608-b6d9-84e9c818522a tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:56.973274 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.wsgi [None req-80f53b3b-325f-4608-b6d9-84e9c818522a tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] HTTP exception thrown: Instance 73cb6bde-cad3-43ef-b361-62ff89b3544a could not be found. Jun 17 12:58:56.976717 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-80f53b3b-325f-4608-b6d9-84e9c818522a tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Request method failure captured: Jun 17 12:58:56.976717 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: request: GET /compute/v2.1/servers/73cb6bde-cad3-43ef-b361-62ff89b3544a/os-volume_attachments HTTP/1.1 Jun 17 12:58:56.976717 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Accept: application/json Jun 17 12:58:56.976717 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Accept-Encoding: identity Jun 17 12:58:56.976717 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Connection: close Jun 17 12:58:56.976717 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Content-Length: 0 Jun 17 12:58:56.976717 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Content-Type: application/json Jun 17 12:58:56.976717 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Host: 10.222.0.48 Jun 17 12:58:56.976717 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Openstack-System-Scope: None Jun 17 12:58:56.976717 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: User-Agent: python-urllib3/1.26.9 Jun 17 12:58:56.976717 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Auth-Token: gAAAAABirHo1cMP6I0bqLGlyvysuvRBOW7vO5EyaOF1TqmIGy9qsnHHTDUXR4wH3uw5U80N1uecYmMI7iBJJu05dKjYPk-hn_yS5y_VYcI_yUyOXoTMlaM1DLSgaszWocEGx8X2HweABN9ZlfvR9RV2vh9MEKLMVp90zOjE3ASqXxFM6xdn_pco Jun 17 12:58:56.976717 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Domain-Id: None Jun 17 12:58:56.976717 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Domain-Name: None Jun 17 12:58:56.976717 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Identity-Status: Confirmed Jun 17 12:58:56.976717 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Is-Admin-Project: True Jun 17 12:58:56.976717 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Project-Domain-Id: default Jun 17 12:58:56.976717 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Project-Domain-Name: Default Jun 17 12:58:56.976717 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Project-Id: 4c048fb2cf4e491980fb65a8e32b0fb2 Jun 17 12:58:56.976717 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Project-Name: tempest-DeleteServersTestJSON-367009746 Jun 17 12:58:56.976717 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Role: member,reader Jun 17 12:58:56.976717 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Roles: member,reader Jun 17 12:58:56.978927 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_4c048fb2cf4e491980fb65a8e32b0fb2", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4c048fb2cf4e491980fb65a8e32b0fb2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4c048fb2cf4e491980fb65a8e32b0fb2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/4c048fb2cf4e491980fb65a8e32b0fb2"}]}] Jun 17 12:58:56.978927 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Tenant: tempest-DeleteServersTestJSON-367009746 Jun 17 12:58:56.978927 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Tenant-Id: 4c048fb2cf4e491980fb65a8e32b0fb2 Jun 17 12:58:56.978927 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Tenant-Name: tempest-DeleteServersTestJSON-367009746 Jun 17 12:58:56.978927 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User: tempest-DeleteServersTestJSON-367009746-project Jun 17 12:58:56.978927 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User-Domain-Id: default Jun 17 12:58:56.978927 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User-Domain-Name: Default Jun 17 12:58:56.978927 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User-Id: e2d0edf9b51d4370950f7ff503c324b8 Jun 17 12:58:56.978927 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User-Name: tempest-DeleteServersTestJSON-367009746-project Jun 17 12:58:56.978927 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: method: > Jun 17 12:58:56.978927 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: exception: Instance 73cb6bde-cad3-43ef-b361-62ff89b3544a could not be found. Jun 17 12:58:56.978927 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: action_args: {'server_id': '73cb6bde-cad3-43ef-b361-62ff89b3544a'} Jun 17 12:58:56.980459 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 12:58:56.980459 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 12:58:56.980459 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 12:58:56.980459 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 12:58:56.980459 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 12:58:56.980459 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 12:58:56.980459 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 12:58:56.980459 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 12:58:56.980459 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 12:58:56.980459 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 12:58:56.980459 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73cb6bde-cad3-43ef-b361-62ff89b3544a could not be found. Jun 17 12:58:56.980459 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 12:58:56.980459 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 12:58:56.980459 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 12:58:56.980459 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 12:58:56.980459 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 12:58:56.980459 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 12:58:56.980459 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 12:58:56.980459 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 12:58:56.980459 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 12:58:56.981859 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 12:58:56.981859 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 17 12:58:56.981859 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 17 12:58:56.981859 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 17 12:58:56.981859 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 17 12:58:56.981859 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jun 17 12:58:56.981859 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jun 17 12:58:56.981859 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 12:58:56.981859 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 12:58:56.981859 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73cb6bde-cad3-43ef-b361-62ff89b3544a could not be found. Jun 17 12:58:56.981859 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 12:58:56.981859 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 12:58:56.981859 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 12:58:56.981859 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 12:58:56.981859 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 12:58:56.981859 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 12:58:56.981859 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 12:58:56.981859 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 12:58:56.981859 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73cb6bde-cad3-43ef-b361-62ff89b3544a could not be found. Jun 17 12:58:56.981859 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 12:58:56.983120 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-80f53b3b-325f-4608-b6d9-84e9c818522a tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Returning 404 to user: Instance 73cb6bde-cad3-43ef-b361-62ff89b3544a could not be found. {{(pid=117659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 12:58:56.983835 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-80f53b3b-325f-4608-b6d9-84e9c818522a tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] 10.222.0.48 "GET /compute/v2.1/servers/73cb6bde-cad3-43ef-b361-62ff89b3544a/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.044170 Jun 17 12:58:56.984313 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 111/227] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 12:58:56 2022] GET /compute/v2.1/servers/73cb6bde-cad3-43ef-b361-62ff89b3544a/os-volume_attachments => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 17 12:58:57.171937 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-e64590c6-20f6-4096-9030-8003b1306d1c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:57.180091 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-e64590c6-20f6-4096-9030-8003b1306d1c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce" status: 200 len: 1520 microversion: 2.1 time: 0.270474 Jun 17 12:58:57.180661 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 117/228] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:58:56 2022] GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce => generated 1520 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 12:58:58.200215 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-2fdef26e-93a7-46d7-8f71-42533ab6db77 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:58:58.201358 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-2fdef26e-93a7-46d7-8f71-42533ab6db77 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: cc3f5e1d-d03b-4fe4-b777-8aedac2761ce] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:58:58.214252 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2fdef26e-93a7-46d7-8f71-42533ab6db77 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:58.214965 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2fdef26e-93a7-46d7-8f71-42533ab6db77 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:58.216245 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2fdef26e-93a7-46d7-8f71-42533ab6db77 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:58.216971 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2fdef26e-93a7-46d7-8f71-42533ab6db77 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:58.254901 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-30264494-a850-4657-83e1-467ee8a0286e tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:58:58.259826 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-30264494-a850-4657-83e1-467ee8a0286e tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] [instance: 73cb6bde-cad3-43ef-b361-62ff89b3544a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:58:58.272461 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-30264494-a850-4657-83e1-467ee8a0286e tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:58.273224 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-30264494-a850-4657-83e1-467ee8a0286e tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:58.274307 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-30264494-a850-4657-83e1-467ee8a0286e tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:58.275021 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-30264494-a850-4657-83e1-467ee8a0286e tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:58.292653 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.wsgi [None req-30264494-a850-4657-83e1-467ee8a0286e tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] HTTP exception thrown: Instance 73cb6bde-cad3-43ef-b361-62ff89b3544a could not be found. Jun 17 12:58:58.298469 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-30264494-a850-4657-83e1-467ee8a0286e tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Request method failure captured: Jun 17 12:58:58.298469 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: request: DELETE /compute/v2.1/servers/73cb6bde-cad3-43ef-b361-62ff89b3544a HTTP/1.1 Jun 17 12:58:58.298469 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Accept: application/json Jun 17 12:58:58.298469 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Accept-Encoding: identity Jun 17 12:58:58.298469 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Connection: close Jun 17 12:58:58.298469 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Content-Length: 0 Jun 17 12:58:58.298469 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Content-Type: application/json Jun 17 12:58:58.298469 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Host: 10.222.0.48 Jun 17 12:58:58.298469 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Openstack-System-Scope: None Jun 17 12:58:58.298469 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: User-Agent: python-urllib3/1.26.9 Jun 17 12:58:58.298469 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Auth-Token: gAAAAABirHo1cMP6I0bqLGlyvysuvRBOW7vO5EyaOF1TqmIGy9qsnHHTDUXR4wH3uw5U80N1uecYmMI7iBJJu05dKjYPk-hn_yS5y_VYcI_yUyOXoTMlaM1DLSgaszWocEGx8X2HweABN9ZlfvR9RV2vh9MEKLMVp90zOjE3ASqXxFM6xdn_pco Jun 17 12:58:58.298469 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Domain-Id: None Jun 17 12:58:58.298469 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Domain-Name: None Jun 17 12:58:58.298469 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Identity-Status: Confirmed Jun 17 12:58:58.298469 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Is-Admin-Project: True Jun 17 12:58:58.298469 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Project-Domain-Id: default Jun 17 12:58:58.298469 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Project-Domain-Name: Default Jun 17 12:58:58.298469 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Project-Id: 4c048fb2cf4e491980fb65a8e32b0fb2 Jun 17 12:58:58.298469 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Project-Name: tempest-DeleteServersTestJSON-367009746 Jun 17 12:58:58.298469 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Role: member,reader Jun 17 12:58:58.298469 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Roles: member,reader Jun 17 12:58:58.303430 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_4c048fb2cf4e491980fb65a8e32b0fb2", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4c048fb2cf4e491980fb65a8e32b0fb2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4c048fb2cf4e491980fb65a8e32b0fb2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/4c048fb2cf4e491980fb65a8e32b0fb2"}]}] Jun 17 12:58:58.303430 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Tenant: tempest-DeleteServersTestJSON-367009746 Jun 17 12:58:58.303430 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Tenant-Id: 4c048fb2cf4e491980fb65a8e32b0fb2 Jun 17 12:58:58.303430 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Tenant-Name: tempest-DeleteServersTestJSON-367009746 Jun 17 12:58:58.303430 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-User: tempest-DeleteServersTestJSON-367009746-project Jun 17 12:58:58.303430 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-User-Domain-Id: default Jun 17 12:58:58.303430 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-User-Domain-Name: Default Jun 17 12:58:58.303430 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-User-Id: e2d0edf9b51d4370950f7ff503c324b8 Jun 17 12:58:58.303430 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-User-Name: tempest-DeleteServersTestJSON-367009746-project Jun 17 12:58:58.303430 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: method: > Jun 17 12:58:58.303430 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: exception: Instance 73cb6bde-cad3-43ef-b361-62ff89b3544a could not be found. Jun 17 12:58:58.303430 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: action_args: {'id': '73cb6bde-cad3-43ef-b361-62ff89b3544a'} Jun 17 12:58:58.305030 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 12:58:58.305030 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 12:58:58.305030 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 12:58:58.305030 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 12:58:58.305030 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 12:58:58.305030 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 12:58:58.305030 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 12:58:58.305030 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 12:58:58.305030 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 12:58:58.305030 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 12:58:58.305030 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73cb6bde-cad3-43ef-b361-62ff89b3544a could not be found. Jun 17 12:58:58.305030 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 12:58:58.305030 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 12:58:58.305030 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 12:58:58.305030 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 12:58:58.305030 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 12:58:58.305030 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 12:58:58.305030 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 12:58:58.305030 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 12:58:58.305030 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 12:58:58.317504 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 12:58:58.317504 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 17 12:58:58.317504 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 17 12:58:58.317504 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 17 12:58:58.317504 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 17 12:58:58.317504 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 12:58:58.317504 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 12:58:58.317504 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 12:58:58.317504 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 12:58:58.317504 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73cb6bde-cad3-43ef-b361-62ff89b3544a could not be found. Jun 17 12:58:58.317504 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 12:58:58.317504 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 12:58:58.317504 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 12:58:58.317504 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 12:58:58.317504 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 12:58:58.317504 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 12:58:58.317504 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 12:58:58.317504 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 12:58:58.317504 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73cb6bde-cad3-43ef-b361-62ff89b3544a could not be found. Jun 17 12:58:58.317504 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 12:58:58.318876 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-30264494-a850-4657-83e1-467ee8a0286e tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Returning 404 to user: Instance 73cb6bde-cad3-43ef-b361-62ff89b3544a could not be found. {{(pid=117660) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 12:58:58.318876 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-30264494-a850-4657-83e1-467ee8a0286e tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] 10.222.0.48 "DELETE /compute/v2.1/servers/73cb6bde-cad3-43ef-b361-62ff89b3544a" status: 404 len: 111 microversion: 2.1 time: 0.054327 Jun 17 12:58:58.318876 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 118/229] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Jun 17 12:58:58 2022] DELETE /compute/v2.1/servers/73cb6bde-cad3-43ef-b361-62ff89b3544a => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 12:58:58.318876 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-24a6f22f-8f32-4535-91a4-0acf79dd24f2 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:58:58.318876 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-24a6f22f-8f32-4535-91a4-0acf79dd24f2 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] [instance: 73cb6bde-cad3-43ef-b361-62ff89b3544a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:58:58.320905 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-24a6f22f-8f32-4535-91a4-0acf79dd24f2 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:58.321065 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-24a6f22f-8f32-4535-91a4-0acf79dd24f2 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:58.321963 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-24a6f22f-8f32-4535-91a4-0acf79dd24f2 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:58.322486 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-24a6f22f-8f32-4535-91a4-0acf79dd24f2 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:58.337759 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.wsgi [None req-24a6f22f-8f32-4535-91a4-0acf79dd24f2 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] HTTP exception thrown: Instance 73cb6bde-cad3-43ef-b361-62ff89b3544a could not be found. Jun 17 12:58:58.339326 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-24a6f22f-8f32-4535-91a4-0acf79dd24f2 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Request method failure captured: Jun 17 12:58:58.339326 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: request: GET /compute/v2.1/servers/73cb6bde-cad3-43ef-b361-62ff89b3544a HTTP/1.1 Jun 17 12:58:58.339326 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Accept: application/json Jun 17 12:58:58.339326 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Accept-Encoding: identity Jun 17 12:58:58.339326 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Connection: close Jun 17 12:58:58.339326 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Content-Length: 0 Jun 17 12:58:58.339326 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Content-Type: application/json Jun 17 12:58:58.339326 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Host: 10.222.0.48 Jun 17 12:58:58.339326 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Openstack-System-Scope: None Jun 17 12:58:58.339326 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: User-Agent: python-urllib3/1.26.9 Jun 17 12:58:58.339326 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Auth-Token: gAAAAABirHo1cMP6I0bqLGlyvysuvRBOW7vO5EyaOF1TqmIGy9qsnHHTDUXR4wH3uw5U80N1uecYmMI7iBJJu05dKjYPk-hn_yS5y_VYcI_yUyOXoTMlaM1DLSgaszWocEGx8X2HweABN9ZlfvR9RV2vh9MEKLMVp90zOjE3ASqXxFM6xdn_pco Jun 17 12:58:58.339326 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Domain-Id: None Jun 17 12:58:58.339326 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Domain-Name: None Jun 17 12:58:58.339326 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Identity-Status: Confirmed Jun 17 12:58:58.339326 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Is-Admin-Project: True Jun 17 12:58:58.339326 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Project-Domain-Id: default Jun 17 12:58:58.339326 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Project-Domain-Name: Default Jun 17 12:58:58.339326 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Project-Id: 4c048fb2cf4e491980fb65a8e32b0fb2 Jun 17 12:58:58.339326 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Project-Name: tempest-DeleteServersTestJSON-367009746 Jun 17 12:58:58.339326 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Role: member,reader Jun 17 12:58:58.339326 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Roles: member,reader Jun 17 12:58:58.340486 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_4c048fb2cf4e491980fb65a8e32b0fb2", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4c048fb2cf4e491980fb65a8e32b0fb2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4c048fb2cf4e491980fb65a8e32b0fb2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/4c048fb2cf4e491980fb65a8e32b0fb2"}]}] Jun 17 12:58:58.340486 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Tenant: tempest-DeleteServersTestJSON-367009746 Jun 17 12:58:58.340486 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Tenant-Id: 4c048fb2cf4e491980fb65a8e32b0fb2 Jun 17 12:58:58.340486 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Tenant-Name: tempest-DeleteServersTestJSON-367009746 Jun 17 12:58:58.340486 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-User: tempest-DeleteServersTestJSON-367009746-project Jun 17 12:58:58.340486 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-User-Domain-Id: default Jun 17 12:58:58.340486 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-User-Domain-Name: Default Jun 17 12:58:58.340486 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-User-Id: e2d0edf9b51d4370950f7ff503c324b8 Jun 17 12:58:58.340486 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-User-Name: tempest-DeleteServersTestJSON-367009746-project Jun 17 12:58:58.340486 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: method: > Jun 17 12:58:58.340486 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: exception: Instance 73cb6bde-cad3-43ef-b361-62ff89b3544a could not be found. Jun 17 12:58:58.340486 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: action_args: {'id': '73cb6bde-cad3-43ef-b361-62ff89b3544a'} Jun 17 12:58:58.341626 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 12:58:58.341626 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 12:58:58.341626 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 12:58:58.341626 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 12:58:58.341626 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 12:58:58.341626 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 12:58:58.341626 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 12:58:58.341626 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 12:58:58.341626 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 12:58:58.341626 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 12:58:58.341626 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73cb6bde-cad3-43ef-b361-62ff89b3544a could not be found. Jun 17 12:58:58.341626 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 12:58:58.341626 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 12:58:58.341626 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 12:58:58.341626 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 12:58:58.341626 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 12:58:58.341626 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 12:58:58.341626 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 12:58:58.341626 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 12:58:58.341626 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 12:58:58.342713 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 12:58:58.342713 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 12:58:58.342713 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 12:58:58.342713 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 12:58:58.342713 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 12:58:58.342713 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 12:58:58.342713 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 12:58:58.342713 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73cb6bde-cad3-43ef-b361-62ff89b3544a could not be found. Jun 17 12:58:58.342713 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 12:58:58.342713 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 12:58:58.342713 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 12:58:58.342713 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 12:58:58.342713 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 12:58:58.342713 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 12:58:58.342713 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 12:58:58.342713 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 12:58:58.342713 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73cb6bde-cad3-43ef-b361-62ff89b3544a could not be found. Jun 17 12:58:58.342713 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 12:58:58.343632 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-24a6f22f-8f32-4535-91a4-0acf79dd24f2 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] Returning 404 to user: Instance 73cb6bde-cad3-43ef-b361-62ff89b3544a could not be found. {{(pid=117660) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 12:58:58.343632 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-24a6f22f-8f32-4535-91a4-0acf79dd24f2 tempest-DeleteServersTestJSON-367009746 tempest-DeleteServersTestJSON-367009746-project] 10.222.0.48 "GET /compute/v2.1/servers/73cb6bde-cad3-43ef-b361-62ff89b3544a" status: 404 len: 111 microversion: 2.1 time: 0.032274 Jun 17 12:58:58.345876 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 119/230] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:58:58 2022] GET /compute/v2.1/servers/73cb6bde-cad3-43ef-b361-62ff89b3544a => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 12:58:58.412681 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-2fdef26e-93a7-46d7-8f71-42533ab6db77 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:58.428682 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-2fdef26e-93a7-46d7-8f71-42533ab6db77 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce" status: 200 len: 1520 microversion: 2.1 time: 0.234997 Jun 17 12:58:58.429273 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 112/231] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:58:58 2022] GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce => generated 1520 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 12:58:59.446651 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-c4ca71b4-875e-4f0e-82a2-f5a1cfba4bb6 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:58:59.447270 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-c4ca71b4-875e-4f0e-82a2-f5a1cfba4bb6 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: cc3f5e1d-d03b-4fe4-b777-8aedac2761ce] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:58:59.453674 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c4ca71b4-875e-4f0e-82a2-f5a1cfba4bb6 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:59.454148 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c4ca71b4-875e-4f0e-82a2-f5a1cfba4bb6 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:59.454928 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c4ca71b4-875e-4f0e-82a2-f5a1cfba4bb6 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:58:59.455360 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c4ca71b4-875e-4f0e-82a2-f5a1cfba4bb6 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:58:59.458474 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:58:59.613196 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-c4ca71b4-875e-4f0e-82a2-f5a1cfba4bb6 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:58:59.626183 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-c4ca71b4-875e-4f0e-82a2-f5a1cfba4bb6 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce" status: 200 len: 1520 microversion: 2.1 time: 0.182503 Jun 17 12:58:59.627615 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 120/232] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:58:59 2022] GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce => generated 1520 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:59:00.651791 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-47f8a9cf-439d-4b32-b302-5ac8f367790a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:00.652822 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-47f8a9cf-439d-4b32-b302-5ac8f367790a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: cc3f5e1d-d03b-4fe4-b777-8aedac2761ce] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:00.660735 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-47f8a9cf-439d-4b32-b302-5ac8f367790a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:00.661469 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-47f8a9cf-439d-4b32-b302-5ac8f367790a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:00.662995 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-47f8a9cf-439d-4b32-b302-5ac8f367790a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:00.663755 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-47f8a9cf-439d-4b32-b302-5ac8f367790a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:00.974952 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-47f8a9cf-439d-4b32-b302-5ac8f367790a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:59:00.983470 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-47f8a9cf-439d-4b32-b302-5ac8f367790a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce" status: 200 len: 1520 microversion: 2.1 time: 0.335486 Jun 17 12:59:00.984177 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 113/233] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:59:00 2022] GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce => generated 1520 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:59:02.001448 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-508ae7f8-1b8d-4a38-a87d-1fe742e87c76 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:02.002124 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-508ae7f8-1b8d-4a38-a87d-1fe742e87c76 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: cc3f5e1d-d03b-4fe4-b777-8aedac2761ce] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:02.017216 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-508ae7f8-1b8d-4a38-a87d-1fe742e87c76 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:02.017570 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-508ae7f8-1b8d-4a38-a87d-1fe742e87c76 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:02.018556 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-508ae7f8-1b8d-4a38-a87d-1fe742e87c76 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:02.019205 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-508ae7f8-1b8d-4a38-a87d-1fe742e87c76 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:02.276647 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-508ae7f8-1b8d-4a38-a87d-1fe742e87c76 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:59:02.290586 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-508ae7f8-1b8d-4a38-a87d-1fe742e87c76 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce" status: 200 len: 1520 microversion: 2.1 time: 0.293422 Jun 17 12:59:02.296692 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 121/234] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:59:01 2022] GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce => generated 1520 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:59:03.317333 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-cb2af02a-39e6-47ea-a9a7-7e338cde0a3b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:03.323316 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-cb2af02a-39e6-47ea-a9a7-7e338cde0a3b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: cc3f5e1d-d03b-4fe4-b777-8aedac2761ce] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:03.335606 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-cb2af02a-39e6-47ea-a9a7-7e338cde0a3b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:03.336517 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-cb2af02a-39e6-47ea-a9a7-7e338cde0a3b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:03.337636 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-cb2af02a-39e6-47ea-a9a7-7e338cde0a3b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:03.338624 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-cb2af02a-39e6-47ea-a9a7-7e338cde0a3b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:03.621595 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-cb2af02a-39e6-47ea-a9a7-7e338cde0a3b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:59:03.633475 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-cb2af02a-39e6-47ea-a9a7-7e338cde0a3b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce" status: 200 len: 1520 microversion: 2.1 time: 0.326030 Jun 17 12:59:03.634404 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 114/235] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:59:03 2022] GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce => generated 1520 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:59:04.652232 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-9e4b012a-c3b2-4c80-a1f1-a5d2fc291f85 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:04.652881 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-9e4b012a-c3b2-4c80-a1f1-a5d2fc291f85 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: cc3f5e1d-d03b-4fe4-b777-8aedac2761ce] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:04.656418 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_cell0:SELECT=4 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:59:04.660544 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9e4b012a-c3b2-4c80-a1f1-a5d2fc291f85 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:04.661353 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9e4b012a-c3b2-4c80-a1f1-a5d2fc291f85 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:04.662149 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9e4b012a-c3b2-4c80-a1f1-a5d2fc291f85 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:04.662591 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9e4b012a-c3b2-4c80-a1f1-a5d2fc291f85 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:04.889847 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-3f5bbd26-e406-4a67-902b-fad3c59bf127 tempest-VolumesSnapshotsTestJSON-1720863030 tempest-VolumesSnapshotsTestJSON-1720863030-project] Action: 'create', calling method: .version_select at 0x7f019018e550>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1600358212"}} {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 12:59:05.048331 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-9e4b012a-c3b2-4c80-a1f1-a5d2fc291f85 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:59:05.066411 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-9e4b012a-c3b2-4c80-a1f1-a5d2fc291f85 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce" status: 200 len: 1520 microversion: 2.1 time: 0.419594 Jun 17 12:59:05.067444 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 122/236] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:59:04 2022] GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce => generated 1520 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:59:05.400172 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-3f5bbd26-e406-4a67-902b-fad3c59bf127 tempest-VolumesSnapshotsTestJSON-1720863030 tempest-VolumesSnapshotsTestJSON-1720863030-project] 10.222.0.48 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.748535 Jun 17 12:59:05.401969 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 115/237] 10.222.0.48 () {60 vars in 1154 bytes} [Fri Jun 17 12:59:04 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 751 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 17 12:59:05.414974 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-cd4d18fe-cd3a-4d83-b21b-f0cbd7a2758f tempest-VolumesSnapshotsTestJSON-1720863030 tempest-VolumesSnapshotsTestJSON-1720863030-project] Calling method '.version_select at 0x7f01901f30d0>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:05.475192 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-cd4d18fe-cd3a-4d83-b21b-f0cbd7a2758f tempest-VolumesSnapshotsTestJSON-1720863030 tempest-VolumesSnapshotsTestJSON-1720863030-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/41878b9c-fdac-4fa0-9940-a1158a3e3bb5" status: 200 len: 345 microversion: 2.1 time: 0.064833 Jun 17 12:59:05.476080 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 123/238] 10.222.0.48 () {58 vars in 1244 bytes} [Fri Jun 17 12:59:05 2022] GET /compute/v2.1/os-volumes/41878b9c-fdac-4fa0-9940-a1158a3e3bb5 => generated 345 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:59:06.084494 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-43cb74a8-be82-440a-b17c-3c65eb080107 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:06.085230 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-43cb74a8-be82-440a-b17c-3c65eb080107 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: cc3f5e1d-d03b-4fe4-b777-8aedac2761ce] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:06.092663 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-43cb74a8-be82-440a-b17c-3c65eb080107 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:06.093142 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-43cb74a8-be82-440a-b17c-3c65eb080107 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:06.094324 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-43cb74a8-be82-440a-b17c-3c65eb080107 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:06.094764 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-43cb74a8-be82-440a-b17c-3c65eb080107 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:06.102166 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:59:06.272399 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-43cb74a8-be82-440a-b17c-3c65eb080107 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:59:06.281423 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-43cb74a8-be82-440a-b17c-3c65eb080107 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce" status: 200 len: 1520 microversion: 2.1 time: 0.201478 Jun 17 12:59:06.282122 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 116/239] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:59:06 2022] GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce => generated 1520 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:59:06.487656 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-9d85adf8-ebcf-42e4-8742-9766a39cce74 tempest-VolumesSnapshotsTestJSON-1720863030 tempest-VolumesSnapshotsTestJSON-1720863030-project] Calling method '.version_select at 0x7f0190437160>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:06.554731 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-9d85adf8-ebcf-42e4-8742-9766a39cce74 tempest-VolumesSnapshotsTestJSON-1720863030 tempest-VolumesSnapshotsTestJSON-1720863030-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/41878b9c-fdac-4fa0-9940-a1158a3e3bb5" status: 200 len: 345 microversion: 2.1 time: 0.071166 Jun 17 12:59:06.555305 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 124/240] 10.222.0.48 () {58 vars in 1244 bytes} [Fri Jun 17 12:59:06 2022] GET /compute/v2.1/os-volumes/41878b9c-fdac-4fa0-9940-a1158a3e3bb5 => generated 345 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:59:07.304642 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-32542944-bec8-4aa1-a0a2-48ba15160c1d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:07.305618 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-32542944-bec8-4aa1-a0a2-48ba15160c1d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: cc3f5e1d-d03b-4fe4-b777-8aedac2761ce] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:07.316887 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-32542944-bec8-4aa1-a0a2-48ba15160c1d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:07.317539 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-32542944-bec8-4aa1-a0a2-48ba15160c1d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:07.318703 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-32542944-bec8-4aa1-a0a2-48ba15160c1d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:07.319234 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-32542944-bec8-4aa1-a0a2-48ba15160c1d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:07.464589 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-32542944-bec8-4aa1-a0a2-48ba15160c1d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:59:07.484710 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-32542944-bec8-4aa1-a0a2-48ba15160c1d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce" status: 200 len: 1520 microversion: 2.1 time: 0.184925 Jun 17 12:59:07.485866 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 117/241] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:59:07 2022] GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce => generated 1520 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:59:07.567920 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-e8965fc7-eff3-4f1f-8d73-dc474f5d657a tempest-VolumesSnapshotsTestJSON-1720863030 tempest-VolumesSnapshotsTestJSON-1720863030-project] Calling method '.version_select at 0x7f01901e1a60>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:07.626375 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-e8965fc7-eff3-4f1f-8d73-dc474f5d657a tempest-VolumesSnapshotsTestJSON-1720863030 tempest-VolumesSnapshotsTestJSON-1720863030-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/41878b9c-fdac-4fa0-9940-a1158a3e3bb5" status: 200 len: 346 microversion: 2.1 time: 0.062481 Jun 17 12:59:07.626987 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 125/242] 10.222.0.48 () {58 vars in 1244 bytes} [Fri Jun 17 12:59:07 2022] GET /compute/v2.1/os-volumes/41878b9c-fdac-4fa0-9940-a1158a3e3bb5 => generated 346 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:59:07.642541 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-8aaddd26-afd3-493d-b43e-ee300a2a3fc7 tempest-VolumesSnapshotsTestJSON-1720863030 tempest-VolumesSnapshotsTestJSON-1720863030-project] Action: 'create', calling method: .version_select at 0x7f01902c9ca0>, body: {"snapshot": {"volume_id": "41878b9c-fdac-4fa0-9940-a1158a3e3bb5", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-547612662"}} {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 12:59:07.808571 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-8aaddd26-afd3-493d-b43e-ee300a2a3fc7 tempest-VolumesSnapshotsTestJSON-1720863030 tempest-VolumesSnapshotsTestJSON-1720863030-project] 10.222.0.48 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.171482 Jun 17 12:59:07.809166 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 118/243] 10.222.0.48 () {60 vars in 1161 bytes} [Fri Jun 17 12:59:07 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:59:07.820341 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-eef27b18-8f1b-4ad9-906d-ab1adabb5816 tempest-VolumesSnapshotsTestJSON-1720863030 tempest-VolumesSnapshotsTestJSON-1720863030-project] Calling method '.version_select at 0x7f01901e1c10>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:07.855792 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-eef27b18-8f1b-4ad9-906d-ab1adabb5816 tempest-VolumesSnapshotsTestJSON-1720863030 tempest-VolumesSnapshotsTestJSON-1720863030-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/13068a54-f7b7-400d-a867-a9a3b7a3cdf2" status: 200 len: 286 microversion: 2.1 time: 0.040541 Jun 17 12:59:07.856364 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 126/244] 10.222.0.48 () {58 vars in 1250 bytes} [Fri Jun 17 12:59:07 2022] GET /compute/v2.1/os-snapshots/13068a54-f7b7-400d-a867-a9a3b7a3cdf2 => generated 286 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:59:07.866894 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-13023f19-b910-4620-ae0f-ea22d92f65a9 tempest-VolumesSnapshotsTestJSON-1720863030 tempest-VolumesSnapshotsTestJSON-1720863030-project] Calling method '.version_select at 0x7f0190251040>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:07.910109 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-13023f19-b910-4620-ae0f-ea22d92f65a9 tempest-VolumesSnapshotsTestJSON-1720863030 tempest-VolumesSnapshotsTestJSON-1720863030-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.047484 Jun 17 12:59:07.910878 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 119/245] 10.222.0.48 () {58 vars in 1139 bytes} [Fri Jun 17 12:59:07 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:59:07.920875 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-c7932af3-7a0b-4239-be58-bfd642721347 tempest-VolumesSnapshotsTestJSON-1720863030 tempest-VolumesSnapshotsTestJSON-1720863030-project] Calling method '.version_select at 0x7f0190453c10>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:07.974425 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-c7932af3-7a0b-4239-be58-bfd642721347 tempest-VolumesSnapshotsTestJSON-1720863030 tempest-VolumesSnapshotsTestJSON-1720863030-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/13068a54-f7b7-400d-a867-a9a3b7a3cdf2" status: 200 len: 286 microversion: 2.1 time: 0.057249 Jun 17 12:59:07.975096 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 127/246] 10.222.0.48 () {58 vars in 1250 bytes} [Fri Jun 17 12:59:07 2022] GET /compute/v2.1/os-snapshots/13068a54-f7b7-400d-a867-a9a3b7a3cdf2 => generated 286 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:59:08.503885 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-45dbe83c-c125-477e-904f-c4524b76915d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:08.504495 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-45dbe83c-c125-477e-904f-c4524b76915d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: cc3f5e1d-d03b-4fe4-b777-8aedac2761ce] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:08.511737 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-45dbe83c-c125-477e-904f-c4524b76915d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:08.512159 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-45dbe83c-c125-477e-904f-c4524b76915d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:08.512945 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-45dbe83c-c125-477e-904f-c4524b76915d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:08.513371 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-45dbe83c-c125-477e-904f-c4524b76915d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:08.658280 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-45dbe83c-c125-477e-904f-c4524b76915d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:59:08.666847 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-45dbe83c-c125-477e-904f-c4524b76915d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce" status: 200 len: 1520 microversion: 2.1 time: 0.167630 Jun 17 12:59:08.667353 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 120/247] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:59:08 2022] GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce => generated 1520 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:59:08.986679 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-83ab8f14-1bb3-4afb-ab4b-b65be3801604 tempest-VolumesSnapshotsTestJSON-1720863030 tempest-VolumesSnapshotsTestJSON-1720863030-project] Calling method '.version_select at 0x7f01901f3790>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:09.022908 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-83ab8f14-1bb3-4afb-ab4b-b65be3801604 tempest-VolumesSnapshotsTestJSON-1720863030 tempest-VolumesSnapshotsTestJSON-1720863030-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/13068a54-f7b7-400d-a867-a9a3b7a3cdf2" status: 200 len: 286 microversion: 2.1 time: 0.040127 Jun 17 12:59:09.023482 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 128/248] 10.222.0.48 () {58 vars in 1250 bytes} [Fri Jun 17 12:59:08 2022] GET /compute/v2.1/os-snapshots/13068a54-f7b7-400d-a867-a9a3b7a3cdf2 => generated 286 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:59:09.683942 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-c3fe3835-24f4-483b-988e-d8cc72a34df7 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:09.684557 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-c3fe3835-24f4-483b-988e-d8cc72a34df7 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: cc3f5e1d-d03b-4fe4-b777-8aedac2761ce] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:09.690891 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c3fe3835-24f4-483b-988e-d8cc72a34df7 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:09.691339 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c3fe3835-24f4-483b-988e-d8cc72a34df7 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:09.692064 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c3fe3835-24f4-483b-988e-d8cc72a34df7 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:09.692789 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c3fe3835-24f4-483b-988e-d8cc72a34df7 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:10.035248 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-edaae250-3c0a-4223-88dc-5a46d72be477 tempest-VolumesSnapshotsTestJSON-1720863030 tempest-VolumesSnapshotsTestJSON-1720863030-project] Calling method '.version_select at 0x7f01901f34c0>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:10.062269 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-c3fe3835-24f4-483b-988e-d8cc72a34df7 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:59:10.070307 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-c3fe3835-24f4-483b-988e-d8cc72a34df7 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce" status: 200 len: 1520 microversion: 2.1 time: 0.390294 Jun 17 12:59:10.070897 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 121/249] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:59:09 2022] GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce => generated 1520 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:59:10.075507 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-edaae250-3c0a-4223-88dc-5a46d72be477 tempest-VolumesSnapshotsTestJSON-1720863030 tempest-VolumesSnapshotsTestJSON-1720863030-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/13068a54-f7b7-400d-a867-a9a3b7a3cdf2" status: 200 len: 286 microversion: 2.1 time: 0.044195 Jun 17 12:59:10.076157 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 129/250] 10.222.0.48 () {58 vars in 1250 bytes} [Fri Jun 17 12:59:10 2022] GET /compute/v2.1/os-snapshots/13068a54-f7b7-400d-a867-a9a3b7a3cdf2 => generated 286 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:59:11.088510 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-facba3c9-9cb3-4f34-8b0e-0e88f8e08a50 tempest-VolumesSnapshotsTestJSON-1720863030 tempest-VolumesSnapshotsTestJSON-1720863030-project] Calling method '.version_select at 0x7f019018ec10>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:11.089933 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-677314b6-4910-44ec-a9eb-adf80295043a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:11.090905 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-677314b6-4910-44ec-a9eb-adf80295043a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: cc3f5e1d-d03b-4fe4-b777-8aedac2761ce] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:11.101300 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-677314b6-4910-44ec-a9eb-adf80295043a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:11.101748 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-677314b6-4910-44ec-a9eb-adf80295043a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:11.102597 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-677314b6-4910-44ec-a9eb-adf80295043a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:11.103022 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-677314b6-4910-44ec-a9eb-adf80295043a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:11.123511 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-facba3c9-9cb3-4f34-8b0e-0e88f8e08a50 tempest-VolumesSnapshotsTestJSON-1720863030 tempest-VolumesSnapshotsTestJSON-1720863030-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/13068a54-f7b7-400d-a867-a9a3b7a3cdf2" status: 200 len: 286 microversion: 2.1 time: 0.038242 Jun 17 12:59:11.123771 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 122/251] 10.222.0.48 () {58 vars in 1250 bytes} [Fri Jun 17 12:59:11 2022] GET /compute/v2.1/os-snapshots/13068a54-f7b7-400d-a867-a9a3b7a3cdf2 => generated 286 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:59:11.244735 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-677314b6-4910-44ec-a9eb-adf80295043a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:59:11.253550 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-677314b6-4910-44ec-a9eb-adf80295043a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce" status: 200 len: 1520 microversion: 2.1 time: 0.167507 Jun 17 12:59:11.254186 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 130/252] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:59:11 2022] GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce => generated 1520 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:59:12.137183 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-ab80cd6b-2274-4939-8ee8-04b925e6abb0 tempest-VolumesSnapshotsTestJSON-1720863030 tempest-VolumesSnapshotsTestJSON-1720863030-project] Calling method '.version_select at 0x7f01902e63a0>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:12.167959 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-ab80cd6b-2274-4939-8ee8-04b925e6abb0 tempest-VolumesSnapshotsTestJSON-1720863030 tempest-VolumesSnapshotsTestJSON-1720863030-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/13068a54-f7b7-400d-a867-a9a3b7a3cdf2" status: 200 len: 286 microversion: 2.1 time: 0.035314 Jun 17 12:59:12.168556 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 123/253] 10.222.0.48 () {58 vars in 1250 bytes} [Fri Jun 17 12:59:12 2022] GET /compute/v2.1/os-snapshots/13068a54-f7b7-400d-a867-a9a3b7a3cdf2 => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:59:12.273349 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-82a1df59-7a6c-4c39-b14d-63447731306f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:12.273940 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-82a1df59-7a6c-4c39-b14d-63447731306f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: cc3f5e1d-d03b-4fe4-b777-8aedac2761ce] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:12.281021 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-82a1df59-7a6c-4c39-b14d-63447731306f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:12.281474 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-82a1df59-7a6c-4c39-b14d-63447731306f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:12.282337 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-82a1df59-7a6c-4c39-b14d-63447731306f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:12.282770 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-82a1df59-7a6c-4c39-b14d-63447731306f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:12.435311 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-82a1df59-7a6c-4c39-b14d-63447731306f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:59:12.444041 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-82a1df59-7a6c-4c39-b14d-63447731306f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce" status: 200 len: 1520 microversion: 2.1 time: 0.175754 Jun 17 12:59:12.444744 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 131/254] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:59:12 2022] GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce => generated 1520 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 12:59:13.180823 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-cc09dc41-832c-4237-bde2-56dbd12afe67 tempest-VolumesSnapshotsTestJSON-1720863030 tempest-VolumesSnapshotsTestJSON-1720863030-project] Calling method '.version_select at 0x7f01901943a0>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:13.214011 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-cc09dc41-832c-4237-bde2-56dbd12afe67 tempest-VolumesSnapshotsTestJSON-1720863030 tempest-VolumesSnapshotsTestJSON-1720863030-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/13068a54-f7b7-400d-a867-a9a3b7a3cdf2" status: 200 len: 286 microversion: 2.1 time: 0.038237 Jun 17 12:59:13.214469 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 124/255] 10.222.0.48 () {58 vars in 1250 bytes} [Fri Jun 17 12:59:13 2022] GET /compute/v2.1/os-snapshots/13068a54-f7b7-400d-a867-a9a3b7a3cdf2 => generated 286 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:59:13.469040 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-ce0a68a8-85ab-4573-ab67-437f62bff1af tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:13.469637 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-ce0a68a8-85ab-4573-ab67-437f62bff1af tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: cc3f5e1d-d03b-4fe4-b777-8aedac2761ce] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:13.476583 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ce0a68a8-85ab-4573-ab67-437f62bff1af tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:13.478438 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ce0a68a8-85ab-4573-ab67-437f62bff1af tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:13.479302 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ce0a68a8-85ab-4573-ab67-437f62bff1af tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:13.479652 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ce0a68a8-85ab-4573-ab67-437f62bff1af tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:13.613650 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-ce0a68a8-85ab-4573-ab67-437f62bff1af tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:59:13.622479 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-ce0a68a8-85ab-4573-ab67-437f62bff1af tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce" status: 200 len: 1520 microversion: 2.1 time: 0.157875 Jun 17 12:59:13.623056 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 132/256] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:59:13 2022] GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:59:14.225919 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-891672a4-896c-4982-b8e9-b700dc04d9f2 tempest-VolumesSnapshotsTestJSON-1720863030 tempest-VolumesSnapshotsTestJSON-1720863030-project] Calling method '.version_select at 0x7f01902598b0>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:14.256601 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-891672a4-896c-4982-b8e9-b700dc04d9f2 tempest-VolumesSnapshotsTestJSON-1720863030 tempest-VolumesSnapshotsTestJSON-1720863030-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/13068a54-f7b7-400d-a867-a9a3b7a3cdf2" status: 200 len: 286 microversion: 2.1 time: 0.035135 Jun 17 12:59:14.257187 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 125/257] 10.222.0.48 () {58 vars in 1250 bytes} [Fri Jun 17 12:59:14 2022] GET /compute/v2.1/os-snapshots/13068a54-f7b7-400d-a867-a9a3b7a3cdf2 => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:59:14.642037 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-2f5e542d-344a-4cc7-a99c-cfa99056f699 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:14.642622 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-2f5e542d-344a-4cc7-a99c-cfa99056f699 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: cc3f5e1d-d03b-4fe4-b777-8aedac2761ce] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:14.649183 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2f5e542d-344a-4cc7-a99c-cfa99056f699 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:14.649606 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2f5e542d-344a-4cc7-a99c-cfa99056f699 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:14.650418 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2f5e542d-344a-4cc7-a99c-cfa99056f699 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:14.650840 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2f5e542d-344a-4cc7-a99c-cfa99056f699 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:14.788122 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-2f5e542d-344a-4cc7-a99c-cfa99056f699 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:59:14.800164 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-2f5e542d-344a-4cc7-a99c-cfa99056f699 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce" status: 200 len: 1520 microversion: 2.1 time: 0.161345 Jun 17 12:59:14.800911 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 133/258] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:59:14 2022] GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:59:15.269433 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-69b29c3b-5592-4399-be90-5fe5da26e6f3 tempest-VolumesSnapshotsTestJSON-1720863030 tempest-VolumesSnapshotsTestJSON-1720863030-project] Calling method '.version_select at 0x7f019018eb80>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:15.299900 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-69b29c3b-5592-4399-be90-5fe5da26e6f3 tempest-VolumesSnapshotsTestJSON-1720863030 tempest-VolumesSnapshotsTestJSON-1720863030-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/13068a54-f7b7-400d-a867-a9a3b7a3cdf2" status: 200 len: 286 microversion: 2.1 time: 0.034731 Jun 17 12:59:15.301604 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 126/259] 10.222.0.48 () {58 vars in 1250 bytes} [Fri Jun 17 12:59:15 2022] GET /compute/v2.1/os-snapshots/13068a54-f7b7-400d-a867-a9a3b7a3cdf2 => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:59:15.817197 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-dc668b2c-beb7-4b64-8c85-7902d727087f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:15.817821 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-dc668b2c-beb7-4b64-8c85-7902d727087f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: cc3f5e1d-d03b-4fe4-b777-8aedac2761ce] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:15.824569 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dc668b2c-beb7-4b64-8c85-7902d727087f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:15.825018 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dc668b2c-beb7-4b64-8c85-7902d727087f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:15.825797 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dc668b2c-beb7-4b64-8c85-7902d727087f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:15.826311 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dc668b2c-beb7-4b64-8c85-7902d727087f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:15.981516 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-dc668b2c-beb7-4b64-8c85-7902d727087f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:59:15.993373 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-dc668b2c-beb7-4b64-8c85-7902d727087f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce" status: 200 len: 1520 microversion: 2.1 time: 0.179905 Jun 17 12:59:15.994320 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 134/260] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:59:15 2022] GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce => generated 1520 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:59:16.312619 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-1a1f3b18-cd55-4884-92d4-dfc69cb35bcc tempest-VolumesSnapshotsTestJSON-1720863030 tempest-VolumesSnapshotsTestJSON-1720863030-project] Calling method '.version_select at 0x7f019019e040>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:16.347829 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-1a1f3b18-cd55-4884-92d4-dfc69cb35bcc tempest-VolumesSnapshotsTestJSON-1720863030 tempest-VolumesSnapshotsTestJSON-1720863030-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/13068a54-f7b7-400d-a867-a9a3b7a3cdf2" status: 200 len: 287 microversion: 2.1 time: 0.039543 Jun 17 12:59:16.348609 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 127/261] 10.222.0.48 () {58 vars in 1250 bytes} [Fri Jun 17 12:59:16 2022] GET /compute/v2.1/os-snapshots/13068a54-f7b7-400d-a867-a9a3b7a3cdf2 => generated 287 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:59:16.359193 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-c812ac7b-368d-4966-8dcf-8701d363b6b9 tempest-VolumesSnapshotsTestJSON-1720863030 tempest-VolumesSnapshotsTestJSON-1720863030-project] Calling method '.version_select at 0x7f019032c310>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:16.426323 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-c812ac7b-368d-4966-8dcf-8701d363b6b9 tempest-VolumesSnapshotsTestJSON-1720863030 tempest-VolumesSnapshotsTestJSON-1720863030-project] 10.222.0.48 "DELETE /compute/v2.1/os-snapshots/13068a54-f7b7-400d-a867-a9a3b7a3cdf2" status: 202 len: 0 microversion: 2.1 time: 0.070552 Jun 17 12:59:16.427062 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 135/262] 10.222.0.48 () {58 vars in 1253 bytes} [Fri Jun 17 12:59:16 2022] DELETE /compute/v2.1/os-snapshots/13068a54-f7b7-400d-a867-a9a3b7a3cdf2 => generated 0 bytes in 72 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 12:59:16.435680 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-a8f71cd8-2ba3-4786-a387-edafef43211a tempest-VolumesSnapshotsTestJSON-1720863030 tempest-VolumesSnapshotsTestJSON-1720863030-project] Calling method '.version_select at 0x7f0190194940>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:16.465176 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-a8f71cd8-2ba3-4786-a387-edafef43211a tempest-VolumesSnapshotsTestJSON-1720863030 tempest-VolumesSnapshotsTestJSON-1720863030-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/13068a54-f7b7-400d-a867-a9a3b7a3cdf2" status: 200 len: 286 microversion: 2.1 time: 0.033452 Jun 17 12:59:16.465746 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 128/263] 10.222.0.48 () {58 vars in 1250 bytes} [Fri Jun 17 12:59:16 2022] GET /compute/v2.1/os-snapshots/13068a54-f7b7-400d-a867-a9a3b7a3cdf2 => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:59:17.016419 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-1824db25-b1f3-415a-b4be-bfd01349270a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:17.017352 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-1824db25-b1f3-415a-b4be-bfd01349270a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: cc3f5e1d-d03b-4fe4-b777-8aedac2761ce] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:17.023931 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1824db25-b1f3-415a-b4be-bfd01349270a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:17.024369 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1824db25-b1f3-415a-b4be-bfd01349270a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:17.025137 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1824db25-b1f3-415a-b4be-bfd01349270a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:17.025559 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1824db25-b1f3-415a-b4be-bfd01349270a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:17.169516 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-1824db25-b1f3-415a-b4be-bfd01349270a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:59:17.178413 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-1824db25-b1f3-415a-b4be-bfd01349270a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce" status: 200 len: 1520 microversion: 2.1 time: 0.165891 Jun 17 12:59:17.179246 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 136/264] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:59:17 2022] GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce => generated 1520 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:59:17.480019 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-04a6c9a9-830b-48a9-926e-38d977842dd2 tempest-VolumesSnapshotsTestJSON-1720863030 tempest-VolumesSnapshotsTestJSON-1720863030-project] Calling method '.version_select at 0x7f0190259a60>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:17.513728 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-04a6c9a9-830b-48a9-926e-38d977842dd2 tempest-VolumesSnapshotsTestJSON-1720863030 tempest-VolumesSnapshotsTestJSON-1720863030-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/13068a54-f7b7-400d-a867-a9a3b7a3cdf2" status: 200 len: 286 microversion: 2.1 time: 0.039168 Jun 17 12:59:17.514533 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 129/265] 10.222.0.48 () {58 vars in 1250 bytes} [Fri Jun 17 12:59:17 2022] GET /compute/v2.1/os-snapshots/13068a54-f7b7-400d-a867-a9a3b7a3cdf2 => generated 286 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:59:18.199361 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-b07ccabb-f283-4cf5-b3b4-641306a323cc tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:18.199940 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-b07ccabb-f283-4cf5-b3b4-641306a323cc tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: cc3f5e1d-d03b-4fe4-b777-8aedac2761ce] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:18.206072 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b07ccabb-f283-4cf5-b3b4-641306a323cc tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:18.206551 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b07ccabb-f283-4cf5-b3b4-641306a323cc tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:18.207346 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b07ccabb-f283-4cf5-b3b4-641306a323cc tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:18.207776 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b07ccabb-f283-4cf5-b3b4-641306a323cc tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:18.346469 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-b07ccabb-f283-4cf5-b3b4-641306a323cc tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:59:18.356721 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-b07ccabb-f283-4cf5-b3b4-641306a323cc tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce" status: 200 len: 1520 microversion: 2.1 time: 0.161772 Jun 17 12:59:18.357349 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 137/266] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:59:18 2022] GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:59:18.526505 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-4d2ed41c-db68-4bd5-bc22-d671ee6433e4 tempest-VolumesSnapshotsTestJSON-1720863030 tempest-VolumesSnapshotsTestJSON-1720863030-project] Calling method '.version_select at 0x7f0190200670>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:18.555350 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.wsgi [None req-4d2ed41c-db68-4bd5-bc22-d671ee6433e4 tempest-VolumesSnapshotsTestJSON-1720863030 tempest-VolumesSnapshotsTestJSON-1720863030-project] HTTP exception thrown: Snapshot 13068a54-f7b7-400d-a867-a9a3b7a3cdf2 could not be found. Jun 17 12:59:18.557789 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-4d2ed41c-db68-4bd5-bc22-d671ee6433e4 tempest-VolumesSnapshotsTestJSON-1720863030 tempest-VolumesSnapshotsTestJSON-1720863030-project] Request method failure captured: Jun 17 12:59:18.557789 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: request: GET /compute/v2.1/os-snapshots/13068a54-f7b7-400d-a867-a9a3b7a3cdf2 HTTP/1.1 Jun 17 12:59:18.557789 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Accept: application/json Jun 17 12:59:18.557789 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Accept-Encoding: identity Jun 17 12:59:18.557789 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Connection: close Jun 17 12:59:18.557789 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Content-Length: 0 Jun 17 12:59:18.557789 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Content-Type: application/json Jun 17 12:59:18.557789 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Host: 10.222.0.48 Jun 17 12:59:18.557789 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Openstack-System-Scope: None Jun 17 12:59:18.557789 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: User-Agent: python-urllib3/1.26.9 Jun 17 12:59:18.557789 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Auth-Token: gAAAAABirHqY9zh8xfcwmD80Q56UWMnYrmzHz_mx5-WZ9BsLhI2wHt6rBnAS_kCDSqCOj9HRVojKFBepqH5VIbz0XbiuVL2LahN3GB2ZtOjgrTdvvOAZf4HNO306pq6w153XNe8MGt2ua5wQ3LaMNJa8MzObZnieNHozKHaCbbDANDVl7H1Hwlc Jun 17 12:59:18.557789 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Domain-Id: None Jun 17 12:59:18.557789 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Domain-Name: None Jun 17 12:59:18.557789 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Identity-Status: Confirmed Jun 17 12:59:18.557789 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Is-Admin-Project: True Jun 17 12:59:18.557789 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Project-Domain-Id: default Jun 17 12:59:18.557789 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Project-Domain-Name: Default Jun 17 12:59:18.557789 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Project-Id: dfd5f42fc8374fae92906a128181ad69 Jun 17 12:59:18.557789 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1720863030 Jun 17 12:59:18.557789 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Role: member,reader Jun 17 12:59:18.557789 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Roles: member,reader Jun 17 12:59:18.560207 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_dfd5f42fc8374fae92906a128181ad69", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/dfd5f42fc8374fae92906a128181ad69"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/dfd5f42fc8374fae92906a128181ad69"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/dfd5f42fc8374fae92906a128181ad69"}]}] Jun 17 12:59:18.560207 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1720863030 Jun 17 12:59:18.560207 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Tenant-Id: dfd5f42fc8374fae92906a128181ad69 Jun 17 12:59:18.560207 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1720863030 Jun 17 12:59:18.560207 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User: tempest-VolumesSnapshotsTestJSON-1720863030-project Jun 17 12:59:18.560207 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User-Domain-Id: default Jun 17 12:59:18.560207 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User-Domain-Name: Default Jun 17 12:59:18.560207 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User-Id: 6e0fa033a9db4ef5b125dbb77eb8b29b Jun 17 12:59:18.560207 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1720863030-project Jun 17 12:59:18.560207 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: method: Jun 17 12:59:18.560207 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: exception: Snapshot 13068a54-f7b7-400d-a867-a9a3b7a3cdf2 could not be found. Jun 17 12:59:18.560207 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: action_args: {'id': '13068a54-f7b7-400d-a867-a9a3b7a3cdf2'} Jun 17 12:59:18.560207 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 12:59:18.561291 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 12:59:18.561291 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 17 12:59:18.561291 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 17 12:59:18.561291 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 17 12:59:18.561291 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 17 12:59:18.561291 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 17 12:59:18.561291 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 17 12:59:18.561291 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 17 12:59:18.561291 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 17 12:59:18.561291 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 17 12:59:18.561291 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 17 12:59:18.561291 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 12:59:18.561291 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 12:59:18.561291 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 12:59:18.561291 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 12:59:18.561291 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 13068a54-f7b7-400d-a867-a9a3b7a3cdf2 could not be found. (HTTP 404) (Request-ID: req-04aece9d-8c96-4ddf-b0ed-a3088c2728dc) Jun 17 12:59:18.561291 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 12:59:18.561291 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 12:59:18.562924 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 12:59:18.562924 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 12:59:18.562924 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jun 17 12:59:18.562924 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jun 17 12:59:18.562924 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 12:59:18.562924 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 12:59:18.562924 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jun 17 12:59:18.562924 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jun 17 12:59:18.562924 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 17 12:59:18.562924 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 17 12:59:18.562924 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 17 12:59:18.562924 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 17 12:59:18.562924 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 17 12:59:18.562924 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 17 12:59:18.562924 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 17 12:59:18.562924 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 17 12:59:18.562924 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 17 12:59:18.562924 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 17 12:59:18.562924 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 17 12:59:18.564185 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 17 12:59:18.564185 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 12:59:18.564185 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 12:59:18.564185 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 12:59:18.564185 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 12:59:18.564185 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 13068a54-f7b7-400d-a867-a9a3b7a3cdf2 could not be found. Jun 17 12:59:18.564185 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 12:59:18.564185 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 12:59:18.564185 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 12:59:18.564185 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 12:59:18.564185 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 12:59:18.564185 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 12:59:18.564185 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 12:59:18.564185 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 12:59:18.564185 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 17 12:59:18.564185 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 17 12:59:18.564185 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 12:59:18.564185 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 12:59:18.564185 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jun 17 12:59:18.564185 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 12:59:18.565670 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 13068a54-f7b7-400d-a867-a9a3b7a3cdf2 could not be found. Jun 17 12:59:18.565670 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 12:59:18.565670 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 12:59:18.565670 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 12:59:18.565670 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 12:59:18.565670 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 12:59:18.565670 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 12:59:18.565670 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 12:59:18.565670 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 12:59:18.565670 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 13068a54-f7b7-400d-a867-a9a3b7a3cdf2 could not be found. Jun 17 12:59:18.565670 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 12:59:18.567245 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-4d2ed41c-db68-4bd5-bc22-d671ee6433e4 tempest-VolumesSnapshotsTestJSON-1720863030 tempest-VolumesSnapshotsTestJSON-1720863030-project] Returning 404 to user: Snapshot 13068a54-f7b7-400d-a867-a9a3b7a3cdf2 could not be found. {{(pid=117659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 12:59:18.568170 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-4d2ed41c-db68-4bd5-bc22-d671ee6433e4 tempest-VolumesSnapshotsTestJSON-1720863030 tempest-VolumesSnapshotsTestJSON-1720863030-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/13068a54-f7b7-400d-a867-a9a3b7a3cdf2" status: 404 len: 111 microversion: 2.1 time: 0.046180 Jun 17 12:59:18.569139 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 130/267] 10.222.0.48 () {58 vars in 1250 bytes} [Fri Jun 17 12:59:18 2022] GET /compute/v2.1/os-snapshots/13068a54-f7b7-400d-a867-a9a3b7a3cdf2 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 17 12:59:18.577943 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-647feb6c-3dba-49fc-b66b-110589a42a4c tempest-VolumesSnapshotsTestJSON-1720863030 tempest-VolumesSnapshotsTestJSON-1720863030-project] Calling method '.version_select at 0x7f0190400d30>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:18.644267 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-647feb6c-3dba-49fc-b66b-110589a42a4c tempest-VolumesSnapshotsTestJSON-1720863030 tempest-VolumesSnapshotsTestJSON-1720863030-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/41878b9c-fdac-4fa0-9940-a1158a3e3bb5" status: 202 len: 0 microversion: 2.1 time: 0.070922 Jun 17 12:59:18.644843 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 138/268] 10.222.0.48 () {58 vars in 1247 bytes} [Fri Jun 17 12:59:18 2022] DELETE /compute/v2.1/os-volumes/41878b9c-fdac-4fa0-9940-a1158a3e3bb5 => generated 0 bytes in 72 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 12:59:18.653190 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-0b68d61e-fcc5-43f3-b7b6-99d02fda8e59 tempest-VolumesSnapshotsTestJSON-1720863030 tempest-VolumesSnapshotsTestJSON-1720863030-project] Calling method '.version_select at 0x7f01902598b0>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:18.702402 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-0b68d61e-fcc5-43f3-b7b6-99d02fda8e59 tempest-VolumesSnapshotsTestJSON-1720863030 tempest-VolumesSnapshotsTestJSON-1720863030-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/41878b9c-fdac-4fa0-9940-a1158a3e3bb5" status: 200 len: 345 microversion: 2.1 time: 0.052977 Jun 17 12:59:18.702968 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 131/269] 10.222.0.48 () {58 vars in 1244 bytes} [Fri Jun 17 12:59:18 2022] GET /compute/v2.1/os-volumes/41878b9c-fdac-4fa0-9940-a1158a3e3bb5 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:59:19.381145 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-27f10aba-04af-46ce-a27d-61f8edbfff2a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:19.381860 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-27f10aba-04af-46ce-a27d-61f8edbfff2a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: cc3f5e1d-d03b-4fe4-b777-8aedac2761ce] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:19.389466 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-27f10aba-04af-46ce-a27d-61f8edbfff2a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:19.389935 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-27f10aba-04af-46ce-a27d-61f8edbfff2a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:19.390740 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-27f10aba-04af-46ce-a27d-61f8edbfff2a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:19.391143 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-27f10aba-04af-46ce-a27d-61f8edbfff2a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:19.544622 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-27f10aba-04af-46ce-a27d-61f8edbfff2a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:59:19.549204 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-27f10aba-04af-46ce-a27d-61f8edbfff2a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce" status: 200 len: 1520 microversion: 2.1 time: 0.176668 Jun 17 12:59:19.549204 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 139/270] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:59:19 2022] GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce => generated 1520 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:59:19.713183 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:59:19.718207 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-3c98d116-c4c1-41ed-860e-7d15119e4c7f tempest-VolumesSnapshotsTestJSON-1720863030 tempest-VolumesSnapshotsTestJSON-1720863030-project] Calling method '.version_select at 0x7f0190194f70>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:19.769724 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-3c98d116-c4c1-41ed-860e-7d15119e4c7f tempest-VolumesSnapshotsTestJSON-1720863030 tempest-VolumesSnapshotsTestJSON-1720863030-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/41878b9c-fdac-4fa0-9940-a1158a3e3bb5" status: 200 len: 345 microversion: 2.1 time: 0.057894 Jun 17 12:59:19.770341 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 132/271] 10.222.0.48 () {58 vars in 1244 bytes} [Fri Jun 17 12:59:19 2022] GET /compute/v2.1/os-volumes/41878b9c-fdac-4fa0-9940-a1158a3e3bb5 => generated 345 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:59:20.567532 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-bcab5988-a453-46cf-9f72-50ccbb41236d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:20.568086 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-bcab5988-a453-46cf-9f72-50ccbb41236d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: cc3f5e1d-d03b-4fe4-b777-8aedac2761ce] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:20.570693 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:59:20.577598 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bcab5988-a453-46cf-9f72-50ccbb41236d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:20.578143 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bcab5988-a453-46cf-9f72-50ccbb41236d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:20.579015 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bcab5988-a453-46cf-9f72-50ccbb41236d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:20.579452 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bcab5988-a453-46cf-9f72-50ccbb41236d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:20.737604 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-bcab5988-a453-46cf-9f72-50ccbb41236d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:59:20.745610 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-bcab5988-a453-46cf-9f72-50ccbb41236d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce" status: 200 len: 1520 microversion: 2.1 time: 0.183814 Jun 17 12:59:20.746280 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 140/272] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:59:20 2022] GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce => generated 1520 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:59:20.781522 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_cell1:SELECT=23 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:59:20.788628 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-7bb0c403-26ca-45c5-9b92-d71b1f44a038 tempest-VolumesSnapshotsTestJSON-1720863030 tempest-VolumesSnapshotsTestJSON-1720863030-project] Calling method '.version_select at 0x7f01904b55e0>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:20.845363 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-7bb0c403-26ca-45c5-9b92-d71b1f44a038 tempest-VolumesSnapshotsTestJSON-1720863030 tempest-VolumesSnapshotsTestJSON-1720863030-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/41878b9c-fdac-4fa0-9940-a1158a3e3bb5" status: 200 len: 345 microversion: 2.1 time: 0.064753 Jun 17 12:59:20.848475 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 133/273] 10.222.0.48 () {58 vars in 1244 bytes} [Fri Jun 17 12:59:20 2022] GET /compute/v2.1/os-volumes/41878b9c-fdac-4fa0-9940-a1158a3e3bb5 => generated 345 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:59:21.763258 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-98655985-0d10-4cef-b3b2-a8c49d9beb9a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:21.763967 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-98655985-0d10-4cef-b3b2-a8c49d9beb9a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: cc3f5e1d-d03b-4fe4-b777-8aedac2761ce] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:21.770390 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-98655985-0d10-4cef-b3b2-a8c49d9beb9a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:21.770837 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-98655985-0d10-4cef-b3b2-a8c49d9beb9a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:21.771609 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-98655985-0d10-4cef-b3b2-a8c49d9beb9a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:21.772076 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-98655985-0d10-4cef-b3b2-a8c49d9beb9a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:21.859709 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-30e4bd23-adc1-4df1-9408-24423b3ddb58 tempest-VolumesSnapshotsTestJSON-1720863030 tempest-VolumesSnapshotsTestJSON-1720863030-project] Calling method '.version_select at 0x7f0190200f70>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:21.911484 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-30e4bd23-adc1-4df1-9408-24423b3ddb58 tempest-VolumesSnapshotsTestJSON-1720863030 tempest-VolumesSnapshotsTestJSON-1720863030-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/41878b9c-fdac-4fa0-9940-a1158a3e3bb5" status: 200 len: 345 microversion: 2.1 time: 0.056888 Jun 17 12:59:21.912058 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 134/274] 10.222.0.48 () {58 vars in 1244 bytes} [Fri Jun 17 12:59:21 2022] GET /compute/v2.1/os-volumes/41878b9c-fdac-4fa0-9940-a1158a3e3bb5 => generated 345 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:59:21.913582 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-98655985-0d10-4cef-b3b2-a8c49d9beb9a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:59:21.922512 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-98655985-0d10-4cef-b3b2-a8c49d9beb9a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce" status: 200 len: 1520 microversion: 2.1 time: 0.163146 Jun 17 12:59:21.923079 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 141/275] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:59:21 2022] GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:59:22.925880 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-b74b098b-1af5-44fe-9ca2-69ee409f58b2 tempest-VolumesSnapshotsTestJSON-1720863030 tempest-VolumesSnapshotsTestJSON-1720863030-project] Calling method '.version_select at 0x7f019020bb80>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:22.940788 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-9d5371a6-2ba9-4298-b28a-4b43d24d2472 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:22.941427 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-9d5371a6-2ba9-4298-b28a-4b43d24d2472 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: cc3f5e1d-d03b-4fe4-b777-8aedac2761ce] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:22.948959 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9d5371a6-2ba9-4298-b28a-4b43d24d2472 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:22.949415 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9d5371a6-2ba9-4298-b28a-4b43d24d2472 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:22.950260 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9d5371a6-2ba9-4298-b28a-4b43d24d2472 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:22.950900 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9d5371a6-2ba9-4298-b28a-4b43d24d2472 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:22.977745 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-b74b098b-1af5-44fe-9ca2-69ee409f58b2 tempest-VolumesSnapshotsTestJSON-1720863030 tempest-VolumesSnapshotsTestJSON-1720863030-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/41878b9c-fdac-4fa0-9940-a1158a3e3bb5" status: 200 len: 345 microversion: 2.1 time: 0.056840 Jun 17 12:59:22.978327 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 135/276] 10.222.0.48 () {58 vars in 1244 bytes} [Fri Jun 17 12:59:22 2022] GET /compute/v2.1/os-volumes/41878b9c-fdac-4fa0-9940-a1158a3e3bb5 => generated 345 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:59:23.114576 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-9d5371a6-2ba9-4298-b28a-4b43d24d2472 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:59:23.122267 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-9d5371a6-2ba9-4298-b28a-4b43d24d2472 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce" status: 200 len: 1520 microversion: 2.1 time: 0.185274 Jun 17 12:59:23.123551 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 142/277] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:59:22 2022] GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce => generated 1520 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:59:23.995151 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-34a41eee-c359-4dbc-935a-1fdff58283d7 tempest-VolumesSnapshotsTestJSON-1720863030 tempest-VolumesSnapshotsTestJSON-1720863030-project] Calling method '.version_select at 0x7f01904113a0>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:24.053831 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-34a41eee-c359-4dbc-935a-1fdff58283d7 tempest-VolumesSnapshotsTestJSON-1720863030 tempest-VolumesSnapshotsTestJSON-1720863030-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/41878b9c-fdac-4fa0-9940-a1158a3e3bb5" status: 200 len: 345 microversion: 2.1 time: 0.065343 Jun 17 12:59:24.054461 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 136/278] 10.222.0.48 () {58 vars in 1244 bytes} [Fri Jun 17 12:59:23 2022] GET /compute/v2.1/os-volumes/41878b9c-fdac-4fa0-9940-a1158a3e3bb5 => generated 345 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:59:24.140427 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-756234da-6e6d-4aa8-8745-cefbdcd6fe22 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:24.141091 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-756234da-6e6d-4aa8-8745-cefbdcd6fe22 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: cc3f5e1d-d03b-4fe4-b777-8aedac2761ce] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:24.147436 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-756234da-6e6d-4aa8-8745-cefbdcd6fe22 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:24.147774 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-756234da-6e6d-4aa8-8745-cefbdcd6fe22 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:24.148543 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-756234da-6e6d-4aa8-8745-cefbdcd6fe22 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:24.148981 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-756234da-6e6d-4aa8-8745-cefbdcd6fe22 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:24.296579 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-756234da-6e6d-4aa8-8745-cefbdcd6fe22 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:59:24.305490 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-756234da-6e6d-4aa8-8745-cefbdcd6fe22 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce" status: 200 len: 1520 microversion: 2.1 time: 0.168329 Jun 17 12:59:24.306545 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 143/279] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:59:24 2022] GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce => generated 1520 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:59:25.067861 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-de2ab1df-9df8-43df-aa21-b3a385d203c8 tempest-VolumesSnapshotsTestJSON-1720863030 tempest-VolumesSnapshotsTestJSON-1720863030-project] Calling method '.version_select at 0x7f0190259700>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:25.118939 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-de2ab1df-9df8-43df-aa21-b3a385d203c8 tempest-VolumesSnapshotsTestJSON-1720863030 tempest-VolumesSnapshotsTestJSON-1720863030-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/41878b9c-fdac-4fa0-9940-a1158a3e3bb5" status: 200 len: 345 microversion: 2.1 time: 0.055558 Jun 17 12:59:25.119513 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 137/280] 10.222.0.48 () {58 vars in 1244 bytes} [Fri Jun 17 12:59:25 2022] GET /compute/v2.1/os-volumes/41878b9c-fdac-4fa0-9940-a1158a3e3bb5 => generated 345 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:59:25.323650 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-1eee823b-1346-431b-a97d-0c23546c1050 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:25.324234 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-1eee823b-1346-431b-a97d-0c23546c1050 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: cc3f5e1d-d03b-4fe4-b777-8aedac2761ce] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:25.330985 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1eee823b-1346-431b-a97d-0c23546c1050 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:25.331447 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1eee823b-1346-431b-a97d-0c23546c1050 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:25.332204 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1eee823b-1346-431b-a97d-0c23546c1050 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:25.332731 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1eee823b-1346-431b-a97d-0c23546c1050 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:25.470014 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-1eee823b-1346-431b-a97d-0c23546c1050 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:59:25.477856 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-1eee823b-1346-431b-a97d-0c23546c1050 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce" status: 200 len: 1520 microversion: 2.1 time: 0.159196 Jun 17 12:59:25.478451 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 144/281] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:59:25 2022] GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:59:26.134347 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-9c55434b-a2e3-4454-9d62-14c7e0aaadd8 tempest-VolumesSnapshotsTestJSON-1720863030 tempest-VolumesSnapshotsTestJSON-1720863030-project] Calling method '.version_select at 0x7f019020b790>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:26.186867 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-9c55434b-a2e3-4454-9d62-14c7e0aaadd8 tempest-VolumesSnapshotsTestJSON-1720863030 tempest-VolumesSnapshotsTestJSON-1720863030-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/41878b9c-fdac-4fa0-9940-a1158a3e3bb5" status: 200 len: 345 microversion: 2.1 time: 0.057150 Jun 17 12:59:26.187437 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 138/282] 10.222.0.48 () {58 vars in 1244 bytes} [Fri Jun 17 12:59:26 2022] GET /compute/v2.1/os-volumes/41878b9c-fdac-4fa0-9940-a1158a3e3bb5 => generated 345 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:59:26.496062 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-03388f5e-d5bd-4e42-8615-885b8b0e2e60 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:26.496869 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-03388f5e-d5bd-4e42-8615-885b8b0e2e60 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: cc3f5e1d-d03b-4fe4-b777-8aedac2761ce] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:26.505051 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-03388f5e-d5bd-4e42-8615-885b8b0e2e60 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:26.505490 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-03388f5e-d5bd-4e42-8615-885b8b0e2e60 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:26.506305 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-03388f5e-d5bd-4e42-8615-885b8b0e2e60 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:26.506775 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-03388f5e-d5bd-4e42-8615-885b8b0e2e60 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:26.683763 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-03388f5e-d5bd-4e42-8615-885b8b0e2e60 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:59:26.686347 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=100 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:59:26.694049 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-03388f5e-d5bd-4e42-8615-885b8b0e2e60 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce" status: 200 len: 1520 microversion: 2.1 time: 0.202855 Jun 17 12:59:26.694917 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 145/283] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:59:26 2022] GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce => generated 1520 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:59:27.202301 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-0b5ab864-1c0c-4343-be04-cfe7c0eb9d78 tempest-VolumesSnapshotsTestJSON-1720863030 tempest-VolumesSnapshotsTestJSON-1720863030-project] Calling method '.version_select at 0x7f0190194dc0>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:27.256645 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-0b5ab864-1c0c-4343-be04-cfe7c0eb9d78 tempest-VolumesSnapshotsTestJSON-1720863030 tempest-VolumesSnapshotsTestJSON-1720863030-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/41878b9c-fdac-4fa0-9940-a1158a3e3bb5" status: 200 len: 345 microversion: 2.1 time: 0.058827 Jun 17 12:59:27.257301 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 139/284] 10.222.0.48 () {58 vars in 1244 bytes} [Fri Jun 17 12:59:27 2022] GET /compute/v2.1/os-volumes/41878b9c-fdac-4fa0-9940-a1158a3e3bb5 => generated 345 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:59:27.714270 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-4bef0d05-7961-4a89-9a6b-382c7db73b60 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:27.714898 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-4bef0d05-7961-4a89-9a6b-382c7db73b60 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: cc3f5e1d-d03b-4fe4-b777-8aedac2761ce] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:27.722148 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4bef0d05-7961-4a89-9a6b-382c7db73b60 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:27.722624 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4bef0d05-7961-4a89-9a6b-382c7db73b60 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:27.723396 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4bef0d05-7961-4a89-9a6b-382c7db73b60 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:27.723824 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4bef0d05-7961-4a89-9a6b-382c7db73b60 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:27.871843 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-4bef0d05-7961-4a89-9a6b-382c7db73b60 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:59:27.881341 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-4bef0d05-7961-4a89-9a6b-382c7db73b60 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce" status: 200 len: 1520 microversion: 2.1 time: 0.171818 Jun 17 12:59:27.881927 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 146/285] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:59:27 2022] GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce => generated 1520 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:59:28.271858 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-0fed79cf-45d1-478a-865a-8a8357a1c9f0 tempest-VolumesSnapshotsTestJSON-1720863030 tempest-VolumesSnapshotsTestJSON-1720863030-project] Calling method '.version_select at 0x7f01902e6af0>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:28.326372 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-0fed79cf-45d1-478a-865a-8a8357a1c9f0 tempest-VolumesSnapshotsTestJSON-1720863030 tempest-VolumesSnapshotsTestJSON-1720863030-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/41878b9c-fdac-4fa0-9940-a1158a3e3bb5" status: 200 len: 345 microversion: 2.1 time: 0.059175 Jun 17 12:59:28.327114 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 140/286] 10.222.0.48 () {58 vars in 1244 bytes} [Fri Jun 17 12:59:28 2022] GET /compute/v2.1/os-volumes/41878b9c-fdac-4fa0-9940-a1158a3e3bb5 => generated 345 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:59:28.900514 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-429352c3-7709-4e77-a225-64c001a4d76e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:28.901305 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-429352c3-7709-4e77-a225-64c001a4d76e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: cc3f5e1d-d03b-4fe4-b777-8aedac2761ce] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:28.907486 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-429352c3-7709-4e77-a225-64c001a4d76e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:28.907932 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-429352c3-7709-4e77-a225-64c001a4d76e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:28.908734 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-429352c3-7709-4e77-a225-64c001a4d76e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:28.909268 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-429352c3-7709-4e77-a225-64c001a4d76e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:29.062815 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-429352c3-7709-4e77-a225-64c001a4d76e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:59:29.071074 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-429352c3-7709-4e77-a225-64c001a4d76e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce" status: 200 len: 1520 microversion: 2.1 time: 0.176065 Jun 17 12:59:29.071653 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 147/287] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:59:28 2022] GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce => generated 1520 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 12:59:29.342281 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-1d478b43-23f6-4133-9f2c-5096678f4bd6 tempest-VolumesSnapshotsTestJSON-1720863030 tempest-VolumesSnapshotsTestJSON-1720863030-project] Calling method '.version_select at 0x7f01928cca60>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:29.395969 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-1d478b43-23f6-4133-9f2c-5096678f4bd6 tempest-VolumesSnapshotsTestJSON-1720863030 tempest-VolumesSnapshotsTestJSON-1720863030-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/41878b9c-fdac-4fa0-9940-a1158a3e3bb5" status: 200 len: 345 microversion: 2.1 time: 0.059807 Jun 17 12:59:29.396540 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 141/288] 10.222.0.48 () {58 vars in 1244 bytes} [Fri Jun 17 12:59:29 2022] GET /compute/v2.1/os-volumes/41878b9c-fdac-4fa0-9940-a1158a3e3bb5 => generated 345 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 12:59:30.089914 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-edc6babe-64a6-449d-875d-48a3227c6c0f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:30.090524 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-edc6babe-64a6-449d-875d-48a3227c6c0f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: cc3f5e1d-d03b-4fe4-b777-8aedac2761ce] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:30.097077 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-edc6babe-64a6-449d-875d-48a3227c6c0f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:30.097520 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-edc6babe-64a6-449d-875d-48a3227c6c0f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:30.098333 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-edc6babe-64a6-449d-875d-48a3227c6c0f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:30.098766 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-edc6babe-64a6-449d-875d-48a3227c6c0f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:30.245235 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-edc6babe-64a6-449d-875d-48a3227c6c0f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:59:30.253469 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-edc6babe-64a6-449d-875d-48a3227c6c0f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce" status: 200 len: 1520 microversion: 2.1 time: 0.167875 Jun 17 12:59:30.254041 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 148/289] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:59:30 2022] GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce => generated 1520 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:59:30.410779 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-6707c3de-7371-488b-a6da-3e8b7d7dabca tempest-VolumesSnapshotsTestJSON-1720863030 tempest-VolumesSnapshotsTestJSON-1720863030-project] Calling method '.version_select at 0x7f0191545430>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:30.473543 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-6707c3de-7371-488b-a6da-3e8b7d7dabca tempest-VolumesSnapshotsTestJSON-1720863030 tempest-VolumesSnapshotsTestJSON-1720863030-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/41878b9c-fdac-4fa0-9940-a1158a3e3bb5" status: 200 len: 345 microversion: 2.1 time: 0.067777 Jun 17 12:59:30.478876 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 142/290] 10.222.0.48 () {58 vars in 1244 bytes} [Fri Jun 17 12:59:30 2022] GET /compute/v2.1/os-volumes/41878b9c-fdac-4fa0-9940-a1158a3e3bb5 => generated 345 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 12:59:31.272130 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-dab1f71c-5487-4e9e-a415-60923fb26d7a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:31.272810 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-dab1f71c-5487-4e9e-a415-60923fb26d7a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: cc3f5e1d-d03b-4fe4-b777-8aedac2761ce] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:31.279427 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dab1f71c-5487-4e9e-a415-60923fb26d7a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:31.279871 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dab1f71c-5487-4e9e-a415-60923fb26d7a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:31.280627 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dab1f71c-5487-4e9e-a415-60923fb26d7a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:31.281055 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dab1f71c-5487-4e9e-a415-60923fb26d7a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:31.417836 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-dab1f71c-5487-4e9e-a415-60923fb26d7a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:59:31.425756 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-dab1f71c-5487-4e9e-a415-60923fb26d7a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce" status: 200 len: 1520 microversion: 2.1 time: 0.157615 Jun 17 12:59:31.426359 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 149/291] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:59:31 2022] GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:59:31.487508 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-de88aa5a-a42a-486e-aebf-17ce8a2640dc tempest-VolumesSnapshotsTestJSON-1720863030 tempest-VolumesSnapshotsTestJSON-1720863030-project] Calling method '.version_select at 0x7f01902c95e0>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:31.516806 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.wsgi [None req-de88aa5a-a42a-486e-aebf-17ce8a2640dc tempest-VolumesSnapshotsTestJSON-1720863030 tempest-VolumesSnapshotsTestJSON-1720863030-project] HTTP exception thrown: Volume 41878b9c-fdac-4fa0-9940-a1158a3e3bb5 could not be found. Jun 17 12:59:31.519280 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-de88aa5a-a42a-486e-aebf-17ce8a2640dc tempest-VolumesSnapshotsTestJSON-1720863030 tempest-VolumesSnapshotsTestJSON-1720863030-project] Request method failure captured: Jun 17 12:59:31.519280 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: request: GET /compute/v2.1/os-volumes/41878b9c-fdac-4fa0-9940-a1158a3e3bb5 HTTP/1.1 Jun 17 12:59:31.519280 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Accept: application/json Jun 17 12:59:31.519280 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Accept-Encoding: identity Jun 17 12:59:31.519280 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Connection: close Jun 17 12:59:31.519280 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Content-Length: 0 Jun 17 12:59:31.519280 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Content-Type: application/json Jun 17 12:59:31.519280 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Host: 10.222.0.48 Jun 17 12:59:31.519280 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Openstack-System-Scope: None Jun 17 12:59:31.519280 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: User-Agent: python-urllib3/1.26.9 Jun 17 12:59:31.519280 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Auth-Token: gAAAAABirHqY9zh8xfcwmD80Q56UWMnYrmzHz_mx5-WZ9BsLhI2wHt6rBnAS_kCDSqCOj9HRVojKFBepqH5VIbz0XbiuVL2LahN3GB2ZtOjgrTdvvOAZf4HNO306pq6w153XNe8MGt2ua5wQ3LaMNJa8MzObZnieNHozKHaCbbDANDVl7H1Hwlc Jun 17 12:59:31.519280 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Domain-Id: None Jun 17 12:59:31.519280 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Domain-Name: None Jun 17 12:59:31.519280 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Identity-Status: Confirmed Jun 17 12:59:31.519280 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Is-Admin-Project: True Jun 17 12:59:31.519280 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Project-Domain-Id: default Jun 17 12:59:31.519280 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Project-Domain-Name: Default Jun 17 12:59:31.519280 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Project-Id: dfd5f42fc8374fae92906a128181ad69 Jun 17 12:59:31.519280 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1720863030 Jun 17 12:59:31.519280 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Role: member,reader Jun 17 12:59:31.519280 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Roles: member,reader Jun 17 12:59:31.520848 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_dfd5f42fc8374fae92906a128181ad69", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/dfd5f42fc8374fae92906a128181ad69"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/dfd5f42fc8374fae92906a128181ad69"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/dfd5f42fc8374fae92906a128181ad69"}]}] Jun 17 12:59:31.520848 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1720863030 Jun 17 12:59:31.520848 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Tenant-Id: dfd5f42fc8374fae92906a128181ad69 Jun 17 12:59:31.520848 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1720863030 Jun 17 12:59:31.520848 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User: tempest-VolumesSnapshotsTestJSON-1720863030-project Jun 17 12:59:31.520848 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User-Domain-Id: default Jun 17 12:59:31.520848 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User-Domain-Name: Default Jun 17 12:59:31.520848 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User-Id: 6e0fa033a9db4ef5b125dbb77eb8b29b Jun 17 12:59:31.520848 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1720863030-project Jun 17 12:59:31.520848 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: method: Jun 17 12:59:31.520848 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: exception: Volume 41878b9c-fdac-4fa0-9940-a1158a3e3bb5 could not be found. Jun 17 12:59:31.520848 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: action_args: {'id': '41878b9c-fdac-4fa0-9940-a1158a3e3bb5'} Jun 17 12:59:31.520848 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 12:59:31.521895 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 12:59:31.521895 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 12:59:31.521895 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 12:59:31.521895 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 17 12:59:31.521895 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 17 12:59:31.521895 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 17 12:59:31.521895 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 17 12:59:31.521895 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 17 12:59:31.521895 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 17 12:59:31.521895 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 17 12:59:31.521895 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 17 12:59:31.521895 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 12:59:31.521895 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 12:59:31.521895 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 12:59:31.521895 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 12:59:31.521895 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 41878b9c-fdac-4fa0-9940-a1158a3e3bb5 could not be found. (HTTP 404) (Request-ID: req-31ffe5ac-f353-4d84-af21-71ced427bd28) Jun 17 12:59:31.521895 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 12:59:31.521895 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 12:59:31.521895 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 12:59:31.524572 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 12:59:31.524572 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 17 12:59:31.524572 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 17 12:59:31.524572 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 12:59:31.524572 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 12:59:31.524572 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 17 12:59:31.524572 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 17 12:59:31.524572 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 17 12:59:31.524572 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 17 12:59:31.524572 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 12:59:31.524572 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 12:59:31.524572 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 17 12:59:31.524572 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 17 12:59:31.524572 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 17 12:59:31.524572 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 17 12:59:31.524572 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 17 12:59:31.524572 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 17 12:59:31.524572 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 17 12:59:31.524572 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 17 12:59:31.526032 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 12:59:31.526032 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 12:59:31.526032 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 12:59:31.526032 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 12:59:31.526032 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 41878b9c-fdac-4fa0-9940-a1158a3e3bb5 could not be found. Jun 17 12:59:31.526032 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 12:59:31.526032 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 12:59:31.526032 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 12:59:31.526032 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 12:59:31.526032 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 12:59:31.526032 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 12:59:31.526032 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 12:59:31.526032 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 12:59:31.526032 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 17 12:59:31.526032 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 17 12:59:31.526032 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 12:59:31.526032 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 12:59:31.526032 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 17 12:59:31.526032 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 12:59:31.527427 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 41878b9c-fdac-4fa0-9940-a1158a3e3bb5 could not be found. Jun 17 12:59:31.527427 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 12:59:31.527427 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 12:59:31.527427 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 12:59:31.527427 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 12:59:31.527427 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 12:59:31.527427 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 12:59:31.527427 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 12:59:31.527427 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 12:59:31.527427 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 41878b9c-fdac-4fa0-9940-a1158a3e3bb5 could not be found. Jun 17 12:59:31.527427 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 12:59:31.527427 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-de88aa5a-a42a-486e-aebf-17ce8a2640dc tempest-VolumesSnapshotsTestJSON-1720863030 tempest-VolumesSnapshotsTestJSON-1720863030-project] Returning 404 to user: Volume 41878b9c-fdac-4fa0-9940-a1158a3e3bb5 could not be found. {{(pid=117659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 12:59:31.527427 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-de88aa5a-a42a-486e-aebf-17ce8a2640dc tempest-VolumesSnapshotsTestJSON-1720863030 tempest-VolumesSnapshotsTestJSON-1720863030-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/41878b9c-fdac-4fa0-9940-a1158a3e3bb5" status: 404 len: 109 microversion: 2.1 time: 0.037866 Jun 17 12:59:31.527427 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 143/292] 10.222.0.48 () {58 vars in 1244 bytes} [Fri Jun 17 12:59:31 2022] GET /compute/v2.1/os-volumes/41878b9c-fdac-4fa0-9940-a1158a3e3bb5 => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 12:59:31.535731 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-4bc06f02-4fbc-4d98-b1e7-45d915c9e611 tempest-VolumesSnapshotsTestJSON-1720863030 tempest-VolumesSnapshotsTestJSON-1720863030-project] Calling method '.version_select at 0x7f01903e1670>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:31.565433 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.wsgi [None req-4bc06f02-4fbc-4d98-b1e7-45d915c9e611 tempest-VolumesSnapshotsTestJSON-1720863030 tempest-VolumesSnapshotsTestJSON-1720863030-project] HTTP exception thrown: Volume 41878b9c-fdac-4fa0-9940-a1158a3e3bb5 could not be found. Jun 17 12:59:31.567431 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-4bc06f02-4fbc-4d98-b1e7-45d915c9e611 tempest-VolumesSnapshotsTestJSON-1720863030 tempest-VolumesSnapshotsTestJSON-1720863030-project] Request method failure captured: Jun 17 12:59:31.567431 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: request: DELETE /compute/v2.1/os-volumes/41878b9c-fdac-4fa0-9940-a1158a3e3bb5 HTTP/1.1 Jun 17 12:59:31.567431 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Accept: application/json Jun 17 12:59:31.567431 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Accept-Encoding: identity Jun 17 12:59:31.567431 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Connection: close Jun 17 12:59:31.567431 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Content-Length: 0 Jun 17 12:59:31.567431 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Content-Type: application/json Jun 17 12:59:31.567431 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Host: 10.222.0.48 Jun 17 12:59:31.567431 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Openstack-System-Scope: None Jun 17 12:59:31.567431 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: User-Agent: python-urllib3/1.26.9 Jun 17 12:59:31.567431 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Auth-Token: gAAAAABirHqY9zh8xfcwmD80Q56UWMnYrmzHz_mx5-WZ9BsLhI2wHt6rBnAS_kCDSqCOj9HRVojKFBepqH5VIbz0XbiuVL2LahN3GB2ZtOjgrTdvvOAZf4HNO306pq6w153XNe8MGt2ua5wQ3LaMNJa8MzObZnieNHozKHaCbbDANDVl7H1Hwlc Jun 17 12:59:31.567431 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Domain-Id: None Jun 17 12:59:31.567431 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Domain-Name: None Jun 17 12:59:31.567431 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Identity-Status: Confirmed Jun 17 12:59:31.567431 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Is-Admin-Project: True Jun 17 12:59:31.567431 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Project-Domain-Id: default Jun 17 12:59:31.567431 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Project-Domain-Name: Default Jun 17 12:59:31.567431 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Project-Id: dfd5f42fc8374fae92906a128181ad69 Jun 17 12:59:31.567431 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1720863030 Jun 17 12:59:31.567431 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Role: member,reader Jun 17 12:59:31.567431 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Roles: member,reader Jun 17 12:59:31.568838 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_dfd5f42fc8374fae92906a128181ad69", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/dfd5f42fc8374fae92906a128181ad69"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/dfd5f42fc8374fae92906a128181ad69"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/dfd5f42fc8374fae92906a128181ad69"}]}] Jun 17 12:59:31.568838 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1720863030 Jun 17 12:59:31.568838 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Tenant-Id: dfd5f42fc8374fae92906a128181ad69 Jun 17 12:59:31.568838 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1720863030 Jun 17 12:59:31.568838 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-User: tempest-VolumesSnapshotsTestJSON-1720863030-project Jun 17 12:59:31.568838 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-User-Domain-Id: default Jun 17 12:59:31.568838 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-User-Domain-Name: Default Jun 17 12:59:31.568838 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-User-Id: 6e0fa033a9db4ef5b125dbb77eb8b29b Jun 17 12:59:31.568838 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1720863030-project Jun 17 12:59:31.568838 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: method: Jun 17 12:59:31.568838 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: exception: Volume 41878b9c-fdac-4fa0-9940-a1158a3e3bb5 could not be found. Jun 17 12:59:31.568838 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: action_args: {'id': '41878b9c-fdac-4fa0-9940-a1158a3e3bb5'} Jun 17 12:59:31.568838 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 12:59:31.569654 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 12:59:31.569654 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 12:59:31.569654 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 12:59:31.569654 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 17 12:59:31.569654 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 17 12:59:31.569654 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 17 12:59:31.569654 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 17 12:59:31.569654 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 17 12:59:31.569654 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 17 12:59:31.569654 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 17 12:59:31.569654 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 17 12:59:31.569654 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 12:59:31.569654 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 12:59:31.569654 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 12:59:31.569654 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 12:59:31.569654 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 41878b9c-fdac-4fa0-9940-a1158a3e3bb5 could not be found. (HTTP 404) (Request-ID: req-32f02f01-9c5c-46ee-916a-b80ff113e238) Jun 17 12:59:31.569654 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 12:59:31.569654 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 12:59:31.569654 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 12:59:31.570775 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 12:59:31.570775 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 17 12:59:31.570775 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 17 12:59:31.570775 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 12:59:31.570775 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 12:59:31.570775 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 17 12:59:31.570775 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 17 12:59:31.570775 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 17 12:59:31.570775 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 17 12:59:31.570775 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 12:59:31.570775 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 12:59:31.570775 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 17 12:59:31.570775 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 17 12:59:31.570775 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 17 12:59:31.570775 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 17 12:59:31.570775 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 17 12:59:31.570775 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 17 12:59:31.570775 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 17 12:59:31.570775 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 17 12:59:31.571824 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 12:59:31.571824 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 12:59:31.571824 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 12:59:31.571824 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 12:59:31.571824 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 41878b9c-fdac-4fa0-9940-a1158a3e3bb5 could not be found. Jun 17 12:59:31.571824 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 12:59:31.571824 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 12:59:31.571824 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 12:59:31.571824 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 12:59:31.571824 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 12:59:31.571824 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 12:59:31.571824 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 12:59:31.571824 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 12:59:31.571824 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 17 12:59:31.571824 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 17 12:59:31.571824 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 12:59:31.571824 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 12:59:31.571824 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 17 12:59:31.571824 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 12:59:31.573379 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 41878b9c-fdac-4fa0-9940-a1158a3e3bb5 could not be found. Jun 17 12:59:31.573379 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 12:59:31.573379 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 12:59:31.573379 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 12:59:31.573379 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 12:59:31.573379 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 12:59:31.573379 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 12:59:31.573379 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 12:59:31.573379 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 12:59:31.573379 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 41878b9c-fdac-4fa0-9940-a1158a3e3bb5 could not be found. Jun 17 12:59:31.573379 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 12:59:31.573379 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-4bc06f02-4fbc-4d98-b1e7-45d915c9e611 tempest-VolumesSnapshotsTestJSON-1720863030 tempest-VolumesSnapshotsTestJSON-1720863030-project] Returning 404 to user: Volume 41878b9c-fdac-4fa0-9940-a1158a3e3bb5 could not be found. {{(pid=117660) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 12:59:31.573379 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-4bc06f02-4fbc-4d98-b1e7-45d915c9e611 tempest-VolumesSnapshotsTestJSON-1720863030 tempest-VolumesSnapshotsTestJSON-1720863030-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/41878b9c-fdac-4fa0-9940-a1158a3e3bb5" status: 404 len: 109 microversion: 2.1 time: 0.037249 Jun 17 12:59:31.573379 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 150/293] 10.222.0.48 () {58 vars in 1247 bytes} [Fri Jun 17 12:59:31 2022] DELETE /compute/v2.1/os-volumes/41878b9c-fdac-4fa0-9940-a1158a3e3bb5 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 12:59:31.578008 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-13db44d1-47f4-4196-bb44-1886ccfa1f10 tempest-VolumesSnapshotsTestJSON-1720863030 tempest-VolumesSnapshotsTestJSON-1720863030-project] Calling method '.version_select at 0x7f0190200550>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:31.609290 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.wsgi [None req-13db44d1-47f4-4196-bb44-1886ccfa1f10 tempest-VolumesSnapshotsTestJSON-1720863030 tempest-VolumesSnapshotsTestJSON-1720863030-project] HTTP exception thrown: Volume 41878b9c-fdac-4fa0-9940-a1158a3e3bb5 could not be found. Jun 17 12:59:31.611641 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-13db44d1-47f4-4196-bb44-1886ccfa1f10 tempest-VolumesSnapshotsTestJSON-1720863030 tempest-VolumesSnapshotsTestJSON-1720863030-project] Request method failure captured: Jun 17 12:59:31.611641 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: request: GET /compute/v2.1/os-volumes/41878b9c-fdac-4fa0-9940-a1158a3e3bb5 HTTP/1.1 Jun 17 12:59:31.611641 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Accept: application/json Jun 17 12:59:31.611641 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Accept-Encoding: identity Jun 17 12:59:31.611641 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Connection: close Jun 17 12:59:31.611641 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Content-Length: 0 Jun 17 12:59:31.611641 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Content-Type: application/json Jun 17 12:59:31.611641 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Host: 10.222.0.48 Jun 17 12:59:31.611641 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Openstack-System-Scope: None Jun 17 12:59:31.611641 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: User-Agent: python-urllib3/1.26.9 Jun 17 12:59:31.611641 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Auth-Token: gAAAAABirHqY9zh8xfcwmD80Q56UWMnYrmzHz_mx5-WZ9BsLhI2wHt6rBnAS_kCDSqCOj9HRVojKFBepqH5VIbz0XbiuVL2LahN3GB2ZtOjgrTdvvOAZf4HNO306pq6w153XNe8MGt2ua5wQ3LaMNJa8MzObZnieNHozKHaCbbDANDVl7H1Hwlc Jun 17 12:59:31.611641 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Domain-Id: None Jun 17 12:59:31.611641 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Domain-Name: None Jun 17 12:59:31.611641 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Identity-Status: Confirmed Jun 17 12:59:31.611641 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Is-Admin-Project: True Jun 17 12:59:31.611641 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Project-Domain-Id: default Jun 17 12:59:31.611641 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Project-Domain-Name: Default Jun 17 12:59:31.611641 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Project-Id: dfd5f42fc8374fae92906a128181ad69 Jun 17 12:59:31.611641 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1720863030 Jun 17 12:59:31.611641 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Role: member,reader Jun 17 12:59:31.611641 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Roles: member,reader Jun 17 12:59:31.613159 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_dfd5f42fc8374fae92906a128181ad69", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/dfd5f42fc8374fae92906a128181ad69"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/dfd5f42fc8374fae92906a128181ad69"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/dfd5f42fc8374fae92906a128181ad69"}]}] Jun 17 12:59:31.613159 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1720863030 Jun 17 12:59:31.613159 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Tenant-Id: dfd5f42fc8374fae92906a128181ad69 Jun 17 12:59:31.613159 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1720863030 Jun 17 12:59:31.613159 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User: tempest-VolumesSnapshotsTestJSON-1720863030-project Jun 17 12:59:31.613159 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User-Domain-Id: default Jun 17 12:59:31.613159 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User-Domain-Name: Default Jun 17 12:59:31.613159 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User-Id: 6e0fa033a9db4ef5b125dbb77eb8b29b Jun 17 12:59:31.613159 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1720863030-project Jun 17 12:59:31.613159 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: method: Jun 17 12:59:31.613159 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: exception: Volume 41878b9c-fdac-4fa0-9940-a1158a3e3bb5 could not be found. Jun 17 12:59:31.613159 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: action_args: {'id': '41878b9c-fdac-4fa0-9940-a1158a3e3bb5'} Jun 17 12:59:31.613159 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 12:59:31.614038 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 12:59:31.614038 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 12:59:31.614038 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 12:59:31.614038 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 17 12:59:31.614038 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 17 12:59:31.614038 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 17 12:59:31.614038 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 17 12:59:31.614038 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 17 12:59:31.614038 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 17 12:59:31.614038 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 17 12:59:31.614038 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 17 12:59:31.614038 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 12:59:31.614038 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 12:59:31.614038 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 12:59:31.614038 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 12:59:31.614038 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 41878b9c-fdac-4fa0-9940-a1158a3e3bb5 could not be found. (HTTP 404) (Request-ID: req-17391946-2a8e-4582-b7b6-590955d1ae24) Jun 17 12:59:31.614038 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 12:59:31.614038 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 12:59:31.614038 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 12:59:31.615354 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 12:59:31.615354 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 17 12:59:31.615354 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 17 12:59:31.615354 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 12:59:31.615354 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 12:59:31.615354 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 17 12:59:31.615354 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 17 12:59:31.615354 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 17 12:59:31.615354 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 17 12:59:31.615354 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 12:59:31.615354 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 12:59:31.615354 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 17 12:59:31.615354 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 17 12:59:31.615354 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 17 12:59:31.615354 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 17 12:59:31.615354 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 17 12:59:31.615354 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 17 12:59:31.615354 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 17 12:59:31.615354 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 17 12:59:31.616648 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 12:59:31.616648 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 12:59:31.616648 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 12:59:31.616648 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 12:59:31.616648 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 41878b9c-fdac-4fa0-9940-a1158a3e3bb5 could not be found. Jun 17 12:59:31.616648 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 12:59:31.616648 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 12:59:31.616648 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 12:59:31.616648 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 12:59:31.616648 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 12:59:31.616648 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 12:59:31.616648 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 12:59:31.616648 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 12:59:31.616648 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 17 12:59:31.616648 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 17 12:59:31.616648 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 12:59:31.616648 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 12:59:31.616648 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 17 12:59:31.616648 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 12:59:31.617770 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 41878b9c-fdac-4fa0-9940-a1158a3e3bb5 could not be found. Jun 17 12:59:31.617770 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 12:59:31.617770 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 12:59:31.617770 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 12:59:31.617770 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 12:59:31.617770 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 12:59:31.617770 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 12:59:31.617770 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 12:59:31.617770 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 12:59:31.617770 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 41878b9c-fdac-4fa0-9940-a1158a3e3bb5 could not be found. Jun 17 12:59:31.617770 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 12:59:31.617770 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-13db44d1-47f4-4196-bb44-1886ccfa1f10 tempest-VolumesSnapshotsTestJSON-1720863030 tempest-VolumesSnapshotsTestJSON-1720863030-project] Returning 404 to user: Volume 41878b9c-fdac-4fa0-9940-a1158a3e3bb5 could not be found. {{(pid=117659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 12:59:31.617770 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-13db44d1-47f4-4196-bb44-1886ccfa1f10 tempest-VolumesSnapshotsTestJSON-1720863030 tempest-VolumesSnapshotsTestJSON-1720863030-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/41878b9c-fdac-4fa0-9940-a1158a3e3bb5" status: 404 len: 109 microversion: 2.1 time: 0.038952 Jun 17 12:59:31.617770 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 144/294] 10.222.0.48 () {58 vars in 1244 bytes} [Fri Jun 17 12:59:31 2022] GET /compute/v2.1/os-volumes/41878b9c-fdac-4fa0-9940-a1158a3e3bb5 => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 12:59:32.443584 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-648824d0-02cb-4a8b-b44d-3e5426a7efc0 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:32.444198 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-648824d0-02cb-4a8b-b44d-3e5426a7efc0 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: cc3f5e1d-d03b-4fe4-b777-8aedac2761ce] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:32.458318 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-648824d0-02cb-4a8b-b44d-3e5426a7efc0 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:32.458746 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-648824d0-02cb-4a8b-b44d-3e5426a7efc0 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:32.459732 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-648824d0-02cb-4a8b-b44d-3e5426a7efc0 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:32.460307 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-648824d0-02cb-4a8b-b44d-3e5426a7efc0 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:32.629962 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-648824d0-02cb-4a8b-b44d-3e5426a7efc0 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:59:32.638376 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-648824d0-02cb-4a8b-b44d-3e5426a7efc0 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce" status: 200 len: 1520 microversion: 2.1 time: 0.198660 Jun 17 12:59:32.638969 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 151/295] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:59:32 2022] GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce => generated 1520 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:59:33.660610 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-09b3d8a5-52eb-4b15-bf8f-e32b1dc1736e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:33.661213 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-09b3d8a5-52eb-4b15-bf8f-e32b1dc1736e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: cc3f5e1d-d03b-4fe4-b777-8aedac2761ce] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:33.668395 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-09b3d8a5-52eb-4b15-bf8f-e32b1dc1736e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:33.668908 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-09b3d8a5-52eb-4b15-bf8f-e32b1dc1736e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:33.669612 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-09b3d8a5-52eb-4b15-bf8f-e32b1dc1736e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:33.670046 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-09b3d8a5-52eb-4b15-bf8f-e32b1dc1736e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:33.815549 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-09b3d8a5-52eb-4b15-bf8f-e32b1dc1736e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:59:33.823879 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-09b3d8a5-52eb-4b15-bf8f-e32b1dc1736e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce" status: 200 len: 1520 microversion: 2.1 time: 0.168821 Jun 17 12:59:33.824739 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 145/296] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:59:33 2022] GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce => generated 1520 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 12:59:34.841277 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-39fe1b9f-67cc-4823-83dc-228accdb89c3 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:34.841795 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-39fe1b9f-67cc-4823-83dc-228accdb89c3 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: cc3f5e1d-d03b-4fe4-b777-8aedac2761ce] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:34.848410 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-39fe1b9f-67cc-4823-83dc-228accdb89c3 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:34.848883 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-39fe1b9f-67cc-4823-83dc-228accdb89c3 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:34.849660 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-39fe1b9f-67cc-4823-83dc-228accdb89c3 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:34.850118 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-39fe1b9f-67cc-4823-83dc-228accdb89c3 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:34.993888 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-39fe1b9f-67cc-4823-83dc-228accdb89c3 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:59:35.003632 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-39fe1b9f-67cc-4823-83dc-228accdb89c3 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce" status: 200 len: 1520 microversion: 2.1 time: 0.166349 Jun 17 12:59:35.004266 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 152/297] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:59:34 2022] GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce => generated 1520 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:59:36.021541 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-10f3fe73-1c1a-45bd-b59c-2d5c04e53f95 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:36.022429 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-10f3fe73-1c1a-45bd-b59c-2d5c04e53f95 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: cc3f5e1d-d03b-4fe4-b777-8aedac2761ce] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:36.029398 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-10f3fe73-1c1a-45bd-b59c-2d5c04e53f95 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:36.029856 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-10f3fe73-1c1a-45bd-b59c-2d5c04e53f95 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:36.030670 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-10f3fe73-1c1a-45bd-b59c-2d5c04e53f95 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:36.031058 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-10f3fe73-1c1a-45bd-b59c-2d5c04e53f95 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:36.169216 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-10f3fe73-1c1a-45bd-b59c-2d5c04e53f95 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:59:36.180180 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-10f3fe73-1c1a-45bd-b59c-2d5c04e53f95 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce" status: 200 len: 1520 microversion: 2.1 time: 0.162802 Jun 17 12:59:36.180888 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 146/298] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:59:36 2022] GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:59:37.201988 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-e58bb20e-63ae-4f79-8ba3-bfaad11193da tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:37.202579 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-e58bb20e-63ae-4f79-8ba3-bfaad11193da tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: cc3f5e1d-d03b-4fe4-b777-8aedac2761ce] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:37.209041 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e58bb20e-63ae-4f79-8ba3-bfaad11193da tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:37.209481 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e58bb20e-63ae-4f79-8ba3-bfaad11193da tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:37.210280 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e58bb20e-63ae-4f79-8ba3-bfaad11193da tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:37.210706 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e58bb20e-63ae-4f79-8ba3-bfaad11193da tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:37.351194 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-e58bb20e-63ae-4f79-8ba3-bfaad11193da tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:59:37.365621 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-e58bb20e-63ae-4f79-8ba3-bfaad11193da tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce" status: 200 len: 1520 microversion: 2.1 time: 0.167180 Jun 17 12:59:37.366334 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 153/299] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:59:37 2022] GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce => generated 1520 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:59:38.384577 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-5de1de98-bdd4-41a7-b3bb-04324c71515a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:38.385324 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-5de1de98-bdd4-41a7-b3bb-04324c71515a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: cc3f5e1d-d03b-4fe4-b777-8aedac2761ce] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:38.392585 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-5de1de98-bdd4-41a7-b3bb-04324c71515a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:38.393104 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-5de1de98-bdd4-41a7-b3bb-04324c71515a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:38.393875 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-5de1de98-bdd4-41a7-b3bb-04324c71515a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:38.394388 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-5de1de98-bdd4-41a7-b3bb-04324c71515a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:38.541235 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-5de1de98-bdd4-41a7-b3bb-04324c71515a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:59:38.549723 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-5de1de98-bdd4-41a7-b3bb-04324c71515a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce" status: 200 len: 1520 microversion: 2.1 time: 0.169572 Jun 17 12:59:38.550167 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 147/300] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:59:38 2022] GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce => generated 1520 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:59:39.567344 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-bd281c76-6336-4847-b8cb-492a1a89f689 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:39.568039 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-bd281c76-6336-4847-b8cb-492a1a89f689 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: cc3f5e1d-d03b-4fe4-b777-8aedac2761ce] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:39.574935 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bd281c76-6336-4847-b8cb-492a1a89f689 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:39.575836 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bd281c76-6336-4847-b8cb-492a1a89f689 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:39.576332 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bd281c76-6336-4847-b8cb-492a1a89f689 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:39.576783 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bd281c76-6336-4847-b8cb-492a1a89f689 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:39.721360 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-bd281c76-6336-4847-b8cb-492a1a89f689 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:59:39.733005 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-bd281c76-6336-4847-b8cb-492a1a89f689 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce" status: 200 len: 1520 microversion: 2.1 time: 0.169583 Jun 17 12:59:39.733624 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 154/301] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:59:39 2022] GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce => generated 1520 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:59:40.752978 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-b579da20-50c4-4217-bbae-9b9fff442ca4 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:40.753618 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-b579da20-50c4-4217-bbae-9b9fff442ca4 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: cc3f5e1d-d03b-4fe4-b777-8aedac2761ce] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:40.763284 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b579da20-50c4-4217-bbae-9b9fff442ca4 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:40.764404 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b579da20-50c4-4217-bbae-9b9fff442ca4 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:40.764664 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b579da20-50c4-4217-bbae-9b9fff442ca4 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:40.765088 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b579da20-50c4-4217-bbae-9b9fff442ca4 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:40.904305 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-b579da20-50c4-4217-bbae-9b9fff442ca4 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:59:40.912274 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-b579da20-50c4-4217-bbae-9b9fff442ca4 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce" status: 200 len: 1500 microversion: 2.1 time: 0.165322 Jun 17 12:59:40.912851 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 148/302] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:59:40 2022] GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce => generated 1500 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:59:40.929578 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-40240be7-320a-42cf-907d-f0e2fcea983b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:40.930308 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-40240be7-320a-42cf-907d-f0e2fcea983b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 5db43a6d-a079-4e7c-948a-b2600a102f63] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:40.938204 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-40240be7-320a-42cf-907d-f0e2fcea983b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:40.938640 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-40240be7-320a-42cf-907d-f0e2fcea983b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:40.939406 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-40240be7-320a-42cf-907d-f0e2fcea983b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:40.939833 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-40240be7-320a-42cf-907d-f0e2fcea983b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:41.091670 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-40240be7-320a-42cf-907d-f0e2fcea983b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:59:41.104042 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-40240be7-320a-42cf-907d-f0e2fcea983b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/5db43a6d-a079-4e7c-948a-b2600a102f63" status: 200 len: 1515 microversion: 2.1 time: 0.178400 Jun 17 12:59:41.104880 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 155/303] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:59:40 2022] GET /compute/v2.1/servers/5db43a6d-a079-4e7c-948a-b2600a102f63 => generated 1515 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:59:49.915822 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-31efe048-719c-4d34-88e5-22dd0c1566f2 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 12:59:49.916842 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-31efe048-719c-4d34-88e5-22dd0c1566f2 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 5db43a6d-a079-4e7c-948a-b2600a102f63] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:49.925001 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-31efe048-719c-4d34-88e5-22dd0c1566f2 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:49.925467 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-31efe048-719c-4d34-88e5-22dd0c1566f2 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:49.926289 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-31efe048-719c-4d34-88e5-22dd0c1566f2 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:49.926726 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-31efe048-719c-4d34-88e5-22dd0c1566f2 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:49.953272 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.objects.instance [None req-31efe048-719c-4d34-88e5-22dd0c1566f2 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lazy-loading 'flavor' on Instance uuid 5db43a6d-a079-4e7c-948a-b2600a102f63 {{(pid=117659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 12:59:50.047555 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-31efe048-719c-4d34-88e5-22dd0c1566f2 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "POST /compute/v2.1/servers/5db43a6d-a079-4e7c-948a-b2600a102f63/action" status: 200 len: 32 microversion: 2.1 time: 0.135348 Jun 17 12:59:50.048713 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 149/304] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Jun 17 12:59:49 2022] POST /compute/v2.1/servers/5db43a6d-a079-4e7c-948a-b2600a102f63/action => generated 32 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 17 12:59:50.065872 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-5912c63b-7009-4862-924d-b74f64e9e04f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:50.067189 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-5912c63b-7009-4862-924d-b74f64e9e04f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 5db43a6d-a079-4e7c-948a-b2600a102f63] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:50.079770 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5912c63b-7009-4862-924d-b74f64e9e04f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:50.080619 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5912c63b-7009-4862-924d-b74f64e9e04f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:50.082074 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5912c63b-7009-4862-924d-b74f64e9e04f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:50.082969 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5912c63b-7009-4862-924d-b74f64e9e04f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:50.344698 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-5912c63b-7009-4862-924d-b74f64e9e04f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:59:50.353190 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-5912c63b-7009-4862-924d-b74f64e9e04f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/5db43a6d-a079-4e7c-948a-b2600a102f63" status: 200 len: 1521 microversion: 2.1 time: 0.295552 Jun 17 12:59:50.353773 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 156/305] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:59:50 2022] GET /compute/v2.1/servers/5db43a6d-a079-4e7c-948a-b2600a102f63 => generated 1521 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:59:51.371915 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-791c12bf-9fef-44ee-a3cb-8c48906d7974 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:51.372665 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-791c12bf-9fef-44ee-a3cb-8c48906d7974 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 5db43a6d-a079-4e7c-948a-b2600a102f63] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:51.381571 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-791c12bf-9fef-44ee-a3cb-8c48906d7974 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:51.382082 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-791c12bf-9fef-44ee-a3cb-8c48906d7974 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:51.382935 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-791c12bf-9fef-44ee-a3cb-8c48906d7974 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:51.383394 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-791c12bf-9fef-44ee-a3cb-8c48906d7974 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:51.538954 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-791c12bf-9fef-44ee-a3cb-8c48906d7974 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:59:51.547304 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-791c12bf-9fef-44ee-a3cb-8c48906d7974 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/5db43a6d-a079-4e7c-948a-b2600a102f63" status: 200 len: 1521 microversion: 2.1 time: 0.179802 Jun 17 12:59:51.547909 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 150/306] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:59:51 2022] GET /compute/v2.1/servers/5db43a6d-a079-4e7c-948a-b2600a102f63 => generated 1521 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:59:52.567176 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-c77596e2-4186-4166-8f3c-ee0b5c93bd5e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:52.567802 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-c77596e2-4186-4166-8f3c-ee0b5c93bd5e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 5db43a6d-a079-4e7c-948a-b2600a102f63] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:52.570110 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_api:SELECT=32 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:59:52.577951 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c77596e2-4186-4166-8f3c-ee0b5c93bd5e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:52.578460 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c77596e2-4186-4166-8f3c-ee0b5c93bd5e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:52.579261 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c77596e2-4186-4166-8f3c-ee0b5c93bd5e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:52.581944 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c77596e2-4186-4166-8f3c-ee0b5c93bd5e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:52.790718 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-c77596e2-4186-4166-8f3c-ee0b5c93bd5e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:59:52.802814 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-c77596e2-4186-4166-8f3c-ee0b5c93bd5e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/5db43a6d-a079-4e7c-948a-b2600a102f63" status: 200 len: 1521 microversion: 2.1 time: 0.240370 Jun 17 12:59:52.803616 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 157/307] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:59:52 2022] GET /compute/v2.1/servers/5db43a6d-a079-4e7c-948a-b2600a102f63 => generated 1521 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:59:53.822920 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-7ef42b3f-2d8c-46a1-91e8-46ea741980af tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:53.823543 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-7ef42b3f-2d8c-46a1-91e8-46ea741980af tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 5db43a6d-a079-4e7c-948a-b2600a102f63] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:53.831133 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7ef42b3f-2d8c-46a1-91e8-46ea741980af tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:53.831575 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7ef42b3f-2d8c-46a1-91e8-46ea741980af tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:53.832340 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7ef42b3f-2d8c-46a1-91e8-46ea741980af tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:53.832771 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7ef42b3f-2d8c-46a1-91e8-46ea741980af tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:53.975586 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-7ef42b3f-2d8c-46a1-91e8-46ea741980af tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:59:53.984541 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-7ef42b3f-2d8c-46a1-91e8-46ea741980af tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/5db43a6d-a079-4e7c-948a-b2600a102f63" status: 200 len: 1521 microversion: 2.1 time: 0.165196 Jun 17 12:59:53.985301 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 151/308] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:59:53 2022] GET /compute/v2.1/servers/5db43a6d-a079-4e7c-948a-b2600a102f63 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:59:55.003877 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-41133384-1ce5-4f7b-aae3-d5ce7bb561d0 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:55.004473 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-41133384-1ce5-4f7b-aae3-d5ce7bb561d0 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 5db43a6d-a079-4e7c-948a-b2600a102f63] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:55.011319 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-41133384-1ce5-4f7b-aae3-d5ce7bb561d0 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:55.011775 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-41133384-1ce5-4f7b-aae3-d5ce7bb561d0 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:55.012576 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-41133384-1ce5-4f7b-aae3-d5ce7bb561d0 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:55.013107 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-41133384-1ce5-4f7b-aae3-d5ce7bb561d0 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:55.174299 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-41133384-1ce5-4f7b-aae3-d5ce7bb561d0 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:59:55.182034 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-41133384-1ce5-4f7b-aae3-d5ce7bb561d0 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/5db43a6d-a079-4e7c-948a-b2600a102f63" status: 200 len: 1521 microversion: 2.1 time: 0.183622 Jun 17 12:59:55.182660 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 158/309] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:59:54 2022] GET /compute/v2.1/servers/5db43a6d-a079-4e7c-948a-b2600a102f63 => generated 1521 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:59:56.204842 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-e8dd6972-99ec-4692-bf51-01f33693c1bf tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:56.205794 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-e8dd6972-99ec-4692-bf51-01f33693c1bf tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 5db43a6d-a079-4e7c-948a-b2600a102f63] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:56.212213 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e8dd6972-99ec-4692-bf51-01f33693c1bf tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:56.212711 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e8dd6972-99ec-4692-bf51-01f33693c1bf tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:56.213476 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e8dd6972-99ec-4692-bf51-01f33693c1bf tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:56.214012 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e8dd6972-99ec-4692-bf51-01f33693c1bf tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:56.371797 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-e8dd6972-99ec-4692-bf51-01f33693c1bf tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:59:56.380946 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-e8dd6972-99ec-4692-bf51-01f33693c1bf tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/5db43a6d-a079-4e7c-948a-b2600a102f63" status: 200 len: 1521 microversion: 2.1 time: 0.180308 Jun 17 12:59:56.381555 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 152/310] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:59:56 2022] GET /compute/v2.1/servers/5db43a6d-a079-4e7c-948a-b2600a102f63 => generated 1521 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:59:57.399047 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-0165f195-09d7-4752-b2a1-3bd41e174c7e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:57.399853 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-0165f195-09d7-4752-b2a1-3bd41e174c7e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 5db43a6d-a079-4e7c-948a-b2600a102f63] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:57.406793 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0165f195-09d7-4752-b2a1-3bd41e174c7e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:57.407471 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0165f195-09d7-4752-b2a1-3bd41e174c7e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:57.408386 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0165f195-09d7-4752-b2a1-3bd41e174c7e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:57.408816 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0165f195-09d7-4752-b2a1-3bd41e174c7e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:57.567211 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-0165f195-09d7-4752-b2a1-3bd41e174c7e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:59:57.575236 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-0165f195-09d7-4752-b2a1-3bd41e174c7e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/5db43a6d-a079-4e7c-948a-b2600a102f63" status: 200 len: 1521 microversion: 2.1 time: 0.180082 Jun 17 12:59:57.575891 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 159/311] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:59:57 2022] GET /compute/v2.1/servers/5db43a6d-a079-4e7c-948a-b2600a102f63 => generated 1521 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:59:58.602436 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-681d910c-0b5b-4a58-be0a-3b2a9f9b1e31 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:58.603721 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-681d910c-0b5b-4a58-be0a-3b2a9f9b1e31 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 5db43a6d-a079-4e7c-948a-b2600a102f63] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:58.610971 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-681d910c-0b5b-4a58-be0a-3b2a9f9b1e31 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:58.611157 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-681d910c-0b5b-4a58-be0a-3b2a9f9b1e31 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:58.611851 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-681d910c-0b5b-4a58-be0a-3b2a9f9b1e31 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:58.612306 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-681d910c-0b5b-4a58-be0a-3b2a9f9b1e31 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:58.804238 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-681d910c-0b5b-4a58-be0a-3b2a9f9b1e31 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 12:59:58.818347 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-681d910c-0b5b-4a58-be0a-3b2a9f9b1e31 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/5db43a6d-a079-4e7c-948a-b2600a102f63" status: 200 len: 1521 microversion: 2.1 time: 0.227876 Jun 17 12:59:58.819151 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 153/312] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:59:58 2022] GET /compute/v2.1/servers/5db43a6d-a079-4e7c-948a-b2600a102f63 => generated 1521 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 12:59:59.835779 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-117e839f-8f23-4ce1-ab8e-dd1761eae2d8 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 12:59:59.836401 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-117e839f-8f23-4ce1-ab8e-dd1761eae2d8 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 5db43a6d-a079-4e7c-948a-b2600a102f63] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 12:59:59.842730 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-117e839f-8f23-4ce1-ab8e-dd1761eae2d8 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:59.843212 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-117e839f-8f23-4ce1-ab8e-dd1761eae2d8 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:59.843988 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-117e839f-8f23-4ce1-ab8e-dd1761eae2d8 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 12:59:59.844399 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-117e839f-8f23-4ce1-ab8e-dd1761eae2d8 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 12:59:59.848415 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=80 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:00:00.010338 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-117e839f-8f23-4ce1-ab8e-dd1761eae2d8 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:00:00.022671 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-117e839f-8f23-4ce1-ab8e-dd1761eae2d8 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/5db43a6d-a079-4e7c-948a-b2600a102f63" status: 200 len: 1521 microversion: 2.1 time: 0.190540 Jun 17 13:00:00.023965 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 160/313] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 12:59:59 2022] GET /compute/v2.1/servers/5db43a6d-a079-4e7c-948a-b2600a102f63 => generated 1521 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:00:01.047628 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-502ae63c-b289-4ec6-be53-0a44c87d6a3e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:01.048317 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-502ae63c-b289-4ec6-be53-0a44c87d6a3e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 5db43a6d-a079-4e7c-948a-b2600a102f63] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:01.051458 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_api:SELECT=19 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:00:01.057496 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-502ae63c-b289-4ec6-be53-0a44c87d6a3e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:01.058054 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-502ae63c-b289-4ec6-be53-0a44c87d6a3e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:01.059080 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-502ae63c-b289-4ec6-be53-0a44c87d6a3e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:01.059550 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-502ae63c-b289-4ec6-be53-0a44c87d6a3e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:01.209707 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-502ae63c-b289-4ec6-be53-0a44c87d6a3e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:00:01.218524 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-502ae63c-b289-4ec6-be53-0a44c87d6a3e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/5db43a6d-a079-4e7c-948a-b2600a102f63" status: 200 len: 1521 microversion: 2.1 time: 0.174916 Jun 17 13:00:01.219131 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 154/314] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:00:01 2022] GET /compute/v2.1/servers/5db43a6d-a079-4e7c-948a-b2600a102f63 => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:00:02.238837 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-fc85c31b-8932-4117-b89e-c917ac9b2520 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:02.239659 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-fc85c31b-8932-4117-b89e-c917ac9b2520 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 5db43a6d-a079-4e7c-948a-b2600a102f63] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:02.246505 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fc85c31b-8932-4117-b89e-c917ac9b2520 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:02.247093 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fc85c31b-8932-4117-b89e-c917ac9b2520 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:02.247918 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fc85c31b-8932-4117-b89e-c917ac9b2520 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:02.248567 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fc85c31b-8932-4117-b89e-c917ac9b2520 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:02.400676 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-fc85c31b-8932-4117-b89e-c917ac9b2520 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:00:02.409262 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-fc85c31b-8932-4117-b89e-c917ac9b2520 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/5db43a6d-a079-4e7c-948a-b2600a102f63" status: 200 len: 1521 microversion: 2.1 time: 0.174588 Jun 17 13:00:02.409889 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 161/315] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:00:02 2022] GET /compute/v2.1/servers/5db43a6d-a079-4e7c-948a-b2600a102f63 => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:00:03.428613 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-588e6375-5110-4801-bbab-2656b7ad5414 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:03.429244 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-588e6375-5110-4801-bbab-2656b7ad5414 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 5db43a6d-a079-4e7c-948a-b2600a102f63] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:03.437444 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-588e6375-5110-4801-bbab-2656b7ad5414 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:03.437945 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-588e6375-5110-4801-bbab-2656b7ad5414 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:03.438772 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-588e6375-5110-4801-bbab-2656b7ad5414 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:03.439233 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-588e6375-5110-4801-bbab-2656b7ad5414 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:03.442573 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:00:03.588125 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-588e6375-5110-4801-bbab-2656b7ad5414 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:00:03.595884 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-588e6375-5110-4801-bbab-2656b7ad5414 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/5db43a6d-a079-4e7c-948a-b2600a102f63" status: 200 len: 1521 microversion: 2.1 time: 0.171240 Jun 17 13:00:03.596456 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 155/316] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:00:03 2022] GET /compute/v2.1/servers/5db43a6d-a079-4e7c-948a-b2600a102f63 => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:00:04.614465 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-72db4b40-b4e3-4926-9a5d-03e9ab992f85 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:04.615085 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-72db4b40-b4e3-4926-9a5d-03e9ab992f85 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 5db43a6d-a079-4e7c-948a-b2600a102f63] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:04.621504 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-72db4b40-b4e3-4926-9a5d-03e9ab992f85 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:04.621944 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-72db4b40-b4e3-4926-9a5d-03e9ab992f85 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:04.622729 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-72db4b40-b4e3-4926-9a5d-03e9ab992f85 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:04.623179 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-72db4b40-b4e3-4926-9a5d-03e9ab992f85 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:04.776390 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-72db4b40-b4e3-4926-9a5d-03e9ab992f85 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:00:04.784820 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-72db4b40-b4e3-4926-9a5d-03e9ab992f85 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/5db43a6d-a079-4e7c-948a-b2600a102f63" status: 200 len: 1521 microversion: 2.1 time: 0.175535 Jun 17 13:00:04.794296 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 162/317] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:00:04 2022] GET /compute/v2.1/servers/5db43a6d-a079-4e7c-948a-b2600a102f63 => generated 1521 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:00:05.802197 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-753f91fd-6867-494f-afe6-4cae6e141e23 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:05.802832 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-753f91fd-6867-494f-afe6-4cae6e141e23 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 5db43a6d-a079-4e7c-948a-b2600a102f63] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:05.809547 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-753f91fd-6867-494f-afe6-4cae6e141e23 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:05.809992 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-753f91fd-6867-494f-afe6-4cae6e141e23 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:05.810772 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-753f91fd-6867-494f-afe6-4cae6e141e23 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:05.811202 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-753f91fd-6867-494f-afe6-4cae6e141e23 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:05.949356 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-753f91fd-6867-494f-afe6-4cae6e141e23 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:00:05.956812 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-753f91fd-6867-494f-afe6-4cae6e141e23 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/5db43a6d-a079-4e7c-948a-b2600a102f63" status: 200 len: 1521 microversion: 2.1 time: 0.158766 Jun 17 13:00:05.957461 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 156/318] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:00:05 2022] GET /compute/v2.1/servers/5db43a6d-a079-4e7c-948a-b2600a102f63 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:00:06.979416 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-e7701c22-eaca-47b0-8909-1c00aecc1b7c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:06.980073 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-e7701c22-eaca-47b0-8909-1c00aecc1b7c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 5db43a6d-a079-4e7c-948a-b2600a102f63] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:06.986788 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e7701c22-eaca-47b0-8909-1c00aecc1b7c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:06.987238 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e7701c22-eaca-47b0-8909-1c00aecc1b7c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:06.988027 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e7701c22-eaca-47b0-8909-1c00aecc1b7c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:06.988450 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e7701c22-eaca-47b0-8909-1c00aecc1b7c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:07.133840 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-e7701c22-eaca-47b0-8909-1c00aecc1b7c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:00:07.141811 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-e7701c22-eaca-47b0-8909-1c00aecc1b7c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/5db43a6d-a079-4e7c-948a-b2600a102f63" status: 200 len: 1521 microversion: 2.1 time: 0.166482 Jun 17 13:00:07.142497 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 163/319] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:00:06 2022] GET /compute/v2.1/servers/5db43a6d-a079-4e7c-948a-b2600a102f63 => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:00:08.161050 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-4b6291a3-c33d-4fe7-a241-cd7d17acca52 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:08.162651 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-4b6291a3-c33d-4fe7-a241-cd7d17acca52 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 5db43a6d-a079-4e7c-948a-b2600a102f63] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:08.171011 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4b6291a3-c33d-4fe7-a241-cd7d17acca52 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:08.171465 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4b6291a3-c33d-4fe7-a241-cd7d17acca52 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:08.172236 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4b6291a3-c33d-4fe7-a241-cd7d17acca52 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:08.173249 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4b6291a3-c33d-4fe7-a241-cd7d17acca52 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:08.363142 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-4b6291a3-c33d-4fe7-a241-cd7d17acca52 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:00:08.373724 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-4b6291a3-c33d-4fe7-a241-cd7d17acca52 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/5db43a6d-a079-4e7c-948a-b2600a102f63" status: 200 len: 1521 microversion: 2.1 time: 0.217202 Jun 17 13:00:08.389159 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 157/320] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:00:08 2022] GET /compute/v2.1/servers/5db43a6d-a079-4e7c-948a-b2600a102f63 => generated 1521 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:00:09.132917 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-bda60b67-8db3-4096-8fa0-2a38ff130065 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-190268760", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-892142400", "security_groups": [{"name": "tempest-secgroup-smoke-831135846"}], "block_device_mapping_v2": [{"uuid": "628e9f17-0617-436f-be26-663dcef02f0b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "d80e5346-cf3e-4443-a63e-37e0e88a82d9"}]}} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:00:09.249815 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.network.neutron [None req-bda60b67-8db3-4096-8fa0-2a38ff130065 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] validate_networks() for [('d80e5346-cf3e-4443-a63e-37e0e88a82d9', None, None, None, None, None)] {{(pid=117660) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 17 13:00:09.407968 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-fcd93900-2fb1-4d01-923d-fb1bce00085e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:09.411181 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-fcd93900-2fb1-4d01-923d-fb1bce00085e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 5db43a6d-a079-4e7c-948a-b2600a102f63] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:09.438929 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-fcd93900-2fb1-4d01-923d-fb1bce00085e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:09.439608 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-fcd93900-2fb1-4d01-923d-fb1bce00085e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:09.440637 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-fcd93900-2fb1-4d01-923d-fb1bce00085e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:09.441493 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-fcd93900-2fb1-4d01-923d-fb1bce00085e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:09.785768 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-fcd93900-2fb1-4d01-923d-fb1bce00085e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:00:09.794431 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-fcd93900-2fb1-4d01-923d-fb1bce00085e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/5db43a6d-a079-4e7c-948a-b2600a102f63" status: 200 len: 1521 microversion: 2.1 time: 0.402369 Jun 17 13:00:09.795025 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 158/321] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:00:09 2022] GET /compute/v2.1/servers/5db43a6d-a079-4e7c-948a-b2600a102f63 => generated 1521 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:00:09.845281 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.virt.hardware [None req-bda60b67-8db3-4096-8fa0-2a38ff130065 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Flavor limits 0:0:0 {{(pid=117660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 17 13:00:09.845993 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.virt.hardware [None req-bda60b67-8db3-4096-8fa0-2a38ff130065 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Image limits 0:0:0 {{(pid=117660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 17 13:00:09.846720 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.virt.hardware [None req-bda60b67-8db3-4096-8fa0-2a38ff130065 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Flavor pref 0:0:0 {{(pid=117660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 17 13:00:09.847251 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.virt.hardware [None req-bda60b67-8db3-4096-8fa0-2a38ff130065 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Image pref 0:0:0 {{(pid=117660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 17 13:00:09.847859 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.virt.hardware [None req-bda60b67-8db3-4096-8fa0-2a38ff130065 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 17 13:00:09.858889 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bda60b67-8db3-4096-8fa0-2a38ff130065 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:09.859641 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bda60b67-8db3-4096-8fa0-2a38ff130065 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:09.861490 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bda60b67-8db3-4096-8fa0-2a38ff130065 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:09.861490 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bda60b67-8db3-4096-8fa0-2a38ff130065 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:09.880404 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.quota [None req-bda60b67-8db3-4096-8fa0-2a38ff130065 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Getting quotas for project 73bf442df39b4f5cbc18f571a0596f10. Resources: {'ram', 'cores', 'instances'} {{(pid=117660) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 13:00:09.885210 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.quota [None req-bda60b67-8db3-4096-8fa0-2a38ff130065 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Getting quotas for user 18195083037046bd99166f68690c3dce and project 73bf442df39b4f5cbc18f571a0596f10. Resources: {'ram', 'cores', 'instances'} {{(pid=117660) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 13:00:09.946322 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-bda60b67-8db3-4096-8fa0-2a38ff130065 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Going to run 1 instances... {{(pid=117660) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 17 13:00:09.948512 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-bda60b67-8db3-4096-8fa0-2a38ff130065 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] [instance: 72889057-861c-42f3-8629-32fff8f5dab7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='628e9f17-0617-436f-be26-663dcef02f0b',volume_size=None,volume_type=None)] {{(pid=117660) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 17 13:00:10.115394 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-bda60b67-8db3-4096-8fa0-2a38ff130065 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.986476 Jun 17 13:00:10.116037 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 164/322] 10.222.0.48 () {60 vars in 1146 bytes} [Fri Jun 17 13:00:09 2022] POST /compute/v2.1/servers => generated 405 bytes in 988 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 17 13:00:10.126659 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-92a28422-05d7-4767-aaa7-c48bfd561aa8 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:10.127266 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-92a28422-05d7-4767-aaa7-c48bfd561aa8 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] [instance: 72889057-861c-42f3-8629-32fff8f5dab7] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:10.180181 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-92a28422-05d7-4767-aaa7-c48bfd561aa8 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18195083037046bd99166f68690c3dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bf442df39b4f5cbc18f571a0596f10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:00:10.188347 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-92a28422-05d7-4767-aaa7-c48bfd561aa8 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] 10.222.0.48 "GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7" status: 200 len: 1093 microversion: 2.1 time: 0.065850 Jun 17 13:00:10.188900 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 159/323] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:00:10 2022] GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7 => generated 1093 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:00:10.812421 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-b9a034c0-14a0-432d-a13e-67342f8646c6 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:10.813150 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-b9a034c0-14a0-432d-a13e-67342f8646c6 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 5db43a6d-a079-4e7c-948a-b2600a102f63] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:10.828369 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b9a034c0-14a0-432d-a13e-67342f8646c6 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:10.829248 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b9a034c0-14a0-432d-a13e-67342f8646c6 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:10.830466 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b9a034c0-14a0-432d-a13e-67342f8646c6 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:10.830970 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b9a034c0-14a0-432d-a13e-67342f8646c6 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:10.985917 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-b9a034c0-14a0-432d-a13e-67342f8646c6 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:00:10.994813 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-b9a034c0-14a0-432d-a13e-67342f8646c6 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/5db43a6d-a079-4e7c-948a-b2600a102f63" status: 200 len: 1521 microversion: 2.1 time: 0.186413 Jun 17 13:00:10.995396 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 165/324] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:00:10 2022] GET /compute/v2.1/servers/5db43a6d-a079-4e7c-948a-b2600a102f63 => generated 1521 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:00:11.206592 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-3e9ff0f9-7253-4734-bf0d-c48c4b3ba26d tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:11.207211 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-3e9ff0f9-7253-4734-bf0d-c48c4b3ba26d tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] [instance: 72889057-861c-42f3-8629-32fff8f5dab7] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:11.214974 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-3e9ff0f9-7253-4734-bf0d-c48c4b3ba26d tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:11.215429 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-3e9ff0f9-7253-4734-bf0d-c48c4b3ba26d tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:11.216217 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-3e9ff0f9-7253-4734-bf0d-c48c4b3ba26d tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:11.216684 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-3e9ff0f9-7253-4734-bf0d-c48c4b3ba26d tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:11.280785 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-3e9ff0f9-7253-4734-bf0d-c48c4b3ba26d tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18195083037046bd99166f68690c3dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bf442df39b4f5cbc18f571a0596f10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:00:11.289038 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-3e9ff0f9-7253-4734-bf0d-c48c4b3ba26d tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] 10.222.0.48 "GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7" status: 200 len: 1143 microversion: 2.1 time: 0.086290 Jun 17 13:00:11.289588 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 160/325] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:00:11 2022] GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7 => generated 1143 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:00:12.014979 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-ca525b08-742e-47dc-9a3d-4e82b6f28508 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:12.015618 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-ca525b08-742e-47dc-9a3d-4e82b6f28508 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 5db43a6d-a079-4e7c-948a-b2600a102f63] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:12.021702 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ca525b08-742e-47dc-9a3d-4e82b6f28508 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:12.022176 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ca525b08-742e-47dc-9a3d-4e82b6f28508 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:12.023884 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ca525b08-742e-47dc-9a3d-4e82b6f28508 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:12.023884 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ca525b08-742e-47dc-9a3d-4e82b6f28508 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:12.158596 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-ca525b08-742e-47dc-9a3d-4e82b6f28508 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:00:12.166984 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-ca525b08-742e-47dc-9a3d-4e82b6f28508 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/5db43a6d-a079-4e7c-948a-b2600a102f63" status: 200 len: 1521 microversion: 2.1 time: 0.156071 Jun 17 13:00:12.167687 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 166/326] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:00:12 2022] GET /compute/v2.1/servers/5db43a6d-a079-4e7c-948a-b2600a102f63 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 13:00:12.311083 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-c7c3bf28-cd0a-4855-8fdb-ac80db2052af tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:12.312179 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-c7c3bf28-cd0a-4855-8fdb-ac80db2052af tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] [instance: 72889057-861c-42f3-8629-32fff8f5dab7] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:12.323454 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c7c3bf28-cd0a-4855-8fdb-ac80db2052af tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:12.324233 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c7c3bf28-cd0a-4855-8fdb-ac80db2052af tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:12.325588 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c7c3bf28-cd0a-4855-8fdb-ac80db2052af tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:12.326394 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c7c3bf28-cd0a-4855-8fdb-ac80db2052af tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:12.407146 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-c7c3bf28-cd0a-4855-8fdb-ac80db2052af tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18195083037046bd99166f68690c3dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bf442df39b4f5cbc18f571a0596f10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:00:12.415860 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-c7c3bf28-cd0a-4855-8fdb-ac80db2052af tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] 10.222.0.48 "GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7" status: 200 len: 1143 microversion: 2.1 time: 0.112204 Jun 17 13:00:12.416497 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 161/327] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:00:12 2022] GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7 => generated 1143 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:00:13.184727 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-42b870c9-2514-40c9-b4a0-cc6b2f1a57d7 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:13.185356 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-42b870c9-2514-40c9-b4a0-cc6b2f1a57d7 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 5db43a6d-a079-4e7c-948a-b2600a102f63] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:13.191924 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-42b870c9-2514-40c9-b4a0-cc6b2f1a57d7 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:13.192364 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-42b870c9-2514-40c9-b4a0-cc6b2f1a57d7 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:13.193167 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-42b870c9-2514-40c9-b4a0-cc6b2f1a57d7 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:13.193565 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-42b870c9-2514-40c9-b4a0-cc6b2f1a57d7 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:13.344477 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-42b870c9-2514-40c9-b4a0-cc6b2f1a57d7 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:00:13.352150 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-42b870c9-2514-40c9-b4a0-cc6b2f1a57d7 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/5db43a6d-a079-4e7c-948a-b2600a102f63" status: 200 len: 1521 microversion: 2.1 time: 0.171501 Jun 17 13:00:13.352725 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 167/328] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:00:13 2022] GET /compute/v2.1/servers/5db43a6d-a079-4e7c-948a-b2600a102f63 => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:00:13.433417 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-c0ecb639-a789-465d-b2ad-bd772e8411d3 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:13.434031 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-c0ecb639-a789-465d-b2ad-bd772e8411d3 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] [instance: 72889057-861c-42f3-8629-32fff8f5dab7] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:13.441181 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c0ecb639-a789-465d-b2ad-bd772e8411d3 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:13.441533 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c0ecb639-a789-465d-b2ad-bd772e8411d3 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:13.442392 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c0ecb639-a789-465d-b2ad-bd772e8411d3 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:13.442824 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c0ecb639-a789-465d-b2ad-bd772e8411d3 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:13.510009 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-c0ecb639-a789-465d-b2ad-bd772e8411d3 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18195083037046bd99166f68690c3dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bf442df39b4f5cbc18f571a0596f10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:00:13.518226 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-c0ecb639-a789-465d-b2ad-bd772e8411d3 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] 10.222.0.48 "GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7" status: 200 len: 1143 microversion: 2.1 time: 0.088895 Jun 17 13:00:13.518793 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 162/329] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:00:13 2022] GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7 => generated 1143 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:00:14.369252 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-75bd9ec3-d174-438b-9c6a-01ebdc7c3fb8 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:14.369969 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-75bd9ec3-d174-438b-9c6a-01ebdc7c3fb8 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 5db43a6d-a079-4e7c-948a-b2600a102f63] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:14.377322 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-75bd9ec3-d174-438b-9c6a-01ebdc7c3fb8 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:14.377827 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-75bd9ec3-d174-438b-9c6a-01ebdc7c3fb8 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:14.378719 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-75bd9ec3-d174-438b-9c6a-01ebdc7c3fb8 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:14.379242 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-75bd9ec3-d174-438b-9c6a-01ebdc7c3fb8 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:14.517961 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-75bd9ec3-d174-438b-9c6a-01ebdc7c3fb8 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:00:14.525595 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-75bd9ec3-d174-438b-9c6a-01ebdc7c3fb8 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/5db43a6d-a079-4e7c-948a-b2600a102f63" status: 200 len: 1521 microversion: 2.1 time: 0.160183 Jun 17 13:00:14.526289 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 168/330] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:00:14 2022] GET /compute/v2.1/servers/5db43a6d-a079-4e7c-948a-b2600a102f63 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:00:14.536510 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-5b08133a-b526-4c6c-b25d-739b7cd18f1f tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:14.537130 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-5b08133a-b526-4c6c-b25d-739b7cd18f1f tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] [instance: 72889057-861c-42f3-8629-32fff8f5dab7] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:14.544946 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-5b08133a-b526-4c6c-b25d-739b7cd18f1f tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:14.545389 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-5b08133a-b526-4c6c-b25d-739b7cd18f1f tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:14.546187 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-5b08133a-b526-4c6c-b25d-739b7cd18f1f tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:14.546626 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-5b08133a-b526-4c6c-b25d-739b7cd18f1f tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:14.611884 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-5b08133a-b526-4c6c-b25d-739b7cd18f1f tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18195083037046bd99166f68690c3dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bf442df39b4f5cbc18f571a0596f10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:00:14.624554 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-5b08133a-b526-4c6c-b25d-739b7cd18f1f tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] 10.222.0.48 "GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7" status: 200 len: 1135 microversion: 2.1 time: 0.092017 Jun 17 13:00:14.625271 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 163/331] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:00:14 2022] GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7 => generated 1135 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:00:15.544171 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-00eee6c7-819d-4994-9418-0b27e1b547b5 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:15.544786 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-00eee6c7-819d-4994-9418-0b27e1b547b5 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 5db43a6d-a079-4e7c-948a-b2600a102f63] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:15.551370 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-00eee6c7-819d-4994-9418-0b27e1b547b5 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:15.551810 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-00eee6c7-819d-4994-9418-0b27e1b547b5 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:15.552583 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-00eee6c7-819d-4994-9418-0b27e1b547b5 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:15.553014 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-00eee6c7-819d-4994-9418-0b27e1b547b5 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:15.643073 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-add5492c-7264-470c-808a-f79b469483e7 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:15.643769 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-add5492c-7264-470c-808a-f79b469483e7 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] [instance: 72889057-861c-42f3-8629-32fff8f5dab7] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:15.650659 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-add5492c-7264-470c-808a-f79b469483e7 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:15.651137 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-add5492c-7264-470c-808a-f79b469483e7 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:15.652282 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-add5492c-7264-470c-808a-f79b469483e7 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:15.653066 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-add5492c-7264-470c-808a-f79b469483e7 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:15.711047 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-00eee6c7-819d-4994-9418-0b27e1b547b5 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:00:15.721747 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-00eee6c7-819d-4994-9418-0b27e1b547b5 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/5db43a6d-a079-4e7c-948a-b2600a102f63" status: 200 len: 1521 microversion: 2.1 time: 0.181459 Jun 17 13:00:15.722377 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 169/332] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:00:15 2022] GET /compute/v2.1/servers/5db43a6d-a079-4e7c-948a-b2600a102f63 => generated 1521 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:00:15.744809 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-add5492c-7264-470c-808a-f79b469483e7 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18195083037046bd99166f68690c3dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bf442df39b4f5cbc18f571a0596f10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:00:15.754198 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-add5492c-7264-470c-808a-f79b469483e7 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] 10.222.0.48 "GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7" status: 200 len: 1191 microversion: 2.1 time: 0.114873 Jun 17 13:00:15.754772 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 164/333] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:00:15 2022] GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7 => generated 1191 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 13:00:16.739646 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-e64bbd5b-a360-4ab2-9734-a1cc6d4774cf tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:16.740519 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-e64bbd5b-a360-4ab2-9734-a1cc6d4774cf tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 5db43a6d-a079-4e7c-948a-b2600a102f63] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:16.748234 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e64bbd5b-a360-4ab2-9734-a1cc6d4774cf tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:16.748685 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e64bbd5b-a360-4ab2-9734-a1cc6d4774cf tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:16.749752 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e64bbd5b-a360-4ab2-9734-a1cc6d4774cf tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:16.750220 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e64bbd5b-a360-4ab2-9734-a1cc6d4774cf tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:16.772270 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-3d1cb353-84f2-404f-8935-7ace58c32d51 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:16.772899 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-3d1cb353-84f2-404f-8935-7ace58c32d51 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] [instance: 72889057-861c-42f3-8629-32fff8f5dab7] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:16.779993 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-3d1cb353-84f2-404f-8935-7ace58c32d51 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:16.780436 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-3d1cb353-84f2-404f-8935-7ace58c32d51 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:16.781194 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-3d1cb353-84f2-404f-8935-7ace58c32d51 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:16.781622 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-3d1cb353-84f2-404f-8935-7ace58c32d51 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:16.865442 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-3d1cb353-84f2-404f-8935-7ace58c32d51 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18195083037046bd99166f68690c3dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bf442df39b4f5cbc18f571a0596f10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:00:16.874075 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-3d1cb353-84f2-404f-8935-7ace58c32d51 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] 10.222.0.48 "GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7" status: 200 len: 1191 microversion: 2.1 time: 0.105512 Jun 17 13:00:16.874693 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 165/334] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:00:16 2022] GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7 => generated 1191 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:00:16.936927 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-e64bbd5b-a360-4ab2-9734-a1cc6d4774cf tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:00:16.944770 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-e64bbd5b-a360-4ab2-9734-a1cc6d4774cf tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/5db43a6d-a079-4e7c-948a-b2600a102f63" status: 200 len: 1521 microversion: 2.1 time: 0.209068 Jun 17 13:00:16.945346 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 170/335] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:00:16 2022] GET /compute/v2.1/servers/5db43a6d-a079-4e7c-948a-b2600a102f63 => generated 1521 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:00:17.891721 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-a2b290ad-904e-47b3-8153-b16278e155c0 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:17.892340 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-a2b290ad-904e-47b3-8153-b16278e155c0 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] [instance: 72889057-861c-42f3-8629-32fff8f5dab7] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:17.899358 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a2b290ad-904e-47b3-8153-b16278e155c0 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:17.899814 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a2b290ad-904e-47b3-8153-b16278e155c0 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:17.900577 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a2b290ad-904e-47b3-8153-b16278e155c0 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:17.901020 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a2b290ad-904e-47b3-8153-b16278e155c0 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:17.965030 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-fc23a8f0-7334-4eab-9bc4-427fccfe1c4c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:17.965608 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-fc23a8f0-7334-4eab-9bc4-427fccfe1c4c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 5db43a6d-a079-4e7c-948a-b2600a102f63] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:17.972015 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fc23a8f0-7334-4eab-9bc4-427fccfe1c4c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:17.972420 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-a2b290ad-904e-47b3-8153-b16278e155c0 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18195083037046bd99166f68690c3dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bf442df39b4f5cbc18f571a0596f10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:00:17.972542 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fc23a8f0-7334-4eab-9bc4-427fccfe1c4c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:17.973194 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fc23a8f0-7334-4eab-9bc4-427fccfe1c4c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:17.973623 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fc23a8f0-7334-4eab-9bc4-427fccfe1c4c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:17.981011 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-a2b290ad-904e-47b3-8153-b16278e155c0 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] 10.222.0.48 "GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7" status: 200 len: 1191 microversion: 2.1 time: 0.093105 Jun 17 13:00:17.981600 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 166/336] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:00:17 2022] GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7 => generated 1191 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:00:18.116092 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-fc23a8f0-7334-4eab-9bc4-427fccfe1c4c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:00:18.124539 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-fc23a8f0-7334-4eab-9bc4-427fccfe1c4c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/5db43a6d-a079-4e7c-948a-b2600a102f63" status: 200 len: 1521 microversion: 2.1 time: 0.165670 Jun 17 13:00:18.125171 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 171/337] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:00:17 2022] GET /compute/v2.1/servers/5db43a6d-a079-4e7c-948a-b2600a102f63 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:00:19.000941 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-094cef76-90d5-4ac1-98bc-f5724f7e35a5 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:19.001895 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-094cef76-90d5-4ac1-98bc-f5724f7e35a5 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] [instance: 72889057-861c-42f3-8629-32fff8f5dab7] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:19.009672 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-094cef76-90d5-4ac1-98bc-f5724f7e35a5 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:19.010223 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-094cef76-90d5-4ac1-98bc-f5724f7e35a5 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:19.012002 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-094cef76-90d5-4ac1-98bc-f5724f7e35a5 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:19.012508 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-094cef76-90d5-4ac1-98bc-f5724f7e35a5 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:19.079631 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-094cef76-90d5-4ac1-98bc-f5724f7e35a5 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18195083037046bd99166f68690c3dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bf442df39b4f5cbc18f571a0596f10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:00:19.087177 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-094cef76-90d5-4ac1-98bc-f5724f7e35a5 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] 10.222.0.48 "GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7" status: 200 len: 1191 microversion: 2.1 time: 0.090132 Jun 17 13:00:19.087730 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 167/338] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:00:18 2022] GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7 => generated 1191 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:00:19.143463 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-ceb4ecc7-431a-47d1-ba18-5dc2dd59f4e6 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:19.144093 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-ceb4ecc7-431a-47d1-ba18-5dc2dd59f4e6 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 5db43a6d-a079-4e7c-948a-b2600a102f63] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:19.150393 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ceb4ecc7-431a-47d1-ba18-5dc2dd59f4e6 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:19.150859 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ceb4ecc7-431a-47d1-ba18-5dc2dd59f4e6 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:19.151754 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ceb4ecc7-431a-47d1-ba18-5dc2dd59f4e6 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:19.152919 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ceb4ecc7-431a-47d1-ba18-5dc2dd59f4e6 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:19.321945 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-ceb4ecc7-431a-47d1-ba18-5dc2dd59f4e6 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:00:19.330635 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-ceb4ecc7-431a-47d1-ba18-5dc2dd59f4e6 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/5db43a6d-a079-4e7c-948a-b2600a102f63" status: 200 len: 1501 microversion: 2.1 time: 0.191210 Jun 17 13:00:19.331222 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 172/339] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:00:19 2022] GET /compute/v2.1/servers/5db43a6d-a079-4e7c-948a-b2600a102f63 => generated 1501 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:00:19.348273 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-64def07a-3be8-4a3e-a5ea-bf161ce4cd48 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5e2e722c-eac2-48ea-9161-a6239d935262"}} {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:00:19.349444 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-64def07a-3be8-4a3e-a5ea-bf161ce4cd48 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 5db43a6d-a079-4e7c-948a-b2600a102f63] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:19.356332 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-64def07a-3be8-4a3e-a5ea-bf161ce4cd48 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:19.356779 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-64def07a-3be8-4a3e-a5ea-bf161ce4cd48 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:19.357860 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-64def07a-3be8-4a3e-a5ea-bf161ce4cd48 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:19.358485 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-64def07a-3be8-4a3e-a5ea-bf161ce4cd48 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:19.408828 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.wsgi [None req-64def07a-3be8-4a3e-a5ea-bf161ce4cd48 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] HTTP exception thrown: Cannot 'attach_volume' instance 5db43a6d-a079-4e7c-948a-b2600a102f63 while it is in vm_state rescued Jun 17 13:00:19.410865 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-64def07a-3be8-4a3e-a5ea-bf161ce4cd48 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Request method failure captured: Jun 17 13:00:19.410865 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: request: POST /compute/v2.1/servers/5db43a6d-a079-4e7c-948a-b2600a102f63/os-volume_attachments HTTP/1.1 Jun 17 13:00:19.410865 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Accept: application/json Jun 17 13:00:19.410865 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Accept-Encoding: identity Jun 17 13:00:19.410865 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Connection: close Jun 17 13:00:19.410865 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Content-Length: 74 Jun 17 13:00:19.410865 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Content-Type: application/json Jun 17 13:00:19.410865 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Host: 10.222.0.48 Jun 17 13:00:19.410865 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Openstack-System-Scope: None Jun 17 13:00:19.410865 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: User-Agent: python-urllib3/1.26.9 Jun 17 13:00:19.410865 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Auth-Token: gAAAAABirHoxM0oq9BgeHLRFPYzXBHG5U4OV8ZU-A1ymANbGzbLAnLt205Q4DLlvW5I3ZQK2kg4ViraZvfMlofkEkYssplETqKLDgpV_0cDAupkiyxxXo0oRMQ1NOAKA18FF8OZJnb5Gs-d_9R_XYIMft4Dwgbdu5CEqMFZ9aQiMHSbSwXIg9SU Jun 17 13:00:19.410865 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Domain-Id: None Jun 17 13:00:19.410865 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Domain-Name: None Jun 17 13:00:19.410865 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Identity-Status: Confirmed Jun 17 13:00:19.410865 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Is-Admin-Project: True Jun 17 13:00:19.410865 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Project-Domain-Id: default Jun 17 13:00:19.410865 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Project-Domain-Name: Default Jun 17 13:00:19.410865 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Project-Id: 17ea6f9d80f345dbb3b2bf75e0138fd3 Jun 17 13:00:19.410865 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1652483342 Jun 17 13:00:19.410865 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Role: member,reader Jun 17 13:00:19.410865 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Roles: member,reader Jun 17 13:00:19.413633 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_17ea6f9d80f345dbb3b2bf75e0138fd3", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/17ea6f9d80f345dbb3b2bf75e0138fd3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/17ea6f9d80f345dbb3b2bf75e0138fd3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/17ea6f9d80f345dbb3b2bf75e0138fd3"}]}] Jun 17 13:00:19.413633 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1652483342 Jun 17 13:00:19.413633 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Tenant-Id: 17ea6f9d80f345dbb3b2bf75e0138fd3 Jun 17 13:00:19.413633 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1652483342 Jun 17 13:00:19.413633 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User: tempest-ServerRescueNegativeTestJSON-1652483342-project Jun 17 13:00:19.413633 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User-Domain-Id: default Jun 17 13:00:19.413633 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User-Domain-Name: Default Jun 17 13:00:19.413633 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User-Id: b75243e37f2342c0a428d39e193e0d4b Jun 17 13:00:19.413633 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1652483342-project Jun 17 13:00:19.413633 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Jun 17 13:00:19.413633 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: {"volumeAttachment": {"volumeId": "5e2e722c-eac2-48ea-9161-a6239d935262"}} Jun 17 13:00:19.413633 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: method: > Jun 17 13:00:19.415256 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: exception: Cannot 'attach_volume' instance 5db43a6d-a079-4e7c-948a-b2600a102f63 while it is in vm_state rescued Jun 17 13:00:19.415256 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: action_args: {'server_id': '5db43a6d-a079-4e7c-948a-b2600a102f63', 'body': {'volumeAttachment': {'volumeId': '5e2e722c-eac2-48ea-9161-a6239d935262'}}} Jun 17 13:00:19.415256 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 13:00:19.415256 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:00:19.415256 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 17 13:00:19.415256 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 17 13:00:19.415256 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 17 13:00:19.415256 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 17 13:00:19.415256 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 17 13:00:19.415256 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 17 13:00:19.415256 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 5db43a6d-a079-4e7c-948a-b2600a102f63 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jun 17 13:00:19.415256 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:00:19.415256 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:00:19.415256 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:00:19.415256 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:00:19.415256 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:00:19.415256 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:00:19.415256 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 13:00:19.415256 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 13:00:19.417756 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 13:00:19.417756 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 13:00:19.417756 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 17 13:00:19.417756 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 17 13:00:19.417756 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 17 13:00:19.417756 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 17 13:00:19.417756 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 17 13:00:19.417756 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 17 13:00:19.417756 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jun 17 13:00:19.417756 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 17 13:00:19.417756 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 17 13:00:19.417756 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 17 13:00:19.417756 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 5db43a6d-a079-4e7c-948a-b2600a102f63 while it is in vm_state rescued Jun 17 13:00:19.417756 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:00:19.417756 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:00:19.417756 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:00:19.417756 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:00:19.417756 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:00:19.417756 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:00:19.420292 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 13:00:19.420292 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 13:00:19.420292 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 5db43a6d-a079-4e7c-948a-b2600a102f63 while it is in vm_state rescued Jun 17 13:00:19.420292 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:00:19.420292 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-64def07a-3be8-4a3e-a5ea-bf161ce4cd48 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Returning 409 to user: Cannot 'attach_volume' instance 5db43a6d-a079-4e7c-948a-b2600a102f63 while it is in vm_state rescued {{(pid=117659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 13:00:19.420292 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-64def07a-3be8-4a3e-a5ea-bf161ce4cd48 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "POST /compute/v2.1/servers/5db43a6d-a079-4e7c-948a-b2600a102f63/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.068232 Jun 17 13:00:19.420292 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 168/340] 10.222.0.48 () {60 vars in 1322 bytes} [Fri Jun 17 13:00:19 2022] POST /compute/v2.1/servers/5db43a6d-a079-4e7c-948a-b2600a102f63/os-volume_attachments => generated 152 bytes in 70 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jun 17 13:00:19.422548 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-1e773ab2-ac3b-4be5-b36f-3ccea8b4cfcf tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:00:19.423128 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-1e773ab2-ac3b-4be5-b36f-3ccea8b4cfcf tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 5db43a6d-a079-4e7c-948a-b2600a102f63] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:19.434331 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1e773ab2-ac3b-4be5-b36f-3ccea8b4cfcf tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:19.437266 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1e773ab2-ac3b-4be5-b36f-3ccea8b4cfcf tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:19.440268 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1e773ab2-ac3b-4be5-b36f-3ccea8b4cfcf tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:19.440695 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1e773ab2-ac3b-4be5-b36f-3ccea8b4cfcf tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:19.536888 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-1e773ab2-ac3b-4be5-b36f-3ccea8b4cfcf tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "POST /compute/v2.1/servers/5db43a6d-a079-4e7c-948a-b2600a102f63/action" status: 202 len: 0 microversion: 2.1 time: 0.117658 Jun 17 13:00:19.541750 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 173/341] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Jun 17 13:00:19 2022] POST /compute/v2.1/servers/5db43a6d-a079-4e7c-948a-b2600a102f63/action => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 13:00:19.551036 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-51f7a4d8-4686-4c46-b659-e2e56a404ff6 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:19.555939 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-51f7a4d8-4686-4c46-b659-e2e56a404ff6 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 5db43a6d-a079-4e7c-948a-b2600a102f63] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:19.564476 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-51f7a4d8-4686-4c46-b659-e2e56a404ff6 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:19.564864 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-51f7a4d8-4686-4c46-b659-e2e56a404ff6 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:19.565641 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-51f7a4d8-4686-4c46-b659-e2e56a404ff6 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:19.566134 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-51f7a4d8-4686-4c46-b659-e2e56a404ff6 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:19.714892 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-51f7a4d8-4686-4c46-b659-e2e56a404ff6 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:00:19.724608 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-51f7a4d8-4686-4c46-b659-e2e56a404ff6 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/5db43a6d-a079-4e7c-948a-b2600a102f63" status: 200 len: 1509 microversion: 2.1 time: 0.177440 Jun 17 13:00:19.725147 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 169/342] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:00:19 2022] GET /compute/v2.1/servers/5db43a6d-a079-4e7c-948a-b2600a102f63 => generated 1509 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:00:20.102393 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell0:SELECT=2 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:00:20.103111 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell0:SELECT=6 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:00:20.107979 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-fcb45559-71ea-458d-9ea8-8b19948bd822 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:20.108680 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-fcb45559-71ea-458d-9ea8-8b19948bd822 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] [instance: 72889057-861c-42f3-8629-32fff8f5dab7] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:20.116511 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fcb45559-71ea-458d-9ea8-8b19948bd822 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:20.116689 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fcb45559-71ea-458d-9ea8-8b19948bd822 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:20.117446 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fcb45559-71ea-458d-9ea8-8b19948bd822 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:20.117922 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fcb45559-71ea-458d-9ea8-8b19948bd822 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:20.188927 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-fcb45559-71ea-458d-9ea8-8b19948bd822 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18195083037046bd99166f68690c3dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bf442df39b4f5cbc18f571a0596f10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:00:20.196810 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-fcb45559-71ea-458d-9ea8-8b19948bd822 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] 10.222.0.48 "GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7" status: 200 len: 1191 microversion: 2.1 time: 0.095557 Jun 17 13:00:20.197395 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 174/343] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:00:20 2022] GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7 => generated 1191 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:00:20.743031 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-5b3cb10d-5492-427b-a059-17e93311ebf8 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:20.743848 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-5b3cb10d-5492-427b-a059-17e93311ebf8 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 5db43a6d-a079-4e7c-948a-b2600a102f63] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:20.752545 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_cell0:SELECT=2 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:00:20.759279 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-5b3cb10d-5492-427b-a059-17e93311ebf8 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:20.759566 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-5b3cb10d-5492-427b-a059-17e93311ebf8 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:20.762294 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-5b3cb10d-5492-427b-a059-17e93311ebf8 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:20.763004 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-5b3cb10d-5492-427b-a059-17e93311ebf8 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:20.942212 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-5b3cb10d-5492-427b-a059-17e93311ebf8 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:00:20.950224 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-5b3cb10d-5492-427b-a059-17e93311ebf8 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/5db43a6d-a079-4e7c-948a-b2600a102f63" status: 200 len: 1509 microversion: 2.1 time: 0.212094 Jun 17 13:00:20.950793 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 170/344] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:00:20 2022] GET /compute/v2.1/servers/5db43a6d-a079-4e7c-948a-b2600a102f63 => generated 1509 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:00:21.213748 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-7e2c859a-3c7b-423c-9a25-a2c305b2166f tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:21.214534 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-7e2c859a-3c7b-423c-9a25-a2c305b2166f tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] [instance: 72889057-861c-42f3-8629-32fff8f5dab7] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:21.221956 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7e2c859a-3c7b-423c-9a25-a2c305b2166f tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:21.224373 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7e2c859a-3c7b-423c-9a25-a2c305b2166f tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:21.226209 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7e2c859a-3c7b-423c-9a25-a2c305b2166f tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:21.234500 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7e2c859a-3c7b-423c-9a25-a2c305b2166f tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:21.326934 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-7e2c859a-3c7b-423c-9a25-a2c305b2166f tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18195083037046bd99166f68690c3dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bf442df39b4f5cbc18f571a0596f10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:00:21.335830 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-7e2c859a-3c7b-423c-9a25-a2c305b2166f tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] 10.222.0.48 "GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7" status: 200 len: 1209 microversion: 2.1 time: 0.126464 Jun 17 13:00:21.336659 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 175/345] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:00:21 2022] GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7 => generated 1209 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:00:21.968498 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-c356d409-5e52-4b31-8b67-785a7cfc8a32 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:21.969170 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-c356d409-5e52-4b31-8b67-785a7cfc8a32 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 5db43a6d-a079-4e7c-948a-b2600a102f63] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:21.976813 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c356d409-5e52-4b31-8b67-785a7cfc8a32 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:21.977277 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c356d409-5e52-4b31-8b67-785a7cfc8a32 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:21.978738 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c356d409-5e52-4b31-8b67-785a7cfc8a32 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:21.979390 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c356d409-5e52-4b31-8b67-785a7cfc8a32 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:22.186475 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-c356d409-5e52-4b31-8b67-785a7cfc8a32 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:00:22.213674 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-c356d409-5e52-4b31-8b67-785a7cfc8a32 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/5db43a6d-a079-4e7c-948a-b2600a102f63" status: 200 len: 1509 microversion: 2.1 time: 0.249382 Jun 17 13:00:22.219958 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 171/346] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:00:21 2022] GET /compute/v2.1/servers/5db43a6d-a079-4e7c-948a-b2600a102f63 => generated 1509 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:00:22.358780 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-c12bda11-4a83-4039-8e68-a0ed78f3d567 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:22.359353 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-c12bda11-4a83-4039-8e68-a0ed78f3d567 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] [instance: 72889057-861c-42f3-8629-32fff8f5dab7] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:22.368821 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c12bda11-4a83-4039-8e68-a0ed78f3d567 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:22.369258 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c12bda11-4a83-4039-8e68-a0ed78f3d567 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:22.370265 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c12bda11-4a83-4039-8e68-a0ed78f3d567 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:22.370966 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c12bda11-4a83-4039-8e68-a0ed78f3d567 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:22.392644 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:00:22.531899 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-c12bda11-4a83-4039-8e68-a0ed78f3d567 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18195083037046bd99166f68690c3dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bf442df39b4f5cbc18f571a0596f10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:00:22.543259 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-c12bda11-4a83-4039-8e68-a0ed78f3d567 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] 10.222.0.48 "GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7" status: 200 len: 1264 microversion: 2.1 time: 0.190327 Jun 17 13:00:22.543958 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 176/347] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:00:22 2022] GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7 => generated 1264 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:00:23.245748 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-2ad8fb70-2ae0-4a15-afd2-1dc76d08e830 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:23.246348 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-2ad8fb70-2ae0-4a15-afd2-1dc76d08e830 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 5db43a6d-a079-4e7c-948a-b2600a102f63] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:23.253856 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2ad8fb70-2ae0-4a15-afd2-1dc76d08e830 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:23.254339 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2ad8fb70-2ae0-4a15-afd2-1dc76d08e830 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:23.255113 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2ad8fb70-2ae0-4a15-afd2-1dc76d08e830 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:23.255543 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2ad8fb70-2ae0-4a15-afd2-1dc76d08e830 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:23.402953 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-2ad8fb70-2ae0-4a15-afd2-1dc76d08e830 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:00:23.417097 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-2ad8fb70-2ae0-4a15-afd2-1dc76d08e830 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/5db43a6d-a079-4e7c-948a-b2600a102f63" status: 200 len: 1509 microversion: 2.1 time: 0.183417 Jun 17 13:00:23.417990 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 172/348] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:00:23 2022] GET /compute/v2.1/servers/5db43a6d-a079-4e7c-948a-b2600a102f63 => generated 1509 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:00:23.565556 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-f0b1c03c-292e-4c2a-a876-566b46c8daf4 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:23.565556 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-f0b1c03c-292e-4c2a-a876-566b46c8daf4 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] [instance: 72889057-861c-42f3-8629-32fff8f5dab7] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:23.565556 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:00:23.571807 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f0b1c03c-292e-4c2a-a876-566b46c8daf4 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:23.572330 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f0b1c03c-292e-4c2a-a876-566b46c8daf4 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:23.573078 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f0b1c03c-292e-4c2a-a876-566b46c8daf4 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:23.573851 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f0b1c03c-292e-4c2a-a876-566b46c8daf4 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:23.741310 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-f0b1c03c-292e-4c2a-a876-566b46c8daf4 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18195083037046bd99166f68690c3dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bf442df39b4f5cbc18f571a0596f10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:00:23.750208 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-f0b1c03c-292e-4c2a-a876-566b46c8daf4 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] 10.222.0.48 "GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7" status: 200 len: 1264 microversion: 2.1 time: 0.192673 Jun 17 13:00:23.754158 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 177/349] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:00:23 2022] GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7 => generated 1264 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:00:24.437120 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-d7b05b81-4540-4677-80b6-4e0d82416949 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:24.437906 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-d7b05b81-4540-4677-80b6-4e0d82416949 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 5db43a6d-a079-4e7c-948a-b2600a102f63] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:24.445968 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d7b05b81-4540-4677-80b6-4e0d82416949 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:24.446462 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d7b05b81-4540-4677-80b6-4e0d82416949 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:24.447528 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d7b05b81-4540-4677-80b6-4e0d82416949 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:24.447706 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d7b05b81-4540-4677-80b6-4e0d82416949 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:24.458857 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_cell1:SELECT=100 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:00:24.696540 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-d7b05b81-4540-4677-80b6-4e0d82416949 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:00:24.705417 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-d7b05b81-4540-4677-80b6-4e0d82416949 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/5db43a6d-a079-4e7c-948a-b2600a102f63" status: 200 len: 1509 microversion: 2.1 time: 0.272435 Jun 17 13:00:24.706517 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 173/350] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:00:24 2022] GET /compute/v2.1/servers/5db43a6d-a079-4e7c-948a-b2600a102f63 => generated 1509 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 13:00:24.767741 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-6c1d17ae-bbfe-4593-ab84-98c03e934da2 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:24.770756 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-6c1d17ae-bbfe-4593-ab84-98c03e934da2 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] [instance: 72889057-861c-42f3-8629-32fff8f5dab7] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:24.782888 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6c1d17ae-bbfe-4593-ab84-98c03e934da2 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:24.783455 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6c1d17ae-bbfe-4593-ab84-98c03e934da2 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:24.800068 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6c1d17ae-bbfe-4593-ab84-98c03e934da2 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:24.801979 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6c1d17ae-bbfe-4593-ab84-98c03e934da2 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:24.836233 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [req-96a3da47-2d51-4780-ba67-13ee4969905e req-499a67fd-c381-4bf0-a489-af196b8b656b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "72889057-861c-42f3-8629-32fff8f5dab7", "tag": "d7d2b4c7-923d-46bd-94ad-388673be0fbb"}]} {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:00:24.882589 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [req-96a3da47-2d51-4780-ba67-13ee4969905e req-499a67fd-c381-4bf0-a489-af196b8b656b service nova] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:24.883042 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [req-96a3da47-2d51-4780-ba67-13ee4969905e req-499a67fd-c381-4bf0-a489-af196b8b656b service nova] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:24.917813 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.compute.server_external_events [req-96a3da47-2d51-4780-ba67-13ee4969905e req-499a67fd-c381-4bf0-a489-af196b8b656b service nova] Creating event network-changed:d7d2b4c7-923d-46bd-94ad-388673be0fbb for instance 72889057-861c-42f3-8629-32fff8f5dab7 on hv-cinder-83754 Jun 17 13:00:24.942381 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [req-96a3da47-2d51-4780-ba67-13ee4969905e req-499a67fd-c381-4bf0-a489-af196b8b656b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115825 Jun 17 13:00:24.943475 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 174/351] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 13:00:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:00:25.195496 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-6c1d17ae-bbfe-4593-ab84-98c03e934da2 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18195083037046bd99166f68690c3dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bf442df39b4f5cbc18f571a0596f10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:00:25.206805 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-6c1d17ae-bbfe-4593-ab84-98c03e934da2 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] 10.222.0.48 "GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7" status: 200 len: 1264 microversion: 2.1 time: 0.443197 Jun 17 13:00:25.209227 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 178/352] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:00:24 2022] GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7 => generated 1264 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:00:25.730522 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-af6f1a07-b93c-4e00-85b6-70b046c6b410 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:25.731986 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-af6f1a07-b93c-4e00-85b6-70b046c6b410 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 5db43a6d-a079-4e7c-948a-b2600a102f63] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:25.743416 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-af6f1a07-b93c-4e00-85b6-70b046c6b410 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:25.744052 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-af6f1a07-b93c-4e00-85b6-70b046c6b410 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:25.745435 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-af6f1a07-b93c-4e00-85b6-70b046c6b410 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:25.746183 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-af6f1a07-b93c-4e00-85b6-70b046c6b410 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:25.923528 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-af6f1a07-b93c-4e00-85b6-70b046c6b410 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:00:25.937736 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-af6f1a07-b93c-4e00-85b6-70b046c6b410 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/5db43a6d-a079-4e7c-948a-b2600a102f63" status: 200 len: 1515 microversion: 2.1 time: 0.217174 Jun 17 13:00:25.938686 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 175/353] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:00:25 2022] GET /compute/v2.1/servers/5db43a6d-a079-4e7c-948a-b2600a102f63 => generated 1515 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:00:26.224938 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-66c9d35f-079a-4ae1-a3bc-8e2e4cd49938 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:26.226083 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-66c9d35f-079a-4ae1-a3bc-8e2e4cd49938 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] [instance: 72889057-861c-42f3-8629-32fff8f5dab7] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:26.240307 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-66c9d35f-079a-4ae1-a3bc-8e2e4cd49938 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:26.241259 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-66c9d35f-079a-4ae1-a3bc-8e2e4cd49938 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:26.242374 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-66c9d35f-079a-4ae1-a3bc-8e2e4cd49938 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:26.243776 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-66c9d35f-079a-4ae1-a3bc-8e2e4cd49938 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:26.575914 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-66c9d35f-079a-4ae1-a3bc-8e2e4cd49938 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18195083037046bd99166f68690c3dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bf442df39b4f5cbc18f571a0596f10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:00:26.593422 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-66c9d35f-079a-4ae1-a3bc-8e2e4cd49938 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] 10.222.0.48 "GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7" status: 200 len: 1264 microversion: 2.1 time: 0.371699 Jun 17 13:00:26.609257 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 179/354] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:00:26 2022] GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7 => generated 1264 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:00:27.439515 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-6032e81c-cd76-4991-80b9-58a185fc5b97 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Action: 'create', calling method: .version_select at 0x7f01901c0040>, body: {"keypair": {"name": "tempest-keypair-1288020396", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOmxCl76ozxQTZohb72zrdfMROjvZVeB+Ai/ZomTRIjL+8VIzy2d8vTN7MUH2zlARkmvpfilZ/N5Y9aRAT4C6ON5AGtU8+4MVz06iYWcyzPLz+GC2xcr/pD82za2kzP0fQ=="}} {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:00:27.470323 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.quota [None req-6032e81c-cd76-4991-80b9-58a185fc5b97 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Getting quotas for project 17ea6f9d80f345dbb3b2bf75e0138fd3. Resources: {'key_pairs'} {{(pid=117659) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 13:00:27.480915 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.quota [None req-6032e81c-cd76-4991-80b9-58a185fc5b97 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Getting quotas for user b75243e37f2342c0a428d39e193e0d4b and project 17ea6f9d80f345dbb3b2bf75e0138fd3. Resources: {'key_pairs'} {{(pid=117659) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 13:00:27.521968 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-6032e81c-cd76-4991-80b9-58a185fc5b97 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.090251 Jun 17 13:00:27.523086 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 176/355] 10.222.0.48 () {60 vars in 1158 bytes} [Fri Jun 17 13:00:27 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:00:27.618912 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-aad38810-019d-4f81-9dc7-c8c871b6a999 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:27.621179 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-aad38810-019d-4f81-9dc7-c8c871b6a999 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] [instance: 72889057-861c-42f3-8629-32fff8f5dab7] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:27.640849 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-aad38810-019d-4f81-9dc7-c8c871b6a999 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:27.641347 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-aad38810-019d-4f81-9dc7-c8c871b6a999 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:27.642291 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-aad38810-019d-4f81-9dc7-c8c871b6a999 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:27.642791 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-aad38810-019d-4f81-9dc7-c8c871b6a999 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:27.942568 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-aad38810-019d-4f81-9dc7-c8c871b6a999 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18195083037046bd99166f68690c3dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bf442df39b4f5cbc18f571a0596f10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:00:27.953740 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-aad38810-019d-4f81-9dc7-c8c871b6a999 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] 10.222.0.48 "GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7" status: 200 len: 1264 microversion: 2.1 time: 0.343982 Jun 17 13:00:27.954792 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 180/356] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:00:27 2022] GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7 => generated 1264 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:00:28.976448 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-a0a7e917-4062-4ebb-8ecf-0a90f78c7ea3 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:28.978347 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-a0a7e917-4062-4ebb-8ecf-0a90f78c7ea3 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] [instance: 72889057-861c-42f3-8629-32fff8f5dab7] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:28.989240 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a0a7e917-4062-4ebb-8ecf-0a90f78c7ea3 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:28.990192 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a0a7e917-4062-4ebb-8ecf-0a90f78c7ea3 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:28.991207 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a0a7e917-4062-4ebb-8ecf-0a90f78c7ea3 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:28.992714 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a0a7e917-4062-4ebb-8ecf-0a90f78c7ea3 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:29.260591 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-a0a7e917-4062-4ebb-8ecf-0a90f78c7ea3 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18195083037046bd99166f68690c3dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bf442df39b4f5cbc18f571a0596f10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:00:29.270009 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-a0a7e917-4062-4ebb-8ecf-0a90f78c7ea3 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] 10.222.0.48 "GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7" status: 200 len: 1264 microversion: 2.1 time: 0.300168 Jun 17 13:00:29.270736 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 177/357] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:00:28 2022] GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7 => generated 1264 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:00:29.543378 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-0ed392fd-9fc3-403f-acf4-639f59f3c4f2 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-279057720", "imageRef": "ccec3e37-1df8-4f10-a8f6-f97dfac54cf5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7be0f63f-8071-4d9e-ba66-cd0bb196b9c0"}], "security_groups": [{"name": "tempest-securitygroup--1860472411"}], "key_name": "tempest-keypair-1288020396", "user_data": "}} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:00:29.694390 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.network.neutron [None req-0ed392fd-9fc3-403f-acf4-639f59f3c4f2 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] validate_networks() for [('7be0f63f-8071-4d9e-ba66-cd0bb196b9c0', None, None, None, None, None)] {{(pid=117660) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 17 13:00:30.194481 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.virt.hardware [None req-0ed392fd-9fc3-403f-acf4-639f59f3c4f2 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Flavor limits 0:0:0 {{(pid=117660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 17 13:00:30.194481 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.virt.hardware [None req-0ed392fd-9fc3-403f-acf4-639f59f3c4f2 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Image limits 0:0:0 {{(pid=117660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 17 13:00:30.194481 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.virt.hardware [None req-0ed392fd-9fc3-403f-acf4-639f59f3c4f2 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Flavor pref 0:0:0 {{(pid=117660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 17 13:00:30.194481 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.virt.hardware [None req-0ed392fd-9fc3-403f-acf4-639f59f3c4f2 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Image pref 0:0:0 {{(pid=117660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 17 13:00:30.194481 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.virt.hardware [None req-0ed392fd-9fc3-403f-acf4-639f59f3c4f2 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 17 13:00:30.209040 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0ed392fd-9fc3-403f-acf4-639f59f3c4f2 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:30.209745 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0ed392fd-9fc3-403f-acf4-639f59f3c4f2 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:30.210973 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0ed392fd-9fc3-403f-acf4-639f59f3c4f2 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:30.211677 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0ed392fd-9fc3-403f-acf4-639f59f3c4f2 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:30.240648 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.quota [None req-0ed392fd-9fc3-403f-acf4-639f59f3c4f2 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Getting quotas for project 17ea6f9d80f345dbb3b2bf75e0138fd3. Resources: {'ram', 'cores', 'instances'} {{(pid=117660) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 13:00:30.247175 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.quota [None req-0ed392fd-9fc3-403f-acf4-639f59f3c4f2 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Getting quotas for user b75243e37f2342c0a428d39e193e0d4b and project 17ea6f9d80f345dbb3b2bf75e0138fd3. Resources: {'ram', 'cores', 'instances'} {{(pid=117660) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 13:00:30.263606 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-0ed392fd-9fc3-403f-acf4-639f59f3c4f2 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Going to run 1 instances... {{(pid=117660) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 17 13:00:30.265989 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-0ed392fd-9fc3-403f-acf4-639f59f3c4f2 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ccec3e37-1df8-4f10-a8f6-f97dfac54cf5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117660) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 17 13:00:30.302141 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-dce050e3-09cc-4760-a7f2-e66e224c4253 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:30.310123 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-dce050e3-09cc-4760-a7f2-e66e224c4253 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] [instance: 72889057-861c-42f3-8629-32fff8f5dab7] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:30.327905 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-dce050e3-09cc-4760-a7f2-e66e224c4253 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:30.328427 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-0ed392fd-9fc3-403f-acf4-639f59f3c4f2 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.789371 Jun 17 13:00:30.329997 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-dce050e3-09cc-4760-a7f2-e66e224c4253 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:30.330291 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 181/358] 10.222.0.48 () {60 vars in 1146 bytes} [Fri Jun 17 13:00:29 2022] POST /compute/v2.1/servers => generated 409 bytes in 792 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 17 13:00:30.332069 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-dce050e3-09cc-4760-a7f2-e66e224c4253 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:30.332956 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-dce050e3-09cc-4760-a7f2-e66e224c4253 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:30.362563 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-c5370b8d-c54e-43a7-80fc-ba2636a8ab9a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:30.364853 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-c5370b8d-c54e-43a7-80fc-ba2636a8ab9a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:30.511315 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-c5370b8d-c54e-43a7-80fc-ba2636a8ab9a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:00:30.525126 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-c5370b8d-c54e-43a7-80fc-ba2636a8ab9a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1245 microversion: 2.1 time: 0.182640 Jun 17 13:00:30.526922 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 182/359] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:00:30 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1245 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:00:30.570426 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-dce050e3-09cc-4760-a7f2-e66e224c4253 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18195083037046bd99166f68690c3dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bf442df39b4f5cbc18f571a0596f10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:00:30.579747 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-dce050e3-09cc-4760-a7f2-e66e224c4253 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] 10.222.0.48 "GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7" status: 200 len: 1264 microversion: 2.1 time: 0.292455 Jun 17 13:00:30.580468 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 178/360] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:00:30 2022] GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7 => generated 1264 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:00:31.553590 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-ee3e9ecd-5a20-4453-bcfd-5377d34eed81 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:31.554263 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-ee3e9ecd-5a20-4453-bcfd-5377d34eed81 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:31.611130 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-856734a0-f1d0-472c-aa40-7ce043e0ab4a tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:31.612293 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-856734a0-f1d0-472c-aa40-7ce043e0ab4a tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] [instance: 72889057-861c-42f3-8629-32fff8f5dab7] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:31.616411 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=1 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:00:31.625442 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-ee3e9ecd-5a20-4453-bcfd-5377d34eed81 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:00:31.628022 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-856734a0-f1d0-472c-aa40-7ce043e0ab4a tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:31.629000 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-856734a0-f1d0-472c-aa40-7ce043e0ab4a tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:31.629975 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-856734a0-f1d0-472c-aa40-7ce043e0ab4a tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:31.630614 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-856734a0-f1d0-472c-aa40-7ce043e0ab4a tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:31.644868 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-ee3e9ecd-5a20-4453-bcfd-5377d34eed81 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1245 microversion: 2.1 time: 0.087974 Jun 17 13:00:31.647795 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 183/361] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:00:31 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1245 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:00:31.848756 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-856734a0-f1d0-472c-aa40-7ce043e0ab4a tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18195083037046bd99166f68690c3dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bf442df39b4f5cbc18f571a0596f10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:00:31.857615 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-856734a0-f1d0-472c-aa40-7ce043e0ab4a tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] 10.222.0.48 "GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7" status: 200 len: 1264 microversion: 2.1 time: 0.255914 Jun 17 13:00:31.858242 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 179/362] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:00:31 2022] GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7 => generated 1264 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:00:32.677293 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-fb581831-529c-4996-82c4-5aad6ff9bbb2 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:32.677954 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-fb581831-529c-4996-82c4-5aad6ff9bbb2 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:32.753410 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-fb581831-529c-4996-82c4-5aad6ff9bbb2 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:00:32.762728 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-fb581831-529c-4996-82c4-5aad6ff9bbb2 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1245 microversion: 2.1 time: 0.088868 Jun 17 13:00:32.763335 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 184/363] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:00:32 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1245 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:00:32.876614 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-8aa3e4fb-3c3b-40ae-8506-a414e6035b17 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:32.877225 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-8aa3e4fb-3c3b-40ae-8506-a414e6035b17 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] [instance: 72889057-861c-42f3-8629-32fff8f5dab7] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:32.884245 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8aa3e4fb-3c3b-40ae-8506-a414e6035b17 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:32.884696 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8aa3e4fb-3c3b-40ae-8506-a414e6035b17 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:32.885483 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8aa3e4fb-3c3b-40ae-8506-a414e6035b17 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:32.885894 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8aa3e4fb-3c3b-40ae-8506-a414e6035b17 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:33.033178 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-8aa3e4fb-3c3b-40ae-8506-a414e6035b17 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18195083037046bd99166f68690c3dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bf442df39b4f5cbc18f571a0596f10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:00:33.044630 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-8aa3e4fb-3c3b-40ae-8506-a414e6035b17 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] 10.222.0.48 "GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7" status: 200 len: 1264 microversion: 2.1 time: 0.172052 Jun 17 13:00:33.045254 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 180/364] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:00:32 2022] GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7 => generated 1264 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:00:33.779478 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-570327c7-e055-4f4e-a594-d827e9b36fe9 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:33.780751 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-570327c7-e055-4f4e-a594-d827e9b36fe9 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:33.841431 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-570327c7-e055-4f4e-a594-d827e9b36fe9 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:00:33.849348 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-570327c7-e055-4f4e-a594-d827e9b36fe9 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1245 microversion: 2.1 time: 0.074213 Jun 17 13:00:33.849984 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 185/365] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:00:33 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1245 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:00:34.064353 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-25090cd3-78ad-440d-8f45-fd7c9e73d219 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:34.065013 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-25090cd3-78ad-440d-8f45-fd7c9e73d219 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] [instance: 72889057-861c-42f3-8629-32fff8f5dab7] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:34.072335 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-25090cd3-78ad-440d-8f45-fd7c9e73d219 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:34.072903 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-25090cd3-78ad-440d-8f45-fd7c9e73d219 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:34.073836 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-25090cd3-78ad-440d-8f45-fd7c9e73d219 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:34.074537 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-25090cd3-78ad-440d-8f45-fd7c9e73d219 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:34.220427 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-25090cd3-78ad-440d-8f45-fd7c9e73d219 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18195083037046bd99166f68690c3dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bf442df39b4f5cbc18f571a0596f10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:00:34.229449 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-25090cd3-78ad-440d-8f45-fd7c9e73d219 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] 10.222.0.48 "GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7" status: 200 len: 1264 microversion: 2.1 time: 0.170439 Jun 17 13:00:34.230285 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 181/366] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:00:34 2022] GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7 => generated 1264 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:00:34.867685 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-7ec3ded1-5583-4ffc-b3ae-1dcfcca7d483 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:34.868315 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-7ec3ded1-5583-4ffc-b3ae-1dcfcca7d483 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:34.876779 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7ec3ded1-5583-4ffc-b3ae-1dcfcca7d483 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:34.877388 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7ec3ded1-5583-4ffc-b3ae-1dcfcca7d483 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:34.878468 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7ec3ded1-5583-4ffc-b3ae-1dcfcca7d483 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:34.878801 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7ec3ded1-5583-4ffc-b3ae-1dcfcca7d483 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:34.957919 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-7ec3ded1-5583-4ffc-b3ae-1dcfcca7d483 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:00:34.969333 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-7ec3ded1-5583-4ffc-b3ae-1dcfcca7d483 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1249 microversion: 2.1 time: 0.105763 Jun 17 13:00:34.969952 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 186/367] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:00:34 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1249 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:00:35.247363 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-b236c843-e4b8-426a-b38e-aa9007b5ef9b tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:35.247971 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-b236c843-e4b8-426a-b38e-aa9007b5ef9b tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] [instance: 72889057-861c-42f3-8629-32fff8f5dab7] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:35.255593 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b236c843-e4b8-426a-b38e-aa9007b5ef9b tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:35.256047 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b236c843-e4b8-426a-b38e-aa9007b5ef9b tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:35.256815 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b236c843-e4b8-426a-b38e-aa9007b5ef9b tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:35.257227 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b236c843-e4b8-426a-b38e-aa9007b5ef9b tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:35.405238 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-b236c843-e4b8-426a-b38e-aa9007b5ef9b tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18195083037046bd99166f68690c3dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bf442df39b4f5cbc18f571a0596f10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:00:35.413170 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-b236c843-e4b8-426a-b38e-aa9007b5ef9b tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] 10.222.0.48 "GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7" status: 200 len: 1264 microversion: 2.1 time: 0.170119 Jun 17 13:00:35.413765 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 182/368] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:00:35 2022] GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7 => generated 1264 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:00:35.998038 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-c9b80927-8d5b-46ff-9d1c-382d54365eae tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:35.998038 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-c9b80927-8d5b-46ff-9d1c-382d54365eae tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:35.998038 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c9b80927-8d5b-46ff-9d1c-382d54365eae tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:35.998038 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c9b80927-8d5b-46ff-9d1c-382d54365eae tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:35.999225 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c9b80927-8d5b-46ff-9d1c-382d54365eae tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:35.999225 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c9b80927-8d5b-46ff-9d1c-382d54365eae tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:36.087125 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-c9b80927-8d5b-46ff-9d1c-382d54365eae tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:00:36.097329 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-c9b80927-8d5b-46ff-9d1c-382d54365eae tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1249 microversion: 2.1 time: 0.113735 Jun 17 13:00:36.098118 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 187/369] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:00:35 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1249 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:00:36.431527 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-f09a627d-447b-45e0-a347-372c1c4d4828 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:36.432397 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-f09a627d-447b-45e0-a347-372c1c4d4828 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] [instance: 72889057-861c-42f3-8629-32fff8f5dab7] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:36.439699 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f09a627d-447b-45e0-a347-372c1c4d4828 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:36.440151 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f09a627d-447b-45e0-a347-372c1c4d4828 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:36.440937 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f09a627d-447b-45e0-a347-372c1c4d4828 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:36.441358 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f09a627d-447b-45e0-a347-372c1c4d4828 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:36.587258 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-f09a627d-447b-45e0-a347-372c1c4d4828 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18195083037046bd99166f68690c3dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bf442df39b4f5cbc18f571a0596f10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:00:36.595680 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-f09a627d-447b-45e0-a347-372c1c4d4828 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] 10.222.0.48 "GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7" status: 200 len: 1264 microversion: 2.1 time: 0.168499 Jun 17 13:00:36.596284 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 183/370] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:00:36 2022] GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7 => generated 1264 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:00:37.114529 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-2be00a21-7bd5-4e72-be02-a6d7bf0748eb tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:37.115163 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-2be00a21-7bd5-4e72-be02-a6d7bf0748eb tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:37.121886 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2be00a21-7bd5-4e72-be02-a6d7bf0748eb tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:37.122423 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2be00a21-7bd5-4e72-be02-a6d7bf0748eb tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:37.123200 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2be00a21-7bd5-4e72-be02-a6d7bf0748eb tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:37.123633 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2be00a21-7bd5-4e72-be02-a6d7bf0748eb tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:37.188765 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-2be00a21-7bd5-4e72-be02-a6d7bf0748eb tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:00:37.197411 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-2be00a21-7bd5-4e72-be02-a6d7bf0748eb tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1249 microversion: 2.1 time: 0.086612 Jun 17 13:00:37.198158 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 188/371] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:00:37 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1249 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:00:37.617567 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-2081ba58-2861-4326-96c9-7dab79e9e9e7 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:37.618634 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-2081ba58-2861-4326-96c9-7dab79e9e9e7 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] [instance: 72889057-861c-42f3-8629-32fff8f5dab7] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:37.622978 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_cell0:SELECT=4 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:00:37.633202 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2081ba58-2861-4326-96c9-7dab79e9e9e7 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:37.633966 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2081ba58-2861-4326-96c9-7dab79e9e9e7 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:37.635209 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2081ba58-2861-4326-96c9-7dab79e9e9e7 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:37.635785 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2081ba58-2861-4326-96c9-7dab79e9e9e7 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:37.807272 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-2081ba58-2861-4326-96c9-7dab79e9e9e7 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18195083037046bd99166f68690c3dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bf442df39b4f5cbc18f571a0596f10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:00:37.815868 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-2081ba58-2861-4326-96c9-7dab79e9e9e7 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] 10.222.0.48 "GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7" status: 200 len: 1264 microversion: 2.1 time: 0.205188 Jun 17 13:00:37.816466 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 184/372] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:00:37 2022] GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7 => generated 1264 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:00:38.220367 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-e2c8fe4a-f32a-4270-bd32-d2ea34654127 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:38.221478 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-e2c8fe4a-f32a-4270-bd32-d2ea34654127 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:38.230578 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e2c8fe4a-f32a-4270-bd32-d2ea34654127 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:38.231221 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e2c8fe4a-f32a-4270-bd32-d2ea34654127 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:38.232042 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e2c8fe4a-f32a-4270-bd32-d2ea34654127 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:38.232589 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e2c8fe4a-f32a-4270-bd32-d2ea34654127 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:38.317613 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-e2c8fe4a-f32a-4270-bd32-d2ea34654127 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:00:38.326898 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-e2c8fe4a-f32a-4270-bd32-d2ea34654127 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1249 microversion: 2.1 time: 0.113872 Jun 17 13:00:38.327509 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 189/373] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:00:38 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1249 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:00:38.782000 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 13:00:38.782438 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Fri Jun 17 13:00:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 17 13:00:38.836179 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-b80f41a6-9509-4fbb-9f0e-7bee71612395 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:38.837228 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-b80f41a6-9509-4fbb-9f0e-7bee71612395 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] [instance: 72889057-861c-42f3-8629-32fff8f5dab7] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:38.849042 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b80f41a6-9509-4fbb-9f0e-7bee71612395 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:38.849840 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b80f41a6-9509-4fbb-9f0e-7bee71612395 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:38.851290 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b80f41a6-9509-4fbb-9f0e-7bee71612395 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:38.852080 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b80f41a6-9509-4fbb-9f0e-7bee71612395 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:39.003156 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-b80f41a6-9509-4fbb-9f0e-7bee71612395 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18195083037046bd99166f68690c3dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bf442df39b4f5cbc18f571a0596f10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:00:39.013310 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-b80f41a6-9509-4fbb-9f0e-7bee71612395 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] 10.222.0.48 "GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7" status: 200 len: 1264 microversion: 2.1 time: 0.183706 Jun 17 13:00:39.013991 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 185/374] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:00:38 2022] GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7 => generated 1264 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:00:39.344535 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-4d835fa5-01c0-4d91-af41-144ccf4b6f35 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:39.345180 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-4d835fa5-01c0-4d91-af41-144ccf4b6f35 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:39.352643 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4d835fa5-01c0-4d91-af41-144ccf4b6f35 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:39.353175 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4d835fa5-01c0-4d91-af41-144ccf4b6f35 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:39.354023 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4d835fa5-01c0-4d91-af41-144ccf4b6f35 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:39.354681 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4d835fa5-01c0-4d91-af41-144ccf4b6f35 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:39.425626 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-4d835fa5-01c0-4d91-af41-144ccf4b6f35 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:00:39.439591 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-4d835fa5-01c0-4d91-af41-144ccf4b6f35 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1249 microversion: 2.1 time: 0.098713 Jun 17 13:00:39.440589 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 190/375] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:00:39 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1249 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:00:40.031692 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-48a9379d-f89b-46d9-b5c1-123c75d11f8b tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:40.032343 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-48a9379d-f89b-46d9-b5c1-123c75d11f8b tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] [instance: 72889057-861c-42f3-8629-32fff8f5dab7] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:40.040182 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-48a9379d-f89b-46d9-b5c1-123c75d11f8b tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:40.040645 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-48a9379d-f89b-46d9-b5c1-123c75d11f8b tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:40.041399 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-48a9379d-f89b-46d9-b5c1-123c75d11f8b tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:40.041831 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-48a9379d-f89b-46d9-b5c1-123c75d11f8b tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:40.188213 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-48a9379d-f89b-46d9-b5c1-123c75d11f8b tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18195083037046bd99166f68690c3dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bf442df39b4f5cbc18f571a0596f10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:00:40.199853 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-48a9379d-f89b-46d9-b5c1-123c75d11f8b tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] 10.222.0.48 "GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7" status: 200 len: 1264 microversion: 2.1 time: 0.172159 Jun 17 13:00:40.200977 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 186/376] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:00:40 2022] GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7 => generated 1264 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:00:40.457528 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-e4cad567-6d77-4027-9273-eaae704addb0 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:40.458290 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-e4cad567-6d77-4027-9273-eaae704addb0 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:40.460053 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell0:SELECT=2 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:00:40.466075 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e4cad567-6d77-4027-9273-eaae704addb0 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:40.466539 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e4cad567-6d77-4027-9273-eaae704addb0 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:40.467317 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e4cad567-6d77-4027-9273-eaae704addb0 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:40.467744 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e4cad567-6d77-4027-9273-eaae704addb0 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:40.532809 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-e4cad567-6d77-4027-9273-eaae704addb0 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:00:40.542993 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-e4cad567-6d77-4027-9273-eaae704addb0 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1249 microversion: 2.1 time: 0.089429 Jun 17 13:00:40.543682 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 191/377] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:00:40 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1249 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:00:41.223631 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-3e1faa6e-4e9a-4a6f-a0d6-ede0c32bba8f tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:41.224766 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-3e1faa6e-4e9a-4a6f-a0d6-ede0c32bba8f tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] [instance: 72889057-861c-42f3-8629-32fff8f5dab7] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:41.237509 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-3e1faa6e-4e9a-4a6f-a0d6-ede0c32bba8f tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:41.238358 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-3e1faa6e-4e9a-4a6f-a0d6-ede0c32bba8f tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:41.239766 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-3e1faa6e-4e9a-4a6f-a0d6-ede0c32bba8f tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:41.240569 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-3e1faa6e-4e9a-4a6f-a0d6-ede0c32bba8f tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:41.460975 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-3e1faa6e-4e9a-4a6f-a0d6-ede0c32bba8f tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18195083037046bd99166f68690c3dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bf442df39b4f5cbc18f571a0596f10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:00:41.469447 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-3e1faa6e-4e9a-4a6f-a0d6-ede0c32bba8f tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] 10.222.0.48 "GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7" status: 200 len: 1264 microversion: 2.1 time: 0.252335 Jun 17 13:00:41.470046 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 187/378] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:00:41 2022] GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7 => generated 1264 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:00:41.561388 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-b189d127-3b44-468f-b0ad-db0966195f82 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:41.562015 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-b189d127-3b44-468f-b0ad-db0966195f82 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:41.570122 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b189d127-3b44-468f-b0ad-db0966195f82 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:41.570725 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b189d127-3b44-468f-b0ad-db0966195f82 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:41.571855 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b189d127-3b44-468f-b0ad-db0966195f82 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:41.572580 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b189d127-3b44-468f-b0ad-db0966195f82 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:41.646706 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-b189d127-3b44-468f-b0ad-db0966195f82 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:00:41.658521 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-b189d127-3b44-468f-b0ad-db0966195f82 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1297 microversion: 2.1 time: 0.101254 Jun 17 13:00:41.659382 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 192/379] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:00:41 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1297 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:00:42.488792 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-984f0481-f9e4-4416-93b3-9b1e50598a61 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:42.490632 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-984f0481-f9e4-4416-93b3-9b1e50598a61 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] [instance: 72889057-861c-42f3-8629-32fff8f5dab7] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:42.499084 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-984f0481-f9e4-4416-93b3-9b1e50598a61 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:42.499993 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-984f0481-f9e4-4416-93b3-9b1e50598a61 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:42.501228 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-984f0481-f9e4-4416-93b3-9b1e50598a61 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:42.502373 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-984f0481-f9e4-4416-93b3-9b1e50598a61 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:42.683520 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-72abd581-ca6f-4e45-ad8d-d7c4ece0ccd7 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:42.686363 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-72abd581-ca6f-4e45-ad8d-d7c4ece0ccd7 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:42.702169 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-72abd581-ca6f-4e45-ad8d-d7c4ece0ccd7 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:42.702861 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-72abd581-ca6f-4e45-ad8d-d7c4ece0ccd7 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:42.703726 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-72abd581-ca6f-4e45-ad8d-d7c4ece0ccd7 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:42.704363 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-72abd581-ca6f-4e45-ad8d-d7c4ece0ccd7 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:42.869108 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-72abd581-ca6f-4e45-ad8d-d7c4ece0ccd7 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:00:42.887967 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-72abd581-ca6f-4e45-ad8d-d7c4ece0ccd7 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1303 microversion: 2.1 time: 0.212176 Jun 17 13:00:42.889758 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 193/380] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:00:42 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1303 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:00:42.917209 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-984f0481-f9e4-4416-93b3-9b1e50598a61 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18195083037046bd99166f68690c3dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bf442df39b4f5cbc18f571a0596f10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:00:42.927249 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-984f0481-f9e4-4416-93b3-9b1e50598a61 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] 10.222.0.48 "GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7" status: 200 len: 1264 microversion: 2.1 time: 0.443844 Jun 17 13:00:42.928832 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 188/381] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:00:42 2022] GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7 => generated 1264 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 13:00:43.909231 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [req-3d6f5c13-3ab4-4839-a873-d90e20439212 req-3d7f48d6-71c3-4182-ae1c-78647c6e1acb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72889057-861c-42f3-8629-32fff8f5dab7", "name": "network-vif-plugged", "status": "completed", "tag": "d7d2b4c7-923d-46bd-94ad-388673be0fbb"}]} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:00:43.920342 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-25ec1b14-7fff-460c-abbe-ef5fdc82c3ff tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:43.920342 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-25ec1b14-7fff-460c-abbe-ef5fdc82c3ff tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:43.932424 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-25ec1b14-7fff-460c-abbe-ef5fdc82c3ff tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:43.934054 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-25ec1b14-7fff-460c-abbe-ef5fdc82c3ff tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:43.936246 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-25ec1b14-7fff-460c-abbe-ef5fdc82c3ff tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:43.937973 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-25ec1b14-7fff-460c-abbe-ef5fdc82c3ff tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:43.950959 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell0:SELECT=14 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:00:43.959762 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-3d6f5c13-3ab4-4839-a873-d90e20439212 req-3d7f48d6-71c3-4182-ae1c-78647c6e1acb service nova] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:43.966371 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-3d6f5c13-3ab4-4839-a873-d90e20439212 req-3d7f48d6-71c3-4182-ae1c-78647c6e1acb service nova] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:44.006507 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.compute.server_external_events [req-3d6f5c13-3ab4-4839-a873-d90e20439212 req-3d7f48d6-71c3-4182-ae1c-78647c6e1acb service nova] Creating event network-vif-plugged:d7d2b4c7-923d-46bd-94ad-388673be0fbb for instance 72889057-861c-42f3-8629-32fff8f5dab7 on hv-cinder-83754 Jun 17 13:00:44.019656 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [req-3d6f5c13-3ab4-4839-a873-d90e20439212 req-3d7f48d6-71c3-4182-ae1c-78647c6e1acb service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119263 Jun 17 13:00:44.021112 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 194/382] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 13:00:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:00:44.030284 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-5ef63faa-ac0c-40f1-84cb-1e45857523b3 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:44.044098 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-5ef63faa-ac0c-40f1-84cb-1e45857523b3 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] [instance: 72889057-861c-42f3-8629-32fff8f5dab7] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:44.058926 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5ef63faa-ac0c-40f1-84cb-1e45857523b3 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:44.060171 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5ef63faa-ac0c-40f1-84cb-1e45857523b3 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:44.061599 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5ef63faa-ac0c-40f1-84cb-1e45857523b3 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:44.062426 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5ef63faa-ac0c-40f1-84cb-1e45857523b3 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:44.508849 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-5ef63faa-ac0c-40f1-84cb-1e45857523b3 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18195083037046bd99166f68690c3dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bf442df39b4f5cbc18f571a0596f10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:00:44.540093 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-5ef63faa-ac0c-40f1-84cb-1e45857523b3 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] 10.222.0.48 "GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7" status: 200 len: 1264 microversion: 2.1 time: 0.515934 Jun 17 13:00:44.541170 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 195/383] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:00:44 2022] GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7 => generated 1264 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:00:44.598386 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-25ec1b14-7fff-460c-abbe-ef5fdc82c3ff tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:00:44.625355 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-25ec1b14-7fff-460c-abbe-ef5fdc82c3ff tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1371 microversion: 2.1 time: 0.713849 Jun 17 13:00:44.629929 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 189/384] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:00:43 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1371 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:00:44.827073 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [req-6bd51829-bc99-49ae-9041-e8670e859aa4 req-9b8b2793-0b61-4590-8ac4-f8e9f3bbe779 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29d26a8a-a734-4531-b9ee-04506c852fe2", "tag": "4ae50ebd-a268-4596-8c67-1e7de84bfb9e"}]} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:00:44.858306 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-6bd51829-bc99-49ae-9041-e8670e859aa4 req-9b8b2793-0b61-4590-8ac4-f8e9f3bbe779 service nova] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:44.860301 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-6bd51829-bc99-49ae-9041-e8670e859aa4 req-9b8b2793-0b61-4590-8ac4-f8e9f3bbe779 service nova] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:44.882327 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.compute.server_external_events [req-6bd51829-bc99-49ae-9041-e8670e859aa4 req-9b8b2793-0b61-4590-8ac4-f8e9f3bbe779 service nova] Creating event network-changed:4ae50ebd-a268-4596-8c67-1e7de84bfb9e for instance 29d26a8a-a734-4531-b9ee-04506c852fe2 on hv-cinder-83754 Jun 17 13:00:44.893159 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [req-6bd51829-bc99-49ae-9041-e8670e859aa4 req-9b8b2793-0b61-4590-8ac4-f8e9f3bbe779 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073631 Jun 17 13:00:44.893774 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 196/385] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 13:00:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:00:45.562441 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-fb62c4d9-f1ae-4e69-acb4-9244a8fb57ae tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:45.563873 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-fb62c4d9-f1ae-4e69-acb4-9244a8fb57ae tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] [instance: 72889057-861c-42f3-8629-32fff8f5dab7] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:45.588761 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-fb62c4d9-f1ae-4e69-acb4-9244a8fb57ae tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:45.589543 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-fb62c4d9-f1ae-4e69-acb4-9244a8fb57ae tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:45.590985 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-fb62c4d9-f1ae-4e69-acb4-9244a8fb57ae tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:45.592333 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-fb62c4d9-f1ae-4e69-acb4-9244a8fb57ae tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:45.646730 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-1f7924e3-c45f-4d1e-a593-c3885c4fd722 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:45.647637 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-1f7924e3-c45f-4d1e-a593-c3885c4fd722 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:45.657858 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1f7924e3-c45f-4d1e-a593-c3885c4fd722 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:45.663667 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1f7924e3-c45f-4d1e-a593-c3885c4fd722 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:45.664954 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1f7924e3-c45f-4d1e-a593-c3885c4fd722 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:45.665729 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1f7924e3-c45f-4d1e-a593-c3885c4fd722 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:46.196485 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-1f7924e3-c45f-4d1e-a593-c3885c4fd722 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:00:46.210230 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-fb62c4d9-f1ae-4e69-acb4-9244a8fb57ae tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18195083037046bd99166f68690c3dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bf442df39b4f5cbc18f571a0596f10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:00:46.220937 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-fb62c4d9-f1ae-4e69-acb4-9244a8fb57ae tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] 10.222.0.48 "GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7" status: 200 len: 1264 microversion: 2.1 time: 0.665268 Jun 17 13:00:46.221524 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 190/386] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:00:45 2022] GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7 => generated 1264 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:00:46.233812 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-1f7924e3-c45f-4d1e-a593-c3885c4fd722 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1371 microversion: 2.1 time: 0.591507 Jun 17 13:00:46.234804 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 197/387] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:00:45 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1371 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 13:00:47.246382 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-6cf01aeb-5e96-4ce2-ad43-3800330338a0 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:47.248379 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-6cf01aeb-5e96-4ce2-ad43-3800330338a0 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] [instance: 72889057-861c-42f3-8629-32fff8f5dab7] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:47.256721 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-862957ae-04b5-4c18-8f66-a6f83ef896ab tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:47.270724 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6cf01aeb-5e96-4ce2-ad43-3800330338a0 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:47.270724 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6cf01aeb-5e96-4ce2-ad43-3800330338a0 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:47.270724 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6cf01aeb-5e96-4ce2-ad43-3800330338a0 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:47.270724 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6cf01aeb-5e96-4ce2-ad43-3800330338a0 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:47.282400 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-862957ae-04b5-4c18-8f66-a6f83ef896ab tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:47.294455 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-862957ae-04b5-4c18-8f66-a6f83ef896ab tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:47.294934 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-862957ae-04b5-4c18-8f66-a6f83ef896ab tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:47.295681 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-862957ae-04b5-4c18-8f66-a6f83ef896ab tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:47.296127 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-862957ae-04b5-4c18-8f66-a6f83ef896ab tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:47.301071 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_cell1:SELECT=100 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:00:47.732835 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-6cf01aeb-5e96-4ce2-ad43-3800330338a0 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18195083037046bd99166f68690c3dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bf442df39b4f5cbc18f571a0596f10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:00:47.744716 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-6cf01aeb-5e96-4ce2-ad43-3800330338a0 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] 10.222.0.48 "GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7" status: 200 len: 1451 microversion: 2.1 time: 0.507132 Jun 17 13:00:47.746186 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 191/388] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:00:47 2022] GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7 => generated 1451 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:00:47.781464 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-96a3e3cc-eed2-4041-bbb3-3915b1e927c5 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:47.782876 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-96a3e3cc-eed2-4041-bbb3-3915b1e927c5 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] [instance: 72889057-861c-42f3-8629-32fff8f5dab7] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:47.795048 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-96a3e3cc-eed2-4041-bbb3-3915b1e927c5 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:47.795935 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-96a3e3cc-eed2-4041-bbb3-3915b1e927c5 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:47.797530 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-96a3e3cc-eed2-4041-bbb3-3915b1e927c5 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:47.798547 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-96a3e3cc-eed2-4041-bbb3-3915b1e927c5 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:47.804994 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-862957ae-04b5-4c18-8f66-a6f83ef896ab tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:00:47.826684 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-862957ae-04b5-4c18-8f66-a6f83ef896ab tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1371 microversion: 2.1 time: 0.578262 Jun 17 13:00:47.828621 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 198/389] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:00:47 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1371 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:00:48.095130 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-96a3e3cc-eed2-4041-bbb3-3915b1e927c5 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18195083037046bd99166f68690c3dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bf442df39b4f5cbc18f571a0596f10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:00:48.105750 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-96a3e3cc-eed2-4041-bbb3-3915b1e927c5 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] 10.222.0.48 "GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7" status: 200 len: 1451 microversion: 2.1 time: 0.328687 Jun 17 13:00:48.106457 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 192/390] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:00:47 2022] GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7 => generated 1451 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:00:48.847848 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-5af84356-5c15-4411-963e-2b01e3c4465d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:48.849264 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-5af84356-5c15-4411-963e-2b01e3c4465d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:48.858076 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5af84356-5c15-4411-963e-2b01e3c4465d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:48.859230 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5af84356-5c15-4411-963e-2b01e3c4465d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:48.860724 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5af84356-5c15-4411-963e-2b01e3c4465d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:48.861328 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5af84356-5c15-4411-963e-2b01e3c4465d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:48.867156 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=100 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:00:49.099300 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-5af84356-5c15-4411-963e-2b01e3c4465d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:00:49.109105 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-5af84356-5c15-4411-963e-2b01e3c4465d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1371 microversion: 2.1 time: 0.265553 Jun 17 13:00:49.119606 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 199/391] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:00:48 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1371 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 13:00:49.540843 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 13:00:49.541668 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Fri Jun 17 13:00:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 17 13:00:50.128810 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-316d3206-ba7e-49ae-b959-005c2dcfb044 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:50.129481 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-316d3206-ba7e-49ae-b959-005c2dcfb044 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:50.139078 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-316d3206-ba7e-49ae-b959-005c2dcfb044 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:50.139530 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-316d3206-ba7e-49ae-b959-005c2dcfb044 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:50.141083 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-316d3206-ba7e-49ae-b959-005c2dcfb044 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:50.142133 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-316d3206-ba7e-49ae-b959-005c2dcfb044 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:50.636481 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-316d3206-ba7e-49ae-b959-005c2dcfb044 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:00:50.648237 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-316d3206-ba7e-49ae-b959-005c2dcfb044 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1371 microversion: 2.1 time: 0.525902 Jun 17 13:00:50.649049 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 193/392] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:00:50 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1371 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:00:51.068192 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [req-e1d6a30c-ac68-4026-99d2-eb96f87cf40b req-807754ea-698e-4e8c-9a5a-d91cc6cd8739 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "72889057-861c-42f3-8629-32fff8f5dab7", "tag": "d7d2b4c7-923d-46bd-94ad-388673be0fbb"}]} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:00:51.077166 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-e1d6a30c-ac68-4026-99d2-eb96f87cf40b req-807754ea-698e-4e8c-9a5a-d91cc6cd8739 service nova] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:51.077520 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-e1d6a30c-ac68-4026-99d2-eb96f87cf40b req-807754ea-698e-4e8c-9a5a-d91cc6cd8739 service nova] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:51.095946 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.compute.server_external_events [req-e1d6a30c-ac68-4026-99d2-eb96f87cf40b req-807754ea-698e-4e8c-9a5a-d91cc6cd8739 service nova] Creating event network-changed:d7d2b4c7-923d-46bd-94ad-388673be0fbb for instance 72889057-861c-42f3-8629-32fff8f5dab7 on hv-cinder-83754 Jun 17 13:00:51.101240 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [req-e1d6a30c-ac68-4026-99d2-eb96f87cf40b req-807754ea-698e-4e8c-9a5a-d91cc6cd8739 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036793 Jun 17 13:00:51.101839 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 200/393] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 13:00:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:00:51.674712 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-becf405f-264c-44b1-85f5-8bb99412f39a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:51.675759 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-becf405f-264c-44b1-85f5-8bb99412f39a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:51.684795 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-becf405f-264c-44b1-85f5-8bb99412f39a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:51.685248 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-becf405f-264c-44b1-85f5-8bb99412f39a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:51.686027 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-becf405f-264c-44b1-85f5-8bb99412f39a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:51.686498 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-becf405f-264c-44b1-85f5-8bb99412f39a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:51.829914 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-becf405f-264c-44b1-85f5-8bb99412f39a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:00:51.837964 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-becf405f-264c-44b1-85f5-8bb99412f39a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1371 microversion: 2.1 time: 0.171641 Jun 17 13:00:51.838745 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 194/394] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:00:51 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1371 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:00:52.856701 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-32bbd446-93c9-4361-a7ee-3ff630f784c2 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:52.857794 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-32bbd446-93c9-4361-a7ee-3ff630f784c2 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:52.864875 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-32bbd446-93c9-4361-a7ee-3ff630f784c2 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:52.865325 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-32bbd446-93c9-4361-a7ee-3ff630f784c2 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:52.866114 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-32bbd446-93c9-4361-a7ee-3ff630f784c2 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:52.866540 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-32bbd446-93c9-4361-a7ee-3ff630f784c2 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:53.032157 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-32bbd446-93c9-4361-a7ee-3ff630f784c2 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:00:53.041586 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-32bbd446-93c9-4361-a7ee-3ff630f784c2 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1371 microversion: 2.1 time: 0.189243 Jun 17 13:00:53.042269 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 201/395] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:00:52 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1371 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:00:54.060909 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-7f08f255-4e94-4ea3-a4df-eea40dd3d9d1 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:54.061591 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-7f08f255-4e94-4ea3-a4df-eea40dd3d9d1 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:54.069622 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7f08f255-4e94-4ea3-a4df-eea40dd3d9d1 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:54.070053 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7f08f255-4e94-4ea3-a4df-eea40dd3d9d1 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:54.070870 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7f08f255-4e94-4ea3-a4df-eea40dd3d9d1 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:54.071323 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7f08f255-4e94-4ea3-a4df-eea40dd3d9d1 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:54.209341 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-7f08f255-4e94-4ea3-a4df-eea40dd3d9d1 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:00:54.221574 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-7f08f255-4e94-4ea3-a4df-eea40dd3d9d1 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1371 microversion: 2.1 time: 0.164505 Jun 17 13:00:54.222359 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 195/396] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:00:54 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1371 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:00:55.240923 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-27103d72-fe5a-4b6f-a0d3-ff39fdbbbbfd tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:55.241518 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-27103d72-fe5a-4b6f-a0d3-ff39fdbbbbfd tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:55.243695 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=3 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:00:55.249521 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-27103d72-fe5a-4b6f-a0d3-ff39fdbbbbfd tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:55.249945 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-27103d72-fe5a-4b6f-a0d3-ff39fdbbbbfd tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:55.250741 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-27103d72-fe5a-4b6f-a0d3-ff39fdbbbbfd tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:55.251162 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-27103d72-fe5a-4b6f-a0d3-ff39fdbbbbfd tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:55.515673 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-27103d72-fe5a-4b6f-a0d3-ff39fdbbbbfd tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:00:55.529866 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-27103d72-fe5a-4b6f-a0d3-ff39fdbbbbfd tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1371 microversion: 2.1 time: 0.292839 Jun 17 13:00:55.531217 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 202/397] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:00:55 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1371 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:00:56.552541 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-1fb5d1a6-2863-4ea4-b925-a1150f0b8de5 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:56.553620 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-1fb5d1a6-2863-4ea4-b925-a1150f0b8de5 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:56.565013 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-1fb5d1a6-2863-4ea4-b925-a1150f0b8de5 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:56.565915 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-1fb5d1a6-2863-4ea4-b925-a1150f0b8de5 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:56.568032 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-1fb5d1a6-2863-4ea4-b925-a1150f0b8de5 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:56.568902 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-1fb5d1a6-2863-4ea4-b925-a1150f0b8de5 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:56.754883 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-1fb5d1a6-2863-4ea4-b925-a1150f0b8de5 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:00:56.763285 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-1fb5d1a6-2863-4ea4-b925-a1150f0b8de5 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1371 microversion: 2.1 time: 0.216296 Jun 17 13:00:56.766135 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 196/398] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:00:56 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1371 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:00:57.169907 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [req-26795126-5d32-4207-b8ad-95afa1a12360 req-a2dcd80a-fa47-4305-82be-fd11d25e4ae5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29d26a8a-a734-4531-b9ee-04506c852fe2", "name": "network-vif-plugged", "status": "completed", "tag": "4ae50ebd-a268-4596-8c67-1e7de84bfb9e"}]} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:00:57.197929 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-26795126-5d32-4207-b8ad-95afa1a12360 req-a2dcd80a-fa47-4305-82be-fd11d25e4ae5 service nova] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:57.200558 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-26795126-5d32-4207-b8ad-95afa1a12360 req-a2dcd80a-fa47-4305-82be-fd11d25e4ae5 service nova] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:57.221781 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.compute.server_external_events [req-26795126-5d32-4207-b8ad-95afa1a12360 req-a2dcd80a-fa47-4305-82be-fd11d25e4ae5 service nova] Creating event network-vif-plugged:4ae50ebd-a268-4596-8c67-1e7de84bfb9e for instance 29d26a8a-a734-4531-b9ee-04506c852fe2 on hv-cinder-83754 Jun 17 13:00:57.229826 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [req-26795126-5d32-4207-b8ad-95afa1a12360 req-a2dcd80a-fa47-4305-82be-fd11d25e4ae5 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068137 Jun 17 13:00:57.231480 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 203/399] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 13:00:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:00:57.787952 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-d12c0d02-8ce3-4c48-b034-f8d8d4cc6b3b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:57.788810 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-d12c0d02-8ce3-4c48-b034-f8d8d4cc6b3b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:57.797143 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d12c0d02-8ce3-4c48-b034-f8d8d4cc6b3b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:57.797685 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d12c0d02-8ce3-4c48-b034-f8d8d4cc6b3b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:57.798584 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d12c0d02-8ce3-4c48-b034-f8d8d4cc6b3b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:57.799080 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d12c0d02-8ce3-4c48-b034-f8d8d4cc6b3b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:57.978489 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-d12c0d02-8ce3-4c48-b034-f8d8d4cc6b3b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:00:57.987964 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-d12c0d02-8ce3-4c48-b034-f8d8d4cc6b3b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1371 microversion: 2.1 time: 0.204813 Jun 17 13:00:57.988616 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 197/400] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:00:57 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1371 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:00:59.030569 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-865cb489-3dc5-43ec-819a-74ceec587635 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:00:59.035494 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-865cb489-3dc5-43ec-819a-74ceec587635 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:00:59.050385 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-865cb489-3dc5-43ec-819a-74ceec587635 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:59.051880 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-865cb489-3dc5-43ec-819a-74ceec587635 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:59.053172 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-865cb489-3dc5-43ec-819a-74ceec587635 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:00:59.054379 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-865cb489-3dc5-43ec-819a-74ceec587635 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:00:59.352471 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-865cb489-3dc5-43ec-819a-74ceec587635 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:00:59.384906 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-865cb489-3dc5-43ec-819a-74ceec587635 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1371 microversion: 2.1 time: 0.379037 Jun 17 13:00:59.385928 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 204/401] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:00:59 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1371 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:01:00.412011 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-b504542f-e7f7-4a8a-91f2-35b2953dfd74 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:00.414300 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-b504542f-e7f7-4a8a-91f2-35b2953dfd74 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:00.428976 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b504542f-e7f7-4a8a-91f2-35b2953dfd74 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:00.430232 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b504542f-e7f7-4a8a-91f2-35b2953dfd74 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:00.432099 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b504542f-e7f7-4a8a-91f2-35b2953dfd74 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:00.435010 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b504542f-e7f7-4a8a-91f2-35b2953dfd74 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:00.682658 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-b504542f-e7f7-4a8a-91f2-35b2953dfd74 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:01:00.692148 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-b504542f-e7f7-4a8a-91f2-35b2953dfd74 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1564 microversion: 2.1 time: 0.289917 Jun 17 13:01:00.693206 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 198/402] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:01:00 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1564 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:01:00.728475 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-209262f8-28bc-4138-b971-85263d6813c7 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:00.729496 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-209262f8-28bc-4138-b971-85263d6813c7 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:00.749355 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-209262f8-28bc-4138-b971-85263d6813c7 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:00.750022 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-209262f8-28bc-4138-b971-85263d6813c7 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:00.750984 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-209262f8-28bc-4138-b971-85263d6813c7 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:00.751503 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-209262f8-28bc-4138-b971-85263d6813c7 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:00.894505 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-209262f8-28bc-4138-b971-85263d6813c7 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.174567 Jun 17 13:01:00.895802 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 205/403] 10.222.0.48 () {58 vars in 1274 bytes} [Fri Jun 17 13:01:00 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-interface => generated 284 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:01:03.581493 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [req-cef4517f-6634-4f41-9775-b068792127e8 req-76daedc1-64cd-4be7-9e13-1bf71fd38e6a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29d26a8a-a734-4531-b9ee-04506c852fe2", "tag": "4ae50ebd-a268-4596-8c67-1e7de84bfb9e"}]} {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:01:03.588017 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_api:SELECT=40 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:01:03.593371 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [req-cef4517f-6634-4f41-9775-b068792127e8 req-76daedc1-64cd-4be7-9e13-1bf71fd38e6a service nova] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:03.594328 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [req-cef4517f-6634-4f41-9775-b068792127e8 req-76daedc1-64cd-4be7-9e13-1bf71fd38e6a service nova] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:03.608485 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.compute.server_external_events [req-cef4517f-6634-4f41-9775-b068792127e8 req-76daedc1-64cd-4be7-9e13-1bf71fd38e6a service nova] Creating event network-changed:4ae50ebd-a268-4596-8c67-1e7de84bfb9e for instance 29d26a8a-a734-4531-b9ee-04506c852fe2 on hv-cinder-83754 Jun 17 13:01:03.614781 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [req-cef4517f-6634-4f41-9775-b068792127e8 req-76daedc1-64cd-4be7-9e13-1bf71fd38e6a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036845 Jun 17 13:01:03.616479 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 199/404] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 13:01:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 13:01:24.686938 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_api:SELECT=7 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:01:24.687761 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=31 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:01:24.692616 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-d04a5518-ae91-49d2-aa88-4588892e38b5 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Action: 'create', calling method: .version_select at 0x7f01901db4c0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1523504503", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB6e87bFmM13kUXYFFZCffH3mqZWjlnRYYVV6CJZs7zTDskTHyQ9SVcFY64M3qYWGlDLcQ8C+BYF1EYhVEbSYVv0plvPqb1Lf1FA6n17NVOXrmULTzqgkfbECekK0Y/LCg=="}} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:01:24.709950 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.quota [None req-d04a5518-ae91-49d2-aa88-4588892e38b5 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Getting quotas for project 1686ea199c5442958f97102a61ce41aa. Resources: {'key_pairs'} {{(pid=117660) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 13:01:24.714468 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.quota [None req-d04a5518-ae91-49d2-aa88-4588892e38b5 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Getting quotas for user e7a99ccc238943a098833d03c6233413 and project 1686ea199c5442958f97102a61ce41aa. Resources: {'key_pairs'} {{(pid=117660) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 13:01:24.748622 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-d04a5518-ae91-49d2-aa88-4588892e38b5 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.062642 Jun 17 13:01:24.749487 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 206/405] 10.222.0.48 () {60 vars in 1158 bytes} [Fri Jun 17 13:01:24 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:01:24.809561 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-6bade950-b4e0-45c4-ba08-d1e112a29851 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1023013026", "imageRef": "cbe5eff0-cecb-4fe7-a909-6899161d5112", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1523504503", "networks": [{"uuid": "1fd93226-8dc5-4747-87df-5d3267b0aaaa"}]}} {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:01:24.823878 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_api:SELECT=1 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:01:24.824899 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_cell1:SELECT=47 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:01:24.886312 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.network.neutron [None req-6bade950-b4e0-45c4-ba08-d1e112a29851 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] validate_networks() for [('1fd93226-8dc5-4747-87df-5d3267b0aaaa', None, None, None, None, None)] {{(pid=117659) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 17 13:01:25.440448 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.virt.hardware [None req-6bade950-b4e0-45c4-ba08-d1e112a29851 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Flavor limits 0:0:0 {{(pid=117659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 17 13:01:25.440914 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.virt.hardware [None req-6bade950-b4e0-45c4-ba08-d1e112a29851 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Image limits 0:0:0 {{(pid=117659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 17 13:01:25.441434 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.virt.hardware [None req-6bade950-b4e0-45c4-ba08-d1e112a29851 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Flavor pref 0:0:0 {{(pid=117659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 17 13:01:25.441845 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.virt.hardware [None req-6bade950-b4e0-45c4-ba08-d1e112a29851 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Image pref 0:0:0 {{(pid=117659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 17 13:01:25.442294 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.virt.hardware [None req-6bade950-b4e0-45c4-ba08-d1e112a29851 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 17 13:01:25.451707 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6bade950-b4e0-45c4-ba08-d1e112a29851 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:25.452155 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6bade950-b4e0-45c4-ba08-d1e112a29851 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:25.452959 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6bade950-b4e0-45c4-ba08-d1e112a29851 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:25.453464 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6bade950-b4e0-45c4-ba08-d1e112a29851 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:25.474839 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.quota [None req-6bade950-b4e0-45c4-ba08-d1e112a29851 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Getting quotas for project 1686ea199c5442958f97102a61ce41aa. Resources: {'ram', 'cores', 'instances'} {{(pid=117659) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 13:01:25.479620 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.quota [None req-6bade950-b4e0-45c4-ba08-d1e112a29851 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Getting quotas for user e7a99ccc238943a098833d03c6233413 and project 1686ea199c5442958f97102a61ce41aa. Resources: {'ram', 'cores', 'instances'} {{(pid=117659) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 13:01:25.493030 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-6bade950-b4e0-45c4-ba08-d1e112a29851 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Going to run 1 instances... {{(pid=117659) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 17 13:01:25.495429 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-6bade950-b4e0-45c4-ba08-d1e112a29851 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cbe5eff0-cecb-4fe7-a909-6899161d5112',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117659) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 17 13:01:25.547617 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-6bade950-b4e0-45c4-ba08-d1e112a29851 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.746307 Jun 17 13:01:25.548268 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 200/406] 10.222.0.48 () {60 vars in 1146 bytes} [Fri Jun 17 13:01:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 749 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 17 13:01:25.561934 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-b2d31e6d-6217-4371-949f-e98d3db1a688 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:25.562763 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-b2d31e6d-6217-4371-949f-e98d3db1a688 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:25.621452 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-b2d31e6d-6217-4371-949f-e98d3db1a688 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:01:25.631788 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-b2d31e6d-6217-4371-949f-e98d3db1a688 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1259 microversion: 2.1 time: 0.074839 Jun 17 13:01:25.632642 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 207/407] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:01:25 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1259 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:01:26.652562 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-4cd8a3d4-5afa-4eeb-8e9f-3d527306b2e3 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:26.653829 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-4cd8a3d4-5afa-4eeb-8e9f-3d527306b2e3 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:26.663288 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4cd8a3d4-5afa-4eeb-8e9f-3d527306b2e3 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:26.663721 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4cd8a3d4-5afa-4eeb-8e9f-3d527306b2e3 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:26.664507 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4cd8a3d4-5afa-4eeb-8e9f-3d527306b2e3 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:26.664951 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4cd8a3d4-5afa-4eeb-8e9f-3d527306b2e3 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:26.736565 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-4cd8a3d4-5afa-4eeb-8e9f-3d527306b2e3 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:01:26.744359 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-4cd8a3d4-5afa-4eeb-8e9f-3d527306b2e3 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1311 microversion: 2.1 time: 0.097627 Jun 17 13:01:26.744929 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 201/408] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:01:26 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1311 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:01:27.770057 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-11ac0309-d0b2-4553-a7dc-470b4ec95d66 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:27.771310 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-11ac0309-d0b2-4553-a7dc-470b4ec95d66 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:27.796415 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-11ac0309-d0b2-4553-a7dc-470b4ec95d66 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:27.798108 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-11ac0309-d0b2-4553-a7dc-470b4ec95d66 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:27.801726 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-11ac0309-d0b2-4553-a7dc-470b4ec95d66 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:27.802465 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-11ac0309-d0b2-4553-a7dc-470b4ec95d66 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:28.085926 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-11ac0309-d0b2-4553-a7dc-470b4ec95d66 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:01:28.094738 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-11ac0309-d0b2-4553-a7dc-470b4ec95d66 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1359 microversion: 2.1 time: 0.333710 Jun 17 13:01:28.096133 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 208/409] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:01:27 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1359 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:01:29.119648 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-60934dcb-1000-474b-bb39-b747b9208329 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:29.120378 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-60934dcb-1000-474b-bb39-b747b9208329 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:29.128490 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-60934dcb-1000-474b-bb39-b747b9208329 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:29.128937 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-60934dcb-1000-474b-bb39-b747b9208329 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:29.129722 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-60934dcb-1000-474b-bb39-b747b9208329 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:29.130164 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-60934dcb-1000-474b-bb39-b747b9208329 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:29.712053 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-60934dcb-1000-474b-bb39-b747b9208329 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:01:29.722527 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-60934dcb-1000-474b-bb39-b747b9208329 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1359 microversion: 2.1 time: 0.606800 Jun 17 13:01:29.723418 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 202/410] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:01:29 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1359 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:01:30.748267 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-d874f059-858e-4782-8ac1-baed1a5e700f tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:30.749396 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-d874f059-858e-4782-8ac1-baed1a5e700f tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:30.760149 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d874f059-858e-4782-8ac1-baed1a5e700f tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:30.760806 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d874f059-858e-4782-8ac1-baed1a5e700f tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:30.762551 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d874f059-858e-4782-8ac1-baed1a5e700f tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:30.763118 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d874f059-858e-4782-8ac1-baed1a5e700f tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:30.957683 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-d874f059-858e-4782-8ac1-baed1a5e700f tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:01:30.972148 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-d874f059-858e-4782-8ac1-baed1a5e700f tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1359 microversion: 2.1 time: 0.233724 Jun 17 13:01:30.978638 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 209/411] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:01:30 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1359 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:01:31.999903 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-b475fcdd-a713-41c1-b154-95e0a13f1266 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:32.000995 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-b475fcdd-a713-41c1-b154-95e0a13f1266 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:32.012389 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b475fcdd-a713-41c1-b154-95e0a13f1266 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:32.013219 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b475fcdd-a713-41c1-b154-95e0a13f1266 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:32.014726 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b475fcdd-a713-41c1-b154-95e0a13f1266 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:32.015507 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b475fcdd-a713-41c1-b154-95e0a13f1266 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:32.274827 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-b475fcdd-a713-41c1-b154-95e0a13f1266 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:01:32.289865 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-b475fcdd-a713-41c1-b154-95e0a13f1266 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1359 microversion: 2.1 time: 0.296966 Jun 17 13:01:32.291458 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 203/412] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:01:31 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1359 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:01:32.676490 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-2ad75d5c-32b1-4daf-afe5-321a03f4f8cf tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:32.677136 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-2ad75d5c-32b1-4daf-afe5-321a03f4f8cf tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:32.686018 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2ad75d5c-32b1-4daf-afe5-321a03f4f8cf tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:32.686655 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2ad75d5c-32b1-4daf-afe5-321a03f4f8cf tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:32.687602 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2ad75d5c-32b1-4daf-afe5-321a03f4f8cf tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:32.688087 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2ad75d5c-32b1-4daf-afe5-321a03f4f8cf tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:32.717325 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-2ad75d5c-32b1-4daf-afe5-321a03f4f8cf tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/ips" status: 200 len: 144 microversion: 2.1 time: 0.044970 Jun 17 13:01:32.717933 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 210/413] 10.222.0.48 () {58 vars in 1247 bytes} [Fri Jun 17 13:01:32 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/ips => generated 144 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:01:33.307833 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-65a42bf7-a427-4b7a-baa7-936604583d9b tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:33.308750 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-65a42bf7-a427-4b7a-baa7-936604583d9b tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:33.317424 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-65a42bf7-a427-4b7a-baa7-936604583d9b tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:33.317910 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-65a42bf7-a427-4b7a-baa7-936604583d9b tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:33.318859 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-65a42bf7-a427-4b7a-baa7-936604583d9b tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:33.319331 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-65a42bf7-a427-4b7a-baa7-936604583d9b tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:33.504754 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-65a42bf7-a427-4b7a-baa7-936604583d9b tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:01:33.515107 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-65a42bf7-a427-4b7a-baa7-936604583d9b tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1359 microversion: 2.1 time: 0.210979 Jun 17 13:01:33.515703 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 204/414] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:01:33 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1359 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:01:34.532596 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-a150b0f0-a333-4a74-a598-09c8c2bba55f tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:34.533684 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-a150b0f0-a333-4a74-a598-09c8c2bba55f tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:34.540514 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a150b0f0-a333-4a74-a598-09c8c2bba55f tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:34.540955 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a150b0f0-a333-4a74-a598-09c8c2bba55f tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:34.541727 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a150b0f0-a333-4a74-a598-09c8c2bba55f tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:34.542267 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a150b0f0-a333-4a74-a598-09c8c2bba55f tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:34.747458 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-a150b0f0-a333-4a74-a598-09c8c2bba55f tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:01:34.758889 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-a150b0f0-a333-4a74-a598-09c8c2bba55f tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1359 microversion: 2.1 time: 0.230175 Jun 17 13:01:34.759528 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 211/415] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:01:34 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1359 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:01:35.604179 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-b1da3a4a-6b82-40ce-9a71-3eb9b247b598 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:35.605083 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-b1da3a4a-6b82-40ce-9a71-3eb9b247b598 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:35.607473 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_cell0:SELECT=2 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:01:35.608143 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_cell0:SELECT=6 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:01:35.614374 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b1da3a4a-6b82-40ce-9a71-3eb9b247b598 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:35.614821 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b1da3a4a-6b82-40ce-9a71-3eb9b247b598 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:35.615610 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b1da3a4a-6b82-40ce-9a71-3eb9b247b598 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:35.616048 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b1da3a4a-6b82-40ce-9a71-3eb9b247b598 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:35.645989 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-b1da3a4a-6b82-40ce-9a71-3eb9b247b598 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/ips" status: 200 len: 152 microversion: 2.20 time: 0.045837 Jun 17 13:01:35.647268 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 205/416] 10.222.0.48 () {60 vars in 1288 bytes} [Fri Jun 17 13:01:35 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/ips => generated 152 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:01:35.778855 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-e852c181-cce7-49bb-802f-0e59f5188a70 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:35.779698 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-e852c181-cce7-49bb-802f-0e59f5188a70 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:35.782487 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell0:SELECT=6 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:01:35.790461 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e852c181-cce7-49bb-802f-0e59f5188a70 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:35.791170 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e852c181-cce7-49bb-802f-0e59f5188a70 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:35.792421 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e852c181-cce7-49bb-802f-0e59f5188a70 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:35.793170 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e852c181-cce7-49bb-802f-0e59f5188a70 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:36.039820 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-e852c181-cce7-49bb-802f-0e59f5188a70 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:01:36.059329 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-e852c181-cce7-49bb-802f-0e59f5188a70 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1359 microversion: 2.1 time: 0.285768 Jun 17 13:01:36.060914 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 212/417] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:01:35 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1359 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:01:36.962971 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-a68a5cff-6239-40e3-a80c-3c50d856d571 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "68643bc5-4e32-49a5-b5fe-bac2a20e6b7e"}} {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:01:36.964517 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-a68a5cff-6239-40e3-a80c-3c50d856d571 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:36.973154 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a68a5cff-6239-40e3-a80c-3c50d856d571 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:36.973607 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a68a5cff-6239-40e3-a80c-3c50d856d571 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:36.974454 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a68a5cff-6239-40e3-a80c-3c50d856d571 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:36.974893 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a68a5cff-6239-40e3-a80c-3c50d856d571 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:37.082433 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-6167b385-9807-428d-a0db-18dfc89b387f tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:37.083553 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-6167b385-9807-428d-a0db-18dfc89b387f tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:37.095106 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6167b385-9807-428d-a0db-18dfc89b387f tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:37.096369 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6167b385-9807-428d-a0db-18dfc89b387f tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:37.098192 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6167b385-9807-428d-a0db-18dfc89b387f tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:37.099357 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6167b385-9807-428d-a0db-18dfc89b387f tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:37.309986 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-6167b385-9807-428d-a0db-18dfc89b387f tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:01:37.324265 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-6167b385-9807-428d-a0db-18dfc89b387f tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1359 microversion: 2.1 time: 0.248816 Jun 17 13:01:37.325587 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 213/418] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:01:37 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1359 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:01:38.346777 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-4a2ebda3-d98d-441c-a4f9-02c6bd3d66ee tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:38.347519 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-4a2ebda3-d98d-441c-a4f9-02c6bd3d66ee tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:38.354485 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4a2ebda3-d98d-441c-a4f9-02c6bd3d66ee tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:38.355067 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4a2ebda3-d98d-441c-a4f9-02c6bd3d66ee tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:38.356949 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4a2ebda3-d98d-441c-a4f9-02c6bd3d66ee tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:38.357403 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4a2ebda3-d98d-441c-a4f9-02c6bd3d66ee tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:38.559699 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-4a2ebda3-d98d-441c-a4f9-02c6bd3d66ee tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:01:38.575230 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-4a2ebda3-d98d-441c-a4f9-02c6bd3d66ee tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1359 microversion: 2.1 time: 0.232860 Jun 17 13:01:38.576643 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 214/419] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:01:38 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1359 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:01:39.110331 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-2811e2f0-34f8-45c3-a24d-1cc182fd265b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:01:39.110877 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-2811e2f0-34f8-45c3-a24d-1cc182fd265b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:39.117910 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2811e2f0-34f8-45c3-a24d-1cc182fd265b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:39.118301 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2811e2f0-34f8-45c3-a24d-1cc182fd265b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:39.119101 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2811e2f0-34f8-45c3-a24d-1cc182fd265b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:39.119540 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2811e2f0-34f8-45c3-a24d-1cc182fd265b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:39.152240 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.objects.instance [None req-2811e2f0-34f8-45c3-a24d-1cc182fd265b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lazy-loading 'flavor' on Instance uuid c8fdea98-917f-4c4d-aaba-d4f5df4622d6 {{(pid=117660) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 13:01:39.583631 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-2811e2f0-34f8-45c3-a24d-1cc182fd265b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "POST /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/action" status: 202 len: 0 microversion: 2.20 time: 0.478161 Jun 17 13:01:39.584426 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 215/420] 10.222.0.48 () {62 vars in 1318 bytes} [Fri Jun 17 13:01:39 2022] POST /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/action => generated 0 bytes in 480 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 17 13:01:39.594697 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-055cb42e-3aeb-48d0-9c8a-f1bba30e2649 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:39.595405 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-055cb42e-3aeb-48d0-9c8a-f1bba30e2649 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:39.603331 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-055cb42e-3aeb-48d0-9c8a-f1bba30e2649 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:39.603925 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-055cb42e-3aeb-48d0-9c8a-f1bba30e2649 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:39.604995 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-055cb42e-3aeb-48d0-9c8a-f1bba30e2649 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:39.606374 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-055cb42e-3aeb-48d0-9c8a-f1bba30e2649 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:39.821401 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-055cb42e-3aeb-48d0-9c8a-f1bba30e2649 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:01:39.844879 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-055cb42e-3aeb-48d0-9c8a-f1bba30e2649 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:01:39.846900 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-055cb42e-3aeb-48d0-9c8a-f1bba30e2649 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:01:39.848322 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-055cb42e-3aeb-48d0-9c8a-f1bba30e2649 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1724 microversion: 2.20 time: 0.258485 Jun 17 13:01:39.849102 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 216/421] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:01:39 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1724 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:01:39.855439 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-ee7b3ead-048b-4e0c-b30a-cc706125660a tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:39.856201 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-ee7b3ead-048b-4e0c-b30a-cc706125660a tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:39.864566 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ee7b3ead-048b-4e0c-b30a-cc706125660a tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:39.865055 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ee7b3ead-048b-4e0c-b30a-cc706125660a tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:39.866018 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ee7b3ead-048b-4e0c-b30a-cc706125660a tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:39.866669 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ee7b3ead-048b-4e0c-b30a-cc706125660a tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:40.034308 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-ee7b3ead-048b-4e0c-b30a-cc706125660a tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:01:40.048463 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-ee7b3ead-048b-4e0c-b30a-cc706125660a tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1359 microversion: 2.1 time: 0.197765 Jun 17 13:01:40.049453 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 217/422] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:01:39 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1359 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:01:40.870210 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-6d21f07a-559d-45f8-9f9d-b35971830947 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:40.872222 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-6d21f07a-559d-45f8-9f9d-b35971830947 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:40.884438 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6d21f07a-559d-45f8-9f9d-b35971830947 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:40.885659 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6d21f07a-559d-45f8-9f9d-b35971830947 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:40.886994 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6d21f07a-559d-45f8-9f9d-b35971830947 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:40.887688 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6d21f07a-559d-45f8-9f9d-b35971830947 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:41.069119 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-6d21f07a-559d-45f8-9f9d-b35971830947 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:01:41.078318 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-6d21f07a-559d-45f8-9f9d-b35971830947 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:01:41.079977 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-6d21f07a-559d-45f8-9f9d-b35971830947 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:01:41.081311 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-6d21f07a-559d-45f8-9f9d-b35971830947 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1724 microversion: 2.20 time: 0.217007 Jun 17 13:01:41.082264 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 218/423] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:01:40 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1724 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 13:01:41.086999 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-6c3f591f-b84c-4d65-be7a-d4e01cc61dda tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:41.087703 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-6c3f591f-b84c-4d65-be7a-d4e01cc61dda tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:41.094704 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6c3f591f-b84c-4d65-be7a-d4e01cc61dda tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:41.095171 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6c3f591f-b84c-4d65-be7a-d4e01cc61dda tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:41.096087 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6c3f591f-b84c-4d65-be7a-d4e01cc61dda tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:41.096591 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6c3f591f-b84c-4d65-be7a-d4e01cc61dda tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:41.261055 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-6c3f591f-b84c-4d65-be7a-d4e01cc61dda tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:01:41.275615 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-6c3f591f-b84c-4d65-be7a-d4e01cc61dda tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1359 microversion: 2.1 time: 0.192025 Jun 17 13:01:41.277919 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 219/424] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:01:41 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1359 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:01:42.101428 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-c8895011-743e-48b3-a490-6371379b5e71 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:42.102262 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-c8895011-743e-48b3-a490-6371379b5e71 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:42.108912 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c8895011-743e-48b3-a490-6371379b5e71 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:42.109346 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c8895011-743e-48b3-a490-6371379b5e71 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:42.110222 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c8895011-743e-48b3-a490-6371379b5e71 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:42.110602 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c8895011-743e-48b3-a490-6371379b5e71 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:42.284732 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-c8895011-743e-48b3-a490-6371379b5e71 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:01:42.293626 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-c8895011-743e-48b3-a490-6371379b5e71 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:01:42.295197 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-c8895011-743e-48b3-a490-6371379b5e71 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:01:42.296434 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-c8895011-743e-48b3-a490-6371379b5e71 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1724 microversion: 2.20 time: 0.199213 Jun 17 13:01:42.297012 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 220/425] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:01:42 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1724 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 13:01:42.301731 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-e6d4623b-aa3d-4e3d-a295-4d5747995b8d tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:42.302371 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-e6d4623b-aa3d-4e3d-a295-4d5747995b8d tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:42.309463 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e6d4623b-aa3d-4e3d-a295-4d5747995b8d tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:42.309909 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e6d4623b-aa3d-4e3d-a295-4d5747995b8d tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:42.310742 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e6d4623b-aa3d-4e3d-a295-4d5747995b8d tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:42.311178 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e6d4623b-aa3d-4e3d-a295-4d5747995b8d tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:42.456060 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-e6d4623b-aa3d-4e3d-a295-4d5747995b8d tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:01:42.464769 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-e6d4623b-aa3d-4e3d-a295-4d5747995b8d tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1359 microversion: 2.1 time: 0.166475 Jun 17 13:01:42.465224 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 221/426] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:01:42 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1359 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:01:43.315731 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-cb1fba9a-ea54-4e39-bcc5-5ec56e65f6c4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:43.316311 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-cb1fba9a-ea54-4e39-bcc5-5ec56e65f6c4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:43.322777 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cb1fba9a-ea54-4e39-bcc5-5ec56e65f6c4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:43.323212 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cb1fba9a-ea54-4e39-bcc5-5ec56e65f6c4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:43.324005 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cb1fba9a-ea54-4e39-bcc5-5ec56e65f6c4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:43.324476 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cb1fba9a-ea54-4e39-bcc5-5ec56e65f6c4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:43.491785 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-cb1fba9a-ea54-4e39-bcc5-5ec56e65f6c4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:01:43.495796 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:01:43.501603 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-cb1fba9a-ea54-4e39-bcc5-5ec56e65f6c4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:01:43.503712 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-cb1fba9a-ea54-4e39-bcc5-5ec56e65f6c4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:01:43.504895 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-cb1fba9a-ea54-4e39-bcc5-5ec56e65f6c4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1724 microversion: 2.20 time: 0.193335 Jun 17 13:01:43.505457 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 222/427] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:01:43 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1724 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:01:43.509984 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-36d2c8f3-04c4-41a1-9d79-a47e39e8e4a3 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:43.510610 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-36d2c8f3-04c4-41a1-9d79-a47e39e8e4a3 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:43.517876 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-36d2c8f3-04c4-41a1-9d79-a47e39e8e4a3 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:43.518341 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-36d2c8f3-04c4-41a1-9d79-a47e39e8e4a3 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:43.519112 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-36d2c8f3-04c4-41a1-9d79-a47e39e8e4a3 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:43.519535 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-36d2c8f3-04c4-41a1-9d79-a47e39e8e4a3 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:43.672396 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-36d2c8f3-04c4-41a1-9d79-a47e39e8e4a3 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:01:43.680261 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-36d2c8f3-04c4-41a1-9d79-a47e39e8e4a3 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1359 microversion: 2.1 time: 0.173750 Jun 17 13:01:43.680834 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 223/428] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:01:43 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1359 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:01:44.527178 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-5030401c-666e-4957-ad8c-2dcd11ac97ca tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:44.527907 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-5030401c-666e-4957-ad8c-2dcd11ac97ca tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:44.535450 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5030401c-666e-4957-ad8c-2dcd11ac97ca tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:44.540657 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5030401c-666e-4957-ad8c-2dcd11ac97ca tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:44.541578 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5030401c-666e-4957-ad8c-2dcd11ac97ca tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:44.542012 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5030401c-666e-4957-ad8c-2dcd11ac97ca tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:44.691433 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-5030401c-666e-4957-ad8c-2dcd11ac97ca tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:01:44.703733 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-5030401c-666e-4957-ad8c-2dcd11ac97ca tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:01:44.704963 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-5030401c-666e-4957-ad8c-2dcd11ac97ca tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:01:44.706141 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-5030401c-666e-4957-ad8c-2dcd11ac97ca tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1724 microversion: 2.20 time: 0.185283 Jun 17 13:01:44.706803 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 224/429] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:01:44 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1724 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:01:44.711815 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-b42ab032-1d30-441c-926d-e7aa15faf43d tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:44.712670 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-b42ab032-1d30-441c-926d-e7aa15faf43d tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:44.721383 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b42ab032-1d30-441c-926d-e7aa15faf43d tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:44.721824 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b42ab032-1d30-441c-926d-e7aa15faf43d tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:44.722639 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b42ab032-1d30-441c-926d-e7aa15faf43d tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:44.723065 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b42ab032-1d30-441c-926d-e7aa15faf43d tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:44.859812 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-b42ab032-1d30-441c-926d-e7aa15faf43d tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:01:44.867941 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-b42ab032-1d30-441c-926d-e7aa15faf43d tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1359 microversion: 2.1 time: 0.160198 Jun 17 13:01:44.868527 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 225/430] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:01:44 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1359 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:01:45.728017 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-ff1dc1ee-94bc-41e2-8b81-49fc6a447fdc tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:45.728747 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-ff1dc1ee-94bc-41e2-8b81-49fc6a447fdc tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:45.735338 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ff1dc1ee-94bc-41e2-8b81-49fc6a447fdc tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:45.735746 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ff1dc1ee-94bc-41e2-8b81-49fc6a447fdc tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:45.736540 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ff1dc1ee-94bc-41e2-8b81-49fc6a447fdc tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:45.736939 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ff1dc1ee-94bc-41e2-8b81-49fc6a447fdc tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:45.874195 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-ff1dc1ee-94bc-41e2-8b81-49fc6a447fdc tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:01:45.883848 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-ff1dc1ee-94bc-41e2-8b81-49fc6a447fdc tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:01:45.885332 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-ff1dc1ee-94bc-41e2-8b81-49fc6a447fdc tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:01:45.886508 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-ff1dc1ee-94bc-41e2-8b81-49fc6a447fdc tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1724 microversion: 2.20 time: 0.162568 Jun 17 13:01:45.887084 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 226/431] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:01:45 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:01:45.891761 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-7d4d87cd-7a65-4a28-beb3-e4919f77d3cc tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:45.892358 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-7d4d87cd-7a65-4a28-beb3-e4919f77d3cc tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:45.898668 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7d4d87cd-7a65-4a28-beb3-e4919f77d3cc tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:45.899099 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7d4d87cd-7a65-4a28-beb3-e4919f77d3cc tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:45.900290 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7d4d87cd-7a65-4a28-beb3-e4919f77d3cc tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:45.900290 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7d4d87cd-7a65-4a28-beb3-e4919f77d3cc tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:46.047215 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-7d4d87cd-7a65-4a28-beb3-e4919f77d3cc tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:01:46.055337 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-7d4d87cd-7a65-4a28-beb3-e4919f77d3cc tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1359 microversion: 2.1 time: 0.167149 Jun 17 13:01:46.055895 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 227/432] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:01:45 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1359 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:01:46.905131 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-5a970187-e350-4b91-8e82-7793fba21b91 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:46.905752 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-5a970187-e350-4b91-8e82-7793fba21b91 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:46.912315 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5a970187-e350-4b91-8e82-7793fba21b91 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:46.912761 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5a970187-e350-4b91-8e82-7793fba21b91 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:46.913523 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5a970187-e350-4b91-8e82-7793fba21b91 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:46.913965 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5a970187-e350-4b91-8e82-7793fba21b91 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:46.972921 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:01:47.051784 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-5a970187-e350-4b91-8e82-7793fba21b91 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:01:47.059954 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-5a970187-e350-4b91-8e82-7793fba21b91 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:01:47.062012 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-5a970187-e350-4b91-8e82-7793fba21b91 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:01:47.063206 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-5a970187-e350-4b91-8e82-7793fba21b91 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1724 microversion: 2.20 time: 0.162153 Jun 17 13:01:47.063789 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 228/433] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:01:46 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 13:01:47.071991 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-46689f51-c14b-4f50-8345-44d64614d5df tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:47.072529 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-46689f51-c14b-4f50-8345-44d64614d5df tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:47.073277 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_cell1:SELECT=36 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:01:47.078764 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-46689f51-c14b-4f50-8345-44d64614d5df tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:47.079198 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-46689f51-c14b-4f50-8345-44d64614d5df tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:47.080005 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-46689f51-c14b-4f50-8345-44d64614d5df tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:47.080369 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-46689f51-c14b-4f50-8345-44d64614d5df tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:47.217007 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-46689f51-c14b-4f50-8345-44d64614d5df tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:01:47.228914 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-46689f51-c14b-4f50-8345-44d64614d5df tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1359 microversion: 2.1 time: 0.160167 Jun 17 13:01:47.229712 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 229/434] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:01:47 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1359 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:01:48.083126 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-ba047fac-dc4a-4669-ad41-381735295356 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:48.083795 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-ba047fac-dc4a-4669-ad41-381735295356 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:48.090035 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ba047fac-dc4a-4669-ad41-381735295356 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:48.090513 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ba047fac-dc4a-4669-ad41-381735295356 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:48.091275 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ba047fac-dc4a-4669-ad41-381735295356 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:48.091705 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ba047fac-dc4a-4669-ad41-381735295356 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:48.238059 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-ba047fac-dc4a-4669-ad41-381735295356 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:01:48.250518 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-ba047fac-dc4a-4669-ad41-381735295356 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:01:48.252022 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-ba047fac-dc4a-4669-ad41-381735295356 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:01:48.253809 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-ba047fac-dc4a-4669-ad41-381735295356 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1724 microversion: 2.20 time: 0.174708 Jun 17 13:01:48.254412 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 230/435] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:01:48 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1724 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:01:48.258863 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-d8d3b8a5-6a47-470a-bc82-351d8af153e5 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:48.259469 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-d8d3b8a5-6a47-470a-bc82-351d8af153e5 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:48.265980 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d8d3b8a5-6a47-470a-bc82-351d8af153e5 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:48.266457 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d8d3b8a5-6a47-470a-bc82-351d8af153e5 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:48.267714 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d8d3b8a5-6a47-470a-bc82-351d8af153e5 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:48.267714 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d8d3b8a5-6a47-470a-bc82-351d8af153e5 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:48.401693 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-d8d3b8a5-6a47-470a-bc82-351d8af153e5 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:01:48.409450 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-d8d3b8a5-6a47-470a-bc82-351d8af153e5 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1359 microversion: 2.1 time: 0.154025 Jun 17 13:01:48.410009 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 231/436] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:01:48 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1359 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:01:49.275560 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-5e13def2-02d1-4a00-ab92-62cf125b22e5 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:49.276573 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-5e13def2-02d1-4a00-ab92-62cf125b22e5 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:49.288066 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5e13def2-02d1-4a00-ab92-62cf125b22e5 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:49.289160 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5e13def2-02d1-4a00-ab92-62cf125b22e5 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:49.290784 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5e13def2-02d1-4a00-ab92-62cf125b22e5 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:49.291101 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5e13def2-02d1-4a00-ab92-62cf125b22e5 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:49.574544 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-5e13def2-02d1-4a00-ab92-62cf125b22e5 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:01:49.584939 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-5e13def2-02d1-4a00-ab92-62cf125b22e5 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:01:49.586911 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-5e13def2-02d1-4a00-ab92-62cf125b22e5 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:01:49.588385 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-5e13def2-02d1-4a00-ab92-62cf125b22e5 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1724 microversion: 2.20 time: 0.319233 Jun 17 13:01:49.592671 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 232/437] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:01:49 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1724 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 13:01:49.600438 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-24757161-9d2e-4115-b4b9-b908d2c8d6bd tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:49.601844 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-24757161-9d2e-4115-b4b9-b908d2c8d6bd tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:49.608993 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-24757161-9d2e-4115-b4b9-b908d2c8d6bd tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:49.609628 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-24757161-9d2e-4115-b4b9-b908d2c8d6bd tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:49.610533 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-24757161-9d2e-4115-b4b9-b908d2c8d6bd tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:49.610983 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-24757161-9d2e-4115-b4b9-b908d2c8d6bd tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:49.697980 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-a68a5cff-6239-40e3-a80c-3c50d856d571 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "POST /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 12.739354 Jun 17 13:01:49.704034 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 206/438] 10.222.0.48 () {60 vars in 1322 bytes} [Fri Jun 17 13:01:36 2022] POST /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 194 bytes in 12741 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:01:49.879024 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-24757161-9d2e-4115-b4b9-b908d2c8d6bd tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:01:49.890776 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-24757161-9d2e-4115-b4b9-b908d2c8d6bd tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1359 microversion: 2.1 time: 0.295928 Jun 17 13:01:49.903002 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 233/439] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:01:49 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1359 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:01:50.168929 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [req-802cd7d8-8d80-4fd7-8cab-389306333d1f req-97dc449d-57dd-4f4f-a8ca-e89aec903687 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a408151-81c8-4490-9190-5e4fa2d98e8a", "tag": "78029a46-f1c7-4b92-ba08-7045080d5b08"}]} {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:01:50.182554 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [req-802cd7d8-8d80-4fd7-8cab-389306333d1f req-97dc449d-57dd-4f4f-a8ca-e89aec903687 service nova] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:50.184736 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [req-802cd7d8-8d80-4fd7-8cab-389306333d1f req-97dc449d-57dd-4f4f-a8ca-e89aec903687 service nova] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:50.202624 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.compute.server_external_events [req-802cd7d8-8d80-4fd7-8cab-389306333d1f req-97dc449d-57dd-4f4f-a8ca-e89aec903687 service nova] Creating event network-changed:78029a46-f1c7-4b92-ba08-7045080d5b08 for instance 8a408151-81c8-4490-9190-5e4fa2d98e8a on hv-cinder-83754 Jun 17 13:01:50.209985 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [req-802cd7d8-8d80-4fd7-8cab-389306333d1f req-97dc449d-57dd-4f4f-a8ca-e89aec903687 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046850 Jun 17 13:01:50.211247 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 207/440] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 13:01:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:01:50.607899 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-082f2fed-b106-4cba-8cdf-18efa074cde9 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:50.608478 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-082f2fed-b106-4cba-8cdf-18efa074cde9 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:50.615519 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-082f2fed-b106-4cba-8cdf-18efa074cde9 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:50.615941 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-082f2fed-b106-4cba-8cdf-18efa074cde9 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:50.616718 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-082f2fed-b106-4cba-8cdf-18efa074cde9 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:50.617148 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-082f2fed-b106-4cba-8cdf-18efa074cde9 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:50.810758 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-082f2fed-b106-4cba-8cdf-18efa074cde9 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:01:50.819168 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-082f2fed-b106-4cba-8cdf-18efa074cde9 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:01:50.820657 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-082f2fed-b106-4cba-8cdf-18efa074cde9 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:01:50.821810 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-082f2fed-b106-4cba-8cdf-18efa074cde9 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1724 microversion: 2.20 time: 0.218075 Jun 17 13:01:50.822560 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 234/441] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:01:50 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1724 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:01:50.910897 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-5042a722-11d7-424c-8066-c705d06cf747 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:50.911609 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-5042a722-11d7-424c-8066-c705d06cf747 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:50.919009 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-5042a722-11d7-424c-8066-c705d06cf747 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:50.919453 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-5042a722-11d7-424c-8066-c705d06cf747 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:50.920220 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-5042a722-11d7-424c-8066-c705d06cf747 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:50.920653 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-5042a722-11d7-424c-8066-c705d06cf747 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:51.069180 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-5042a722-11d7-424c-8066-c705d06cf747 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:01:51.076942 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-5042a722-11d7-424c-8066-c705d06cf747 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1359 microversion: 2.1 time: 0.170474 Jun 17 13:01:51.077504 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 208/442] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:01:50 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1359 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:01:51.841120 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-d8d78347-5c2c-43dc-8904-10e5a809554a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:51.841683 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-d8d78347-5c2c-43dc-8904-10e5a809554a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:51.848393 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d8d78347-5c2c-43dc-8904-10e5a809554a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:51.848828 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d8d78347-5c2c-43dc-8904-10e5a809554a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:51.849584 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d8d78347-5c2c-43dc-8904-10e5a809554a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:51.850008 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d8d78347-5c2c-43dc-8904-10e5a809554a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:51.992091 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-d8d78347-5c2c-43dc-8904-10e5a809554a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:01:52.001626 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-d8d78347-5c2c-43dc-8904-10e5a809554a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:01:52.003527 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-d8d78347-5c2c-43dc-8904-10e5a809554a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:01:52.004728 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-d8d78347-5c2c-43dc-8904-10e5a809554a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1724 microversion: 2.20 time: 0.167747 Jun 17 13:01:52.005296 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 235/443] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:01:51 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:01:52.094192 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-f50e9f29-30c4-4d7a-96d9-67257549d089 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:52.094866 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-f50e9f29-30c4-4d7a-96d9-67257549d089 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:52.103056 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f50e9f29-30c4-4d7a-96d9-67257549d089 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:52.103532 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f50e9f29-30c4-4d7a-96d9-67257549d089 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:52.104290 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f50e9f29-30c4-4d7a-96d9-67257549d089 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:52.104708 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f50e9f29-30c4-4d7a-96d9-67257549d089 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:52.238081 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-f50e9f29-30c4-4d7a-96d9-67257549d089 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:01:52.245621 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-f50e9f29-30c4-4d7a-96d9-67257549d089 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1359 microversion: 2.1 time: 0.155490 Jun 17 13:01:52.246189 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 209/444] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:01:52 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1359 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:01:53.027673 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-fa6621ce-197d-464d-9f69-b2f85c26c272 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:53.028777 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-fa6621ce-197d-464d-9f69-b2f85c26c272 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:53.037226 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fa6621ce-197d-464d-9f69-b2f85c26c272 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:53.039157 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fa6621ce-197d-464d-9f69-b2f85c26c272 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:53.039987 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fa6621ce-197d-464d-9f69-b2f85c26c272 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:53.040481 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fa6621ce-197d-464d-9f69-b2f85c26c272 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:53.195978 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-fa6621ce-197d-464d-9f69-b2f85c26c272 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:01:53.205687 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-fa6621ce-197d-464d-9f69-b2f85c26c272 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:01:53.207216 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-fa6621ce-197d-464d-9f69-b2f85c26c272 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:01:53.208424 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-fa6621ce-197d-464d-9f69-b2f85c26c272 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1724 microversion: 2.20 time: 0.187749 Jun 17 13:01:53.208974 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 236/445] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:01:53 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1724 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:01:53.267658 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-7adccb05-dd92-49a5-9ae1-adf16d7ec0d9 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:53.268380 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-7adccb05-dd92-49a5-9ae1-adf16d7ec0d9 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:53.279590 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7adccb05-dd92-49a5-9ae1-adf16d7ec0d9 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:53.280164 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7adccb05-dd92-49a5-9ae1-adf16d7ec0d9 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:53.281335 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7adccb05-dd92-49a5-9ae1-adf16d7ec0d9 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:53.281830 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7adccb05-dd92-49a5-9ae1-adf16d7ec0d9 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:53.462693 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-7adccb05-dd92-49a5-9ae1-adf16d7ec0d9 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:01:53.473769 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-7adccb05-dd92-49a5-9ae1-adf16d7ec0d9 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1359 microversion: 2.1 time: 0.212922 Jun 17 13:01:53.474727 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 210/446] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:01:53 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1359 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:01:54.227764 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-062e27ab-55a7-4570-9850-e5da2fe6ea9c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:54.228377 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-062e27ab-55a7-4570-9850-e5da2fe6ea9c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:54.234986 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-062e27ab-55a7-4570-9850-e5da2fe6ea9c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:54.235433 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-062e27ab-55a7-4570-9850-e5da2fe6ea9c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:54.236204 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-062e27ab-55a7-4570-9850-e5da2fe6ea9c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:54.236639 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-062e27ab-55a7-4570-9850-e5da2fe6ea9c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:54.396332 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-062e27ab-55a7-4570-9850-e5da2fe6ea9c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:01:54.405173 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-062e27ab-55a7-4570-9850-e5da2fe6ea9c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:01:54.407051 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-062e27ab-55a7-4570-9850-e5da2fe6ea9c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:01:54.408253 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-062e27ab-55a7-4570-9850-e5da2fe6ea9c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1724 microversion: 2.20 time: 0.184783 Jun 17 13:01:54.408863 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 237/447] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:01:54 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1724 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:01:54.492821 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-3ba4883f-5556-459a-86c8-34b0b78e0165 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:54.493441 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-3ba4883f-5556-459a-86c8-34b0b78e0165 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:54.500130 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-3ba4883f-5556-459a-86c8-34b0b78e0165 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:54.500805 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-3ba4883f-5556-459a-86c8-34b0b78e0165 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:54.501405 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-3ba4883f-5556-459a-86c8-34b0b78e0165 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:54.501844 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-3ba4883f-5556-459a-86c8-34b0b78e0165 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:54.670878 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-3ba4883f-5556-459a-86c8-34b0b78e0165 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:01:54.680642 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-3ba4883f-5556-459a-86c8-34b0b78e0165 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1359 microversion: 2.1 time: 0.191514 Jun 17 13:01:54.681354 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 211/448] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:01:54 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1359 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:01:55.427648 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-e365d7fc-4731-4427-8041-1d413fc14202 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:55.428276 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-e365d7fc-4731-4427-8041-1d413fc14202 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:55.430291 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=1 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:01:55.436242 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e365d7fc-4731-4427-8041-1d413fc14202 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:55.436831 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e365d7fc-4731-4427-8041-1d413fc14202 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:55.437786 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e365d7fc-4731-4427-8041-1d413fc14202 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:55.438529 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e365d7fc-4731-4427-8041-1d413fc14202 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:55.583124 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-e365d7fc-4731-4427-8041-1d413fc14202 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:01:55.593968 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-e365d7fc-4731-4427-8041-1d413fc14202 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:01:55.595522 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-e365d7fc-4731-4427-8041-1d413fc14202 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:01:55.596718 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-e365d7fc-4731-4427-8041-1d413fc14202 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1724 microversion: 2.20 time: 0.173234 Jun 17 13:01:55.597287 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 238/449] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:01:55 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1724 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 13:01:55.700734 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-84614e25-92f9-42ac-8537-ffc597bcd141 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:55.701479 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-84614e25-92f9-42ac-8537-ffc597bcd141 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:55.710882 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-84614e25-92f9-42ac-8537-ffc597bcd141 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:55.711493 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-84614e25-92f9-42ac-8537-ffc597bcd141 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:55.712610 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-84614e25-92f9-42ac-8537-ffc597bcd141 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:55.713088 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-84614e25-92f9-42ac-8537-ffc597bcd141 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:55.869917 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-84614e25-92f9-42ac-8537-ffc597bcd141 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:01:55.879045 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-84614e25-92f9-42ac-8537-ffc597bcd141 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1359 microversion: 2.1 time: 0.184013 Jun 17 13:01:55.888802 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 212/450] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:01:55 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1359 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:01:56.616180 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-7d95885f-9039-411b-9ace-0fb2b0de8d6a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:56.616759 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-7d95885f-9039-411b-9ace-0fb2b0de8d6a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:56.623907 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7d95885f-9039-411b-9ace-0fb2b0de8d6a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:56.624353 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7d95885f-9039-411b-9ace-0fb2b0de8d6a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:56.625113 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7d95885f-9039-411b-9ace-0fb2b0de8d6a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:56.625584 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7d95885f-9039-411b-9ace-0fb2b0de8d6a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:56.645602 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=100 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:01:56.764178 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-7d95885f-9039-411b-9ace-0fb2b0de8d6a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:01:56.772913 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-7d95885f-9039-411b-9ace-0fb2b0de8d6a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:01:56.774495 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-7d95885f-9039-411b-9ace-0fb2b0de8d6a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:01:56.775683 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-7d95885f-9039-411b-9ace-0fb2b0de8d6a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1724 microversion: 2.20 time: 0.163971 Jun 17 13:01:56.776242 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 239/451] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:01:56 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:01:56.900263 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-6ee1f849-104e-40df-abe2-ff911a04b9fb tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:56.901407 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-6ee1f849-104e-40df-abe2-ff911a04b9fb tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:56.912473 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6ee1f849-104e-40df-abe2-ff911a04b9fb tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:56.913231 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6ee1f849-104e-40df-abe2-ff911a04b9fb tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:56.914387 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6ee1f849-104e-40df-abe2-ff911a04b9fb tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:56.914922 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6ee1f849-104e-40df-abe2-ff911a04b9fb tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:57.063460 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-6ee1f849-104e-40df-abe2-ff911a04b9fb tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:01:57.071216 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-6ee1f849-104e-40df-abe2-ff911a04b9fb tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1359 microversion: 2.1 time: 0.178250 Jun 17 13:01:57.071941 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 213/452] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:01:56 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1359 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:01:57.541958 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [req-54155f99-bda1-425e-b75a-30f5027137c4 req-72cbbc85-4128-4c70-854c-8ee239058697 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a408151-81c8-4490-9190-5e4fa2d98e8a", "name": "network-vif-plugged", "status": "completed", "tag": "78029a46-f1c7-4b92-ba08-7045080d5b08"}]} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:01:57.551976 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-54155f99-bda1-425e-b75a-30f5027137c4 req-72cbbc85-4128-4c70-854c-8ee239058697 service nova] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:57.552408 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-54155f99-bda1-425e-b75a-30f5027137c4 req-72cbbc85-4128-4c70-854c-8ee239058697 service nova] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:57.566892 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.compute.server_external_events [req-54155f99-bda1-425e-b75a-30f5027137c4 req-72cbbc85-4128-4c70-854c-8ee239058697 service nova] Creating event network-vif-plugged:78029a46-f1c7-4b92-ba08-7045080d5b08 for instance 8a408151-81c8-4490-9190-5e4fa2d98e8a on hv-cinder-83754 Jun 17 13:01:57.572426 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [req-54155f99-bda1-425e-b75a-30f5027137c4 req-72cbbc85-4128-4c70-854c-8ee239058697 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034468 Jun 17 13:01:57.573242 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 240/453] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 13:01:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 13:01:57.795325 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-4aacbfcb-be95-445c-9aa6-0cdf8e6fe81e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:57.796272 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-4aacbfcb-be95-445c-9aa6-0cdf8e6fe81e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:57.803519 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4aacbfcb-be95-445c-9aa6-0cdf8e6fe81e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:57.803736 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4aacbfcb-be95-445c-9aa6-0cdf8e6fe81e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:57.804572 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4aacbfcb-be95-445c-9aa6-0cdf8e6fe81e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:57.805162 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4aacbfcb-be95-445c-9aa6-0cdf8e6fe81e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:57.988025 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-4aacbfcb-be95-445c-9aa6-0cdf8e6fe81e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:01:57.996701 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-4aacbfcb-be95-445c-9aa6-0cdf8e6fe81e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:01:57.998233 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-4aacbfcb-be95-445c-9aa6-0cdf8e6fe81e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:01:57.999413 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-4aacbfcb-be95-445c-9aa6-0cdf8e6fe81e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1724 microversion: 2.20 time: 0.208535 Jun 17 13:01:57.999962 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 214/454] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:01:57 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1724 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:01:58.094221 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-4d519f7c-56f2-46da-9cfd-3ca4dd19d332 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:58.095573 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-4d519f7c-56f2-46da-9cfd-3ca4dd19d332 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:58.101733 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4d519f7c-56f2-46da-9cfd-3ca4dd19d332 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:58.102315 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4d519f7c-56f2-46da-9cfd-3ca4dd19d332 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:58.103155 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4d519f7c-56f2-46da-9cfd-3ca4dd19d332 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:58.103620 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4d519f7c-56f2-46da-9cfd-3ca4dd19d332 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:58.251942 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-4d519f7c-56f2-46da-9cfd-3ca4dd19d332 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:01:58.261959 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-4d519f7c-56f2-46da-9cfd-3ca4dd19d332 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1359 microversion: 2.1 time: 0.172416 Jun 17 13:01:58.262816 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 241/455] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:01:58 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1359 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:01:58.351166 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-27fc7298-398d-4ebe-b21f-fe31a944780e tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:01:58.357801 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-27fc7298-398d-4ebe-b21f-fe31a944780e tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:58.358287 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-27fc7298-398d-4ebe-b21f-fe31a944780e tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:58.430902 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-27fc7298-398d-4ebe-b21f-fe31a944780e tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Going to try to stop instance {{(pid=117659) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 17 13:01:58.481479 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-27fc7298-398d-4ebe-b21f-fe31a944780e tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "POST /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/action" status: 202 len: 0 microversion: 2.1 time: 0.134429 Jun 17 13:01:58.482108 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 215/456] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Jun 17 13:01:58 2022] POST /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/action => generated 0 bytes in 136 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 13:01:58.490992 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-7436c455-5dab-4560-a3c7-69c9d70ea8e7 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:58.491631 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-7436c455-5dab-4560-a3c7-69c9d70ea8e7 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:58.498175 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7436c455-5dab-4560-a3c7-69c9d70ea8e7 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:58.498624 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7436c455-5dab-4560-a3c7-69c9d70ea8e7 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:58.499388 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7436c455-5dab-4560-a3c7-69c9d70ea8e7 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:58.499812 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7436c455-5dab-4560-a3c7-69c9d70ea8e7 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:58.654986 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-7436c455-5dab-4560-a3c7-69c9d70ea8e7 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:01:58.665767 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-7436c455-5dab-4560-a3c7-69c9d70ea8e7 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1722 microversion: 2.1 time: 0.178607 Jun 17 13:01:58.666371 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 242/457] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:01:58 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1722 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:01:59.020457 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-999112fa-fecc-40f8-8793-bbb493e8f485 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:59.021148 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-999112fa-fecc-40f8-8793-bbb493e8f485 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:59.028144 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-999112fa-fecc-40f8-8793-bbb493e8f485 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:59.028716 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-999112fa-fecc-40f8-8793-bbb493e8f485 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:59.029575 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-999112fa-fecc-40f8-8793-bbb493e8f485 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:59.030028 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-999112fa-fecc-40f8-8793-bbb493e8f485 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:59.188834 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-999112fa-fecc-40f8-8793-bbb493e8f485 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:01:59.198212 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-999112fa-fecc-40f8-8793-bbb493e8f485 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:01:59.199714 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-999112fa-fecc-40f8-8793-bbb493e8f485 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:01:59.200895 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-999112fa-fecc-40f8-8793-bbb493e8f485 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1724 microversion: 2.20 time: 0.185647 Jun 17 13:01:59.201436 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 216/458] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:01:59 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1724 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:01:59.287939 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-ba0382e9-b23c-4b92-878d-1c8b1deed03d tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:59.288641 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-ba0382e9-b23c-4b92-878d-1c8b1deed03d tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:59.295558 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ba0382e9-b23c-4b92-878d-1c8b1deed03d tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:59.296136 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ba0382e9-b23c-4b92-878d-1c8b1deed03d tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:59.296900 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ba0382e9-b23c-4b92-878d-1c8b1deed03d tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:59.297340 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ba0382e9-b23c-4b92-878d-1c8b1deed03d tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:59.455968 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-ba0382e9-b23c-4b92-878d-1c8b1deed03d tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:01:59.463902 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-ba0382e9-b23c-4b92-878d-1c8b1deed03d tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1359 microversion: 2.1 time: 0.180171 Jun 17 13:01:59.470150 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 243/459] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:01:59 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1359 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:01:59.685514 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-aaa56f65-bdfc-4071-ae33-c1be8c108440 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:01:59.686262 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-aaa56f65-bdfc-4071-ae33-c1be8c108440 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:01:59.693306 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-aaa56f65-bdfc-4071-ae33-c1be8c108440 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:59.693754 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-aaa56f65-bdfc-4071-ae33-c1be8c108440 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:59.694757 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-aaa56f65-bdfc-4071-ae33-c1be8c108440 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:01:59.695202 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-aaa56f65-bdfc-4071-ae33-c1be8c108440 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:01:59.855526 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-aaa56f65-bdfc-4071-ae33-c1be8c108440 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:01:59.864875 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-aaa56f65-bdfc-4071-ae33-c1be8c108440 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1722 microversion: 2.1 time: 0.183258 Jun 17 13:01:59.865479 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 217/460] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:01:59 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1722 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:02:00.223673 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-2157008a-ae77-4c9b-be42-3045be31296a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:02:00.224308 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-2157008a-ae77-4c9b-be42-3045be31296a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:02:00.231921 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2157008a-ae77-4c9b-be42-3045be31296a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:00.232467 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2157008a-ae77-4c9b-be42-3045be31296a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:00.233595 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2157008a-ae77-4c9b-be42-3045be31296a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:00.234166 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2157008a-ae77-4c9b-be42-3045be31296a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:00.419254 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-2157008a-ae77-4c9b-be42-3045be31296a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:02:00.428544 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-2157008a-ae77-4c9b-be42-3045be31296a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:02:00.430054 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-2157008a-ae77-4c9b-be42-3045be31296a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:02:00.431269 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-2157008a-ae77-4c9b-be42-3045be31296a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1724 microversion: 2.20 time: 0.211833 Jun 17 13:02:00.431829 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 244/461] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:02:00 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1724 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:02:00.481348 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-6be37fc1-35f4-4ab3-8dce-6df4504f582a tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:02:00.482169 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-6be37fc1-35f4-4ab3-8dce-6df4504f582a tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:02:00.489428 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6be37fc1-35f4-4ab3-8dce-6df4504f582a tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:00.489875 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6be37fc1-35f4-4ab3-8dce-6df4504f582a tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:00.490681 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6be37fc1-35f4-4ab3-8dce-6df4504f582a tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:00.491118 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6be37fc1-35f4-4ab3-8dce-6df4504f582a tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:00.667524 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-6be37fc1-35f4-4ab3-8dce-6df4504f582a tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:02:00.672320 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-6be37fc1-35f4-4ab3-8dce-6df4504f582a tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1550 microversion: 2.1 time: 0.194702 Jun 17 13:02:00.673088 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 218/462] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:02:00 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1550 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 13:02:00.692908 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-169819a1-9f1b-4054-bd13-9a9ee55541b3 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:02:00.693516 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-169819a1-9f1b-4054-bd13-9a9ee55541b3 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:02:00.699772 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-169819a1-9f1b-4054-bd13-9a9ee55541b3 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:00.700205 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-169819a1-9f1b-4054-bd13-9a9ee55541b3 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:00.700968 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-169819a1-9f1b-4054-bd13-9a9ee55541b3 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:00.701390 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-169819a1-9f1b-4054-bd13-9a9ee55541b3 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:00.856829 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-169819a1-9f1b-4054-bd13-9a9ee55541b3 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:02:00.870891 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-169819a1-9f1b-4054-bd13-9a9ee55541b3 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1550 microversion: 2.1 time: 0.182049 Jun 17 13:02:00.871871 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 245/463] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:02:00 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1550 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:02:00.883327 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-d5e3c585-8b8d-4b75-84a9-ef996fa48139 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:02:00.884091 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-d5e3c585-8b8d-4b75-84a9-ef996fa48139 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:02:00.890741 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d5e3c585-8b8d-4b75-84a9-ef996fa48139 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:00.891331 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d5e3c585-8b8d-4b75-84a9-ef996fa48139 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:00.892635 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d5e3c585-8b8d-4b75-84a9-ef996fa48139 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:00.893100 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d5e3c585-8b8d-4b75-84a9-ef996fa48139 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:00.895936 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-678d2c4b-71d7-4906-a71c-3cf43548c393 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:02:00.899656 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-678d2c4b-71d7-4906-a71c-3cf43548c393 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:02:00.900427 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-678d2c4b-71d7-4906-a71c-3cf43548c393 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Searching by: {'deleted': False, 'project_id': '1686ea199c5442958f97102a61ce41aa'} {{(pid=117660) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 17 13:02:00.907327 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-678d2c4b-71d7-4906-a71c-3cf43548c393 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:00.907769 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-678d2c4b-71d7-4906-a71c-3cf43548c393 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:00.908547 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-678d2c4b-71d7-4906-a71c-3cf43548c393 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:00.908975 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-678d2c4b-71d7-4906-a71c-3cf43548c393 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:01.010382 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.multi_cell_list [None req-678d2c4b-71d7-4906-a71c-3cf43548c393 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117660) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 17 13:02:01.082663 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-d5e3c585-8b8d-4b75-84a9-ef996fa48139 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:02:01.091838 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-d5e3c585-8b8d-4b75-84a9-ef996fa48139 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1722 microversion: 2.1 time: 0.212500 Jun 17 13:02:01.092430 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 219/464] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:02:00 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1722 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:02:01.117621 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-678d2c4b-71d7-4906-a71c-3cf43548c393 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.230487 Jun 17 13:02:01.118497 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 246/465] 10.222.0.48 () {58 vars in 1124 bytes} [Fri Jun 17 13:02:00 2022] GET /compute/v2.1/servers => generated 343 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:02:01.130425 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-41f63b30-9bd2-4617-957a-e44d462302e6 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:02:01.131053 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-41f63b30-9bd2-4617-957a-e44d462302e6 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:02:01.137805 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-41f63b30-9bd2-4617-957a-e44d462302e6 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:01.138310 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-41f63b30-9bd2-4617-957a-e44d462302e6 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:01.139170 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-41f63b30-9bd2-4617-957a-e44d462302e6 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:01.139603 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-41f63b30-9bd2-4617-957a-e44d462302e6 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:01.290822 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-41f63b30-9bd2-4617-957a-e44d462302e6 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:02:01.300168 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-41f63b30-9bd2-4617-957a-e44d462302e6 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1550 microversion: 2.1 time: 0.174739 Jun 17 13:02:01.301195 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 220/466] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:02:01 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1550 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:02:01.459850 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-0f8ab5ac-71d0-4899-a8fc-d8eade729d72 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:02:01.461940 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-0f8ab5ac-71d0-4899-a8fc-d8eade729d72 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:02:01.469983 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0f8ab5ac-71d0-4899-a8fc-d8eade729d72 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:01.470499 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0f8ab5ac-71d0-4899-a8fc-d8eade729d72 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:01.472637 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0f8ab5ac-71d0-4899-a8fc-d8eade729d72 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:01.473365 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0f8ab5ac-71d0-4899-a8fc-d8eade729d72 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:01.642523 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-0f8ab5ac-71d0-4899-a8fc-d8eade729d72 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:02:01.662181 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-0f8ab5ac-71d0-4899-a8fc-d8eade729d72 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:02:01.663878 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-0f8ab5ac-71d0-4899-a8fc-d8eade729d72 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:02:01.665175 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-0f8ab5ac-71d0-4899-a8fc-d8eade729d72 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1724 microversion: 2.20 time: 0.211868 Jun 17 13:02:01.666071 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 247/467] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:02:01 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1724 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:02:02.109109 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-d3c67c87-7790-4d32-8400-cda009d87437 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:02:02.109717 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-d3c67c87-7790-4d32-8400-cda009d87437 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:02:02.117535 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d3c67c87-7790-4d32-8400-cda009d87437 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:02.117987 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d3c67c87-7790-4d32-8400-cda009d87437 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:02.118863 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d3c67c87-7790-4d32-8400-cda009d87437 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:02.119221 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d3c67c87-7790-4d32-8400-cda009d87437 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:02.259628 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-d3c67c87-7790-4d32-8400-cda009d87437 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:02:02.263283 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:02:02.268335 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-d3c67c87-7790-4d32-8400-cda009d87437 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1722 microversion: 2.1 time: 0.163008 Jun 17 13:02:02.268933 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 221/468] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:02:02 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:02:02.687304 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-40c318a9-7ebb-4e88-be67-26e076900b17 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:02:02.687994 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-40c318a9-7ebb-4e88-be67-26e076900b17 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:02:02.697726 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-40c318a9-7ebb-4e88-be67-26e076900b17 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:02.698162 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-40c318a9-7ebb-4e88-be67-26e076900b17 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:02.699336 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-40c318a9-7ebb-4e88-be67-26e076900b17 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:02.699756 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-40c318a9-7ebb-4e88-be67-26e076900b17 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:02.976004 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-95a2c4ab-b702-4659-a37c-9b172e6f87e9 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "520bf7f4-5382-4c9c-81be-934670e0f29c"}} {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:02:02.977158 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-95a2c4ab-b702-4659-a37c-9b172e6f87e9 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:02:02.984132 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-95a2c4ab-b702-4659-a37c-9b172e6f87e9 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:02.984578 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-95a2c4ab-b702-4659-a37c-9b172e6f87e9 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:02.985335 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-95a2c4ab-b702-4659-a37c-9b172e6f87e9 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:02.985761 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-95a2c4ab-b702-4659-a37c-9b172e6f87e9 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:03.057178 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-40c318a9-7ebb-4e88-be67-26e076900b17 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:02:03.065445 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-40c318a9-7ebb-4e88-be67-26e076900b17 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:02:03.067121 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-40c318a9-7ebb-4e88-be67-26e076900b17 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:02:03.068703 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-40c318a9-7ebb-4e88-be67-26e076900b17 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1724 microversion: 2.20 time: 0.387296 Jun 17 13:02:03.069341 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 248/469] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:02:02 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1724 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:02:03.287343 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-bf3f4b5b-c112-46f1-a995-d4b84421acbd tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:02:03.288592 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-bf3f4b5b-c112-46f1-a995-d4b84421acbd tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:02:03.295853 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bf3f4b5b-c112-46f1-a995-d4b84421acbd tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:03.296297 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bf3f4b5b-c112-46f1-a995-d4b84421acbd tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:03.297068 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bf3f4b5b-c112-46f1-a995-d4b84421acbd tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:03.297497 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bf3f4b5b-c112-46f1-a995-d4b84421acbd tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:03.352356 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-95a2c4ab-b702-4659-a37c-9b172e6f87e9 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "POST /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.380388 Jun 17 13:02:03.353101 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 222/470] 10.222.0.48 () {60 vars in 1322 bytes} [Fri Jun 17 13:02:02 2022] POST /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a/os-volume_attachments => generated 194 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:02:03.452053 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-bf3f4b5b-c112-46f1-a995-d4b84421acbd tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:02:03.462383 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-bf3f4b5b-c112-46f1-a995-d4b84421acbd tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1722 microversion: 2.1 time: 0.179490 Jun 17 13:02:03.462974 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 249/471] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:02:03 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1722 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:02:03.586460 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-40b0b54d-2dba-46d3-a42d-bc86215759ee tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1559709844", "imageRef": "ccec3e37-1df8-4f10-a8f6-f97dfac54cf5", "flavorRef": "452", "networks": [{"uuid": "7821939d-09ca-4e1f-a339-e6b4f8ca98fb"}]}} {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:02:03.646247 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.network.neutron [None req-40b0b54d-2dba-46d3-a42d-bc86215759ee tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] validate_networks() for [('7821939d-09ca-4e1f-a339-e6b4f8ca98fb', None, None, None, None, None)] {{(pid=117659) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 17 13:02:04.054717 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.virt.hardware [None req-40b0b54d-2dba-46d3-a42d-bc86215759ee tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Flavor limits 0:0:0 {{(pid=117659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 17 13:02:04.055141 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.virt.hardware [None req-40b0b54d-2dba-46d3-a42d-bc86215759ee tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Image limits 0:0:0 {{(pid=117659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 17 13:02:04.055606 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.virt.hardware [None req-40b0b54d-2dba-46d3-a42d-bc86215759ee tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Flavor pref 0:0:0 {{(pid=117659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 17 13:02:04.056005 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.virt.hardware [None req-40b0b54d-2dba-46d3-a42d-bc86215759ee tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Image pref 0:0:0 {{(pid=117659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 17 13:02:04.056468 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.virt.hardware [None req-40b0b54d-2dba-46d3-a42d-bc86215759ee tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 17 13:02:04.065921 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-40b0b54d-2dba-46d3-a42d-bc86215759ee tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:04.066400 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-40b0b54d-2dba-46d3-a42d-bc86215759ee tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:04.067183 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-40b0b54d-2dba-46d3-a42d-bc86215759ee tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:04.067614 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-40b0b54d-2dba-46d3-a42d-bc86215759ee tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:04.085425 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.quota [None req-40b0b54d-2dba-46d3-a42d-bc86215759ee tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Getting quotas for project 834ac53907e54975851947e5f653c688. Resources: {'ram', 'cores', 'instances'} {{(pid=117659) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 13:02:04.087900 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-62cea7c9-095d-433e-85f5-75972bd8d183 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:02:04.088600 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-62cea7c9-095d-433e-85f5-75972bd8d183 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:02:04.089960 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.quota [None req-40b0b54d-2dba-46d3-a42d-bc86215759ee tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Getting quotas for user c6bc5146c28948c5859cd9eb3d09e0cf and project 834ac53907e54975851947e5f653c688. Resources: {'ram', 'cores', 'instances'} {{(pid=117659) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 13:02:04.094837 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-62cea7c9-095d-433e-85f5-75972bd8d183 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:04.095276 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-62cea7c9-095d-433e-85f5-75972bd8d183 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:04.096163 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-62cea7c9-095d-433e-85f5-75972bd8d183 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:04.096595 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-62cea7c9-095d-433e-85f5-75972bd8d183 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:04.101782 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-40b0b54d-2dba-46d3-a42d-bc86215759ee tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Going to run 1 instances... {{(pid=117659) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 17 13:02:04.104194 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-40b0b54d-2dba-46d3-a42d-bc86215759ee tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ccec3e37-1df8-4f10-a8f6-f97dfac54cf5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117659) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 17 13:02:04.151976 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-40b0b54d-2dba-46d3-a42d-bc86215759ee tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.571204 Jun 17 13:02:04.152819 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 223/472] 10.222.0.48 () {60 vars in 1146 bytes} [Fri Jun 17 13:02:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 573 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 17 13:02:04.162495 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-7c2a2e05-ebd5-48e4-bbe4-30cf7d26ce57 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:02:04.163115 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-7c2a2e05-ebd5-48e4-bbe4-30cf7d26ce57 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:02:04.236309 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-7c2a2e05-ebd5-48e4-bbe4-30cf7d26ce57 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:02:04.244706 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-7c2a2e05-ebd5-48e4-bbe4-30cf7d26ce57 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1219 microversion: 2.1 time: 0.086048 Jun 17 13:02:04.246441 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 224/473] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:02:04 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 13:02:04.275458 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-62cea7c9-095d-433e-85f5-75972bd8d183 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:02:04.284400 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-62cea7c9-095d-433e-85f5-75972bd8d183 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:02:04.285933 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-62cea7c9-095d-433e-85f5-75972bd8d183 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:02:04.287354 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-62cea7c9-095d-433e-85f5-75972bd8d183 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1724 microversion: 2.20 time: 0.204023 Jun 17 13:02:04.287924 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 250/474] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:02:04 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1724 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:02:04.479770 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-3f3cd3b7-22cf-4538-95f4-414b6c7a2b84 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:02:04.480409 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-3f3cd3b7-22cf-4538-95f4-414b6c7a2b84 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:02:04.488713 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-3f3cd3b7-22cf-4538-95f4-414b6c7a2b84 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:04.489303 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-3f3cd3b7-22cf-4538-95f4-414b6c7a2b84 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:04.489946 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-3f3cd3b7-22cf-4538-95f4-414b6c7a2b84 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:04.490554 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-3f3cd3b7-22cf-4538-95f4-414b6c7a2b84 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:04.649051 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-3f3cd3b7-22cf-4538-95f4-414b6c7a2b84 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:02:04.657560 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-3f3cd3b7-22cf-4538-95f4-414b6c7a2b84 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1722 microversion: 2.1 time: 0.181692 Jun 17 13:02:04.658180 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 225/475] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:02:04 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1722 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:02:05.262679 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-fdc6d85b-5a7c-4198-b522-540b1a10244f tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:02:05.263255 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-fdc6d85b-5a7c-4198-b522-540b1a10244f tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:02:05.269720 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fdc6d85b-5a7c-4198-b522-540b1a10244f tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:05.270202 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fdc6d85b-5a7c-4198-b522-540b1a10244f tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:05.270979 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fdc6d85b-5a7c-4198-b522-540b1a10244f tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:05.271460 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fdc6d85b-5a7c-4198-b522-540b1a10244f tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:05.305936 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-c0b6bdde-77ca-4cf7-8b28-df1a111ee4e6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:02:05.306603 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-c0b6bdde-77ca-4cf7-8b28-df1a111ee4e6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:02:05.313724 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c0b6bdde-77ca-4cf7-8b28-df1a111ee4e6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:05.314236 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c0b6bdde-77ca-4cf7-8b28-df1a111ee4e6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:05.315006 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c0b6bdde-77ca-4cf7-8b28-df1a111ee4e6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:05.315447 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c0b6bdde-77ca-4cf7-8b28-df1a111ee4e6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:05.342234 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-fdc6d85b-5a7c-4198-b522-540b1a10244f tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:02:05.351236 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-fdc6d85b-5a7c-4198-b522-540b1a10244f tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1271 microversion: 2.1 time: 0.092429 Jun 17 13:02:05.351845 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 251/476] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:02:05 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1271 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:02:05.499188 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-c0b6bdde-77ca-4cf7-8b28-df1a111ee4e6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:02:05.511885 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-c0b6bdde-77ca-4cf7-8b28-df1a111ee4e6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:02:05.513510 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-c0b6bdde-77ca-4cf7-8b28-df1a111ee4e6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:02:05.514828 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-c0b6bdde-77ca-4cf7-8b28-df1a111ee4e6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1724 microversion: 2.20 time: 0.212954 Jun 17 13:02:05.515707 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 226/477] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:02:05 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1724 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:02:05.685196 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-ad72fad3-b73e-437c-80c0-28e21602d41f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:02:05.686242 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-ad72fad3-b73e-437c-80c0-28e21602d41f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:02:05.699912 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ad72fad3-b73e-437c-80c0-28e21602d41f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:05.700833 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ad72fad3-b73e-437c-80c0-28e21602d41f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:05.703135 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ad72fad3-b73e-437c-80c0-28e21602d41f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:05.703934 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ad72fad3-b73e-437c-80c0-28e21602d41f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:05.947069 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-ad72fad3-b73e-437c-80c0-28e21602d41f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:02:05.955524 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-ad72fad3-b73e-437c-80c0-28e21602d41f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1722 microversion: 2.1 time: 0.280219 Jun 17 13:02:05.956143 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 252/478] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:02:05 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1722 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:02:06.369050 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-46847287-1d8e-4661-abe4-7b1cdd9e5559 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:02:06.369652 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-46847287-1d8e-4661-abe4-7b1cdd9e5559 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:02:06.376665 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-46847287-1d8e-4661-abe4-7b1cdd9e5559 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:06.377106 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-46847287-1d8e-4661-abe4-7b1cdd9e5559 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:06.378259 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-46847287-1d8e-4661-abe4-7b1cdd9e5559 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:06.378690 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-46847287-1d8e-4661-abe4-7b1cdd9e5559 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:06.535365 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-5d82c745-838f-4440-be39-2006b800bc7b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:02:06.536165 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-5d82c745-838f-4440-be39-2006b800bc7b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:02:06.546321 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5d82c745-838f-4440-be39-2006b800bc7b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:06.546760 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5d82c745-838f-4440-be39-2006b800bc7b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:06.547530 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5d82c745-838f-4440-be39-2006b800bc7b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:06.547953 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5d82c745-838f-4440-be39-2006b800bc7b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:06.660214 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-46847287-1d8e-4661-abe4-7b1cdd9e5559 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:02:06.668578 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-46847287-1d8e-4661-abe4-7b1cdd9e5559 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1319 microversion: 2.1 time: 0.303352 Jun 17 13:02:06.669084 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 227/479] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:02:06 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1319 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 13:02:06.807653 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-5d82c745-838f-4440-be39-2006b800bc7b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:02:06.817135 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-5d82c745-838f-4440-be39-2006b800bc7b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:02:06.819107 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-5d82c745-838f-4440-be39-2006b800bc7b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:02:06.820347 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-5d82c745-838f-4440-be39-2006b800bc7b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1745 microversion: 2.20 time: 0.289196 Jun 17 13:02:06.820910 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 253/480] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:02:06 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1745 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:02:06.974974 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-1ea25ca0-a2e7-4697-81bd-9959f98a0535 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:02:06.975615 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-1ea25ca0-a2e7-4697-81bd-9959f98a0535 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:02:06.985056 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-1ea25ca0-a2e7-4697-81bd-9959f98a0535 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:06.985572 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-1ea25ca0-a2e7-4697-81bd-9959f98a0535 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:06.986529 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-1ea25ca0-a2e7-4697-81bd-9959f98a0535 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:06.986995 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-1ea25ca0-a2e7-4697-81bd-9959f98a0535 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:07.290598 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-1ea25ca0-a2e7-4697-81bd-9959f98a0535 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:02:07.303763 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-1ea25ca0-a2e7-4697-81bd-9959f98a0535 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1722 microversion: 2.1 time: 0.333504 Jun 17 13:02:07.317266 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 228/481] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:02:06 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1722 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:02:07.633371 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [req-c9027f3a-0b0f-4f2d-a827-6885a49fb324 req-bb924f87-25c6-40c8-a957-a6262f7e824f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a983e3a-9451-4a00-b4f3-b6b2e5a003d6", "tag": "bf2b4bfb-50d4-45f0-8273-ccfa08843494"}]} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:02:07.648285 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-c9027f3a-0b0f-4f2d-a827-6885a49fb324 req-bb924f87-25c6-40c8-a957-a6262f7e824f service nova] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:07.648608 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-c9027f3a-0b0f-4f2d-a827-6885a49fb324 req-bb924f87-25c6-40c8-a957-a6262f7e824f service nova] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:07.683147 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.compute.server_external_events [req-c9027f3a-0b0f-4f2d-a827-6885a49fb324 req-bb924f87-25c6-40c8-a957-a6262f7e824f service nova] Creating event network-changed:bf2b4bfb-50d4-45f0-8273-ccfa08843494 for instance 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 on hv-cinder-83754 Jun 17 13:02:07.695721 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [req-c9027f3a-0b0f-4f2d-a827-6885a49fb324 req-bb924f87-25c6-40c8-a957-a6262f7e824f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066163 Jun 17 13:02:07.696683 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 254/482] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 13:02:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:02:07.707439 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-892192af-97c8-420b-959a-e0055395ac17 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:02:07.708712 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-892192af-97c8-420b-959a-e0055395ac17 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:02:07.718934 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-892192af-97c8-420b-959a-e0055395ac17 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:07.719465 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-892192af-97c8-420b-959a-e0055395ac17 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:07.720269 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-892192af-97c8-420b-959a-e0055395ac17 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:07.720700 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-892192af-97c8-420b-959a-e0055395ac17 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:07.843300 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-b448a540-a1d6-4200-a2d0-7dd71b5bd564 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:02:07.844622 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-b448a540-a1d6-4200-a2d0-7dd71b5bd564 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:02:07.852197 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b448a540-a1d6-4200-a2d0-7dd71b5bd564 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:07.852649 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b448a540-a1d6-4200-a2d0-7dd71b5bd564 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:07.853421 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b448a540-a1d6-4200-a2d0-7dd71b5bd564 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:07.853850 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b448a540-a1d6-4200-a2d0-7dd71b5bd564 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:08.034362 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-892192af-97c8-420b-959a-e0055395ac17 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:02:08.043109 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-892192af-97c8-420b-959a-e0055395ac17 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1319 microversion: 2.1 time: 0.360849 Jun 17 13:02:08.043711 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 229/483] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:02:07 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1319 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 13:02:08.129605 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-b448a540-a1d6-4200-a2d0-7dd71b5bd564 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:02:08.139058 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-b448a540-a1d6-4200-a2d0-7dd71b5bd564 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:02:08.140681 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-b448a540-a1d6-4200-a2d0-7dd71b5bd564 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:02:08.141903 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-b448a540-a1d6-4200-a2d0-7dd71b5bd564 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1745 microversion: 2.20 time: 0.305083 Jun 17 13:02:08.142508 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 255/484] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:02:07 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1745 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 13:02:08.325230 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-2e907064-2347-4c83-8632-4b8b766844ab tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:02:08.325839 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-2e907064-2347-4c83-8632-4b8b766844ab tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:02:08.332802 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2e907064-2347-4c83-8632-4b8b766844ab tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:08.333288 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2e907064-2347-4c83-8632-4b8b766844ab tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:08.336190 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2e907064-2347-4c83-8632-4b8b766844ab tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:08.337015 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2e907064-2347-4c83-8632-4b8b766844ab tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:08.514517 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-2e907064-2347-4c83-8632-4b8b766844ab tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:02:08.523493 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-2e907064-2347-4c83-8632-4b8b766844ab tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1722 microversion: 2.1 time: 0.202191 Jun 17 13:02:08.524088 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 230/485] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:02:08 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1722 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:02:09.060952 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-e2536dec-6b41-4256-bb8c-d69dc163abd2 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:02:09.061603 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-e2536dec-6b41-4256-bb8c-d69dc163abd2 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:02:09.068299 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e2536dec-6b41-4256-bb8c-d69dc163abd2 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:09.068889 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e2536dec-6b41-4256-bb8c-d69dc163abd2 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:09.069685 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e2536dec-6b41-4256-bb8c-d69dc163abd2 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:09.070130 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e2536dec-6b41-4256-bb8c-d69dc163abd2 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:09.164386 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-535ac077-069b-4b5d-9da2-9527e3818368 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:02:09.165337 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-535ac077-069b-4b5d-9da2-9527e3818368 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:02:09.173304 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-535ac077-069b-4b5d-9da2-9527e3818368 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:09.173781 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-535ac077-069b-4b5d-9da2-9527e3818368 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:09.174696 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-535ac077-069b-4b5d-9da2-9527e3818368 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:09.175184 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-535ac077-069b-4b5d-9da2-9527e3818368 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:09.232053 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-e2536dec-6b41-4256-bb8c-d69dc163abd2 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:02:09.240832 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-e2536dec-6b41-4256-bb8c-d69dc163abd2 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1319 microversion: 2.1 time: 0.183818 Jun 17 13:02:09.241426 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 256/486] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:02:09 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1319 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:02:09.329521 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-535ac077-069b-4b5d-9da2-9527e3818368 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:02:09.338240 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-535ac077-069b-4b5d-9da2-9527e3818368 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:02:09.339727 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-535ac077-069b-4b5d-9da2-9527e3818368 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:02:09.340932 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-535ac077-069b-4b5d-9da2-9527e3818368 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1745 microversion: 2.20 time: 0.183464 Jun 17 13:02:09.341480 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 231/487] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:02:09 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1745 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:02:09.542452 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-847d40e6-ada7-4d03-92f8-630086aa3bc9 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:02:09.544094 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-847d40e6-ada7-4d03-92f8-630086aa3bc9 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:02:09.550487 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-847d40e6-ada7-4d03-92f8-630086aa3bc9 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:09.550943 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-847d40e6-ada7-4d03-92f8-630086aa3bc9 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:09.551795 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-847d40e6-ada7-4d03-92f8-630086aa3bc9 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:09.552310 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-847d40e6-ada7-4d03-92f8-630086aa3bc9 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:09.558949 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=100 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:02:09.700992 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-847d40e6-ada7-4d03-92f8-630086aa3bc9 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:02:09.714131 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-847d40e6-ada7-4d03-92f8-630086aa3bc9 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1722 microversion: 2.1 time: 0.176897 Jun 17 13:02:09.714734 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 257/488] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:02:09 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1722 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:02:10.260614 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-d2bbef38-1d8c-43f2-9ce2-e2a865fd3429 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:02:10.261234 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-d2bbef38-1d8c-43f2-9ce2-e2a865fd3429 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:02:10.268247 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d2bbef38-1d8c-43f2-9ce2-e2a865fd3429 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:10.268702 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d2bbef38-1d8c-43f2-9ce2-e2a865fd3429 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:10.269478 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d2bbef38-1d8c-43f2-9ce2-e2a865fd3429 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:10.269914 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d2bbef38-1d8c-43f2-9ce2-e2a865fd3429 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:10.360350 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-0906995b-ad0d-467d-a83d-ef55942e4484 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:02:10.360925 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-0906995b-ad0d-467d-a83d-ef55942e4484 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:02:10.368236 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0906995b-ad0d-467d-a83d-ef55942e4484 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:10.368679 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0906995b-ad0d-467d-a83d-ef55942e4484 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:10.369442 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0906995b-ad0d-467d-a83d-ef55942e4484 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:10.369876 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0906995b-ad0d-467d-a83d-ef55942e4484 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:10.422337 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-d2bbef38-1d8c-43f2-9ce2-e2a865fd3429 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:02:10.430164 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-d2bbef38-1d8c-43f2-9ce2-e2a865fd3429 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1319 microversion: 2.1 time: 0.173406 Jun 17 13:02:10.430769 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 232/489] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:02:10 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1319 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:02:10.507709 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-0906995b-ad0d-467d-a83d-ef55942e4484 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:02:10.516417 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-0906995b-ad0d-467d-a83d-ef55942e4484 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:02:10.517852 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-0906995b-ad0d-467d-a83d-ef55942e4484 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:02:10.519041 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-0906995b-ad0d-467d-a83d-ef55942e4484 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1745 microversion: 2.20 time: 0.162622 Jun 17 13:02:10.519616 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 258/490] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:02:10 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1745 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:02:10.731810 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-07653ead-0954-48b5-aab5-78559062a80b tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:02:10.732430 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-07653ead-0954-48b5-aab5-78559062a80b tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:02:10.739040 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-07653ead-0954-48b5-aab5-78559062a80b tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:10.739535 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-07653ead-0954-48b5-aab5-78559062a80b tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:10.740292 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-07653ead-0954-48b5-aab5-78559062a80b tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:10.740732 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-07653ead-0954-48b5-aab5-78559062a80b tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:10.887579 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-07653ead-0954-48b5-aab5-78559062a80b tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:02:10.904744 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-07653ead-0954-48b5-aab5-78559062a80b tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1722 microversion: 2.1 time: 0.176944 Jun 17 13:02:10.905368 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 233/491] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:02:10 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1722 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:02:11.447493 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-ca6d06e3-35cd-419e-9f89-ba7cd5c0666e tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:02:11.448174 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-ca6d06e3-35cd-419e-9f89-ba7cd5c0666e tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:02:11.450002 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell0:SELECT=2 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:02:11.455910 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ca6d06e3-35cd-419e-9f89-ba7cd5c0666e tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:11.456353 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ca6d06e3-35cd-419e-9f89-ba7cd5c0666e tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:11.457113 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ca6d06e3-35cd-419e-9f89-ba7cd5c0666e tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:11.457525 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ca6d06e3-35cd-419e-9f89-ba7cd5c0666e tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:11.543509 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-9a137c82-54ed-456a-a2b9-a591b788b08a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:02:11.543989 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-9a137c82-54ed-456a-a2b9-a591b788b08a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:02:11.551205 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9a137c82-54ed-456a-a2b9-a591b788b08a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:11.551652 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9a137c82-54ed-456a-a2b9-a591b788b08a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:11.552427 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9a137c82-54ed-456a-a2b9-a591b788b08a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:11.552884 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9a137c82-54ed-456a-a2b9-a591b788b08a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:11.613890 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-ca6d06e3-35cd-419e-9f89-ba7cd5c0666e tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:02:11.621977 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-ca6d06e3-35cd-419e-9f89-ba7cd5c0666e tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1319 microversion: 2.1 time: 0.178326 Jun 17 13:02:11.622961 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 259/492] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:02:11 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1319 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:02:11.629004 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [req-16c8e2dd-6e33-47d4-a863-0d75d16099bb req-caf08aee-b7fe-4af9-8c5a-595bb999282b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8fdea98-917f-4c4d-aaba-d4f5df4622d6", "name": "network-vif-plugged", "status": "completed", "tag": "936c48d1-9e45-4b7e-9fa7-86ea87893b56"}]} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:02:11.637949 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-16c8e2dd-6e33-47d4-a863-0d75d16099bb req-caf08aee-b7fe-4af9-8c5a-595bb999282b service nova] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:11.638385 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-16c8e2dd-6e33-47d4-a863-0d75d16099bb req-caf08aee-b7fe-4af9-8c5a-595bb999282b service nova] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:11.650207 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.compute.server_external_events [req-16c8e2dd-6e33-47d4-a863-0d75d16099bb req-caf08aee-b7fe-4af9-8c5a-595bb999282b service nova] Creating event network-vif-plugged:936c48d1-9e45-4b7e-9fa7-86ea87893b56 for instance c8fdea98-917f-4c4d-aaba-d4f5df4622d6 on hv-cinder-83754 Jun 17 13:02:11.655554 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [req-16c8e2dd-6e33-47d4-a863-0d75d16099bb req-caf08aee-b7fe-4af9-8c5a-595bb999282b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031272 Jun 17 13:02:11.656115 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 260/493] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 13:02:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:02:11.717152 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-9a137c82-54ed-456a-a2b9-a591b788b08a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:02:11.728803 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-9a137c82-54ed-456a-a2b9-a591b788b08a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:02:11.731009 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-9a137c82-54ed-456a-a2b9-a591b788b08a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:02:11.732445 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-9a137c82-54ed-456a-a2b9-a591b788b08a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1745 microversion: 2.20 time: 0.193046 Jun 17 13:02:11.733291 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 234/494] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:02:11 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1745 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:02:11.923354 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-00c33a3b-7c2a-49bc-8932-e2d48b5bac2e tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:02:11.924049 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-00c33a3b-7c2a-49bc-8932-e2d48b5bac2e tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:02:11.938465 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-00c33a3b-7c2a-49bc-8932-e2d48b5bac2e tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:11.939157 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-00c33a3b-7c2a-49bc-8932-e2d48b5bac2e tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:11.940138 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-00c33a3b-7c2a-49bc-8932-e2d48b5bac2e tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:11.940845 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-00c33a3b-7c2a-49bc-8932-e2d48b5bac2e tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:12.103199 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-00c33a3b-7c2a-49bc-8932-e2d48b5bac2e tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:02:12.111461 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-00c33a3b-7c2a-49bc-8932-e2d48b5bac2e tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1722 microversion: 2.1 time: 0.192377 Jun 17 13:02:12.114486 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 261/495] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:02:11 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1722 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:02:12.643259 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-3210b092-914f-41ef-8635-92e3fe500027 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:02:12.643839 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-3210b092-914f-41ef-8635-92e3fe500027 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:02:12.651270 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-3210b092-914f-41ef-8635-92e3fe500027 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:12.651733 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-3210b092-914f-41ef-8635-92e3fe500027 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:12.652484 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-3210b092-914f-41ef-8635-92e3fe500027 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:12.652912 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-3210b092-914f-41ef-8635-92e3fe500027 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:12.755514 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-5abda3c2-01fb-409b-9639-9be810e187de tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:02:12.756249 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-5abda3c2-01fb-409b-9639-9be810e187de tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:02:12.766791 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5abda3c2-01fb-409b-9639-9be810e187de tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:12.767228 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5abda3c2-01fb-409b-9639-9be810e187de tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:12.768047 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5abda3c2-01fb-409b-9639-9be810e187de tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:12.768520 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5abda3c2-01fb-409b-9639-9be810e187de tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:12.816075 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-3210b092-914f-41ef-8635-92e3fe500027 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:02:12.824098 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-3210b092-914f-41ef-8635-92e3fe500027 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1319 microversion: 2.1 time: 0.186447 Jun 17 13:02:12.824773 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 235/496] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:02:12 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1319 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:02:12.910124 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-5abda3c2-01fb-409b-9639-9be810e187de tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:02:12.918523 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-5abda3c2-01fb-409b-9639-9be810e187de tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:02:12.920011 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-5abda3c2-01fb-409b-9639-9be810e187de tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:02:12.921166 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-5abda3c2-01fb-409b-9639-9be810e187de tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1745 microversion: 2.20 time: 0.171893 Jun 17 13:02:12.921729 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 262/497] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:02:12 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1745 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:02:13.132901 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-96873b2f-9d8c-46e5-91d6-dc60c56aba40 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:02:13.133752 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-96873b2f-9d8c-46e5-91d6-dc60c56aba40 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:02:13.143188 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-96873b2f-9d8c-46e5-91d6-dc60c56aba40 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:13.143837 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-96873b2f-9d8c-46e5-91d6-dc60c56aba40 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:13.144797 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-96873b2f-9d8c-46e5-91d6-dc60c56aba40 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:13.145399 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-96873b2f-9d8c-46e5-91d6-dc60c56aba40 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:13.291396 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-96873b2f-9d8c-46e5-91d6-dc60c56aba40 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:02:13.300475 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-96873b2f-9d8c-46e5-91d6-dc60c56aba40 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1699 microversion: 2.1 time: 0.173534 Jun 17 13:02:13.301315 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 236/498] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:02:13 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1699 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:02:13.323144 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-49730e1d-f8cb-4289-a185-660d2e305909 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:02:13.333428 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-49730e1d-f8cb-4289-a185-660d2e305909 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:13.339153 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-49730e1d-f8cb-4289-a185-660d2e305909 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:13.413949 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-49730e1d-f8cb-4289-a185-660d2e305909 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Going to try to start instance {{(pid=117660) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 17 13:02:13.464730 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-49730e1d-f8cb-4289-a185-660d2e305909 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "POST /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/action" status: 202 len: 0 microversion: 2.1 time: 0.150767 Jun 17 13:02:13.465366 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 263/499] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Jun 17 13:02:13 2022] POST /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/action => generated 0 bytes in 152 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 13:02:13.473604 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-9e208dbb-b208-4be6-a2f4-a96cde59c928 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:02:13.474259 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-9e208dbb-b208-4be6-a2f4-a96cde59c928 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:02:13.481394 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9e208dbb-b208-4be6-a2f4-a96cde59c928 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:13.481850 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9e208dbb-b208-4be6-a2f4-a96cde59c928 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:13.482720 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9e208dbb-b208-4be6-a2f4-a96cde59c928 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:13.483103 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9e208dbb-b208-4be6-a2f4-a96cde59c928 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:13.626558 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-9e208dbb-b208-4be6-a2f4-a96cde59c928 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:02:13.635077 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-9e208dbb-b208-4be6-a2f4-a96cde59c928 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1708 microversion: 2.1 time: 0.165346 Jun 17 13:02:13.635674 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 237/500] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:02:13 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1708 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:02:13.845972 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-f6e6f1ad-805f-4887-821b-fc2fe46d7812 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:02:13.846663 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-f6e6f1ad-805f-4887-821b-fc2fe46d7812 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:02:13.856458 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f6e6f1ad-805f-4887-821b-fc2fe46d7812 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:13.857057 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f6e6f1ad-805f-4887-821b-fc2fe46d7812 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:13.858173 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f6e6f1ad-805f-4887-821b-fc2fe46d7812 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:13.858906 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f6e6f1ad-805f-4887-821b-fc2fe46d7812 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:13.940090 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-a0baa21d-fe7e-4e49-bbe1-c51df34279e2 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:02:13.940726 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-a0baa21d-fe7e-4e49-bbe1-c51df34279e2 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:02:13.948534 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a0baa21d-fe7e-4e49-bbe1-c51df34279e2 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:13.949127 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a0baa21d-fe7e-4e49-bbe1-c51df34279e2 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:13.950239 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a0baa21d-fe7e-4e49-bbe1-c51df34279e2 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:13.950834 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a0baa21d-fe7e-4e49-bbe1-c51df34279e2 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:14.031702 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-f6e6f1ad-805f-4887-821b-fc2fe46d7812 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:02:14.047065 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-f6e6f1ad-805f-4887-821b-fc2fe46d7812 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1319 microversion: 2.1 time: 0.207758 Jun 17 13:02:14.048002 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 264/501] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:02:13 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1319 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:02:14.074888 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_cell0:SELECT=2 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:02:14.169939 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-a0baa21d-fe7e-4e49-bbe1-c51df34279e2 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:02:14.173799 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:02:14.179323 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-a0baa21d-fe7e-4e49-bbe1-c51df34279e2 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:02:14.181245 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-a0baa21d-fe7e-4e49-bbe1-c51df34279e2 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:02:14.182778 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-a0baa21d-fe7e-4e49-bbe1-c51df34279e2 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1745 microversion: 2.20 time: 0.246675 Jun 17 13:02:14.183906 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 238/502] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:02:13 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1745 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:02:14.652986 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-7755db46-bac5-49ba-96dc-8ed26bda26f7 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:02:14.653596 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-7755db46-bac5-49ba-96dc-8ed26bda26f7 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:02:14.660039 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7755db46-bac5-49ba-96dc-8ed26bda26f7 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:14.660511 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7755db46-bac5-49ba-96dc-8ed26bda26f7 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:14.661234 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7755db46-bac5-49ba-96dc-8ed26bda26f7 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:14.662133 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7755db46-bac5-49ba-96dc-8ed26bda26f7 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:14.906520 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-7755db46-bac5-49ba-96dc-8ed26bda26f7 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:02:14.915027 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-7755db46-bac5-49ba-96dc-8ed26bda26f7 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1708 microversion: 2.1 time: 0.265891 Jun 17 13:02:14.915646 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 265/503] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:02:14 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1708 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:02:15.067709 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-835a2e24-5ee5-4045-8fa0-1874d06ee82f tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:02:15.068316 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-835a2e24-5ee5-4045-8fa0-1874d06ee82f tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:02:15.070720 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_cell0:SELECT=8 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:02:15.079179 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-835a2e24-5ee5-4045-8fa0-1874d06ee82f tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:15.079625 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-835a2e24-5ee5-4045-8fa0-1874d06ee82f tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:15.080404 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-835a2e24-5ee5-4045-8fa0-1874d06ee82f tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:15.080834 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-835a2e24-5ee5-4045-8fa0-1874d06ee82f tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:15.204434 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-89d6ae9b-87e3-4d92-a44d-c361d2c3dad9 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:02:15.205381 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-89d6ae9b-87e3-4d92-a44d-c361d2c3dad9 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:02:15.215521 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-89d6ae9b-87e3-4d92-a44d-c361d2c3dad9 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:15.216298 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-89d6ae9b-87e3-4d92-a44d-c361d2c3dad9 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:15.218334 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-89d6ae9b-87e3-4d92-a44d-c361d2c3dad9 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:15.219162 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-89d6ae9b-87e3-4d92-a44d-c361d2c3dad9 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:15.240331 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-835a2e24-5ee5-4045-8fa0-1874d06ee82f tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:02:15.270186 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-835a2e24-5ee5-4045-8fa0-1874d06ee82f tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1319 microversion: 2.1 time: 0.206659 Jun 17 13:02:15.271123 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 239/504] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:02:15 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1319 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:02:15.326608 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-0d5a0a17-2ba0-4506-ac9f-04e83f473de1 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:02:15.327225 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-0d5a0a17-2ba0-4506-ac9f-04e83f473de1 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:02:15.333254 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0d5a0a17-2ba0-4506-ac9f-04e83f473de1 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:15.333683 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0d5a0a17-2ba0-4506-ac9f-04e83f473de1 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:15.334813 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0d5a0a17-2ba0-4506-ac9f-04e83f473de1 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:15.335255 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0d5a0a17-2ba0-4506-ac9f-04e83f473de1 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:15.365441 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-89d6ae9b-87e3-4d92-a44d-c361d2c3dad9 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:02:15.374294 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-89d6ae9b-87e3-4d92-a44d-c361d2c3dad9 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:02:15.375800 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-89d6ae9b-87e3-4d92-a44d-c361d2c3dad9 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:02:15.376984 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-89d6ae9b-87e3-4d92-a44d-c361d2c3dad9 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1745 microversion: 2.20 time: 0.178168 Jun 17 13:02:15.377568 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 266/505] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:02:15 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1745 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:02:15.483353 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-0d5a0a17-2ba0-4506-ac9f-04e83f473de1 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:02:15.494179 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-0d5a0a17-2ba0-4506-ac9f-04e83f473de1 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1596 microversion: 2.1 time: 0.171324 Jun 17 13:02:15.494756 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 240/506] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:02:15 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1596 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 13:02:15.919244 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [req-0eeac5a8-8076-4598-a4cf-b92e13838d4b req-53995f52-68fc-414a-a236-759276df7cd8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a983e3a-9451-4a00-b4f3-b6b2e5a003d6", "name": "network-vif-plugged", "status": "completed", "tag": "bf2b4bfb-50d4-45f0-8273-ccfa08843494"}]} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:02:15.932920 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-ee9f1180-b7bf-4d5c-9a8e-38efb71f0589 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:02:15.933942 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-ee9f1180-b7bf-4d5c-9a8e-38efb71f0589 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:02:15.939882 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-0eeac5a8-8076-4598-a4cf-b92e13838d4b req-53995f52-68fc-414a-a236-759276df7cd8 service nova] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:15.945709 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ee9f1180-b7bf-4d5c-9a8e-38efb71f0589 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:15.946365 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-0eeac5a8-8076-4598-a4cf-b92e13838d4b req-53995f52-68fc-414a-a236-759276df7cd8 service nova] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:15.946919 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ee9f1180-b7bf-4d5c-9a8e-38efb71f0589 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:15.951826 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ee9f1180-b7bf-4d5c-9a8e-38efb71f0589 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:15.952557 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ee9f1180-b7bf-4d5c-9a8e-38efb71f0589 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:15.965747 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.compute.server_external_events [req-0eeac5a8-8076-4598-a4cf-b92e13838d4b req-53995f52-68fc-414a-a236-759276df7cd8 service nova] Creating event network-vif-plugged:bf2b4bfb-50d4-45f0-8273-ccfa08843494 for instance 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 on hv-cinder-83754 Jun 17 13:02:15.971530 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [req-0eeac5a8-8076-4598-a4cf-b92e13838d4b req-53995f52-68fc-414a-a236-759276df7cd8 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056820 Jun 17 13:02:15.973498 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 267/507] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 13:02:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:02:16.100084 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-ee9f1180-b7bf-4d5c-9a8e-38efb71f0589 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:02:16.108609 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-ee9f1180-b7bf-4d5c-9a8e-38efb71f0589 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1708 microversion: 2.1 time: 0.179667 Jun 17 13:02:16.109237 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 241/508] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:02:15 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1708 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:02:16.288364 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-c3e0442d-41c4-459f-ad2c-6bd77c0432e8 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:02:16.289137 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-c3e0442d-41c4-459f-ad2c-6bd77c0432e8 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:02:16.295762 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c3e0442d-41c4-459f-ad2c-6bd77c0432e8 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:16.296170 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c3e0442d-41c4-459f-ad2c-6bd77c0432e8 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:16.296926 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c3e0442d-41c4-459f-ad2c-6bd77c0432e8 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:16.297462 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c3e0442d-41c4-459f-ad2c-6bd77c0432e8 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:16.398193 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-e55cf577-97f3-46e1-8940-2612c363226d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:02:16.398987 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-e55cf577-97f3-46e1-8940-2612c363226d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:02:16.424297 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e55cf577-97f3-46e1-8940-2612c363226d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:16.424932 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e55cf577-97f3-46e1-8940-2612c363226d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:16.425794 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e55cf577-97f3-46e1-8940-2612c363226d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:16.426388 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e55cf577-97f3-46e1-8940-2612c363226d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:16.473105 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-c3e0442d-41c4-459f-ad2c-6bd77c0432e8 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:02:16.496399 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-c3e0442d-41c4-459f-ad2c-6bd77c0432e8 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1319 microversion: 2.1 time: 0.212137 Jun 17 13:02:16.509752 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 268/509] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:02:16 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1319 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:02:16.607067 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-e55cf577-97f3-46e1-8940-2612c363226d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:02:16.617935 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-e55cf577-97f3-46e1-8940-2612c363226d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:02:16.619591 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-e55cf577-97f3-46e1-8940-2612c363226d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:02:16.620817 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-e55cf577-97f3-46e1-8940-2612c363226d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1740 microversion: 2.20 time: 0.227517 Jun 17 13:02:16.621895 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 242/510] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:02:16 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1740 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:02:17.125257 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-08443bf0-d682-45db-9db3-278b125fb3f2 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:02:17.125954 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-08443bf0-d682-45db-9db3-278b125fb3f2 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:02:17.135355 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-08443bf0-d682-45db-9db3-278b125fb3f2 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:17.135930 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-08443bf0-d682-45db-9db3-278b125fb3f2 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:17.137031 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-08443bf0-d682-45db-9db3-278b125fb3f2 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:17.149950 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-08443bf0-d682-45db-9db3-278b125fb3f2 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:17.365759 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-08443bf0-d682-45db-9db3-278b125fb3f2 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:02:17.375641 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-08443bf0-d682-45db-9db3-278b125fb3f2 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1712 microversion: 2.1 time: 0.254425 Jun 17 13:02:17.376422 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 269/511] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:02:17 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1712 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:02:17.514488 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-cac06bbe-08fc-4266-a1e6-f5306d65c1b7 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:02:17.515123 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-cac06bbe-08fc-4266-a1e6-f5306d65c1b7 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:02:17.521988 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=3 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:02:17.523890 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-cac06bbe-08fc-4266-a1e6-f5306d65c1b7 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:17.524603 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-cac06bbe-08fc-4266-a1e6-f5306d65c1b7 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:17.525857 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-cac06bbe-08fc-4266-a1e6-f5306d65c1b7 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:17.526574 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-cac06bbe-08fc-4266-a1e6-f5306d65c1b7 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:17.642477 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-15dc340a-02cb-4a0b-bb77-2f4ebe429094 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:02:17.642907 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-15dc340a-02cb-4a0b-bb77-2f4ebe429094 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:02:17.652788 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-15dc340a-02cb-4a0b-bb77-2f4ebe429094 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:17.653217 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-15dc340a-02cb-4a0b-bb77-2f4ebe429094 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:17.657285 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-15dc340a-02cb-4a0b-bb77-2f4ebe429094 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:17.657868 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-15dc340a-02cb-4a0b-bb77-2f4ebe429094 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:17.705995 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-cac06bbe-08fc-4266-a1e6-f5306d65c1b7 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:02:17.716582 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-cac06bbe-08fc-4266-a1e6-f5306d65c1b7 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1319 microversion: 2.1 time: 0.206146 Jun 17 13:02:17.717952 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 243/512] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:02:17 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1319 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:02:17.897149 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-15dc340a-02cb-4a0b-bb77-2f4ebe429094 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:02:17.910411 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-15dc340a-02cb-4a0b-bb77-2f4ebe429094 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:02:17.912216 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-15dc340a-02cb-4a0b-bb77-2f4ebe429094 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:02:17.914674 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-15dc340a-02cb-4a0b-bb77-2f4ebe429094 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1740 microversion: 2.20 time: 0.277543 Jun 17 13:02:17.926513 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 270/513] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:02:17 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1740 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 13:02:18.071657 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [req-f132ba30-9256-47a9-bc65-6779568fbcd1 req-4b9251af-3736-4149-bec7-4a600763fa58 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a408151-81c8-4490-9190-5e4fa2d98e8a", "tag": "78029a46-f1c7-4b92-ba08-7045080d5b08"}]} {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:02:18.087489 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [req-f132ba30-9256-47a9-bc65-6779568fbcd1 req-4b9251af-3736-4149-bec7-4a600763fa58 service nova] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:18.088148 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [req-f132ba30-9256-47a9-bc65-6779568fbcd1 req-4b9251af-3736-4149-bec7-4a600763fa58 service nova] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:18.106189 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.compute.server_external_events [req-f132ba30-9256-47a9-bc65-6779568fbcd1 req-4b9251af-3736-4149-bec7-4a600763fa58 service nova] Creating event network-changed:78029a46-f1c7-4b92-ba08-7045080d5b08 for instance 8a408151-81c8-4490-9190-5e4fa2d98e8a on hv-cinder-83754 Jun 17 13:02:18.119126 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [req-f132ba30-9256-47a9-bc65-6779568fbcd1 req-4b9251af-3736-4149-bec7-4a600763fa58 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052288 Jun 17 13:02:18.120539 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 244/514] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 13:02:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:02:18.738855 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-33a4e308-1e07-4205-8a94-5afb80b9b834 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:02:18.739659 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-33a4e308-1e07-4205-8a94-5afb80b9b834 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:02:18.752136 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-33a4e308-1e07-4205-8a94-5afb80b9b834 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:18.754265 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-33a4e308-1e07-4205-8a94-5afb80b9b834 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:18.756747 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-33a4e308-1e07-4205-8a94-5afb80b9b834 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:18.757775 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-33a4e308-1e07-4205-8a94-5afb80b9b834 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:18.935098 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-c25996df-d886-4e48-8709-e4461169126c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:02:18.936484 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-c25996df-d886-4e48-8709-e4461169126c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:02:18.943196 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c25996df-d886-4e48-8709-e4461169126c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:18.943985 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c25996df-d886-4e48-8709-e4461169126c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:18.945556 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c25996df-d886-4e48-8709-e4461169126c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:18.946229 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c25996df-d886-4e48-8709-e4461169126c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:19.328675 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-33a4e308-1e07-4205-8a94-5afb80b9b834 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:02:19.343628 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-33a4e308-1e07-4205-8a94-5afb80b9b834 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1319 microversion: 2.1 time: 0.610775 Jun 17 13:02:19.349852 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 271/515] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:02:18 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1319 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:02:19.382881 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-c25996df-d886-4e48-8709-e4461169126c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:02:19.404833 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-c25996df-d886-4e48-8709-e4461169126c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:02:19.415339 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-c25996df-d886-4e48-8709-e4461169126c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:02:19.416950 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-c25996df-d886-4e48-8709-e4461169126c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1740 microversion: 2.20 time: 0.486686 Jun 17 13:02:19.417529 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 245/516] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:02:18 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1740 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:02:19.855130 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-32b5fb6d-2b01-465e-9eab-f6e960ec1f3b tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-918340478"}} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:02:19.856343 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-32b5fb6d-2b01-465e-9eab-f6e960ec1f3b tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:02:19.874908 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-32b5fb6d-2b01-465e-9eab-f6e960ec1f3b tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:19.875352 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-32b5fb6d-2b01-465e-9eab-f6e960ec1f3b tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:19.876395 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-32b5fb6d-2b01-465e-9eab-f6e960ec1f3b tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:19.876819 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-32b5fb6d-2b01-465e-9eab-f6e960ec1f3b tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:20.129692 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.network.security_group_api [None req-32b5fb6d-2b01-465e-9eab-f6e960ec1f3b tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Adding security group 1605cae9-9619-43de-8eb3-959972c2e68c to port 78029a46-f1c7-4b92-ba08-7045080d5b08 Jun 17 13:02:20.368071 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-d7eb3f6f-cf8d-49ff-a43f-867cebb0b099 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:02:20.369583 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-d7eb3f6f-cf8d-49ff-a43f-867cebb0b099 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:02:20.378332 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d7eb3f6f-cf8d-49ff-a43f-867cebb0b099 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:20.379204 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d7eb3f6f-cf8d-49ff-a43f-867cebb0b099 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:20.380217 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d7eb3f6f-cf8d-49ff-a43f-867cebb0b099 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:20.380917 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d7eb3f6f-cf8d-49ff-a43f-867cebb0b099 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:20.833818 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-d7eb3f6f-cf8d-49ff-a43f-867cebb0b099 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:02:20.844130 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-d7eb3f6f-cf8d-49ff-a43f-867cebb0b099 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1508 microversion: 2.1 time: 0.480731 Jun 17 13:02:20.856766 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 246/517] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:02:20 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1508 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:02:21.004187 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-790e3e4f-888b-4af0-aabc-4ff107861d81 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:02:21.004875 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-790e3e4f-888b-4af0-aabc-4ff107861d81 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:02:21.011925 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-790e3e4f-888b-4af0-aabc-4ff107861d81 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:21.012454 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-790e3e4f-888b-4af0-aabc-4ff107861d81 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:21.013294 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-790e3e4f-888b-4af0-aabc-4ff107861d81 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:21.013797 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-790e3e4f-888b-4af0-aabc-4ff107861d81 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:21.227325 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-32b5fb6d-2b01-465e-9eab-f6e960ec1f3b tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "POST /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a/action" status: 202 len: 0 microversion: 2.1 time: 1.376390 Jun 17 13:02:21.228820 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 272/518] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Jun 17 13:02:19 2022] POST /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a/action => generated 0 bytes in 1379 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 13:02:21.238831 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [req-3fee4559-ffcf-42be-a9d2-22008dfa4087 req-9df59c35-5467-4f0b-b670-5469056fbe4a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a408151-81c8-4490-9190-5e4fa2d98e8a", "tag": "78029a46-f1c7-4b92-ba08-7045080d5b08"}]} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:02:21.255072 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-3fee4559-ffcf-42be-a9d2-22008dfa4087 req-9df59c35-5467-4f0b-b670-5469056fbe4a service nova] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:21.258491 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-3fee4559-ffcf-42be-a9d2-22008dfa4087 req-9df59c35-5467-4f0b-b670-5469056fbe4a service nova] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:21.291081 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.compute.server_external_events [req-3fee4559-ffcf-42be-a9d2-22008dfa4087 req-9df59c35-5467-4f0b-b670-5469056fbe4a service nova] Creating event network-changed:78029a46-f1c7-4b92-ba08-7045080d5b08 for instance 8a408151-81c8-4490-9190-5e4fa2d98e8a on hv-cinder-83754 Jun 17 13:02:21.294173 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-790e3e4f-888b-4af0-aabc-4ff107861d81 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:02:21.304222 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-790e3e4f-888b-4af0-aabc-4ff107861d81 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:02:21.311089 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-790e3e4f-888b-4af0-aabc-4ff107861d81 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:02:21.315966 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [req-3fee4559-ffcf-42be-a9d2-22008dfa4087 req-9df59c35-5467-4f0b-b670-5469056fbe4a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080627 Jun 17 13:02:21.316319 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 273/519] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 13:02:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 13:02:21.320944 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-790e3e4f-888b-4af0-aabc-4ff107861d81 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1740 microversion: 2.20 time: 0.463045 Jun 17 13:02:21.321694 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 247/520] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:02:20 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1740 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:02:21.325564 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-63cb8681-822e-4b26-85de-84c950d1f117 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:02:21.326551 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-63cb8681-822e-4b26-85de-84c950d1f117 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:02:21.343357 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-63cb8681-822e-4b26-85de-84c950d1f117 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:21.345535 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-63cb8681-822e-4b26-85de-84c950d1f117 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:21.349666 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-63cb8681-822e-4b26-85de-84c950d1f117 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:21.350519 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-63cb8681-822e-4b26-85de-84c950d1f117 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:21.791284 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-63cb8681-822e-4b26-85de-84c950d1f117 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:02:21.806597 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-63cb8681-822e-4b26-85de-84c950d1f117 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1761 microversion: 2.1 time: 0.488780 Jun 17 13:02:21.819251 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 274/521] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:02:21 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1761 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:02:22.341188 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-f4491d97-c837-4ba1-897a-288fec7fc1d8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:02:22.342579 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-f4491d97-c837-4ba1-897a-288fec7fc1d8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:02:22.368671 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f4491d97-c837-4ba1-897a-288fec7fc1d8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:22.370381 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f4491d97-c837-4ba1-897a-288fec7fc1d8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:22.371237 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f4491d97-c837-4ba1-897a-288fec7fc1d8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:22.371746 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f4491d97-c837-4ba1-897a-288fec7fc1d8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:22.565653 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-f4491d97-c837-4ba1-897a-288fec7fc1d8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:02:22.578592 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-f4491d97-c837-4ba1-897a-288fec7fc1d8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:02:22.580077 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-f4491d97-c837-4ba1-897a-288fec7fc1d8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:02:22.581243 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-f4491d97-c837-4ba1-897a-288fec7fc1d8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1740 microversion: 2.20 time: 0.245176 Jun 17 13:02:22.582131 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 248/522] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:02:22 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1740 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 13:02:23.605919 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-34381b64-f017-45a9-85f3-4a70122341d5 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:02:23.608422 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-34381b64-f017-45a9-85f3-4a70122341d5 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:02:23.616277 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-34381b64-f017-45a9-85f3-4a70122341d5 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:23.617151 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-34381b64-f017-45a9-85f3-4a70122341d5 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:23.618044 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-34381b64-f017-45a9-85f3-4a70122341d5 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:23.618698 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-34381b64-f017-45a9-85f3-4a70122341d5 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:23.623667 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:02:23.774194 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-34381b64-f017-45a9-85f3-4a70122341d5 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:02:23.783225 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-34381b64-f017-45a9-85f3-4a70122341d5 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:02:23.786533 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-34381b64-f017-45a9-85f3-4a70122341d5 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:02:23.788848 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-34381b64-f017-45a9-85f3-4a70122341d5 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1740 microversion: 2.20 time: 0.191835 Jun 17 13:02:23.798148 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 275/523] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:02:23 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1740 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:02:24.807780 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-0d453ac0-d739-4895-b496-88fb35826e71 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:02:24.808441 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-0d453ac0-d739-4895-b496-88fb35826e71 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:02:24.828225 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0d453ac0-d739-4895-b496-88fb35826e71 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:24.828669 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0d453ac0-d739-4895-b496-88fb35826e71 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:24.829518 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0d453ac0-d739-4895-b496-88fb35826e71 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:24.830003 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0d453ac0-d739-4895-b496-88fb35826e71 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:25.020833 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-0d453ac0-d739-4895-b496-88fb35826e71 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:02:25.031465 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-0d453ac0-d739-4895-b496-88fb35826e71 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:02:25.033754 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-0d453ac0-d739-4895-b496-88fb35826e71 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:02:25.035908 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-0d453ac0-d739-4895-b496-88fb35826e71 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1740 microversion: 2.20 time: 0.232323 Jun 17 13:02:25.036663 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 249/524] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:02:24 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1740 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:02:26.058517 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-3022323e-2f54-4d49-8990-e082ce07055d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:02:26.059154 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-3022323e-2f54-4d49-8990-e082ce07055d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:02:26.062386 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_api:SELECT=76 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:02:26.066050 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3022323e-2f54-4d49-8990-e082ce07055d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:26.066713 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3022323e-2f54-4d49-8990-e082ce07055d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:26.067493 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3022323e-2f54-4d49-8990-e082ce07055d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:26.067923 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3022323e-2f54-4d49-8990-e082ce07055d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:26.220495 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-3022323e-2f54-4d49-8990-e082ce07055d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:02:26.229381 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-3022323e-2f54-4d49-8990-e082ce07055d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:02:26.230915 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-3022323e-2f54-4d49-8990-e082ce07055d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:02:26.232082 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-3022323e-2f54-4d49-8990-e082ce07055d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1740 microversion: 2.20 time: 0.177678 Jun 17 13:02:26.232720 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 276/525] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:02:26 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1740 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:02:27.265453 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-28f113b4-df30-4ab0-b7f8-e25a4e134c51 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:02:27.266272 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-28f113b4-df30-4ab0-b7f8-e25a4e134c51 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:02:27.273586 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-28f113b4-df30-4ab0-b7f8-e25a4e134c51 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:27.274053 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-28f113b4-df30-4ab0-b7f8-e25a4e134c51 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:27.274944 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-28f113b4-df30-4ab0-b7f8-e25a4e134c51 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:27.275287 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-28f113b4-df30-4ab0-b7f8-e25a4e134c51 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:27.419338 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-28f113b4-df30-4ab0-b7f8-e25a4e134c51 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:02:27.429277 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-28f113b4-df30-4ab0-b7f8-e25a4e134c51 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:02:27.431018 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-28f113b4-df30-4ab0-b7f8-e25a4e134c51 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:02:27.432193 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-28f113b4-df30-4ab0-b7f8-e25a4e134c51 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1740 microversion: 2.20 time: 0.170915 Jun 17 13:02:27.432930 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 250/526] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:02:27 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1740 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:02:28.451547 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-62f96041-d01d-4ae9-ad8f-37639ec299a1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:02:28.452158 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-62f96041-d01d-4ae9-ad8f-37639ec299a1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:02:28.459038 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-62f96041-d01d-4ae9-ad8f-37639ec299a1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:28.460064 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-62f96041-d01d-4ae9-ad8f-37639ec299a1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:28.461117 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-62f96041-d01d-4ae9-ad8f-37639ec299a1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:28.461641 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-62f96041-d01d-4ae9-ad8f-37639ec299a1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:28.659354 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-62f96041-d01d-4ae9-ad8f-37639ec299a1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:02:28.669865 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-62f96041-d01d-4ae9-ad8f-37639ec299a1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:02:28.671566 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-62f96041-d01d-4ae9-ad8f-37639ec299a1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:02:28.672789 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-62f96041-d01d-4ae9-ad8f-37639ec299a1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1740 microversion: 2.20 time: 0.225386 Jun 17 13:02:28.685163 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 277/527] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:02:28 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1740 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:02:29.699158 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-205eb1d2-5808-4652-82f6-621ccee6ac38 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:02:29.700832 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-205eb1d2-5808-4652-82f6-621ccee6ac38 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:02:29.709057 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-205eb1d2-5808-4652-82f6-621ccee6ac38 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:29.709837 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-205eb1d2-5808-4652-82f6-621ccee6ac38 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:29.710686 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-205eb1d2-5808-4652-82f6-621ccee6ac38 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:29.711118 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-205eb1d2-5808-4652-82f6-621ccee6ac38 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:29.849105 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-205eb1d2-5808-4652-82f6-621ccee6ac38 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:02:29.858812 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-205eb1d2-5808-4652-82f6-621ccee6ac38 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:02:29.860307 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-205eb1d2-5808-4652-82f6-621ccee6ac38 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:02:29.861469 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-205eb1d2-5808-4652-82f6-621ccee6ac38 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1740 microversion: 2.20 time: 0.166962 Jun 17 13:02:29.862020 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 251/528] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:02:29 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1740 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:02:30.883236 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-3ebded7d-3d19-4ea4-a0a0-30f10963f005 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:02:30.883842 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-3ebded7d-3d19-4ea4-a0a0-30f10963f005 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:02:30.891365 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3ebded7d-3d19-4ea4-a0a0-30f10963f005 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:30.891805 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3ebded7d-3d19-4ea4-a0a0-30f10963f005 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:30.892551 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3ebded7d-3d19-4ea4-a0a0-30f10963f005 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:30.892972 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3ebded7d-3d19-4ea4-a0a0-30f10963f005 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:31.040157 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-3ebded7d-3d19-4ea4-a0a0-30f10963f005 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:02:31.049171 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-3ebded7d-3d19-4ea4-a0a0-30f10963f005 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:02:31.050724 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-3ebded7d-3d19-4ea4-a0a0-30f10963f005 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:02:31.051912 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-3ebded7d-3d19-4ea4-a0a0-30f10963f005 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1722 microversion: 2.20 time: 0.174834 Jun 17 13:02:31.052479 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 278/529] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:02:30 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1722 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:02:32.071893 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-56d139fd-fb10-4df9-b5c5-7787a06c9417 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:02:32.072556 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-56d139fd-fb10-4df9-b5c5-7787a06c9417 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:02:32.079960 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-56d139fd-fb10-4df9-b5c5-7787a06c9417 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:32.080409 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-56d139fd-fb10-4df9-b5c5-7787a06c9417 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:32.081154 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-56d139fd-fb10-4df9-b5c5-7787a06c9417 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:32.081585 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-56d139fd-fb10-4df9-b5c5-7787a06c9417 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:32.224893 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-56d139fd-fb10-4df9-b5c5-7787a06c9417 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:02:32.234512 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-56d139fd-fb10-4df9-b5c5-7787a06c9417 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:02:32.236044 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-56d139fd-fb10-4df9-b5c5-7787a06c9417 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:02:32.237277 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-56d139fd-fb10-4df9-b5c5-7787a06c9417 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1722 microversion: 2.20 time: 0.169443 Jun 17 13:02:32.237805 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 252/530] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:02:32 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:02:33.256994 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-9366afeb-2d56-4693-a810-7d35c188783d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:02:33.257669 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-9366afeb-2d56-4693-a810-7d35c188783d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:02:33.263999 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9366afeb-2d56-4693-a810-7d35c188783d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:33.264469 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9366afeb-2d56-4693-a810-7d35c188783d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:33.265227 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9366afeb-2d56-4693-a810-7d35c188783d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:33.265652 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9366afeb-2d56-4693-a810-7d35c188783d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:33.410687 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-9366afeb-2d56-4693-a810-7d35c188783d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:02:33.419061 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-9366afeb-2d56-4693-a810-7d35c188783d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:02:33.420563 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-9366afeb-2d56-4693-a810-7d35c188783d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:02:33.421727 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-9366afeb-2d56-4693-a810-7d35c188783d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1725 microversion: 2.20 time: 0.169227 Jun 17 13:02:33.422337 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 279/531] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:02:33 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1725 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:02:33.449558 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-39b204d1-a474-4ce0-a2ea-671c0fd2b253 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dc0d8f94-669d-473e-b967-103b03ff07d8"}} {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:02:33.452283 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-39b204d1-a474-4ce0-a2ea-671c0fd2b253 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:02:33.460980 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-39b204d1-a474-4ce0-a2ea-671c0fd2b253 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:33.461448 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-39b204d1-a474-4ce0-a2ea-671c0fd2b253 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:33.462259 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-39b204d1-a474-4ce0-a2ea-671c0fd2b253 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:33.462694 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-39b204d1-a474-4ce0-a2ea-671c0fd2b253 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:33.770324 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:02:33.785064 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-39b204d1-a474-4ce0-a2ea-671c0fd2b253 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "POST /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.347880 Jun 17 13:02:33.790403 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 253/532] 10.222.0.48 () {62 vars in 1363 bytes} [Fri Jun 17 13:02:33 2022] POST /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 188 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:02:33.911508 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-be9ac29b-b957-41f6-b120-0fd612457da0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:02:33.912199 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-be9ac29b-b957-41f6-b120-0fd612457da0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:02:33.918646 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-be9ac29b-b957-41f6-b120-0fd612457da0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:33.919092 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-be9ac29b-b957-41f6-b120-0fd612457da0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:33.919843 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-be9ac29b-b957-41f6-b120-0fd612457da0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:33.920267 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-be9ac29b-b957-41f6-b120-0fd612457da0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:33.966767 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [req-3f1641e3-9962-4b9c-abe5-8741d855c91b req-88f14f46-4157-42d0-9420-5a5b3f83a9c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8fdea98-917f-4c4d-aaba-d4f5df4622d6", "name": "network-vif-unplugged", "status": "completed", "tag": "936c48d1-9e45-4b7e-9fa7-86ea87893b56"}]} {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:02:33.978190 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [req-3f1641e3-9962-4b9c-abe5-8741d855c91b req-88f14f46-4157-42d0-9420-5a5b3f83a9c7 service nova] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:33.979046 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [req-3f1641e3-9962-4b9c-abe5-8741d855c91b req-88f14f46-4157-42d0-9420-5a5b3f83a9c7 service nova] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:33.991520 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.compute.server_external_events [req-3f1641e3-9962-4b9c-abe5-8741d855c91b req-88f14f46-4157-42d0-9420-5a5b3f83a9c7 service nova] Unable to find a host for instance c8fdea98-917f-4c4d-aaba-d4f5df4622d6. Dropping event network-vif-unplugged {{(pid=117659) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 17 13:02:33.992655 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [req-3f1641e3-9962-4b9c-abe5-8741d855c91b req-88f14f46-4157-42d0-9420-5a5b3f83a9c7 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.030560 Jun 17 13:02:33.993545 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 254/533] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 13:02:33 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 33 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jun 17 13:02:34.077475 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-be9ac29b-b957-41f6-b120-0fd612457da0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "POST /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/action" status: 202 len: 0 microversion: 2.20 time: 0.170142 Jun 17 13:02:34.078118 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 280/534] 10.222.0.48 () {62 vars in 1318 bytes} [Fri Jun 17 13:02:33 2022] POST /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/action => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 17 13:02:34.088312 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-01ff3afa-fe01-4a04-aad5-3b426f959aad tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:02:34.089264 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-01ff3afa-fe01-4a04-aad5-3b426f959aad tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:02:34.096928 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-01ff3afa-fe01-4a04-aad5-3b426f959aad tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:34.097382 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-01ff3afa-fe01-4a04-aad5-3b426f959aad tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:34.098207 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-01ff3afa-fe01-4a04-aad5-3b426f959aad tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:34.098646 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-01ff3afa-fe01-4a04-aad5-3b426f959aad tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:34.246589 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-01ff3afa-fe01-4a04-aad5-3b426f959aad tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:02:34.256198 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-01ff3afa-fe01-4a04-aad5-3b426f959aad tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:02:34.257801 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-01ff3afa-fe01-4a04-aad5-3b426f959aad tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:02:34.259011 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-01ff3afa-fe01-4a04-aad5-3b426f959aad tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1751 microversion: 2.20 time: 0.174639 Jun 17 13:02:34.259773 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 255/535] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:02:34 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1751 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:02:35.278618 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-e165db1a-c688-4dce-bdf3-9cbc0d600da5 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:02:35.279230 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-e165db1a-c688-4dce-bdf3-9cbc0d600da5 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:02:35.286129 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e165db1a-c688-4dce-bdf3-9cbc0d600da5 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:35.286686 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e165db1a-c688-4dce-bdf3-9cbc0d600da5 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:35.287469 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e165db1a-c688-4dce-bdf3-9cbc0d600da5 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:35.287896 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e165db1a-c688-4dce-bdf3-9cbc0d600da5 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:35.437992 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-e165db1a-c688-4dce-bdf3-9cbc0d600da5 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:02:35.447717 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-e165db1a-c688-4dce-bdf3-9cbc0d600da5 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:02:35.449320 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-e165db1a-c688-4dce-bdf3-9cbc0d600da5 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:02:35.450508 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-e165db1a-c688-4dce-bdf3-9cbc0d600da5 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1751 microversion: 2.20 time: 0.176029 Jun 17 13:02:35.451438 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 281/536] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:02:35 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1751 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:02:36.468853 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-d1abd8ec-dde0-484e-98aa-7ff65c68afe4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:02:36.469490 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-d1abd8ec-dde0-484e-98aa-7ff65c68afe4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:02:36.479900 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d1abd8ec-dde0-484e-98aa-7ff65c68afe4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:36.481033 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d1abd8ec-dde0-484e-98aa-7ff65c68afe4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:36.482418 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d1abd8ec-dde0-484e-98aa-7ff65c68afe4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:36.483291 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d1abd8ec-dde0-484e-98aa-7ff65c68afe4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:36.627726 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-d1abd8ec-dde0-484e-98aa-7ff65c68afe4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:02:36.636766 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-d1abd8ec-dde0-484e-98aa-7ff65c68afe4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:02:36.638285 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-d1abd8ec-dde0-484e-98aa-7ff65c68afe4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:02:36.639469 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-d1abd8ec-dde0-484e-98aa-7ff65c68afe4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1753 microversion: 2.20 time: 0.174544 Jun 17 13:02:36.640054 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 256/537] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:02:36 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1753 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:02:37.658673 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-294af5bc-4a51-4cff-ad19-bef44b6af7bb tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:02:37.659697 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-294af5bc-4a51-4cff-ad19-bef44b6af7bb tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:02:37.667106 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-294af5bc-4a51-4cff-ad19-bef44b6af7bb tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:37.667514 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-294af5bc-4a51-4cff-ad19-bef44b6af7bb tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:37.668303 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-294af5bc-4a51-4cff-ad19-bef44b6af7bb tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:37.668720 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-294af5bc-4a51-4cff-ad19-bef44b6af7bb tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:37.897768 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-294af5bc-4a51-4cff-ad19-bef44b6af7bb tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:02:37.916043 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-294af5bc-4a51-4cff-ad19-bef44b6af7bb tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:02:37.918061 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-294af5bc-4a51-4cff-ad19-bef44b6af7bb tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:02:37.919289 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-294af5bc-4a51-4cff-ad19-bef44b6af7bb tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1809 microversion: 2.20 time: 0.264901 Jun 17 13:02:37.922914 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 282/538] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:02:37 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1809 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:02:38.942936 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-8bf91f82-6cee-40f1-ad47-a1b67dc598a6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:02:38.943600 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-8bf91f82-6cee-40f1-ad47-a1b67dc598a6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:02:38.950267 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8bf91f82-6cee-40f1-ad47-a1b67dc598a6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:38.950708 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8bf91f82-6cee-40f1-ad47-a1b67dc598a6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:38.951499 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8bf91f82-6cee-40f1-ad47-a1b67dc598a6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:38.952114 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8bf91f82-6cee-40f1-ad47-a1b67dc598a6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:39.104739 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-8bf91f82-6cee-40f1-ad47-a1b67dc598a6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:02:39.113530 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-8bf91f82-6cee-40f1-ad47-a1b67dc598a6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:02:39.115875 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-8bf91f82-6cee-40f1-ad47-a1b67dc598a6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:02:39.117072 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-8bf91f82-6cee-40f1-ad47-a1b67dc598a6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1809 microversion: 2.20 time: 0.179862 Jun 17 13:02:39.117839 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 257/539] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:02:38 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1809 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:02:40.138551 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-58298004-6a1a-47bc-88ac-012c4900c23c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:02:40.139393 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-58298004-6a1a-47bc-88ac-012c4900c23c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:02:40.148410 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-58298004-6a1a-47bc-88ac-012c4900c23c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:40.148878 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-58298004-6a1a-47bc-88ac-012c4900c23c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:40.149668 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-58298004-6a1a-47bc-88ac-012c4900c23c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:40.150119 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-58298004-6a1a-47bc-88ac-012c4900c23c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:40.294280 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-58298004-6a1a-47bc-88ac-012c4900c23c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:02:40.311545 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-58298004-6a1a-47bc-88ac-012c4900c23c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:02:40.313042 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-58298004-6a1a-47bc-88ac-012c4900c23c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:02:40.314259 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-58298004-6a1a-47bc-88ac-012c4900c23c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1809 microversion: 2.20 time: 0.181686 Jun 17 13:02:40.314822 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 283/540] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:02:40 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1809 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:02:41.333035 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-c9297036-1846-4b57-a465-2a4e1bd42e7e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:02:41.333860 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-c9297036-1846-4b57-a465-2a4e1bd42e7e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:02:41.340724 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c9297036-1846-4b57-a465-2a4e1bd42e7e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:41.341173 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c9297036-1846-4b57-a465-2a4e1bd42e7e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:41.341924 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c9297036-1846-4b57-a465-2a4e1bd42e7e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:41.342428 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c9297036-1846-4b57-a465-2a4e1bd42e7e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:41.493038 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-c9297036-1846-4b57-a465-2a4e1bd42e7e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:02:41.502486 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-c9297036-1846-4b57-a465-2a4e1bd42e7e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:02:41.504345 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-c9297036-1846-4b57-a465-2a4e1bd42e7e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:02:41.505705 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-c9297036-1846-4b57-a465-2a4e1bd42e7e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1809 microversion: 2.20 time: 0.176612 Jun 17 13:02:41.506692 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 258/541] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:02:41 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1809 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:02:42.524972 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-40f30547-509d-40c5-9cd3-7030b6e7aade tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:02:42.525557 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-40f30547-509d-40c5-9cd3-7030b6e7aade tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:02:42.532010 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-40f30547-509d-40c5-9cd3-7030b6e7aade tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:42.532444 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-40f30547-509d-40c5-9cd3-7030b6e7aade tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:42.533240 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-40f30547-509d-40c5-9cd3-7030b6e7aade tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:42.535076 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-40f30547-509d-40c5-9cd3-7030b6e7aade tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:42.682016 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-40f30547-509d-40c5-9cd3-7030b6e7aade tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:02:42.691449 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-40f30547-509d-40c5-9cd3-7030b6e7aade tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:02:42.693180 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-40f30547-509d-40c5-9cd3-7030b6e7aade tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:02:42.694397 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-40f30547-509d-40c5-9cd3-7030b6e7aade tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1809 microversion: 2.20 time: 0.173537 Jun 17 13:02:42.694988 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 284/542] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:02:42 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1809 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:02:43.714330 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-c4285284-7871-4227-9788-442e3ba077c7 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:02:43.715061 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-c4285284-7871-4227-9788-442e3ba077c7 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:02:43.722385 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c4285284-7871-4227-9788-442e3ba077c7 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:43.722827 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c4285284-7871-4227-9788-442e3ba077c7 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:43.723747 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c4285284-7871-4227-9788-442e3ba077c7 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:43.724175 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c4285284-7871-4227-9788-442e3ba077c7 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:43.863444 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-c4285284-7871-4227-9788-442e3ba077c7 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:02:43.873112 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-c4285284-7871-4227-9788-442e3ba077c7 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:02:43.874659 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-c4285284-7871-4227-9788-442e3ba077c7 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:02:43.875824 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-c4285284-7871-4227-9788-442e3ba077c7 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1809 microversion: 2.20 time: 0.166345 Jun 17 13:02:43.876389 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 259/543] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:02:43 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1809 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:02:44.895138 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-3781d818-775f-4d4c-80b7-18992a7be05e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:02:44.895798 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-3781d818-775f-4d4c-80b7-18992a7be05e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:02:44.902566 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3781d818-775f-4d4c-80b7-18992a7be05e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:44.903008 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3781d818-775f-4d4c-80b7-18992a7be05e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:44.903784 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3781d818-775f-4d4c-80b7-18992a7be05e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:44.904209 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3781d818-775f-4d4c-80b7-18992a7be05e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:45.071249 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-3781d818-775f-4d4c-80b7-18992a7be05e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:02:45.080126 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-3781d818-775f-4d4c-80b7-18992a7be05e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:02:45.081635 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-3781d818-775f-4d4c-80b7-18992a7be05e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:02:45.083044 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-3781d818-775f-4d4c-80b7-18992a7be05e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1809 microversion: 2.20 time: 0.191920 Jun 17 13:02:45.083774 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 285/544] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:02:44 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1809 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:02:46.104415 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-1246a21e-aed7-4dfb-92cb-78a6527ecb9a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:02:46.105087 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-1246a21e-aed7-4dfb-92cb-78a6527ecb9a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:02:46.112637 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-1246a21e-aed7-4dfb-92cb-78a6527ecb9a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:46.113122 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-1246a21e-aed7-4dfb-92cb-78a6527ecb9a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:46.113935 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-1246a21e-aed7-4dfb-92cb-78a6527ecb9a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:46.114410 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-1246a21e-aed7-4dfb-92cb-78a6527ecb9a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:46.265453 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-1246a21e-aed7-4dfb-92cb-78a6527ecb9a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:02:46.274273 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-1246a21e-aed7-4dfb-92cb-78a6527ecb9a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:02:46.275784 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-1246a21e-aed7-4dfb-92cb-78a6527ecb9a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:02:46.276944 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-1246a21e-aed7-4dfb-92cb-78a6527ecb9a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1809 microversion: 2.20 time: 0.177634 Jun 17 13:02:46.277507 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 260/545] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:02:46 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1809 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:02:47.296835 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-8cb1f355-a3cd-4af3-8475-520827db0c2a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:02:47.297581 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-8cb1f355-a3cd-4af3-8475-520827db0c2a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:02:47.307729 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8cb1f355-a3cd-4af3-8475-520827db0c2a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:47.308589 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8cb1f355-a3cd-4af3-8475-520827db0c2a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:47.310264 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8cb1f355-a3cd-4af3-8475-520827db0c2a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:47.311240 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8cb1f355-a3cd-4af3-8475-520827db0c2a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:47.461314 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-8cb1f355-a3cd-4af3-8475-520827db0c2a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:02:47.471399 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-8cb1f355-a3cd-4af3-8475-520827db0c2a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:02:47.472709 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-8cb1f355-a3cd-4af3-8475-520827db0c2a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:02:47.473917 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-8cb1f355-a3cd-4af3-8475-520827db0c2a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1809 microversion: 2.20 time: 0.181541 Jun 17 13:02:47.474521 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 286/546] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:02:47 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1809 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:02:48.494066 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-0ab7625e-e39e-4250-8497-f508ca14d7b5 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:02:48.494755 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-0ab7625e-e39e-4250-8497-f508ca14d7b5 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:02:48.497258 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_api:SELECT=36 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:02:48.504669 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0ab7625e-e39e-4250-8497-f508ca14d7b5 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:48.505140 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0ab7625e-e39e-4250-8497-f508ca14d7b5 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:48.506171 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0ab7625e-e39e-4250-8497-f508ca14d7b5 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:48.506609 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0ab7625e-e39e-4250-8497-f508ca14d7b5 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:48.655405 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-0ab7625e-e39e-4250-8497-f508ca14d7b5 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:02:48.669293 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-0ab7625e-e39e-4250-8497-f508ca14d7b5 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:02:48.671444 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-0ab7625e-e39e-4250-8497-f508ca14d7b5 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:02:48.672872 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-0ab7625e-e39e-4250-8497-f508ca14d7b5 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1809 microversion: 2.20 time: 0.182894 Jun 17 13:02:48.673539 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 261/547] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:02:48 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1809 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:02:49.237803 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-5215e3aa-e629-437b-8d34-180fa9b49481 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "10a44f8a-7ada-45e4-9859-29dfb17185e5", "device": "/dev/sdb"}} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:02:49.239505 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-5215e3aa-e629-437b-8d34-180fa9b49481 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:02:49.248950 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5215e3aa-e629-437b-8d34-180fa9b49481 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:49.249699 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5215e3aa-e629-437b-8d34-180fa9b49481 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:49.251106 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5215e3aa-e629-437b-8d34-180fa9b49481 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:49.251832 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5215e3aa-e629-437b-8d34-180fa9b49481 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:49.693765 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-97f4efa3-4948-41a4-9c59-0b395179d09f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:02:49.694414 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-97f4efa3-4948-41a4-9c59-0b395179d09f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:02:49.702120 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-97f4efa3-4948-41a4-9c59-0b395179d09f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:49.702571 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-97f4efa3-4948-41a4-9c59-0b395179d09f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:49.703385 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-97f4efa3-4948-41a4-9c59-0b395179d09f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:49.703823 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-97f4efa3-4948-41a4-9c59-0b395179d09f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:49.855538 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-97f4efa3-4948-41a4-9c59-0b395179d09f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:02:49.865377 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-97f4efa3-4948-41a4-9c59-0b395179d09f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:02:49.866900 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-97f4efa3-4948-41a4-9c59-0b395179d09f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:02:49.868070 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-97f4efa3-4948-41a4-9c59-0b395179d09f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1809 microversion: 2.20 time: 0.178897 Jun 17 13:02:49.868623 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 262/548] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:02:49 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1809 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:02:50.889130 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-0e48ef8e-f5cb-4a48-af4b-7e0db124a293 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:02:50.889861 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-0e48ef8e-f5cb-4a48-af4b-7e0db124a293 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:02:50.896813 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0e48ef8e-f5cb-4a48-af4b-7e0db124a293 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:50.897283 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0e48ef8e-f5cb-4a48-af4b-7e0db124a293 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:50.898173 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0e48ef8e-f5cb-4a48-af4b-7e0db124a293 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:50.898670 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0e48ef8e-f5cb-4a48-af4b-7e0db124a293 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:51.059299 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-0e48ef8e-f5cb-4a48-af4b-7e0db124a293 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:02:51.069126 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-0e48ef8e-f5cb-4a48-af4b-7e0db124a293 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:02:51.070667 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-0e48ef8e-f5cb-4a48-af4b-7e0db124a293 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:02:51.071849 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-0e48ef8e-f5cb-4a48-af4b-7e0db124a293 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1809 microversion: 2.20 time: 0.187350 Jun 17 13:02:51.072433 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 263/549] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:02:50 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1809 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:02:52.092417 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-9da5f6ff-b615-445a-8a98-2c158da2b11a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:02:52.093124 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-9da5f6ff-b615-445a-8a98-2c158da2b11a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:02:52.100127 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9da5f6ff-b615-445a-8a98-2c158da2b11a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:52.100588 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9da5f6ff-b615-445a-8a98-2c158da2b11a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:52.101385 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9da5f6ff-b615-445a-8a98-2c158da2b11a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:52.101826 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9da5f6ff-b615-445a-8a98-2c158da2b11a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:52.249608 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-9da5f6ff-b615-445a-8a98-2c158da2b11a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:02:52.259265 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-9da5f6ff-b615-445a-8a98-2c158da2b11a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:02:52.260759 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-9da5f6ff-b615-445a-8a98-2c158da2b11a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:02:52.261930 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-9da5f6ff-b615-445a-8a98-2c158da2b11a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1809 microversion: 2.20 time: 0.174690 Jun 17 13:02:52.262630 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 264/550] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:02:52 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1809 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 13:02:53.284346 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-07cd171f-ba3b-4896-bc0a-43264ce3951e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:02:53.285032 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-07cd171f-ba3b-4896-bc0a-43264ce3951e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:02:53.292326 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-07cd171f-ba3b-4896-bc0a-43264ce3951e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:53.292749 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-07cd171f-ba3b-4896-bc0a-43264ce3951e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:53.293536 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-07cd171f-ba3b-4896-bc0a-43264ce3951e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:53.293973 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-07cd171f-ba3b-4896-bc0a-43264ce3951e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:53.451729 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-07cd171f-ba3b-4896-bc0a-43264ce3951e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:02:53.461151 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-07cd171f-ba3b-4896-bc0a-43264ce3951e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:02:53.462671 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-07cd171f-ba3b-4896-bc0a-43264ce3951e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:02:53.464090 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-07cd171f-ba3b-4896-bc0a-43264ce3951e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1809 microversion: 2.20 time: 0.185372 Jun 17 13:02:53.464662 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 265/551] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:02:53 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1809 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:02:54.484204 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-af44d862-8360-4ce1-9bb4-5f55b47f90aa tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:02:54.484916 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-af44d862-8360-4ce1-9bb4-5f55b47f90aa tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:02:54.491930 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-af44d862-8360-4ce1-9bb4-5f55b47f90aa tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:54.492372 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-af44d862-8360-4ce1-9bb4-5f55b47f90aa tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:54.493180 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-af44d862-8360-4ce1-9bb4-5f55b47f90aa tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:54.493631 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-af44d862-8360-4ce1-9bb4-5f55b47f90aa tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:54.640588 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-af44d862-8360-4ce1-9bb4-5f55b47f90aa tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:02:54.649943 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-af44d862-8360-4ce1-9bb4-5f55b47f90aa tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:02:54.651796 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-af44d862-8360-4ce1-9bb4-5f55b47f90aa tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:02:54.653609 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-af44d862-8360-4ce1-9bb4-5f55b47f90aa tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1809 microversion: 2.20 time: 0.172851 Jun 17 13:02:54.653767 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 266/552] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:02:54 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1809 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:02:55.672713 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-4b236692-7050-4ba3-90f6-dfa77af3f9df tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:02:55.673420 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-4b236692-7050-4ba3-90f6-dfa77af3f9df tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:02:55.680384 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4b236692-7050-4ba3-90f6-dfa77af3f9df tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:55.680836 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4b236692-7050-4ba3-90f6-dfa77af3f9df tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:55.681626 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4b236692-7050-4ba3-90f6-dfa77af3f9df tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:55.682054 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4b236692-7050-4ba3-90f6-dfa77af3f9df tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:55.832790 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-4b236692-7050-4ba3-90f6-dfa77af3f9df tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:02:55.842774 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-4b236692-7050-4ba3-90f6-dfa77af3f9df tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:02:55.844276 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-4b236692-7050-4ba3-90f6-dfa77af3f9df tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:02:55.845521 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-4b236692-7050-4ba3-90f6-dfa77af3f9df tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1809 microversion: 2.20 time: 0.177377 Jun 17 13:02:55.846406 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 267/553] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:02:55 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1809 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:02:56.865069 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-9fa6333a-cbec-4c3f-8445-d31f49866e9a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:02:56.865787 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-9fa6333a-cbec-4c3f-8445-d31f49866e9a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:02:56.872713 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9fa6333a-cbec-4c3f-8445-d31f49866e9a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:56.873276 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9fa6333a-cbec-4c3f-8445-d31f49866e9a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:56.874074 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9fa6333a-cbec-4c3f-8445-d31f49866e9a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:56.874623 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9fa6333a-cbec-4c3f-8445-d31f49866e9a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:57.023366 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-9fa6333a-cbec-4c3f-8445-d31f49866e9a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:02:57.033142 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-9fa6333a-cbec-4c3f-8445-d31f49866e9a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:02:57.034664 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-9fa6333a-cbec-4c3f-8445-d31f49866e9a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:02:57.035838 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-9fa6333a-cbec-4c3f-8445-d31f49866e9a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1809 microversion: 2.20 time: 0.174707 Jun 17 13:02:57.036410 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 268/554] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:02:56 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1809 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:02:58.055129 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-48ecaec3-e14f-47b2-a766-686dafc1e243 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:02:58.055874 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-48ecaec3-e14f-47b2-a766-686dafc1e243 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:02:58.063133 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-48ecaec3-e14f-47b2-a766-686dafc1e243 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:58.063581 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-48ecaec3-e14f-47b2-a766-686dafc1e243 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:58.064339 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-48ecaec3-e14f-47b2-a766-686dafc1e243 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:58.064791 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-48ecaec3-e14f-47b2-a766-686dafc1e243 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:58.214911 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-48ecaec3-e14f-47b2-a766-686dafc1e243 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:02:58.226442 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-48ecaec3-e14f-47b2-a766-686dafc1e243 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:02:58.227627 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-48ecaec3-e14f-47b2-a766-686dafc1e243 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:02:58.228854 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-48ecaec3-e14f-47b2-a766-686dafc1e243 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1809 microversion: 2.20 time: 0.177703 Jun 17 13:02:58.229522 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 269/555] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:02:58 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1809 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 13:02:58.255065 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:02:58.389322 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-5215e3aa-e629-437b-8d34-180fa9b49481 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "POST /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 9.154903 Jun 17 13:02:58.389852 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 287/556] 10.222.0.48 () {60 vars in 1322 bytes} [Fri Jun 17 13:02:49 2022] POST /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6/os-volume_attachments => generated 194 bytes in 9157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:02:59.247474 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-6fc66d6b-a394-4311-a5b8-b80c7947a403 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:02:59.248108 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-6fc66d6b-a394-4311-a5b8-b80c7947a403 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:02:59.256453 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6fc66d6b-a394-4311-a5b8-b80c7947a403 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:59.256898 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6fc66d6b-a394-4311-a5b8-b80c7947a403 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:59.257670 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6fc66d6b-a394-4311-a5b8-b80c7947a403 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:02:59.258133 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6fc66d6b-a394-4311-a5b8-b80c7947a403 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:02:59.400932 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-6fc66d6b-a394-4311-a5b8-b80c7947a403 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:02:59.405579 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=98 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:02:59.413399 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-6fc66d6b-a394-4311-a5b8-b80c7947a403 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:02:59.415711 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-6fc66d6b-a394-4311-a5b8-b80c7947a403 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:02:59.417282 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-6fc66d6b-a394-4311-a5b8-b80c7947a403 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1809 microversion: 2.20 time: 0.173599 Jun 17 13:02:59.418057 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 270/557] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:02:59 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1809 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:03:00.434497 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_api:SELECT=25 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:03:00.439739 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-a599064e-8b23-4ef7-8646-fba252879a30 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:03:00.440732 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-a599064e-8b23-4ef7-8646-fba252879a30 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:03:00.448684 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a599064e-8b23-4ef7-8646-fba252879a30 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:03:00.449206 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a599064e-8b23-4ef7-8646-fba252879a30 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:03:00.450014 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a599064e-8b23-4ef7-8646-fba252879a30 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:03:00.450471 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a599064e-8b23-4ef7-8646-fba252879a30 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:03:00.593144 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-a599064e-8b23-4ef7-8646-fba252879a30 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:03:00.602131 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-a599064e-8b23-4ef7-8646-fba252879a30 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:03:00.603629 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-a599064e-8b23-4ef7-8646-fba252879a30 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:03:00.604790 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-a599064e-8b23-4ef7-8646-fba252879a30 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1809 microversion: 2.20 time: 0.171867 Jun 17 13:03:00.605378 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 288/558] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:03:00 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1809 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:03:01.481880 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-f512ee7c-491b-42da-abab-df3421d01c1e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b470fcd5-08d3-4611-a67d-1260c71b9b10"}} {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:03:01.483029 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-f512ee7c-491b-42da-abab-df3421d01c1e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:03:01.489105 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f512ee7c-491b-42da-abab-df3421d01c1e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:03:01.489544 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f512ee7c-491b-42da-abab-df3421d01c1e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:03:01.490329 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f512ee7c-491b-42da-abab-df3421d01c1e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:03:01.490755 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f512ee7c-491b-42da-abab-df3421d01c1e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:03:01.623888 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-36602dcf-ad7f-4d6c-8fb3-4020464041c0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:03:01.624513 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-36602dcf-ad7f-4d6c-8fb3-4020464041c0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:03:01.631559 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-36602dcf-ad7f-4d6c-8fb3-4020464041c0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:03:01.631979 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-36602dcf-ad7f-4d6c-8fb3-4020464041c0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:03:01.632775 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-36602dcf-ad7f-4d6c-8fb3-4020464041c0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:03:01.633166 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-36602dcf-ad7f-4d6c-8fb3-4020464041c0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:03:01.770530 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-f512ee7c-491b-42da-abab-df3421d01c1e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "POST /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.401767 Jun 17 13:03:01.771646 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 271/559] 10.222.0.48 () {60 vars in 1322 bytes} [Fri Jun 17 13:03:01 2022] POST /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 194 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:03:01.771865 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-36602dcf-ad7f-4d6c-8fb3-4020464041c0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:03:01.781447 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-36602dcf-ad7f-4d6c-8fb3-4020464041c0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:03:01.783265 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-36602dcf-ad7f-4d6c-8fb3-4020464041c0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:03:01.784532 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-36602dcf-ad7f-4d6c-8fb3-4020464041c0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1809 microversion: 2.20 time: 0.164885 Jun 17 13:03:01.785446 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 289/560] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:03:01 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1809 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:03:02.804789 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-b37f82f5-9f25-4181-8159-26b37724daa1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:03:02.805533 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-b37f82f5-9f25-4181-8159-26b37724daa1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:03:02.815668 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b37f82f5-9f25-4181-8159-26b37724daa1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:03:02.816125 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b37f82f5-9f25-4181-8159-26b37724daa1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:03:02.816889 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b37f82f5-9f25-4181-8159-26b37724daa1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:03:02.817329 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b37f82f5-9f25-4181-8159-26b37724daa1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:03:03.201438 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-b37f82f5-9f25-4181-8159-26b37724daa1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:03:03.212108 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-b37f82f5-9f25-4181-8159-26b37724daa1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:03:03.213601 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-b37f82f5-9f25-4181-8159-26b37724daa1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:03:03.214820 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-b37f82f5-9f25-4181-8159-26b37724daa1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1809 microversion: 2.20 time: 0.415829 Jun 17 13:03:03.215390 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 272/561] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:03:02 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1809 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:03:04.239212 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-fa793119-fac1-4d36-8811-519ff7b0be6b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:03:04.239857 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-fa793119-fac1-4d36-8811-519ff7b0be6b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:03:04.247067 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fa793119-fac1-4d36-8811-519ff7b0be6b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:03:04.247509 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fa793119-fac1-4d36-8811-519ff7b0be6b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:03:04.248263 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fa793119-fac1-4d36-8811-519ff7b0be6b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:03:04.248687 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fa793119-fac1-4d36-8811-519ff7b0be6b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:03:04.390767 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-fa793119-fac1-4d36-8811-519ff7b0be6b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:03:04.400848 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-fa793119-fac1-4d36-8811-519ff7b0be6b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:03:04.402391 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-fa793119-fac1-4d36-8811-519ff7b0be6b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:03:04.403569 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-fa793119-fac1-4d36-8811-519ff7b0be6b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1809 microversion: 2.20 time: 0.168466 Jun 17 13:03:04.404149 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 290/562] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:03:04 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1809 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:03:05.423611 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-88197aa5-e6e3-44f0-962f-6202e1694ad3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:03:05.424232 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-88197aa5-e6e3-44f0-962f-6202e1694ad3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:03:05.431434 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-88197aa5-e6e3-44f0-962f-6202e1694ad3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:03:05.431881 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-88197aa5-e6e3-44f0-962f-6202e1694ad3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:03:05.432640 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-88197aa5-e6e3-44f0-962f-6202e1694ad3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:03:05.433070 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-88197aa5-e6e3-44f0-962f-6202e1694ad3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:03:05.580233 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-88197aa5-e6e3-44f0-962f-6202e1694ad3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:03:05.589934 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-88197aa5-e6e3-44f0-962f-6202e1694ad3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:03:05.591491 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-88197aa5-e6e3-44f0-962f-6202e1694ad3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:03:05.592636 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-88197aa5-e6e3-44f0-962f-6202e1694ad3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1809 microversion: 2.20 time: 0.173021 Jun 17 13:03:05.593204 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 273/563] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:03:05 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1809 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:03:06.611586 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-80ab46a8-055c-4f9d-a25a-00ff70442db2 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:03:06.612389 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-80ab46a8-055c-4f9d-a25a-00ff70442db2 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:03:06.619483 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-80ab46a8-055c-4f9d-a25a-00ff70442db2 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:03:06.619921 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-80ab46a8-055c-4f9d-a25a-00ff70442db2 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:03:06.620729 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-80ab46a8-055c-4f9d-a25a-00ff70442db2 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:03:06.621109 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-80ab46a8-055c-4f9d-a25a-00ff70442db2 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:03:06.767801 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-80ab46a8-055c-4f9d-a25a-00ff70442db2 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:03:06.777542 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-80ab46a8-055c-4f9d-a25a-00ff70442db2 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:03:06.779060 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-80ab46a8-055c-4f9d-a25a-00ff70442db2 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:03:06.780241 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-80ab46a8-055c-4f9d-a25a-00ff70442db2 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1809 microversion: 2.20 time: 0.173245 Jun 17 13:03:06.780797 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 291/564] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:03:06 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1809 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:03:07.801522 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-882176cc-a7bc-4cb3-93cf-8d0dea76740e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:03:07.802119 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-882176cc-a7bc-4cb3-93cf-8d0dea76740e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:03:07.809257 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-882176cc-a7bc-4cb3-93cf-8d0dea76740e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:03:07.809706 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-882176cc-a7bc-4cb3-93cf-8d0dea76740e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:03:07.810522 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-882176cc-a7bc-4cb3-93cf-8d0dea76740e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:03:07.810960 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-882176cc-a7bc-4cb3-93cf-8d0dea76740e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:03:07.950167 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-882176cc-a7bc-4cb3-93cf-8d0dea76740e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:03:07.963582 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-882176cc-a7bc-4cb3-93cf-8d0dea76740e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:03:07.965894 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-882176cc-a7bc-4cb3-93cf-8d0dea76740e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:03:07.967523 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-882176cc-a7bc-4cb3-93cf-8d0dea76740e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1809 microversion: 2.20 time: 0.170823 Jun 17 13:03:07.968306 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 274/565] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:03:07 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1809 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:03:08.186134 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [req-d1171f21-a5d0-4141-8481-e637a33cac1b req-d4cf4165-ed28-45ec-bce7-f6fc0406f755 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8fdea98-917f-4c4d-aaba-d4f5df4622d6", "name": "network-vif-plugged", "status": "completed", "tag": "936c48d1-9e45-4b7e-9fa7-86ea87893b56"}]} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:03:08.197283 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-d1171f21-a5d0-4141-8481-e637a33cac1b req-d4cf4165-ed28-45ec-bce7-f6fc0406f755 service nova] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:03:08.197935 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-d1171f21-a5d0-4141-8481-e637a33cac1b req-d4cf4165-ed28-45ec-bce7-f6fc0406f755 service nova] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:03:08.217693 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.compute.server_external_events [req-d1171f21-a5d0-4141-8481-e637a33cac1b req-d4cf4165-ed28-45ec-bce7-f6fc0406f755 service nova] Creating event network-vif-plugged:936c48d1-9e45-4b7e-9fa7-86ea87893b56 for instance c8fdea98-917f-4c4d-aaba-d4f5df4622d6 on hv-cinder-83754 Jun 17 13:03:08.227258 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [req-d1171f21-a5d0-4141-8481-e637a33cac1b req-d4cf4165-ed28-45ec-bce7-f6fc0406f755 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044050 Jun 17 13:03:08.228759 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 292/566] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 13:03:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:03:08.987759 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-a2b49823-01fc-406c-a559-058c6275118b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:03:08.988374 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-a2b49823-01fc-406c-a559-058c6275118b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:03:08.995320 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a2b49823-01fc-406c-a559-058c6275118b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:03:08.995779 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a2b49823-01fc-406c-a559-058c6275118b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:03:08.996537 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a2b49823-01fc-406c-a559-058c6275118b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:03:08.996973 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a2b49823-01fc-406c-a559-058c6275118b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:03:09.156917 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-a2b49823-01fc-406c-a559-058c6275118b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:03:09.168392 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-a2b49823-01fc-406c-a559-058c6275118b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:03:09.170781 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-a2b49823-01fc-406c-a559-058c6275118b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:03:09.172558 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-a2b49823-01fc-406c-a559-058c6275118b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1809 microversion: 2.20 time: 0.188732 Jun 17 13:03:09.173218 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 275/567] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:03:08 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1809 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:03:10.198736 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-7335b074-1d85-4022-9243-bfec9ee20967 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:03:10.199409 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-7335b074-1d85-4022-9243-bfec9ee20967 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:03:10.207149 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7335b074-1d85-4022-9243-bfec9ee20967 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:03:10.207798 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7335b074-1d85-4022-9243-bfec9ee20967 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:03:10.208541 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7335b074-1d85-4022-9243-bfec9ee20967 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:03:10.208971 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7335b074-1d85-4022-9243-bfec9ee20967 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:03:10.390480 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-7335b074-1d85-4022-9243-bfec9ee20967 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:03:10.401380 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-7335b074-1d85-4022-9243-bfec9ee20967 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:03:10.402999 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-7335b074-1d85-4022-9243-bfec9ee20967 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:03:10.404350 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-7335b074-1d85-4022-9243-bfec9ee20967 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1809 microversion: 2.20 time: 0.210100 Jun 17 13:03:10.415888 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 293/568] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:03:10 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1809 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:03:11.424450 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-11d3c5f6-7f12-42a6-9c5d-f7a5fa134c3a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:03:11.425431 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-11d3c5f6-7f12-42a6-9c5d-f7a5fa134c3a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:03:11.433753 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-11d3c5f6-7f12-42a6-9c5d-f7a5fa134c3a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:03:11.434664 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-11d3c5f6-7f12-42a6-9c5d-f7a5fa134c3a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:03:11.435780 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-11d3c5f6-7f12-42a6-9c5d-f7a5fa134c3a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:03:11.436416 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-11d3c5f6-7f12-42a6-9c5d-f7a5fa134c3a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:03:11.575638 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-11d3c5f6-7f12-42a6-9c5d-f7a5fa134c3a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:03:11.584654 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-11d3c5f6-7f12-42a6-9c5d-f7a5fa134c3a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:03:11.586221 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-11d3c5f6-7f12-42a6-9c5d-f7a5fa134c3a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:03:11.587406 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-11d3c5f6-7f12-42a6-9c5d-f7a5fa134c3a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1796 microversion: 2.20 time: 0.167518 Jun 17 13:03:11.588000 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 276/569] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:03:11 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1796 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:03:37.007447 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_api:SELECT=12 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:03:37.008411 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=36,nova_cell1:INSERT=1 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:03:37.153779 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-208a74fc-22a1-4b3e-964c-30704c7175f8 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:03:37.154345 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-208a74fc-22a1-4b3e-964c-30704c7175f8 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:03:37.161206 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-208a74fc-22a1-4b3e-964c-30704c7175f8 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:03:37.161650 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-208a74fc-22a1-4b3e-964c-30704c7175f8 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:03:37.162479 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-208a74fc-22a1-4b3e-964c-30704c7175f8 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:03:37.162915 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-208a74fc-22a1-4b3e-964c-30704c7175f8 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:03:37.309120 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.objects.instance [None req-208a74fc-22a1-4b3e-964c-30704c7175f8 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lazy-loading 'services' on Instance uuid 748a3422-aeab-41c8-b051-df5f7d7ca509 {{(pid=117660) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 13:03:37.432249 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-208a74fc-22a1-4b3e-964c-30704c7175f8 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "DELETE /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments/68643bc5-4e32-49a5-b5fe-bac2a20e6b7e" status: 202 len: 0 microversion: 2.1 time: 0.430163 Jun 17 13:03:37.432857 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 294/570] 10.222.0.48 () {58 vars in 1415 bytes} [Fri Jun 17 13:03:37 2022] DELETE /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments/68643bc5-4e32-49a5-b5fe-bac2a20e6b7e => generated 0 bytes in 432 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 13:03:40.705415 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-1c855769-7b2b-449f-b89d-9c33ed614e91 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:03:40.706016 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-1c855769-7b2b-449f-b89d-9c33ed614e91 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] [instance: 72889057-861c-42f3-8629-32fff8f5dab7] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:03:40.708286 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_api:SELECT=31 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:03:40.708906 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_cell1:SELECT=41,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:03:40.715225 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-1c855769-7b2b-449f-b89d-9c33ed614e91 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:03:40.715668 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-1c855769-7b2b-449f-b89d-9c33ed614e91 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:03:40.716437 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-1c855769-7b2b-449f-b89d-9c33ed614e91 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:03:40.716871 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-1c855769-7b2b-449f-b89d-9c33ed614e91 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:03:40.744473 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-1c855769-7b2b-449f-b89d-9c33ed614e91 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] [instance: 72889057-861c-42f3-8629-32fff8f5dab7] Going to try to terminate instance {{(pid=117659) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 17 13:03:40.838241 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-1c855769-7b2b-449f-b89d-9c33ed614e91 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] 10.222.0.48 "DELETE /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7" status: 204 len: 0 microversion: 2.1 time: 0.136364 Jun 17 13:03:40.838850 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 277/571] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Jun 17 13:03:40 2022] DELETE /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 17 13:03:40.848602 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-4becb888-2022-4286-abdf-c1652fe6719f tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:03:40.849296 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-4becb888-2022-4286-abdf-c1652fe6719f tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] [instance: 72889057-861c-42f3-8629-32fff8f5dab7] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:03:40.856206 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4becb888-2022-4286-abdf-c1652fe6719f tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:03:40.856679 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4becb888-2022-4286-abdf-c1652fe6719f tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:03:40.857429 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4becb888-2022-4286-abdf-c1652fe6719f tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:03:40.857860 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4becb888-2022-4286-abdf-c1652fe6719f tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:03:41.007946 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-4becb888-2022-4286-abdf-c1652fe6719f tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18195083037046bd99166f68690c3dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bf442df39b4f5cbc18f571a0596f10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:03:41.015731 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-4becb888-2022-4286-abdf-c1652fe6719f tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] 10.222.0.48 "GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7" status: 200 len: 1576 microversion: 2.1 time: 0.171938 Jun 17 13:03:41.016300 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 295/572] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:03:40 2022] GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7 => generated 1576 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:03:42.033964 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-9d5db26e-c030-47d3-9b8b-34ad9b9d38cc tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:03:42.034749 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-9d5db26e-c030-47d3-9b8b-34ad9b9d38cc tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] [instance: 72889057-861c-42f3-8629-32fff8f5dab7] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:03:42.042476 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9d5db26e-c030-47d3-9b8b-34ad9b9d38cc tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:03:42.042916 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9d5db26e-c030-47d3-9b8b-34ad9b9d38cc tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:03:42.043715 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9d5db26e-c030-47d3-9b8b-34ad9b9d38cc tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:03:42.044121 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9d5db26e-c030-47d3-9b8b-34ad9b9d38cc tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:03:42.193324 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-9d5db26e-c030-47d3-9b8b-34ad9b9d38cc tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18195083037046bd99166f68690c3dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bf442df39b4f5cbc18f571a0596f10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:03:42.201983 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-9d5db26e-c030-47d3-9b8b-34ad9b9d38cc tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] 10.222.0.48 "GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7" status: 200 len: 1576 microversion: 2.1 time: 0.172641 Jun 17 13:03:42.202845 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 278/573] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:03:42 2022] GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7 => generated 1576 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:03:43.222508 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-f68a6245-954a-426a-9078-b10116b52ee6 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:03:43.223581 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-f68a6245-954a-426a-9078-b10116b52ee6 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] [instance: 72889057-861c-42f3-8629-32fff8f5dab7] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:03:43.231989 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f68a6245-954a-426a-9078-b10116b52ee6 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:03:43.232371 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f68a6245-954a-426a-9078-b10116b52ee6 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:03:43.233131 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f68a6245-954a-426a-9078-b10116b52ee6 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:03:43.233563 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f68a6245-954a-426a-9078-b10116b52ee6 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:03:43.384761 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-f68a6245-954a-426a-9078-b10116b52ee6 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18195083037046bd99166f68690c3dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bf442df39b4f5cbc18f571a0596f10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:03:43.395323 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-f68a6245-954a-426a-9078-b10116b52ee6 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] 10.222.0.48 "GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7" status: 200 len: 1576 microversion: 2.1 time: 0.178062 Jun 17 13:03:43.396207 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 296/574] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:03:43 2022] GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7 => generated 1576 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:03:44.414982 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-55e04626-0791-434a-9d08-6503c69ae21c tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:03:44.415686 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-55e04626-0791-434a-9d08-6503c69ae21c tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] [instance: 72889057-861c-42f3-8629-32fff8f5dab7] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:03:44.422546 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-55e04626-0791-434a-9d08-6503c69ae21c tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:03:44.422998 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-55e04626-0791-434a-9d08-6503c69ae21c tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:03:44.423776 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-55e04626-0791-434a-9d08-6503c69ae21c tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:03:44.424209 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-55e04626-0791-434a-9d08-6503c69ae21c tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:03:44.572577 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-55e04626-0791-434a-9d08-6503c69ae21c tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18195083037046bd99166f68690c3dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bf442df39b4f5cbc18f571a0596f10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:03:44.585183 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-55e04626-0791-434a-9d08-6503c69ae21c tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] 10.222.0.48 "GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7" status: 200 len: 1576 microversion: 2.1 time: 0.175037 Jun 17 13:03:44.585796 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 279/575] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:03:44 2022] GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7 => generated 1576 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:03:45.604111 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-1b236680-672c-4964-a739-5b2257df98bf tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:03:45.604685 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-1b236680-672c-4964-a739-5b2257df98bf tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] [instance: 72889057-861c-42f3-8629-32fff8f5dab7] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:03:45.611667 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1b236680-672c-4964-a739-5b2257df98bf tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:03:45.612113 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1b236680-672c-4964-a739-5b2257df98bf tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:03:45.612899 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1b236680-672c-4964-a739-5b2257df98bf tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:03:45.613329 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1b236680-672c-4964-a739-5b2257df98bf tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:03:45.752880 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-1b236680-672c-4964-a739-5b2257df98bf tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18195083037046bd99166f68690c3dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bf442df39b4f5cbc18f571a0596f10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:03:45.761487 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-1b236680-672c-4964-a739-5b2257df98bf tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] 10.222.0.48 "GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7" status: 200 len: 1576 microversion: 2.1 time: 0.161746 Jun 17 13:03:45.762114 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 297/576] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:03:45 2022] GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7 => generated 1576 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:03:46.779245 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-5ef2d451-f827-483b-9ff0-8defa19c6140 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:03:46.779890 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-5ef2d451-f827-483b-9ff0-8defa19c6140 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] [instance: 72889057-861c-42f3-8629-32fff8f5dab7] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:03:46.786720 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-5ef2d451-f827-483b-9ff0-8defa19c6140 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:03:46.787157 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-5ef2d451-f827-483b-9ff0-8defa19c6140 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:03:46.787914 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-5ef2d451-f827-483b-9ff0-8defa19c6140 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:03:46.788343 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-5ef2d451-f827-483b-9ff0-8defa19c6140 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:03:46.936574 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-5ef2d451-f827-483b-9ff0-8defa19c6140 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18195083037046bd99166f68690c3dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bf442df39b4f5cbc18f571a0596f10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:03:46.944487 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-5ef2d451-f827-483b-9ff0-8defa19c6140 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] 10.222.0.48 "GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7" status: 200 len: 1576 microversion: 2.1 time: 0.169095 Jun 17 13:03:46.945222 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 280/577] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:03:46 2022] GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7 => generated 1576 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:03:47.961334 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-5de5b79c-2679-4624-9b8c-64d776f7ed5c tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:03:47.961941 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-5de5b79c-2679-4624-9b8c-64d776f7ed5c tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] [instance: 72889057-861c-42f3-8629-32fff8f5dab7] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:03:47.969281 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5de5b79c-2679-4624-9b8c-64d776f7ed5c tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:03:47.969780 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5de5b79c-2679-4624-9b8c-64d776f7ed5c tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:03:47.970932 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5de5b79c-2679-4624-9b8c-64d776f7ed5c tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:03:47.971702 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5de5b79c-2679-4624-9b8c-64d776f7ed5c tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:03:48.120503 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-5de5b79c-2679-4624-9b8c-64d776f7ed5c tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18195083037046bd99166f68690c3dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bf442df39b4f5cbc18f571a0596f10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:03:48.128493 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-5de5b79c-2679-4624-9b8c-64d776f7ed5c tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] 10.222.0.48 "GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7" status: 200 len: 1576 microversion: 2.1 time: 0.171179 Jun 17 13:03:48.129402 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 298/578] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:03:47 2022] GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7 => generated 1576 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:03:49.147391 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-ae68d6ea-a861-487f-85f6-906fffdc5bff tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:03:49.148052 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-ae68d6ea-a861-487f-85f6-906fffdc5bff tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] [instance: 72889057-861c-42f3-8629-32fff8f5dab7] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:03:49.155504 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ae68d6ea-a861-487f-85f6-906fffdc5bff tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:03:49.155949 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ae68d6ea-a861-487f-85f6-906fffdc5bff tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:03:49.156722 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ae68d6ea-a861-487f-85f6-906fffdc5bff tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:03:49.157160 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ae68d6ea-a861-487f-85f6-906fffdc5bff tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:03:49.303479 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-ae68d6ea-a861-487f-85f6-906fffdc5bff tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18195083037046bd99166f68690c3dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bf442df39b4f5cbc18f571a0596f10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:03:49.315848 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-ae68d6ea-a861-487f-85f6-906fffdc5bff tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] 10.222.0.48 "GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7" status: 200 len: 1576 microversion: 2.1 time: 0.172169 Jun 17 13:03:49.316537 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 281/579] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:03:49 2022] GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7 => generated 1576 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:03:50.334354 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-5fe78170-4dd2-4388-bccc-03355828caa1 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:03:50.335019 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-5fe78170-4dd2-4388-bccc-03355828caa1 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] [instance: 72889057-861c-42f3-8629-32fff8f5dab7] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:03:50.341983 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5fe78170-4dd2-4388-bccc-03355828caa1 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:03:50.342470 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5fe78170-4dd2-4388-bccc-03355828caa1 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:03:50.343249 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5fe78170-4dd2-4388-bccc-03355828caa1 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:03:50.343679 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5fe78170-4dd2-4388-bccc-03355828caa1 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:03:50.485962 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-5fe78170-4dd2-4388-bccc-03355828caa1 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18195083037046bd99166f68690c3dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bf442df39b4f5cbc18f571a0596f10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:03:50.495262 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-5fe78170-4dd2-4388-bccc-03355828caa1 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] 10.222.0.48 "GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7" status: 200 len: 1576 microversion: 2.1 time: 0.164840 Jun 17 13:03:50.496026 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 299/580] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:03:50 2022] GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7 => generated 1576 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:03:50.537776 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-ea3ae16e-759f-410b-976b-1b794060f3b0 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:03:50.539160 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-ea3ae16e-759f-410b-976b-1b794060f3b0 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:03:50.545764 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ea3ae16e-759f-410b-976b-1b794060f3b0 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:03:50.546236 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ea3ae16e-759f-410b-976b-1b794060f3b0 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:03:50.547026 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ea3ae16e-759f-410b-976b-1b794060f3b0 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:03:50.547458 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ea3ae16e-759f-410b-976b-1b794060f3b0 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:03:50.626859 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-ea3ae16e-759f-410b-976b-1b794060f3b0 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "POST /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a/action" status: 202 len: 0 microversion: 2.1 time: 0.093057 Jun 17 13:03:50.627992 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 282/581] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Jun 17 13:03:50 2022] POST /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a/action => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 13:03:50.638188 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-97e3a4d2-11a6-403b-8ddc-6a5820b89598 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:03:50.638806 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-97e3a4d2-11a6-403b-8ddc-6a5820b89598 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:03:50.645167 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-97e3a4d2-11a6-403b-8ddc-6a5820b89598 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:03:50.645607 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-97e3a4d2-11a6-403b-8ddc-6a5820b89598 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:03:50.646406 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-97e3a4d2-11a6-403b-8ddc-6a5820b89598 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:03:50.646836 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-97e3a4d2-11a6-403b-8ddc-6a5820b89598 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:03:50.806615 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-97e3a4d2-11a6-403b-8ddc-6a5820b89598 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:03:50.821894 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-97e3a4d2-11a6-403b-8ddc-6a5820b89598 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1753 microversion: 2.1 time: 0.186378 Jun 17 13:03:50.823026 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 300/582] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:03:50 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1753 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:03:51.514175 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-d1e012e9-32d2-47af-9268-dd128f007328 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:03:51.514814 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-d1e012e9-32d2-47af-9268-dd128f007328 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] [instance: 72889057-861c-42f3-8629-32fff8f5dab7] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:03:51.521464 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d1e012e9-32d2-47af-9268-dd128f007328 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:03:51.521906 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d1e012e9-32d2-47af-9268-dd128f007328 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:03:51.522644 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d1e012e9-32d2-47af-9268-dd128f007328 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:03:51.523076 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d1e012e9-32d2-47af-9268-dd128f007328 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:03:51.673961 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-d1e012e9-32d2-47af-9268-dd128f007328 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18195083037046bd99166f68690c3dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bf442df39b4f5cbc18f571a0596f10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:03:51.683771 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-d1e012e9-32d2-47af-9268-dd128f007328 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] 10.222.0.48 "GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7" status: 200 len: 1576 microversion: 2.1 time: 0.174066 Jun 17 13:03:51.684397 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 283/583] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:03:51 2022] GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7 => generated 1576 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:03:51.846780 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-cc8b814a-8761-4245-ab21-35012a6e0a65 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:03:51.847405 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-cc8b814a-8761-4245-ab21-35012a6e0a65 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:03:51.854544 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cc8b814a-8761-4245-ab21-35012a6e0a65 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:03:51.854993 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cc8b814a-8761-4245-ab21-35012a6e0a65 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:03:51.855792 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cc8b814a-8761-4245-ab21-35012a6e0a65 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:03:51.856220 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cc8b814a-8761-4245-ab21-35012a6e0a65 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:03:52.013173 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-cc8b814a-8761-4245-ab21-35012a6e0a65 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:03:52.028141 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-cc8b814a-8761-4245-ab21-35012a6e0a65 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1753 microversion: 2.1 time: 0.184722 Jun 17 13:03:52.029425 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 301/584] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:03:51 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1753 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:03:52.702047 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-2a9ccdf4-a9e9-4772-a40e-35505c859fac tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:03:52.702705 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-2a9ccdf4-a9e9-4772-a40e-35505c859fac tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] [instance: 72889057-861c-42f3-8629-32fff8f5dab7] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:03:52.713293 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2a9ccdf4-a9e9-4772-a40e-35505c859fac tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:03:52.713738 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2a9ccdf4-a9e9-4772-a40e-35505c859fac tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:03:52.714533 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2a9ccdf4-a9e9-4772-a40e-35505c859fac tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:03:52.714961 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2a9ccdf4-a9e9-4772-a40e-35505c859fac tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:03:52.864523 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-2a9ccdf4-a9e9-4772-a40e-35505c859fac tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18195083037046bd99166f68690c3dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bf442df39b4f5cbc18f571a0596f10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:03:52.873554 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-2a9ccdf4-a9e9-4772-a40e-35505c859fac tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] 10.222.0.48 "GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7" status: 200 len: 1576 microversion: 2.1 time: 0.175821 Jun 17 13:03:52.874155 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 284/585] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:03:52 2022] GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7 => generated 1576 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:03:53.048110 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-acf60555-49a8-4d61-a653-fbcb4f7da960 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:03:53.048716 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-acf60555-49a8-4d61-a653-fbcb4f7da960 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:03:53.056916 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-acf60555-49a8-4d61-a653-fbcb4f7da960 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:03:53.057260 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-acf60555-49a8-4d61-a653-fbcb4f7da960 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:03:53.058066 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-acf60555-49a8-4d61-a653-fbcb4f7da960 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:03:53.058522 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-acf60555-49a8-4d61-a653-fbcb4f7da960 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:03:53.218538 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-acf60555-49a8-4d61-a653-fbcb4f7da960 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:03:53.231830 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-acf60555-49a8-4d61-a653-fbcb4f7da960 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1753 microversion: 2.1 time: 0.187854 Jun 17 13:03:53.232566 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 302/586] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:03:53 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1753 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:03:54.003214 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-bd0809ce-c15b-4f8c-8149-d6369a1a0a02 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:03:54.003844 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-bd0809ce-c15b-4f8c-8149-d6369a1a0a02 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] [instance: 72889057-861c-42f3-8629-32fff8f5dab7] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:03:54.014522 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-bd0809ce-c15b-4f8c-8149-d6369a1a0a02 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:03:54.015147 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-bd0809ce-c15b-4f8c-8149-d6369a1a0a02 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:03:54.016281 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-bd0809ce-c15b-4f8c-8149-d6369a1a0a02 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:03:54.016856 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-bd0809ce-c15b-4f8c-8149-d6369a1a0a02 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:03:54.166655 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-bd0809ce-c15b-4f8c-8149-d6369a1a0a02 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18195083037046bd99166f68690c3dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bf442df39b4f5cbc18f571a0596f10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:03:54.174440 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-bd0809ce-c15b-4f8c-8149-d6369a1a0a02 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] 10.222.0.48 "GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7" status: 200 len: 1576 microversion: 2.1 time: 0.287479 Jun 17 13:03:54.175005 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 285/587] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:03:53 2022] GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7 => generated 1576 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:03:54.253014 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-10160cd7-c0e4-4501-836f-ed96ebf573fc tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:03:54.253802 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-10160cd7-c0e4-4501-836f-ed96ebf573fc tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:03:54.261449 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-10160cd7-c0e4-4501-836f-ed96ebf573fc tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:03:54.261910 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-10160cd7-c0e4-4501-836f-ed96ebf573fc tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:03:54.262691 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-10160cd7-c0e4-4501-836f-ed96ebf573fc tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:03:54.263144 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-10160cd7-c0e4-4501-836f-ed96ebf573fc tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:03:54.424589 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-10160cd7-c0e4-4501-836f-ed96ebf573fc tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:03:54.433028 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-10160cd7-c0e4-4501-836f-ed96ebf573fc tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1753 microversion: 2.1 time: 0.183941 Jun 17 13:03:54.433625 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 303/588] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:03:54 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1753 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:03:55.194816 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-a6b086cd-b0b5-4df5-954c-d574d5f50d4a tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:03:55.195403 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-a6b086cd-b0b5-4df5-954c-d574d5f50d4a tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] [instance: 72889057-861c-42f3-8629-32fff8f5dab7] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:03:55.202741 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a6b086cd-b0b5-4df5-954c-d574d5f50d4a tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:03:55.203191 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a6b086cd-b0b5-4df5-954c-d574d5f50d4a tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:03:55.203966 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a6b086cd-b0b5-4df5-954c-d574d5f50d4a tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:03:55.204431 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a6b086cd-b0b5-4df5-954c-d574d5f50d4a tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:03:55.364602 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-a6b086cd-b0b5-4df5-954c-d574d5f50d4a tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18195083037046bd99166f68690c3dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bf442df39b4f5cbc18f571a0596f10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:03:55.372363 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-a6b086cd-b0b5-4df5-954c-d574d5f50d4a tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] 10.222.0.48 "GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7" status: 200 len: 1576 microversion: 2.1 time: 0.181873 Jun 17 13:03:55.372980 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 286/589] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:03:55 2022] GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7 => generated 1576 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:03:55.451292 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-341d4947-f784-4dd2-a90c-3e6b455d5bd5 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:03:55.451931 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-341d4947-f784-4dd2-a90c-3e6b455d5bd5 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:03:55.458764 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-341d4947-f784-4dd2-a90c-3e6b455d5bd5 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:03:55.459308 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-341d4947-f784-4dd2-a90c-3e6b455d5bd5 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:03:55.460308 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-341d4947-f784-4dd2-a90c-3e6b455d5bd5 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:03:55.461111 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-341d4947-f784-4dd2-a90c-3e6b455d5bd5 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:03:55.634217 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-341d4947-f784-4dd2-a90c-3e6b455d5bd5 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:03:55.642727 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-341d4947-f784-4dd2-a90c-3e6b455d5bd5 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1753 microversion: 2.1 time: 0.195774 Jun 17 13:03:55.643302 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 304/590] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:03:55 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1753 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:03:56.390077 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-d6b2681a-cf80-4df4-b925-c037a2c22324 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:03:56.390724 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-d6b2681a-cf80-4df4-b925-c037a2c22324 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] [instance: 72889057-861c-42f3-8629-32fff8f5dab7] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:03:56.397780 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d6b2681a-cf80-4df4-b925-c037a2c22324 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:03:56.398257 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d6b2681a-cf80-4df4-b925-c037a2c22324 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:03:56.399408 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d6b2681a-cf80-4df4-b925-c037a2c22324 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:03:56.399754 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d6b2681a-cf80-4df4-b925-c037a2c22324 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:03:56.554745 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-d6b2681a-cf80-4df4-b925-c037a2c22324 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18195083037046bd99166f68690c3dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bf442df39b4f5cbc18f571a0596f10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:03:56.565113 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-d6b2681a-cf80-4df4-b925-c037a2c22324 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] 10.222.0.48 "GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7" status: 200 len: 1576 microversion: 2.1 time: 0.178937 Jun 17 13:03:56.565621 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 287/591] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:03:56 2022] GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7 => generated 1576 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:03:56.665774 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-fb6272a2-fc12-4ad5-ace5-40c1fa4cb6f9 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:03:56.666415 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-fb6272a2-fc12-4ad5-ace5-40c1fa4cb6f9 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:03:56.673623 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fb6272a2-fc12-4ad5-ace5-40c1fa4cb6f9 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:03:56.674065 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fb6272a2-fc12-4ad5-ace5-40c1fa4cb6f9 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:03:56.674920 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fb6272a2-fc12-4ad5-ace5-40c1fa4cb6f9 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:03:56.675857 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fb6272a2-fc12-4ad5-ace5-40c1fa4cb6f9 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:03:56.835043 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-fb6272a2-fc12-4ad5-ace5-40c1fa4cb6f9 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:03:56.843934 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-fb6272a2-fc12-4ad5-ace5-40c1fa4cb6f9 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1753 microversion: 2.1 time: 0.182331 Jun 17 13:03:56.844509 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 305/592] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:03:56 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1753 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:03:57.583130 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-1675ff66-c46e-4380-b9ce-8ce383e53e65 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:03:57.583693 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-1675ff66-c46e-4380-b9ce-8ce383e53e65 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] [instance: 72889057-861c-42f3-8629-32fff8f5dab7] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:03:57.591354 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-1675ff66-c46e-4380-b9ce-8ce383e53e65 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:03:57.592050 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-1675ff66-c46e-4380-b9ce-8ce383e53e65 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:03:57.593248 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-1675ff66-c46e-4380-b9ce-8ce383e53e65 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:03:57.593958 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-1675ff66-c46e-4380-b9ce-8ce383e53e65 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:03:57.731868 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-1675ff66-c46e-4380-b9ce-8ce383e53e65 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18195083037046bd99166f68690c3dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bf442df39b4f5cbc18f571a0596f10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:03:57.739846 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-1675ff66-c46e-4380-b9ce-8ce383e53e65 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] 10.222.0.48 "GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7" status: 200 len: 1576 microversion: 2.1 time: 0.160695 Jun 17 13:03:57.740408 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 288/593] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:03:57 2022] GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7 => generated 1576 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:03:57.861658 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-3ffdb130-5fe9-41e8-899d-00c5227dfdd9 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:03:57.862304 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-3ffdb130-5fe9-41e8-899d-00c5227dfdd9 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:03:57.869949 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3ffdb130-5fe9-41e8-899d-00c5227dfdd9 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:03:57.870421 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3ffdb130-5fe9-41e8-899d-00c5227dfdd9 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:03:57.871177 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3ffdb130-5fe9-41e8-899d-00c5227dfdd9 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:03:57.871627 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3ffdb130-5fe9-41e8-899d-00c5227dfdd9 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:03:58.022935 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-3ffdb130-5fe9-41e8-899d-00c5227dfdd9 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:03:58.034785 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-3ffdb130-5fe9-41e8-899d-00c5227dfdd9 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1753 microversion: 2.1 time: 0.177191 Jun 17 13:03:58.035575 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 306/594] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:03:57 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1753 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:03:58.757203 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-41b806fd-1f2d-46a0-b3e1-97b388be7723 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:03:58.757812 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-41b806fd-1f2d-46a0-b3e1-97b388be7723 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] [instance: 72889057-861c-42f3-8629-32fff8f5dab7] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:03:58.764789 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-41b806fd-1f2d-46a0-b3e1-97b388be7723 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:03:58.765253 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-41b806fd-1f2d-46a0-b3e1-97b388be7723 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:03:58.766055 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-41b806fd-1f2d-46a0-b3e1-97b388be7723 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:03:58.766728 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-41b806fd-1f2d-46a0-b3e1-97b388be7723 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:03:58.792388 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 13:03:58.792640 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Fri Jun 17 13:03:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 17 13:03:58.918361 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-41b806fd-1f2d-46a0-b3e1-97b388be7723 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18195083037046bd99166f68690c3dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bf442df39b4f5cbc18f571a0596f10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:03:58.930753 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-41b806fd-1f2d-46a0-b3e1-97b388be7723 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] 10.222.0.48 "GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7" status: 200 len: 1576 microversion: 2.1 time: 0.177507 Jun 17 13:03:58.931462 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 289/595] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:03:58 2022] GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7 => generated 1576 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:03:59.054384 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-3d3c9052-62b1-4398-bd5d-24fa9bedebce tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:03:59.055459 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-3d3c9052-62b1-4398-bd5d-24fa9bedebce tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:03:59.062145 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3d3c9052-62b1-4398-bd5d-24fa9bedebce tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:03:59.062744 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3d3c9052-62b1-4398-bd5d-24fa9bedebce tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:03:59.063606 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3d3c9052-62b1-4398-bd5d-24fa9bedebce tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:03:59.064082 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3d3c9052-62b1-4398-bd5d-24fa9bedebce tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:03:59.209557 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-3d3c9052-62b1-4398-bd5d-24fa9bedebce tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:03:59.218954 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-3d3c9052-62b1-4398-bd5d-24fa9bedebce tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1753 microversion: 2.1 time: 0.168640 Jun 17 13:03:59.219506 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 307/596] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:03:59 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1753 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:03:59.953430 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-31d4d13f-a541-409a-9261-e957ee77501e tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:03:59.954006 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-31d4d13f-a541-409a-9261-e957ee77501e tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] [instance: 72889057-861c-42f3-8629-32fff8f5dab7] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:03:59.961493 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-31d4d13f-a541-409a-9261-e957ee77501e tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:03:59.961945 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-31d4d13f-a541-409a-9261-e957ee77501e tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:03:59.962754 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-31d4d13f-a541-409a-9261-e957ee77501e tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:03:59.963174 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-31d4d13f-a541-409a-9261-e957ee77501e tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:00.104248 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-31d4d13f-a541-409a-9261-e957ee77501e tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18195083037046bd99166f68690c3dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bf442df39b4f5cbc18f571a0596f10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:04:00.109272 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:04:00.115991 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-31d4d13f-a541-409a-9261-e957ee77501e tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] 10.222.0.48 "GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7" status: 200 len: 1576 microversion: 2.1 time: 0.166538 Jun 17 13:04:00.116709 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 290/597] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:03:59 2022] GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7 => generated 1576 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:04:00.236869 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-4813ac88-9c00-4f2b-8bb5-4168f3e5d3f1 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:04:00.237483 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-4813ac88-9c00-4f2b-8bb5-4168f3e5d3f1 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:04:00.244765 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4813ac88-9c00-4f2b-8bb5-4168f3e5d3f1 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:00.245215 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4813ac88-9c00-4f2b-8bb5-4168f3e5d3f1 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:00.245977 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4813ac88-9c00-4f2b-8bb5-4168f3e5d3f1 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:00.246435 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4813ac88-9c00-4f2b-8bb5-4168f3e5d3f1 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:00.408774 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-4813ac88-9c00-4f2b-8bb5-4168f3e5d3f1 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:04:00.417429 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-4813ac88-9c00-4f2b-8bb5-4168f3e5d3f1 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1753 microversion: 2.1 time: 0.184427 Jun 17 13:04:00.417993 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 308/598] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:04:00 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1753 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:04:01.135157 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-46901ba1-203d-4305-a8f0-8793212ee8bd tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:04:01.135781 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-46901ba1-203d-4305-a8f0-8793212ee8bd tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] [instance: 72889057-861c-42f3-8629-32fff8f5dab7] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:04:01.143973 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-46901ba1-203d-4305-a8f0-8793212ee8bd tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:01.144403 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-46901ba1-203d-4305-a8f0-8793212ee8bd tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:01.145149 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-46901ba1-203d-4305-a8f0-8793212ee8bd tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:01.145579 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-46901ba1-203d-4305-a8f0-8793212ee8bd tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:01.295986 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-46901ba1-203d-4305-a8f0-8793212ee8bd tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18195083037046bd99166f68690c3dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bf442df39b4f5cbc18f571a0596f10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:04:01.306914 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-46901ba1-203d-4305-a8f0-8793212ee8bd tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] 10.222.0.48 "GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7" status: 200 len: 1576 microversion: 2.1 time: 0.175636 Jun 17 13:04:01.307469 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 291/599] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:04:01 2022] GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7 => generated 1576 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:04:01.435293 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-5c79f8f3-9f40-4142-b47c-9b9d60b08581 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:04:01.435860 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-5c79f8f3-9f40-4142-b47c-9b9d60b08581 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:04:01.442829 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5c79f8f3-9f40-4142-b47c-9b9d60b08581 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:01.443291 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5c79f8f3-9f40-4142-b47c-9b9d60b08581 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:01.444060 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5c79f8f3-9f40-4142-b47c-9b9d60b08581 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:01.444485 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5c79f8f3-9f40-4142-b47c-9b9d60b08581 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:01.601637 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-5c79f8f3-9f40-4142-b47c-9b9d60b08581 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:04:01.606947 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:04:01.614829 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-5c79f8f3-9f40-4142-b47c-9b9d60b08581 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1753 microversion: 2.1 time: 0.183087 Jun 17 13:04:01.615641 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 309/600] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:04:01 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1753 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:04:02.327564 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-0da80fda-b63a-427d-b70c-fd64e12f946b tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:04:02.328140 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-0da80fda-b63a-427d-b70c-fd64e12f946b tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] [instance: 72889057-861c-42f3-8629-32fff8f5dab7] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:04:02.335480 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0da80fda-b63a-427d-b70c-fd64e12f946b tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:02.335920 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0da80fda-b63a-427d-b70c-fd64e12f946b tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:02.337404 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0da80fda-b63a-427d-b70c-fd64e12f946b tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:02.337842 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0da80fda-b63a-427d-b70c-fd64e12f946b tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:02.476018 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-0da80fda-b63a-427d-b70c-fd64e12f946b tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18195083037046bd99166f68690c3dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bf442df39b4f5cbc18f571a0596f10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:04:02.488086 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-0da80fda-b63a-427d-b70c-fd64e12f946b tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] 10.222.0.48 "GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7" status: 200 len: 1576 microversion: 2.1 time: 0.164200 Jun 17 13:04:02.488852 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 292/601] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:04:02 2022] GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7 => generated 1576 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:04:02.634620 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-eced8263-af57-44c9-b12a-cd9ad167adcd tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:04:02.635225 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-eced8263-af57-44c9-b12a-cd9ad167adcd tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:04:02.642984 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-eced8263-af57-44c9-b12a-cd9ad167adcd tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:02.643424 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-eced8263-af57-44c9-b12a-cd9ad167adcd tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:02.644185 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-eced8263-af57-44c9-b12a-cd9ad167adcd tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:02.644619 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-eced8263-af57-44c9-b12a-cd9ad167adcd tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:02.795864 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-eced8263-af57-44c9-b12a-cd9ad167adcd tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:04:02.807922 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-eced8263-af57-44c9-b12a-cd9ad167adcd tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1753 microversion: 2.1 time: 0.178338 Jun 17 13:04:02.808684 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 310/602] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:04:02 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1753 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:04:03.508602 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-28192bc3-afbf-4f22-a61f-327cc9816298 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:04:03.509249 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-28192bc3-afbf-4f22-a61f-327cc9816298 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] [instance: 72889057-861c-42f3-8629-32fff8f5dab7] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:04:03.516449 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-28192bc3-afbf-4f22-a61f-327cc9816298 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:03.516896 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-28192bc3-afbf-4f22-a61f-327cc9816298 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:03.517642 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-28192bc3-afbf-4f22-a61f-327cc9816298 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:03.518220 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-28192bc3-afbf-4f22-a61f-327cc9816298 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:03.666055 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-28192bc3-afbf-4f22-a61f-327cc9816298 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18195083037046bd99166f68690c3dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bf442df39b4f5cbc18f571a0596f10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:04:03.674034 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-28192bc3-afbf-4f22-a61f-327cc9816298 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] 10.222.0.48 "GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7" status: 200 len: 1576 microversion: 2.1 time: 0.170229 Jun 17 13:04:03.674638 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 293/603] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:04:03 2022] GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7 => generated 1576 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:04:03.830167 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-83e2fef9-6b0b-42eb-9a60-ceec2e495637 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:04:03.830735 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-83e2fef9-6b0b-42eb-9a60-ceec2e495637 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:04:03.838292 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-83e2fef9-6b0b-42eb-9a60-ceec2e495637 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:03.838734 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-83e2fef9-6b0b-42eb-9a60-ceec2e495637 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:03.839483 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-83e2fef9-6b0b-42eb-9a60-ceec2e495637 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:03.839908 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-83e2fef9-6b0b-42eb-9a60-ceec2e495637 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:04.001670 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-83e2fef9-6b0b-42eb-9a60-ceec2e495637 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:04:04.010237 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-83e2fef9-6b0b-42eb-9a60-ceec2e495637 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1753 microversion: 2.1 time: 0.183943 Jun 17 13:04:04.010796 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 311/604] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:04:03 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1753 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:04:04.693798 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-9a5afae3-c33d-4bf3-8e61-403067334609 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:04:04.694599 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-9a5afae3-c33d-4bf3-8e61-403067334609 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] [instance: 72889057-861c-42f3-8629-32fff8f5dab7] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:04:04.703358 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9a5afae3-c33d-4bf3-8e61-403067334609 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:04.703811 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9a5afae3-c33d-4bf3-8e61-403067334609 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:04.704572 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9a5afae3-c33d-4bf3-8e61-403067334609 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:04.705007 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9a5afae3-c33d-4bf3-8e61-403067334609 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:04.844437 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-9a5afae3-c33d-4bf3-8e61-403067334609 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18195083037046bd99166f68690c3dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bf442df39b4f5cbc18f571a0596f10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:04:04.853756 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-9a5afae3-c33d-4bf3-8e61-403067334609 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] 10.222.0.48 "GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7" status: 200 len: 1576 microversion: 2.1 time: 0.165602 Jun 17 13:04:04.854671 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 294/605] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:04:04 2022] GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7 => generated 1576 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:04:05.028650 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-25ef1c99-9670-4a35-b3ec-bdfbe83deb11 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:04:05.029271 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-25ef1c99-9670-4a35-b3ec-bdfbe83deb11 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:04:05.036109 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-25ef1c99-9670-4a35-b3ec-bdfbe83deb11 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:05.036605 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-25ef1c99-9670-4a35-b3ec-bdfbe83deb11 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:05.037448 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-25ef1c99-9670-4a35-b3ec-bdfbe83deb11 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:05.044205 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-25ef1c99-9670-4a35-b3ec-bdfbe83deb11 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:05.199647 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-25ef1c99-9670-4a35-b3ec-bdfbe83deb11 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:04:05.212458 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-25ef1c99-9670-4a35-b3ec-bdfbe83deb11 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1753 microversion: 2.1 time: 0.188117 Jun 17 13:04:05.213254 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 312/606] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:04:05 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1753 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:04:05.872772 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-5d281be4-b8db-4cc8-a2b4-ab26a8152fee tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:04:05.873545 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-5d281be4-b8db-4cc8-a2b4-ab26a8152fee tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] [instance: 72889057-861c-42f3-8629-32fff8f5dab7] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:04:05.880747 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-5d281be4-b8db-4cc8-a2b4-ab26a8152fee tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:05.881199 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-5d281be4-b8db-4cc8-a2b4-ab26a8152fee tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:05.881964 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-5d281be4-b8db-4cc8-a2b4-ab26a8152fee tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:05.882429 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-5d281be4-b8db-4cc8-a2b4-ab26a8152fee tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:06.026810 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-5d281be4-b8db-4cc8-a2b4-ab26a8152fee tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18195083037046bd99166f68690c3dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bf442df39b4f5cbc18f571a0596f10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:04:06.035002 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-5d281be4-b8db-4cc8-a2b4-ab26a8152fee tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] 10.222.0.48 "GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7" status: 200 len: 1576 microversion: 2.1 time: 0.167325 Jun 17 13:04:06.035567 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 295/607] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:04:05 2022] GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7 => generated 1576 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:04:06.234065 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-efba1fab-4431-4fc5-9265-dce3e9061cbc tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:04:06.234661 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-efba1fab-4431-4fc5-9265-dce3e9061cbc tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:04:06.241614 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-efba1fab-4431-4fc5-9265-dce3e9061cbc tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:06.242056 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-efba1fab-4431-4fc5-9265-dce3e9061cbc tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:06.242813 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-efba1fab-4431-4fc5-9265-dce3e9061cbc tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:06.243262 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-efba1fab-4431-4fc5-9265-dce3e9061cbc tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:06.398739 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-efba1fab-4431-4fc5-9265-dce3e9061cbc tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:04:06.407521 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-efba1fab-4431-4fc5-9265-dce3e9061cbc tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1753 microversion: 2.1 time: 0.179293 Jun 17 13:04:06.408063 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 313/608] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:04:06 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1753 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:04:07.052152 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-063be14c-de24-4d32-9471-c68207240708 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:04:07.052754 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-063be14c-de24-4d32-9471-c68207240708 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] [instance: 72889057-861c-42f3-8629-32fff8f5dab7] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:04:07.059921 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-063be14c-de24-4d32-9471-c68207240708 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:07.060365 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-063be14c-de24-4d32-9471-c68207240708 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:07.061144 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-063be14c-de24-4d32-9471-c68207240708 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:07.061578 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-063be14c-de24-4d32-9471-c68207240708 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:07.208686 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-063be14c-de24-4d32-9471-c68207240708 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18195083037046bd99166f68690c3dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bf442df39b4f5cbc18f571a0596f10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:04:07.220129 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-063be14c-de24-4d32-9471-c68207240708 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] 10.222.0.48 "GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7" status: 200 len: 1576 microversion: 2.1 time: 0.171643 Jun 17 13:04:07.220919 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 296/609] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:04:07 2022] GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7 => generated 1576 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:04:07.426002 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-5e1e00fc-f6d9-4956-93bb-609748f77c2c tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:04:07.426637 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-5e1e00fc-f6d9-4956-93bb-609748f77c2c tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:04:07.429004 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_api:SELECT=41 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:04:07.435261 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5e1e00fc-f6d9-4956-93bb-609748f77c2c tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:07.435803 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5e1e00fc-f6d9-4956-93bb-609748f77c2c tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:07.436562 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5e1e00fc-f6d9-4956-93bb-609748f77c2c tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:07.436986 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5e1e00fc-f6d9-4956-93bb-609748f77c2c tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:07.644298 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-5e1e00fc-f6d9-4956-93bb-609748f77c2c tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:04:07.652536 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-5e1e00fc-f6d9-4956-93bb-609748f77c2c tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1753 microversion: 2.1 time: 0.230474 Jun 17 13:04:07.653095 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 314/610] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:04:07 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1753 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:04:08.239070 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-0d574d8d-af3e-4624-ad41-130448308c2a tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:04:08.239621 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-0d574d8d-af3e-4624-ad41-130448308c2a tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] [instance: 72889057-861c-42f3-8629-32fff8f5dab7] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:04:08.248102 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0d574d8d-af3e-4624-ad41-130448308c2a tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:08.248610 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0d574d8d-af3e-4624-ad41-130448308c2a tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:08.249481 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0d574d8d-af3e-4624-ad41-130448308c2a tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:08.250136 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0d574d8d-af3e-4624-ad41-130448308c2a tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:08.388811 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-0d574d8d-af3e-4624-ad41-130448308c2a tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18195083037046bd99166f68690c3dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bf442df39b4f5cbc18f571a0596f10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:04:08.396866 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-0d574d8d-af3e-4624-ad41-130448308c2a tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] 10.222.0.48 "GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7" status: 200 len: 1576 microversion: 2.1 time: 0.163241 Jun 17 13:04:08.397434 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 297/611] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:04:08 2022] GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7 => generated 1576 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:04:08.670553 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-20b52be0-5a08-4df3-a497-871a8e6f57c9 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:04:08.673025 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-20b52be0-5a08-4df3-a497-871a8e6f57c9 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:04:08.682201 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-20b52be0-5a08-4df3-a497-871a8e6f57c9 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:08.682905 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-20b52be0-5a08-4df3-a497-871a8e6f57c9 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:08.684122 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-20b52be0-5a08-4df3-a497-871a8e6f57c9 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:08.684764 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-20b52be0-5a08-4df3-a497-871a8e6f57c9 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:08.954723 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-20b52be0-5a08-4df3-a497-871a8e6f57c9 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:04:08.963378 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-20b52be0-5a08-4df3-a497-871a8e6f57c9 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1753 microversion: 2.1 time: 0.298227 Jun 17 13:04:08.964094 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 315/612] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:04:08 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1753 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:04:09.415178 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-5d07a185-6bdb-4f67-81e5-6a0c9ba73764 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:04:09.415777 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-5d07a185-6bdb-4f67-81e5-6a0c9ba73764 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] [instance: 72889057-861c-42f3-8629-32fff8f5dab7] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:04:09.422497 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-5d07a185-6bdb-4f67-81e5-6a0c9ba73764 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:09.422942 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-5d07a185-6bdb-4f67-81e5-6a0c9ba73764 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:09.423930 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-5d07a185-6bdb-4f67-81e5-6a0c9ba73764 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:09.424359 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-5d07a185-6bdb-4f67-81e5-6a0c9ba73764 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:09.577606 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-5d07a185-6bdb-4f67-81e5-6a0c9ba73764 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18195083037046bd99166f68690c3dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bf442df39b4f5cbc18f571a0596f10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:04:09.586578 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-5d07a185-6bdb-4f67-81e5-6a0c9ba73764 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] 10.222.0.48 "GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7" status: 200 len: 1576 microversion: 2.1 time: 0.175618 Jun 17 13:04:09.587508 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 298/613] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:04:09 2022] GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7 => generated 1576 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:04:09.917742 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-c36b9425-e52b-4c57-a7da-bb2bfc8b0b4f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:04:09.918806 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-c36b9425-e52b-4c57-a7da-bb2bfc8b0b4f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:04:09.925696 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c36b9425-e52b-4c57-a7da-bb2bfc8b0b4f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:09.926177 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c36b9425-e52b-4c57-a7da-bb2bfc8b0b4f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:09.928168 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c36b9425-e52b-4c57-a7da-bb2bfc8b0b4f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:09.928772 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c36b9425-e52b-4c57-a7da-bb2bfc8b0b4f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:09.956749 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.objects.instance [None req-c36b9425-e52b-4c57-a7da-bb2bfc8b0b4f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lazy-loading 'flavor' on Instance uuid 29d26a8a-a734-4531-b9ee-04506c852fe2 {{(pid=117660) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 13:04:09.980816 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-5c18a963-28cd-4fb8-b253-defd17a6e187 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:04:09.981741 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-5c18a963-28cd-4fb8-b253-defd17a6e187 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:04:09.989767 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-5c18a963-28cd-4fb8-b253-defd17a6e187 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:09.990640 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-5c18a963-28cd-4fb8-b253-defd17a6e187 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:09.991570 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-5c18a963-28cd-4fb8-b253-defd17a6e187 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:09.992170 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-5c18a963-28cd-4fb8-b253-defd17a6e187 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:10.147056 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-c36b9425-e52b-4c57-a7da-bb2bfc8b0b4f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "POST /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/action" status: 200 len: 32 microversion: 2.1 time: 0.233151 Jun 17 13:04:10.152589 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 316/614] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Jun 17 13:04:09 2022] POST /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/action => generated 32 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 17 13:04:10.216528 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-5c18a963-28cd-4fb8-b253-defd17a6e187 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:04:10.228959 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [req-1d475290-102c-4733-a045-913f99ad6f2f req-c55706e6-dc6d-46a0-909b-7f9bb53da88c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72889057-861c-42f3-8629-32fff8f5dab7", "name": "network-vif-deleted", "tag": "d7d2b4c7-923d-46bd-94ad-388673be0fbb"}]} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:04:10.245473 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-5c18a963-28cd-4fb8-b253-defd17a6e187 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1758 microversion: 2.1 time: 0.266217 Jun 17 13:04:10.254937 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-1d475290-102c-4733-a045-913f99ad6f2f req-c55706e6-dc6d-46a0-909b-7f9bb53da88c service nova] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:10.256428 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-1d475290-102c-4733-a045-913f99ad6f2f req-c55706e6-dc6d-46a0-909b-7f9bb53da88c service nova] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:10.256559 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 299/615] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:04:09 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1758 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:04:10.261552 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-47be56ac-e54e-45e9-b923-819103374a71 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:04:10.263038 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-47be56ac-e54e-45e9-b923-819103374a71 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:04:10.269673 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-47be56ac-e54e-45e9-b923-819103374a71 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:10.270140 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-47be56ac-e54e-45e9-b923-819103374a71 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:10.270929 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-47be56ac-e54e-45e9-b923-819103374a71 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:10.271364 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-47be56ac-e54e-45e9-b923-819103374a71 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:10.279762 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.compute.server_external_events [req-1d475290-102c-4733-a045-913f99ad6f2f req-c55706e6-dc6d-46a0-909b-7f9bb53da88c service nova] Creating event network-vif-deleted:d7d2b4c7-923d-46bd-94ad-388673be0fbb for instance 72889057-861c-42f3-8629-32fff8f5dab7 on hv-cinder-83754 Jun 17 13:04:10.285505 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [req-1d475290-102c-4733-a045-913f99ad6f2f req-c55706e6-dc6d-46a0-909b-7f9bb53da88c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.136290 Jun 17 13:04:10.286650 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 317/616] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 13:04:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:04:10.426054 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-47be56ac-e54e-45e9-b923-819103374a71 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:04:10.436659 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-47be56ac-e54e-45e9-b923-819103374a71 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.178452 Jun 17 13:04:10.438111 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 300/617] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:04:10 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:04:10.605449 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-975df2ab-9646-47d3-9a61-cc4fcbdb027e tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:04:10.606161 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-975df2ab-9646-47d3-9a61-cc4fcbdb027e tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] [instance: 72889057-861c-42f3-8629-32fff8f5dab7] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:04:10.613640 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-975df2ab-9646-47d3-9a61-cc4fcbdb027e tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:10.614114 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-975df2ab-9646-47d3-9a61-cc4fcbdb027e tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:10.615022 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-975df2ab-9646-47d3-9a61-cc4fcbdb027e tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:10.615457 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-975df2ab-9646-47d3-9a61-cc4fcbdb027e tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:10.685680 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-975df2ab-9646-47d3-9a61-cc4fcbdb027e tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18195083037046bd99166f68690c3dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bf442df39b4f5cbc18f571a0596f10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:04:10.694171 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-975df2ab-9646-47d3-9a61-cc4fcbdb027e tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] 10.222.0.48 "GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7" status: 200 len: 1224 microversion: 2.1 time: 0.093075 Jun 17 13:04:10.694751 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 318/618] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:04:10 2022] GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7 => generated 1224 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:04:11.264460 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-d74eb3b4-4523-4f56-8781-2c237699f60a tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:04:11.265113 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-d74eb3b4-4523-4f56-8781-2c237699f60a tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:04:11.267597 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:04:11.274008 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d74eb3b4-4523-4f56-8781-2c237699f60a tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:11.274567 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d74eb3b4-4523-4f56-8781-2c237699f60a tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:11.275379 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d74eb3b4-4523-4f56-8781-2c237699f60a tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:11.275815 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d74eb3b4-4523-4f56-8781-2c237699f60a tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:11.436425 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-d74eb3b4-4523-4f56-8781-2c237699f60a tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:04:11.445639 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-d74eb3b4-4523-4f56-8781-2c237699f60a tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1758 microversion: 2.1 time: 0.185154 Jun 17 13:04:11.446298 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 301/619] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:04:11 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1758 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:04:11.454523 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-4056daa8-df72-4c88-8aae-c6c4a1dd1be4 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:04:11.455491 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-4056daa8-df72-4c88-8aae-c6c4a1dd1be4 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:04:11.461967 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4056daa8-df72-4c88-8aae-c6c4a1dd1be4 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:11.462450 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4056daa8-df72-4c88-8aae-c6c4a1dd1be4 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:11.463223 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4056daa8-df72-4c88-8aae-c6c4a1dd1be4 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:11.463657 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4056daa8-df72-4c88-8aae-c6c4a1dd1be4 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:11.608989 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-4056daa8-df72-4c88-8aae-c6c4a1dd1be4 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:04:11.617529 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-4056daa8-df72-4c88-8aae-c6c4a1dd1be4 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.166958 Jun 17 13:04:11.618018 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 319/620] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:04:11 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:04:11.711339 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-de5582b1-2335-45bb-bb1c-70ab1abf326d tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:04:11.711939 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-de5582b1-2335-45bb-bb1c-70ab1abf326d tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] [instance: 72889057-861c-42f3-8629-32fff8f5dab7] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:04:11.718679 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-de5582b1-2335-45bb-bb1c-70ab1abf326d tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:11.719128 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-de5582b1-2335-45bb-bb1c-70ab1abf326d tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:11.719936 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-de5582b1-2335-45bb-bb1c-70ab1abf326d tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:11.720503 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-de5582b1-2335-45bb-bb1c-70ab1abf326d tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:11.790704 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-de5582b1-2335-45bb-bb1c-70ab1abf326d tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18195083037046bd99166f68690c3dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bf442df39b4f5cbc18f571a0596f10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:04:11.799486 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-de5582b1-2335-45bb-bb1c-70ab1abf326d tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] 10.222.0.48 "GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7" status: 200 len: 1224 microversion: 2.1 time: 0.091503 Jun 17 13:04:11.800320 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 302/621] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:04:11 2022] GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7 => generated 1224 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:04:12.464012 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-f145ed2a-76f3-405c-bd72-2f8ebc8a0807 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:04:12.464637 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-f145ed2a-76f3-405c-bd72-2f8ebc8a0807 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:04:12.472224 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f145ed2a-76f3-405c-bd72-2f8ebc8a0807 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:12.472643 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f145ed2a-76f3-405c-bd72-2f8ebc8a0807 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:12.473444 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f145ed2a-76f3-405c-bd72-2f8ebc8a0807 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:12.473874 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f145ed2a-76f3-405c-bd72-2f8ebc8a0807 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:12.633995 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-f145ed2a-76f3-405c-bd72-2f8ebc8a0807 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:04:12.639523 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-e0b46a6b-93e5-4aee-a1a8-5eb677c48f2c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:04:12.640583 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-e0b46a6b-93e5-4aee-a1a8-5eb677c48f2c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:04:12.642869 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-f145ed2a-76f3-405c-bd72-2f8ebc8a0807 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1758 microversion: 2.1 time: 0.182906 Jun 17 13:04:12.643474 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 320/622] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:04:12 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1758 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:04:12.654205 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e0b46a6b-93e5-4aee-a1a8-5eb677c48f2c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:12.655012 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e0b46a6b-93e5-4aee-a1a8-5eb677c48f2c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:12.656386 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e0b46a6b-93e5-4aee-a1a8-5eb677c48f2c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:12.656922 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e0b46a6b-93e5-4aee-a1a8-5eb677c48f2c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:12.822980 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-ebb06fc2-eb52-40dd-bb9f-5bc6b5348015 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:04:12.823540 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-ebb06fc2-eb52-40dd-bb9f-5bc6b5348015 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] [instance: 72889057-861c-42f3-8629-32fff8f5dab7] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:04:12.830402 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ebb06fc2-eb52-40dd-bb9f-5bc6b5348015 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:12.830851 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ebb06fc2-eb52-40dd-bb9f-5bc6b5348015 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:12.831838 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ebb06fc2-eb52-40dd-bb9f-5bc6b5348015 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:12.832271 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ebb06fc2-eb52-40dd-bb9f-5bc6b5348015 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:12.843941 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-e0b46a6b-93e5-4aee-a1a8-5eb677c48f2c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:04:12.855692 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-e0b46a6b-93e5-4aee-a1a8-5eb677c48f2c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.223292 Jun 17 13:04:12.863442 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 303/623] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:04:12 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:04:12.915851 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-ebb06fc2-eb52-40dd-bb9f-5bc6b5348015 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18195083037046bd99166f68690c3dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bf442df39b4f5cbc18f571a0596f10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:04:12.925641 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-ebb06fc2-eb52-40dd-bb9f-5bc6b5348015 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] 10.222.0.48 "GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7" status: 200 len: 1224 microversion: 2.1 time: 0.107970 Jun 17 13:04:12.926154 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 321/624] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:04:12 2022] GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7 => generated 1224 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 13:04:13.661760 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-75936987-95ff-4a89-a8f6-38f8382874cb tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:04:13.662642 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-75936987-95ff-4a89-a8f6-38f8382874cb tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:04:13.670146 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-75936987-95ff-4a89-a8f6-38f8382874cb tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:13.670631 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-75936987-95ff-4a89-a8f6-38f8382874cb tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:13.671751 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-75936987-95ff-4a89-a8f6-38f8382874cb tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:13.672342 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-75936987-95ff-4a89-a8f6-38f8382874cb tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:13.845791 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-75936987-95ff-4a89-a8f6-38f8382874cb tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:04:13.855000 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-75936987-95ff-4a89-a8f6-38f8382874cb tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1758 microversion: 2.1 time: 0.197851 Jun 17 13:04:13.855601 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 304/625] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:04:13 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1758 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:04:13.877377 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-63f141e8-7af6-4554-8870-05a12e3a57db tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:04:13.878496 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-63f141e8-7af6-4554-8870-05a12e3a57db tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:04:13.888572 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-63f141e8-7af6-4554-8870-05a12e3a57db tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:13.889008 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-63f141e8-7af6-4554-8870-05a12e3a57db tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:13.889780 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-63f141e8-7af6-4554-8870-05a12e3a57db tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:13.890246 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-63f141e8-7af6-4554-8870-05a12e3a57db tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:13.946869 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-119c8520-5713-4443-9073-a1076b34c6b0 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:04:13.947091 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-119c8520-5713-4443-9073-a1076b34c6b0 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] [instance: 72889057-861c-42f3-8629-32fff8f5dab7] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:04:13.953716 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-119c8520-5713-4443-9073-a1076b34c6b0 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:13.954193 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-119c8520-5713-4443-9073-a1076b34c6b0 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:13.954967 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-119c8520-5713-4443-9073-a1076b34c6b0 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:13.955378 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-119c8520-5713-4443-9073-a1076b34c6b0 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:14.038289 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-119c8520-5713-4443-9073-a1076b34c6b0 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18195083037046bd99166f68690c3dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bf442df39b4f5cbc18f571a0596f10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:04:14.046922 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-119c8520-5713-4443-9073-a1076b34c6b0 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] 10.222.0.48 "GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7" status: 200 len: 1224 microversion: 2.1 time: 0.104339 Jun 17 13:04:14.047510 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 305/626] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:04:13 2022] GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7 => generated 1224 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:04:14.060282 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-63f141e8-7af6-4554-8870-05a12e3a57db tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:04:14.072938 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-63f141e8-7af6-4554-8870-05a12e3a57db tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.202214 Jun 17 13:04:14.073330 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 322/627] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:04:13 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:04:14.872803 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-d139eebf-0674-487a-ae88-30f7516dd2df tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:04:14.873395 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-d139eebf-0674-487a-ae88-30f7516dd2df tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:04:14.881804 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d139eebf-0674-487a-ae88-30f7516dd2df tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:14.882300 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d139eebf-0674-487a-ae88-30f7516dd2df tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:14.883209 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d139eebf-0674-487a-ae88-30f7516dd2df tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:14.883652 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d139eebf-0674-487a-ae88-30f7516dd2df tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:15.037426 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-d139eebf-0674-487a-ae88-30f7516dd2df tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:04:15.046398 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-d139eebf-0674-487a-ae88-30f7516dd2df tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1758 microversion: 2.1 time: 0.177461 Jun 17 13:04:15.047034 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 306/628] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:04:14 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1758 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:04:15.064848 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-6ad347dc-ed05-4b0b-9b1e-68d6040811b4 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:04:15.065453 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-6ad347dc-ed05-4b0b-9b1e-68d6040811b4 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] [instance: 72889057-861c-42f3-8629-32fff8f5dab7] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:04:15.072131 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6ad347dc-ed05-4b0b-9b1e-68d6040811b4 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:15.072577 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6ad347dc-ed05-4b0b-9b1e-68d6040811b4 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:15.073986 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6ad347dc-ed05-4b0b-9b1e-68d6040811b4 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:15.074458 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6ad347dc-ed05-4b0b-9b1e-68d6040811b4 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:15.095190 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-aee894b6-b2ca-4946-bbc5-f7fcd84fc5e9 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:04:15.096167 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-aee894b6-b2ca-4946-bbc5-f7fcd84fc5e9 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:04:15.102941 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-aee894b6-b2ca-4946-bbc5-f7fcd84fc5e9 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:15.103947 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-aee894b6-b2ca-4946-bbc5-f7fcd84fc5e9 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:15.104903 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-aee894b6-b2ca-4946-bbc5-f7fcd84fc5e9 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:15.105520 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-aee894b6-b2ca-4946-bbc5-f7fcd84fc5e9 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:15.135273 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_cell1:SELECT=100 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:04:15.151033 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-6ad347dc-ed05-4b0b-9b1e-68d6040811b4 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18195083037046bd99166f68690c3dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bf442df39b4f5cbc18f571a0596f10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:04:15.162607 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-6ad347dc-ed05-4b0b-9b1e-68d6040811b4 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] 10.222.0.48 "GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7" status: 200 len: 1224 microversion: 2.1 time: 0.099184 Jun 17 13:04:15.162607 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 323/629] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:04:15 2022] GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7 => generated 1224 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:04:15.263875 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-aee894b6-b2ca-4946-bbc5-f7fcd84fc5e9 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:04:15.272377 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-aee894b6-b2ca-4946-bbc5-f7fcd84fc5e9 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.181781 Jun 17 13:04:15.273000 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 307/630] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:04:15 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:04:16.064110 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-5e8a0614-ce5e-49a1-bb9c-b73ee0a4cf13 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:04:16.064732 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-5e8a0614-ce5e-49a1-bb9c-b73ee0a4cf13 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:04:16.071604 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5e8a0614-ce5e-49a1-bb9c-b73ee0a4cf13 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:16.072237 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5e8a0614-ce5e-49a1-bb9c-b73ee0a4cf13 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:16.072825 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5e8a0614-ce5e-49a1-bb9c-b73ee0a4cf13 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:16.073296 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5e8a0614-ce5e-49a1-bb9c-b73ee0a4cf13 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:16.178292 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-ac86affc-ae2a-426c-9f77-43eb098000d6 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:04:16.178922 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-ac86affc-ae2a-426c-9f77-43eb098000d6 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] [instance: 72889057-861c-42f3-8629-32fff8f5dab7] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:04:16.187617 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ac86affc-ae2a-426c-9f77-43eb098000d6 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:16.187617 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ac86affc-ae2a-426c-9f77-43eb098000d6 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:16.188537 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ac86affc-ae2a-426c-9f77-43eb098000d6 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:16.189041 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ac86affc-ae2a-426c-9f77-43eb098000d6 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:16.238625 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-5e8a0614-ce5e-49a1-bb9c-b73ee0a4cf13 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:04:16.249049 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-5e8a0614-ce5e-49a1-bb9c-b73ee0a4cf13 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1758 microversion: 2.1 time: 0.187805 Jun 17 13:04:16.249049 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 324/631] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:04:16 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1758 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:04:16.265600 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-ac86affc-ae2a-426c-9f77-43eb098000d6 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18195083037046bd99166f68690c3dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bf442df39b4f5cbc18f571a0596f10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:04:16.274745 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-ac86affc-ae2a-426c-9f77-43eb098000d6 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] 10.222.0.48 "GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7" status: 200 len: 1224 microversion: 2.1 time: 0.100505 Jun 17 13:04:16.275319 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 308/632] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:04:16 2022] GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7 => generated 1224 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:04:16.289619 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-d9793a96-c371-4c1b-ae21-ff38e0a5c9ab tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:04:16.290391 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-d9793a96-c371-4c1b-ae21-ff38e0a5c9ab tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:04:16.297603 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d9793a96-c371-4c1b-ae21-ff38e0a5c9ab tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:16.298129 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d9793a96-c371-4c1b-ae21-ff38e0a5c9ab tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:16.299017 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d9793a96-c371-4c1b-ae21-ff38e0a5c9ab tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:16.299576 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d9793a96-c371-4c1b-ae21-ff38e0a5c9ab tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:16.305257 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:04:16.445351 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-d9793a96-c371-4c1b-ae21-ff38e0a5c9ab tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:04:16.453891 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-d9793a96-c371-4c1b-ae21-ff38e0a5c9ab tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.168220 Jun 17 13:04:16.455234 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 325/633] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:04:16 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 13:04:17.265922 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-9b9205ff-4aa8-47bc-9f2a-818887177091 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:04:17.266547 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-9b9205ff-4aa8-47bc-9f2a-818887177091 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:04:17.273775 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9b9205ff-4aa8-47bc-9f2a-818887177091 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:17.274259 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9b9205ff-4aa8-47bc-9f2a-818887177091 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:17.275023 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9b9205ff-4aa8-47bc-9f2a-818887177091 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:17.275454 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9b9205ff-4aa8-47bc-9f2a-818887177091 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:17.292706 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-0503189c-b00d-4cda-94c1-1af5d70ef269 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:04:17.293416 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-0503189c-b00d-4cda-94c1-1af5d70ef269 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] [instance: 72889057-861c-42f3-8629-32fff8f5dab7] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:04:17.302243 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0503189c-b00d-4cda-94c1-1af5d70ef269 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:17.302699 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0503189c-b00d-4cda-94c1-1af5d70ef269 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:17.303513 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0503189c-b00d-4cda-94c1-1af5d70ef269 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:17.304042 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0503189c-b00d-4cda-94c1-1af5d70ef269 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:17.378372 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-0503189c-b00d-4cda-94c1-1af5d70ef269 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18195083037046bd99166f68690c3dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bf442df39b4f5cbc18f571a0596f10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:04:17.391419 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-0503189c-b00d-4cda-94c1-1af5d70ef269 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] 10.222.0.48 "GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7" status: 200 len: 1224 microversion: 2.1 time: 0.100568 Jun 17 13:04:17.391419 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 326/634] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:04:17 2022] GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7 => generated 1224 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:04:17.470742 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-9b9205ff-4aa8-47bc-9f2a-818887177091 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:04:17.474068 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-723fb88b-70ec-4a58-9a08-0faf5360d189 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:04:17.474793 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-723fb88b-70ec-4a58-9a08-0faf5360d189 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:04:17.479439 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-9b9205ff-4aa8-47bc-9f2a-818887177091 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1758 microversion: 2.1 time: 0.217539 Jun 17 13:04:17.480037 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 309/635] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:04:17 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1758 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:04:17.480976 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-723fb88b-70ec-4a58-9a08-0faf5360d189 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:17.482240 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-723fb88b-70ec-4a58-9a08-0faf5360d189 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:17.482392 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-723fb88b-70ec-4a58-9a08-0faf5360d189 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:17.482837 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-723fb88b-70ec-4a58-9a08-0faf5360d189 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:17.632415 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-723fb88b-70ec-4a58-9a08-0faf5360d189 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:04:17.641132 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-723fb88b-70ec-4a58-9a08-0faf5360d189 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.171551 Jun 17 13:04:17.641725 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 327/636] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:04:17 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 13:04:18.410293 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-3203dd88-6ac8-4034-8549-ab65356d00cf tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:04:18.410915 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-3203dd88-6ac8-4034-8549-ab65356d00cf tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] [instance: 72889057-861c-42f3-8629-32fff8f5dab7] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:04:18.417643 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-3203dd88-6ac8-4034-8549-ab65356d00cf tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:18.418132 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-3203dd88-6ac8-4034-8549-ab65356d00cf tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:18.419419 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-3203dd88-6ac8-4034-8549-ab65356d00cf tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:18.420081 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-3203dd88-6ac8-4034-8549-ab65356d00cf tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:18.488294 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-3203dd88-6ac8-4034-8549-ab65356d00cf tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18195083037046bd99166f68690c3dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bf442df39b4f5cbc18f571a0596f10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:04:18.497438 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-3203dd88-6ac8-4034-8549-ab65356d00cf tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] 10.222.0.48 "GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7" status: 200 len: 1224 microversion: 2.1 time: 0.091664 Jun 17 13:04:18.500627 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 310/637] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:04:18 2022] GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7 => generated 1224 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:04:18.500866 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-ed80c402-cf75-4c6a-971a-75d5cbad791d tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:04:18.500866 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-ed80c402-cf75-4c6a-971a-75d5cbad791d tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:04:18.509062 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ed80c402-cf75-4c6a-971a-75d5cbad791d tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:18.509515 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ed80c402-cf75-4c6a-971a-75d5cbad791d tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:18.510330 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ed80c402-cf75-4c6a-971a-75d5cbad791d tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:18.510746 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ed80c402-cf75-4c6a-971a-75d5cbad791d tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:18.659372 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-78c701dd-edb7-406d-994f-c365302cbcdc tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:04:18.660304 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-78c701dd-edb7-406d-994f-c365302cbcdc tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:04:18.667816 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-78c701dd-edb7-406d-994f-c365302cbcdc tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:18.668364 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-78c701dd-edb7-406d-994f-c365302cbcdc tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:18.669244 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-78c701dd-edb7-406d-994f-c365302cbcdc tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:18.669739 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-78c701dd-edb7-406d-994f-c365302cbcdc tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:18.674144 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-ed80c402-cf75-4c6a-971a-75d5cbad791d tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:04:18.682617 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-ed80c402-cf75-4c6a-971a-75d5cbad791d tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1758 microversion: 2.1 time: 0.189102 Jun 17 13:04:18.683196 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 328/638] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:04:18 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1758 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:04:18.747784 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-e13c74f9-5bd3-4dfd-967c-7cfdb57917b5 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:04:18.748485 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-e13c74f9-5bd3-4dfd-967c-7cfdb57917b5 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:04:18.755452 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e13c74f9-5bd3-4dfd-967c-7cfdb57917b5 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:18.755887 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e13c74f9-5bd3-4dfd-967c-7cfdb57917b5 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:18.756667 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e13c74f9-5bd3-4dfd-967c-7cfdb57917b5 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:18.757091 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e13c74f9-5bd3-4dfd-967c-7cfdb57917b5 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:18.791097 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-e13c74f9-5bd3-4dfd-967c-7cfdb57917b5 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments/dc0d8f94-669d-473e-b967-103b03ff07d8" status: 200 len: 194 microversion: 2.20 time: 0.048260 Jun 17 13:04:18.791722 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 329/639] 10.222.0.48 () {60 vars in 1453 bytes} [Fri Jun 17 13:04:18 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments/dc0d8f94-669d-473e-b967-103b03ff07d8 => generated 194 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:04:18.823131 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-78c701dd-edb7-406d-994f-c365302cbcdc tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:04:18.832145 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-78c701dd-edb7-406d-994f-c365302cbcdc tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.176715 Jun 17 13:04:18.832745 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 311/640] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:04:18 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:04:19.516650 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-ad6f708d-a712-4a38-8e33-9a3fdb530a3e tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:04:19.517233 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-ad6f708d-a712-4a38-8e33-9a3fdb530a3e tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] [instance: 72889057-861c-42f3-8629-32fff8f5dab7] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:04:19.525501 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ad6f708d-a712-4a38-8e33-9a3fdb530a3e tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:19.526025 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ad6f708d-a712-4a38-8e33-9a3fdb530a3e tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:19.529650 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ad6f708d-a712-4a38-8e33-9a3fdb530a3e tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:19.529650 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ad6f708d-a712-4a38-8e33-9a3fdb530a3e tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:19.592195 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-ad6f708d-a712-4a38-8e33-9a3fdb530a3e tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18195083037046bd99166f68690c3dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bf442df39b4f5cbc18f571a0596f10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:04:19.600212 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-ad6f708d-a712-4a38-8e33-9a3fdb530a3e tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] 10.222.0.48 "GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7" status: 200 len: 1224 microversion: 2.1 time: 0.087533 Jun 17 13:04:19.601350 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 330/641] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:04:19 2022] GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7 => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:04:19.700506 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-4fc383cd-512d-4344-b86e-78349bc1ac1b tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:04:19.701080 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-4fc383cd-512d-4344-b86e-78349bc1ac1b tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:04:19.708139 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4fc383cd-512d-4344-b86e-78349bc1ac1b tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:19.708587 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4fc383cd-512d-4344-b86e-78349bc1ac1b tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:19.709348 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4fc383cd-512d-4344-b86e-78349bc1ac1b tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:19.709777 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4fc383cd-512d-4344-b86e-78349bc1ac1b tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:19.849594 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-426d8333-594d-4ce2-8cb8-dfbfb75333f8 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:04:19.850082 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-426d8333-594d-4ce2-8cb8-dfbfb75333f8 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:04:19.856773 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-426d8333-594d-4ce2-8cb8-dfbfb75333f8 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:19.857228 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-426d8333-594d-4ce2-8cb8-dfbfb75333f8 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:19.857983 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-426d8333-594d-4ce2-8cb8-dfbfb75333f8 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:19.858444 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-426d8333-594d-4ce2-8cb8-dfbfb75333f8 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:19.869846 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-4fc383cd-512d-4344-b86e-78349bc1ac1b tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:04:19.878769 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-4fc383cd-512d-4344-b86e-78349bc1ac1b tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1758 microversion: 2.1 time: 0.182049 Jun 17 13:04:19.879337 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 312/642] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:04:19 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1758 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:04:19.992427 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-426d8333-594d-4ce2-8cb8-dfbfb75333f8 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:04:20.000871 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-426d8333-594d-4ce2-8cb8-dfbfb75333f8 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.155476 Jun 17 13:04:20.001430 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 331/643] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:04:19 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:04:20.617766 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-f055d376-659a-4336-b3f9-059d57190d4c tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:04:20.618380 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-f055d376-659a-4336-b3f9-059d57190d4c tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] [instance: 72889057-861c-42f3-8629-32fff8f5dab7] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:04:20.624958 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f055d376-659a-4336-b3f9-059d57190d4c tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:20.625407 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f055d376-659a-4336-b3f9-059d57190d4c tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:20.626208 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f055d376-659a-4336-b3f9-059d57190d4c tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:20.626643 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f055d376-659a-4336-b3f9-059d57190d4c tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:20.690315 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-f055d376-659a-4336-b3f9-059d57190d4c tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18195083037046bd99166f68690c3dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bf442df39b4f5cbc18f571a0596f10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:04:20.698460 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-f055d376-659a-4336-b3f9-059d57190d4c tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] 10.222.0.48 "GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7" status: 200 len: 1224 microversion: 2.1 time: 0.084618 Jun 17 13:04:20.699036 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 313/644] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:04:20 2022] GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:04:20.897750 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-cdd5a7d9-7b43-4378-a1b5-4d93e5577820 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:04:20.898771 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-cdd5a7d9-7b43-4378-a1b5-4d93e5577820 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:04:20.908912 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cdd5a7d9-7b43-4378-a1b5-4d93e5577820 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:20.909366 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cdd5a7d9-7b43-4378-a1b5-4d93e5577820 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:20.910557 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cdd5a7d9-7b43-4378-a1b5-4d93e5577820 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:20.911090 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cdd5a7d9-7b43-4378-a1b5-4d93e5577820 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:21.019958 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-9c19b04b-3301-490b-a31d-4824f3720655 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:04:21.020680 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-9c19b04b-3301-490b-a31d-4824f3720655 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:04:21.028032 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9c19b04b-3301-490b-a31d-4824f3720655 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:21.028583 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9c19b04b-3301-490b-a31d-4824f3720655 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:21.029670 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9c19b04b-3301-490b-a31d-4824f3720655 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:21.030186 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9c19b04b-3301-490b-a31d-4824f3720655 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:21.087837 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-cdd5a7d9-7b43-4378-a1b5-4d93e5577820 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:04:21.096391 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-cdd5a7d9-7b43-4378-a1b5-4d93e5577820 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1758 microversion: 2.1 time: 0.204016 Jun 17 13:04:21.096973 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 332/645] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:04:20 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1758 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:04:21.189757 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-9c19b04b-3301-490b-a31d-4824f3720655 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:04:21.200817 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-9c19b04b-3301-490b-a31d-4824f3720655 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.185292 Jun 17 13:04:21.201486 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 314/646] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:04:21 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 13:04:21.716130 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-08a79dac-094d-4c6c-9d50-c4a8abd78bbd tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:04:21.716740 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-08a79dac-094d-4c6c-9d50-c4a8abd78bbd tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] [instance: 72889057-861c-42f3-8629-32fff8f5dab7] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:04:21.724633 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-08a79dac-094d-4c6c-9d50-c4a8abd78bbd tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:21.725274 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-08a79dac-094d-4c6c-9d50-c4a8abd78bbd tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:21.726424 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-08a79dac-094d-4c6c-9d50-c4a8abd78bbd tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:21.726906 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-08a79dac-094d-4c6c-9d50-c4a8abd78bbd tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:21.792728 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-08a79dac-094d-4c6c-9d50-c4a8abd78bbd tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18195083037046bd99166f68690c3dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bf442df39b4f5cbc18f571a0596f10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:04:21.801950 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-08a79dac-094d-4c6c-9d50-c4a8abd78bbd tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] 10.222.0.48 "GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7" status: 200 len: 1224 microversion: 2.1 time: 0.089689 Jun 17 13:04:21.802633 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 333/647] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:04:21 2022] GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7 => generated 1224 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:04:22.114002 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-6c8659d9-227e-45ba-ac86-70f21cce0771 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:04:22.114629 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-6c8659d9-227e-45ba-ac86-70f21cce0771 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:04:22.121682 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6c8659d9-227e-45ba-ac86-70f21cce0771 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:22.122133 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6c8659d9-227e-45ba-ac86-70f21cce0771 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:22.122913 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6c8659d9-227e-45ba-ac86-70f21cce0771 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:22.123321 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6c8659d9-227e-45ba-ac86-70f21cce0771 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:22.225340 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-6f15df13-11ac-4663-9a90-9955417e3b76 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:04:22.225985 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-6f15df13-11ac-4663-9a90-9955417e3b76 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:04:22.232903 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6f15df13-11ac-4663-9a90-9955417e3b76 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:22.233344 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6f15df13-11ac-4663-9a90-9955417e3b76 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:22.234143 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6f15df13-11ac-4663-9a90-9955417e3b76 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:22.234588 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6f15df13-11ac-4663-9a90-9955417e3b76 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:22.292610 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-6c8659d9-227e-45ba-ac86-70f21cce0771 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:04:22.300911 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-6c8659d9-227e-45ba-ac86-70f21cce0771 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1758 microversion: 2.1 time: 0.190827 Jun 17 13:04:22.301499 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 315/648] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:04:22 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1758 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:04:22.383990 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-6f15df13-11ac-4663-9a90-9955417e3b76 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:04:22.392611 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-6f15df13-11ac-4663-9a90-9955417e3b76 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.173238 Jun 17 13:04:22.393240 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 334/649] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:04:22 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:04:22.822258 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-c716aab4-b325-46d1-9356-3e80d8bd97ef tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:04:22.822899 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-c716aab4-b325-46d1-9356-3e80d8bd97ef tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] [instance: 72889057-861c-42f3-8629-32fff8f5dab7] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:04:22.829619 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c716aab4-b325-46d1-9356-3e80d8bd97ef tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:22.830072 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c716aab4-b325-46d1-9356-3e80d8bd97ef tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:22.830893 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c716aab4-b325-46d1-9356-3e80d8bd97ef tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:22.831348 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c716aab4-b325-46d1-9356-3e80d8bd97ef tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:22.898963 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-c716aab4-b325-46d1-9356-3e80d8bd97ef tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18195083037046bd99166f68690c3dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bf442df39b4f5cbc18f571a0596f10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:04:22.906807 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-c716aab4-b325-46d1-9356-3e80d8bd97ef tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] 10.222.0.48 "GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7" status: 200 len: 1224 microversion: 2.1 time: 0.088582 Jun 17 13:04:22.907376 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 316/650] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:04:22 2022] GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7 => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:04:23.320214 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-50e13367-80b4-4984-8591-b19afe9c189d tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:04:23.321132 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-50e13367-80b4-4984-8591-b19afe9c189d tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:04:23.330483 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-50e13367-80b4-4984-8591-b19afe9c189d tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:23.330966 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-50e13367-80b4-4984-8591-b19afe9c189d tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:23.331909 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-50e13367-80b4-4984-8591-b19afe9c189d tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:23.332881 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-50e13367-80b4-4984-8591-b19afe9c189d tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:23.410785 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-6defbe9a-0e90-46ac-9aec-543e34c2d06e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:04:23.411406 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-6defbe9a-0e90-46ac-9aec-543e34c2d06e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:04:23.418642 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6defbe9a-0e90-46ac-9aec-543e34c2d06e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:23.419088 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6defbe9a-0e90-46ac-9aec-543e34c2d06e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:23.419839 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6defbe9a-0e90-46ac-9aec-543e34c2d06e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:23.420264 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6defbe9a-0e90-46ac-9aec-543e34c2d06e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:23.789438 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-6defbe9a-0e90-46ac-9aec-543e34c2d06e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:04:23.794345 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-50e13367-80b4-4984-8591-b19afe9c189d tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:04:23.800424 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-6defbe9a-0e90-46ac-9aec-543e34c2d06e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.393479 Jun 17 13:04:23.801961 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 317/651] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:04:23 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:04:23.805786 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-50e13367-80b4-4984-8591-b19afe9c189d tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1758 microversion: 2.1 time: 0.490634 Jun 17 13:04:23.806478 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 335/652] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:04:23 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1758 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:04:23.924670 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-6aafae0a-c5d3-42d0-b8fb-8c8b04a69b77 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:04:23.925278 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-6aafae0a-c5d3-42d0-b8fb-8c8b04a69b77 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] [instance: 72889057-861c-42f3-8629-32fff8f5dab7] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:04:23.932219 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6aafae0a-c5d3-42d0-b8fb-8c8b04a69b77 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:23.932703 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6aafae0a-c5d3-42d0-b8fb-8c8b04a69b77 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:23.933455 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6aafae0a-c5d3-42d0-b8fb-8c8b04a69b77 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:23.933953 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6aafae0a-c5d3-42d0-b8fb-8c8b04a69b77 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:24.002841 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-6aafae0a-c5d3-42d0-b8fb-8c8b04a69b77 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18195083037046bd99166f68690c3dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bf442df39b4f5cbc18f571a0596f10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:04:24.014332 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-6aafae0a-c5d3-42d0-b8fb-8c8b04a69b77 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] 10.222.0.48 "GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7" status: 200 len: 1224 microversion: 2.1 time: 0.093356 Jun 17 13:04:24.015169 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 318/653] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:04:23 2022] GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7 => generated 1224 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:04:24.819412 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-a97348d2-0474-458a-b559-7378484d09bf tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:04:24.820020 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-a97348d2-0474-458a-b559-7378484d09bf tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:04:24.822490 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-f0c88cf1-5c77-41ba-a5aa-6a5a986bca51 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:04:24.823258 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-f0c88cf1-5c77-41ba-a5aa-6a5a986bca51 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:04:24.826970 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a97348d2-0474-458a-b559-7378484d09bf tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:24.827407 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a97348d2-0474-458a-b559-7378484d09bf tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:24.828532 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a97348d2-0474-458a-b559-7378484d09bf tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:24.828986 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a97348d2-0474-458a-b559-7378484d09bf tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:24.829879 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f0c88cf1-5c77-41ba-a5aa-6a5a986bca51 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:24.830368 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f0c88cf1-5c77-41ba-a5aa-6a5a986bca51 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:24.831144 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f0c88cf1-5c77-41ba-a5aa-6a5a986bca51 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:24.831774 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f0c88cf1-5c77-41ba-a5aa-6a5a986bca51 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:25.030568 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-a97348d2-0474-458a-b559-7378484d09bf tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:04:25.038550 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-a97348d2-0474-458a-b559-7378484d09bf tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.223045 Jun 17 13:04:25.039128 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 336/654] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:04:24 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:04:25.048521 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-5a29571c-f01e-4677-aa96-f0d582cb769d tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:04:25.048521 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-5a29571c-f01e-4677-aa96-f0d582cb769d tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] [instance: 72889057-861c-42f3-8629-32fff8f5dab7] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:04:25.048870 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-f0c88cf1-5c77-41ba-a5aa-6a5a986bca51 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:04:25.051036 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5a29571c-f01e-4677-aa96-f0d582cb769d tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:25.051707 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5a29571c-f01e-4677-aa96-f0d582cb769d tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:25.052492 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5a29571c-f01e-4677-aa96-f0d582cb769d tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:25.052943 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5a29571c-f01e-4677-aa96-f0d582cb769d tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:25.055672 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-f0c88cf1-5c77-41ba-a5aa-6a5a986bca51 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1758 microversion: 2.1 time: 0.236974 Jun 17 13:04:25.056254 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 319/655] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:04:24 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1758 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:04:25.115664 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-5a29571c-f01e-4677-aa96-f0d582cb769d tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18195083037046bd99166f68690c3dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bf442df39b4f5cbc18f571a0596f10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:04:25.123514 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-5a29571c-f01e-4677-aa96-f0d582cb769d tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] 10.222.0.48 "GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7" status: 200 len: 1224 microversion: 2.1 time: 0.083462 Jun 17 13:04:25.124092 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 337/656] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:04:25 2022] GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:04:26.056947 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-2776c62f-afa6-473d-86c4-26021e740b51 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:04:26.057552 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-2776c62f-afa6-473d-86c4-26021e740b51 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:04:26.064899 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2776c62f-afa6-473d-86c4-26021e740b51 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:26.065381 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2776c62f-afa6-473d-86c4-26021e740b51 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:26.066125 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2776c62f-afa6-473d-86c4-26021e740b51 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:26.066581 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2776c62f-afa6-473d-86c4-26021e740b51 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:26.074796 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-23b2e127-58dc-4bf6-8382-1fd2cb64eed8 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:04:26.076189 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-23b2e127-58dc-4bf6-8382-1fd2cb64eed8 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:04:26.084410 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-23b2e127-58dc-4bf6-8382-1fd2cb64eed8 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:26.085506 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-23b2e127-58dc-4bf6-8382-1fd2cb64eed8 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:26.086400 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-23b2e127-58dc-4bf6-8382-1fd2cb64eed8 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:26.087338 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-23b2e127-58dc-4bf6-8382-1fd2cb64eed8 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:26.270762 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-2776c62f-afa6-473d-86c4-26021e740b51 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:04:26.280229 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-2776c62f-afa6-473d-86c4-26021e740b51 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.227294 Jun 17 13:04:26.281482 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 320/657] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:04:26 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:04:26.285682 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-4fbc0323-5608-4d05-a7c3-28afd6d5e415 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:04:26.286372 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-4fbc0323-5608-4d05-a7c3-28afd6d5e415 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] [instance: 72889057-861c-42f3-8629-32fff8f5dab7] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:04:26.292861 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4fbc0323-5608-4d05-a7c3-28afd6d5e415 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:26.293311 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4fbc0323-5608-4d05-a7c3-28afd6d5e415 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:26.294119 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4fbc0323-5608-4d05-a7c3-28afd6d5e415 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:26.294574 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4fbc0323-5608-4d05-a7c3-28afd6d5e415 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:26.323057 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-23b2e127-58dc-4bf6-8382-1fd2cb64eed8 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:04:26.331520 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-23b2e127-58dc-4bf6-8382-1fd2cb64eed8 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1758 microversion: 2.1 time: 0.262223 Jun 17 13:04:26.332312 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 338/658] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:04:26 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1758 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:04:26.366650 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-4fbc0323-5608-4d05-a7c3-28afd6d5e415 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18195083037046bd99166f68690c3dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bf442df39b4f5cbc18f571a0596f10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:04:26.374682 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-4fbc0323-5608-4d05-a7c3-28afd6d5e415 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] 10.222.0.48 "GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7" status: 200 len: 1224 microversion: 2.1 time: 0.092718 Jun 17 13:04:26.375272 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 321/659] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:04:26 2022] GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7 => generated 1224 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:04:27.301360 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-1cc0010a-0b6d-46d9-9bd5-3ee77f78ee43 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:04:27.302471 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-1cc0010a-0b6d-46d9-9bd5-3ee77f78ee43 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:04:27.310432 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1cc0010a-0b6d-46d9-9bd5-3ee77f78ee43 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:27.310935 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1cc0010a-0b6d-46d9-9bd5-3ee77f78ee43 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:27.311881 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1cc0010a-0b6d-46d9-9bd5-3ee77f78ee43 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:27.312557 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1cc0010a-0b6d-46d9-9bd5-3ee77f78ee43 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:27.349790 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-abf19610-55e7-4e21-8541-251bc10f1d1a tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:04:27.350483 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-abf19610-55e7-4e21-8541-251bc10f1d1a tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:04:27.357468 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-abf19610-55e7-4e21-8541-251bc10f1d1a tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:27.357913 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-abf19610-55e7-4e21-8541-251bc10f1d1a tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:27.358713 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-abf19610-55e7-4e21-8541-251bc10f1d1a tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:27.359146 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-abf19610-55e7-4e21-8541-251bc10f1d1a tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:27.500121 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-1cc0010a-0b6d-46d9-9bd5-3ee77f78ee43 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:04:27.509028 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-1cc0010a-0b6d-46d9-9bd5-3ee77f78ee43 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.214064 Jun 17 13:04:27.509682 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 339/660] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:04:27 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:04:27.514270 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-fa000ad1-44a5-4f0a-9bfd-26c81cef79a3 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:04:27.514864 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-fa000ad1-44a5-4f0a-9bfd-26c81cef79a3 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] [instance: 72889057-861c-42f3-8629-32fff8f5dab7] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:04:27.521753 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fa000ad1-44a5-4f0a-9bfd-26c81cef79a3 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:27.522210 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fa000ad1-44a5-4f0a-9bfd-26c81cef79a3 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:27.522972 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fa000ad1-44a5-4f0a-9bfd-26c81cef79a3 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:27.523399 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fa000ad1-44a5-4f0a-9bfd-26c81cef79a3 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:27.555556 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-abf19610-55e7-4e21-8541-251bc10f1d1a tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:04:27.564234 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-abf19610-55e7-4e21-8541-251bc10f1d1a tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1758 microversion: 2.1 time: 0.219120 Jun 17 13:04:27.564833 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 322/661] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:04:27 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1758 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:04:27.584587 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-fa000ad1-44a5-4f0a-9bfd-26c81cef79a3 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18195083037046bd99166f68690c3dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bf442df39b4f5cbc18f571a0596f10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:04:27.592326 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-fa000ad1-44a5-4f0a-9bfd-26c81cef79a3 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] 10.222.0.48 "GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7" status: 200 len: 1224 microversion: 2.1 time: 0.081624 Jun 17 13:04:27.592902 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 340/662] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:04:27 2022] GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:04:28.528284 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-31e67ecc-b454-43d0-843b-b9ebccd49f37 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:04:28.528854 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-31e67ecc-b454-43d0-843b-b9ebccd49f37 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:04:28.535733 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-31e67ecc-b454-43d0-843b-b9ebccd49f37 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:28.536179 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-31e67ecc-b454-43d0-843b-b9ebccd49f37 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:28.537086 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-31e67ecc-b454-43d0-843b-b9ebccd49f37 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:28.537493 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-31e67ecc-b454-43d0-843b-b9ebccd49f37 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:28.582625 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-6c7a76e7-72a1-4536-9157-0fb4aeba58aa tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:04:28.583238 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-6c7a76e7-72a1-4536-9157-0fb4aeba58aa tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:04:28.590635 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6c7a76e7-72a1-4536-9157-0fb4aeba58aa tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:28.591086 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6c7a76e7-72a1-4536-9157-0fb4aeba58aa tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:28.591867 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6c7a76e7-72a1-4536-9157-0fb4aeba58aa tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:28.592304 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6c7a76e7-72a1-4536-9157-0fb4aeba58aa tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:28.730258 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-31e67ecc-b454-43d0-843b-b9ebccd49f37 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:04:28.738438 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-31e67ecc-b454-43d0-843b-b9ebccd49f37 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.214190 Jun 17 13:04:28.739012 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 323/663] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:04:28 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:04:28.743838 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-fd6154dd-45bc-4574-bf46-d3a2d5ab7e23 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:04:28.744467 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-fd6154dd-45bc-4574-bf46-d3a2d5ab7e23 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] [instance: 72889057-861c-42f3-8629-32fff8f5dab7] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:04:28.750701 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-fd6154dd-45bc-4574-bf46-d3a2d5ab7e23 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:28.751157 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-fd6154dd-45bc-4574-bf46-d3a2d5ab7e23 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:28.751905 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-fd6154dd-45bc-4574-bf46-d3a2d5ab7e23 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:28.752331 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-fd6154dd-45bc-4574-bf46-d3a2d5ab7e23 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:28.756903 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_cell1:SELECT=100 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:04:28.789828 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-6c7a76e7-72a1-4536-9157-0fb4aeba58aa tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:04:28.793345 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=100 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:04:28.798606 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-6c7a76e7-72a1-4536-9157-0fb4aeba58aa tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1758 microversion: 2.1 time: 0.219931 Jun 17 13:04:28.799201 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 341/664] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:04:28 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1758 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:04:28.819577 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-fd6154dd-45bc-4574-bf46-d3a2d5ab7e23 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18195083037046bd99166f68690c3dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bf442df39b4f5cbc18f571a0596f10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:04:28.827602 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-fd6154dd-45bc-4574-bf46-d3a2d5ab7e23 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] 10.222.0.48 "GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7" status: 200 len: 1224 microversion: 2.1 time: 0.087611 Jun 17 13:04:28.828269 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 324/665] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:04:28 2022] GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7 => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:04:29.760780 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-7d14f63a-fb48-412d-b9eb-da8bad6f2ddd tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:04:29.761410 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-7d14f63a-fb48-412d-b9eb-da8bad6f2ddd tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:04:29.768249 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7d14f63a-fb48-412d-b9eb-da8bad6f2ddd tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:29.768696 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7d14f63a-fb48-412d-b9eb-da8bad6f2ddd tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:29.769458 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7d14f63a-fb48-412d-b9eb-da8bad6f2ddd tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:29.771208 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7d14f63a-fb48-412d-b9eb-da8bad6f2ddd tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:29.816703 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-31d04158-5a5b-462c-ae32-81fc67050ef6 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:04:29.817342 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-31d04158-5a5b-462c-ae32-81fc67050ef6 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:04:29.824806 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-31d04158-5a5b-462c-ae32-81fc67050ef6 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:29.825250 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-31d04158-5a5b-462c-ae32-81fc67050ef6 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:29.826011 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-31d04158-5a5b-462c-ae32-81fc67050ef6 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:29.826480 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-31d04158-5a5b-462c-ae32-81fc67050ef6 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:29.953916 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-7d14f63a-fb48-412d-b9eb-da8bad6f2ddd tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:04:29.963392 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-7d14f63a-fb48-412d-b9eb-da8bad6f2ddd tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.206895 Jun 17 13:04:29.963983 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 342/666] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:04:29 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:04:29.968889 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-3d014055-b86c-40f5-898b-d06c942f5928 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:04:29.969514 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-3d014055-b86c-40f5-898b-d06c942f5928 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] [instance: 72889057-861c-42f3-8629-32fff8f5dab7] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:04:29.977291 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3d014055-b86c-40f5-898b-d06c942f5928 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:29.977739 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3d014055-b86c-40f5-898b-d06c942f5928 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:29.978556 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3d014055-b86c-40f5-898b-d06c942f5928 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:29.978990 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3d014055-b86c-40f5-898b-d06c942f5928 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:30.015945 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-31d04158-5a5b-462c-ae32-81fc67050ef6 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:04:30.025217 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-31d04158-5a5b-462c-ae32-81fc67050ef6 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1758 microversion: 2.1 time: 0.213162 Jun 17 13:04:30.025832 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 325/667] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:04:29 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1758 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:04:30.047256 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-3d014055-b86c-40f5-898b-d06c942f5928 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18195083037046bd99166f68690c3dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bf442df39b4f5cbc18f571a0596f10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:04:30.055463 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-3d014055-b86c-40f5-898b-d06c942f5928 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] 10.222.0.48 "GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7" status: 200 len: 1224 microversion: 2.1 time: 0.090425 Jun 17 13:04:30.056248 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 343/668] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:04:29 2022] GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7 => generated 1224 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:04:30.983829 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-4615cb16-28e7-40b5-9db8-dd6b73ff38e0 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:04:30.984435 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-4615cb16-28e7-40b5-9db8-dd6b73ff38e0 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:04:30.991556 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4615cb16-28e7-40b5-9db8-dd6b73ff38e0 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:30.992004 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4615cb16-28e7-40b5-9db8-dd6b73ff38e0 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:30.992768 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4615cb16-28e7-40b5-9db8-dd6b73ff38e0 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:30.993192 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4615cb16-28e7-40b5-9db8-dd6b73ff38e0 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:31.044535 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-e83c3c2f-837c-4ba7-818f-5d97ad88dddb tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:04:31.045157 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-e83c3c2f-837c-4ba7-818f-5d97ad88dddb tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:04:31.053794 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e83c3c2f-837c-4ba7-818f-5d97ad88dddb tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:31.054584 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e83c3c2f-837c-4ba7-818f-5d97ad88dddb tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:31.055757 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e83c3c2f-837c-4ba7-818f-5d97ad88dddb tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:31.056316 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e83c3c2f-837c-4ba7-818f-5d97ad88dddb tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:31.190529 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-4615cb16-28e7-40b5-9db8-dd6b73ff38e0 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:04:31.201161 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-4615cb16-28e7-40b5-9db8-dd6b73ff38e0 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1715 microversion: 2.1 time: 0.221159 Jun 17 13:04:31.202073 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 326/669] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:04:30 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1715 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:04:31.207238 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-928af8a9-3b1d-4c5e-9396-ca8f6846edf6 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:04:31.208053 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-928af8a9-3b1d-4c5e-9396-ca8f6846edf6 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] [instance: 72889057-861c-42f3-8629-32fff8f5dab7] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:04:31.214839 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-928af8a9-3b1d-4c5e-9396-ca8f6846edf6 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:31.215514 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-928af8a9-3b1d-4c5e-9396-ca8f6846edf6 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:31.216457 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-928af8a9-3b1d-4c5e-9396-ca8f6846edf6 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:31.217022 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-928af8a9-3b1d-4c5e-9396-ca8f6846edf6 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:31.242438 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-e83c3c2f-837c-4ba7-818f-5d97ad88dddb tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:04:31.251414 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-e83c3c2f-837c-4ba7-818f-5d97ad88dddb tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1758 microversion: 2.1 time: 0.211550 Jun 17 13:04:31.252085 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 344/670] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:04:31 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1758 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:04:31.267166 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-89e2b2e4-b594-4533-886c-f2806881dcfa tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:04:31.267661 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-89e2b2e4-b594-4533-886c-f2806881dcfa tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:04:31.274374 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-89e2b2e4-b594-4533-886c-f2806881dcfa tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:31.274819 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-89e2b2e4-b594-4533-886c-f2806881dcfa tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:31.275618 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-89e2b2e4-b594-4533-886c-f2806881dcfa tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:31.276345 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-89e2b2e4-b594-4533-886c-f2806881dcfa tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:31.291492 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-928af8a9-3b1d-4c5e-9396-ca8f6846edf6 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18195083037046bd99166f68690c3dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bf442df39b4f5cbc18f571a0596f10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:04:31.299254 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-928af8a9-3b1d-4c5e-9396-ca8f6846edf6 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] 10.222.0.48 "GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7" status: 200 len: 1224 microversion: 2.1 time: 0.095991 Jun 17 13:04:31.299826 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 327/671] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:04:31 2022] GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7 => generated 1224 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:04:32.272049 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-dafaef14-aa1d-4f48-a8aa-b7abee5769cc tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:04:32.272809 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-dafaef14-aa1d-4f48-a8aa-b7abee5769cc tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:04:32.280448 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-dafaef14-aa1d-4f48-a8aa-b7abee5769cc tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:32.280889 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-dafaef14-aa1d-4f48-a8aa-b7abee5769cc tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:32.281780 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-dafaef14-aa1d-4f48-a8aa-b7abee5769cc tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:32.282245 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-dafaef14-aa1d-4f48-a8aa-b7abee5769cc tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:32.442022 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-dafaef14-aa1d-4f48-a8aa-b7abee5769cc tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:04:32.450847 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-dafaef14-aa1d-4f48-a8aa-b7abee5769cc tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1761 microversion: 2.1 time: 0.183092 Jun 17 13:04:32.451406 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 328/672] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:04:32 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1761 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 13:04:32.455964 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-11e30016-ac35-4d2f-8215-b28805cfc907 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:04:32.456754 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-11e30016-ac35-4d2f-8215-b28805cfc907 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] [instance: 72889057-861c-42f3-8629-32fff8f5dab7] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:04:32.464262 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-11e30016-ac35-4d2f-8215-b28805cfc907 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:32.464709 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-11e30016-ac35-4d2f-8215-b28805cfc907 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:32.465503 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-11e30016-ac35-4d2f-8215-b28805cfc907 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:32.465942 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-11e30016-ac35-4d2f-8215-b28805cfc907 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:32.530539 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-11e30016-ac35-4d2f-8215-b28805cfc907 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18195083037046bd99166f68690c3dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bf442df39b4f5cbc18f571a0596f10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:04:32.539021 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-11e30016-ac35-4d2f-8215-b28805cfc907 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] 10.222.0.48 "GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7" status: 200 len: 1224 microversion: 2.1 time: 0.086588 Jun 17 13:04:32.539649 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 329/673] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:04:32 2022] GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:04:33.557341 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-33fb5a5a-cf1d-448e-ac74-a5b7f6845723 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:04:33.558119 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-33fb5a5a-cf1d-448e-ac74-a5b7f6845723 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] [instance: 72889057-861c-42f3-8629-32fff8f5dab7] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:04:33.564998 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-33fb5a5a-cf1d-448e-ac74-a5b7f6845723 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:33.565384 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-33fb5a5a-cf1d-448e-ac74-a5b7f6845723 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:33.566176 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-33fb5a5a-cf1d-448e-ac74-a5b7f6845723 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:33.566631 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-33fb5a5a-cf1d-448e-ac74-a5b7f6845723 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:33.633733 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-33fb5a5a-cf1d-448e-ac74-a5b7f6845723 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18195083037046bd99166f68690c3dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bf442df39b4f5cbc18f571a0596f10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:04:33.646786 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-33fb5a5a-cf1d-448e-ac74-a5b7f6845723 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] 10.222.0.48 "GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7" status: 200 len: 1224 microversion: 2.1 time: 0.092901 Jun 17 13:04:33.647376 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 330/674] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:04:33 2022] GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7 => generated 1224 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:04:34.670138 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-3872b33a-dc2f-4102-a9aa-cf8399f09fff tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:04:34.670932 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-3872b33a-dc2f-4102-a9aa-cf8399f09fff tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] [instance: 72889057-861c-42f3-8629-32fff8f5dab7] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:04:34.678694 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-3872b33a-dc2f-4102-a9aa-cf8399f09fff tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:34.679187 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-3872b33a-dc2f-4102-a9aa-cf8399f09fff tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:34.680020 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-3872b33a-dc2f-4102-a9aa-cf8399f09fff tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:34.680499 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-3872b33a-dc2f-4102-a9aa-cf8399f09fff tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:34.748172 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-3872b33a-dc2f-4102-a9aa-cf8399f09fff tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18195083037046bd99166f68690c3dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bf442df39b4f5cbc18f571a0596f10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:04:34.756620 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-3872b33a-dc2f-4102-a9aa-cf8399f09fff tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] 10.222.0.48 "GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7" status: 200 len: 1224 microversion: 2.1 time: 0.090808 Jun 17 13:04:34.757188 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 331/675] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:04:34 2022] GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7 => generated 1224 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:04:35.773178 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-6058fb62-181b-4829-ab65-e67dd10b7e41 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:04:35.773805 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-6058fb62-181b-4829-ab65-e67dd10b7e41 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] [instance: 72889057-861c-42f3-8629-32fff8f5dab7] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:04:35.781049 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6058fb62-181b-4829-ab65-e67dd10b7e41 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:35.781518 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6058fb62-181b-4829-ab65-e67dd10b7e41 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:35.782310 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6058fb62-181b-4829-ab65-e67dd10b7e41 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:35.782788 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6058fb62-181b-4829-ab65-e67dd10b7e41 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:35.856779 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-6058fb62-181b-4829-ab65-e67dd10b7e41 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18195083037046bd99166f68690c3dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bf442df39b4f5cbc18f571a0596f10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:04:35.864969 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-6058fb62-181b-4829-ab65-e67dd10b7e41 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] 10.222.0.48 "GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7" status: 200 len: 1224 microversion: 2.1 time: 0.095797 Jun 17 13:04:35.865546 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 332/676] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:04:35 2022] GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7 => generated 1224 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:04:36.885099 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-7a300be9-cf53-4dc0-8013-7d020dbbb86c tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:04:36.885814 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-7a300be9-cf53-4dc0-8013-7d020dbbb86c tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] [instance: 72889057-861c-42f3-8629-32fff8f5dab7] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:04:36.892967 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7a300be9-cf53-4dc0-8013-7d020dbbb86c tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:36.893413 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7a300be9-cf53-4dc0-8013-7d020dbbb86c tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:36.894223 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7a300be9-cf53-4dc0-8013-7d020dbbb86c tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:36.894635 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7a300be9-cf53-4dc0-8013-7d020dbbb86c tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:36.958831 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-7a300be9-cf53-4dc0-8013-7d020dbbb86c tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18195083037046bd99166f68690c3dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bf442df39b4f5cbc18f571a0596f10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:04:36.967060 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-7a300be9-cf53-4dc0-8013-7d020dbbb86c tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] 10.222.0.48 "GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7" status: 200 len: 1224 microversion: 2.1 time: 0.086074 Jun 17 13:04:36.967633 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 333/677] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:04:36 2022] GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 13:04:37.984856 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-38b717dc-c781-46d9-8b16-5f68e970fcaf tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:04:37.985588 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-38b717dc-c781-46d9-8b16-5f68e970fcaf tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] [instance: 72889057-861c-42f3-8629-32fff8f5dab7] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:04:37.992547 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-38b717dc-c781-46d9-8b16-5f68e970fcaf tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:37.993291 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-38b717dc-c781-46d9-8b16-5f68e970fcaf tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:37.994468 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-38b717dc-c781-46d9-8b16-5f68e970fcaf tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:37.994895 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-38b717dc-c781-46d9-8b16-5f68e970fcaf tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:38.058425 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-38b717dc-c781-46d9-8b16-5f68e970fcaf tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18195083037046bd99166f68690c3dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bf442df39b4f5cbc18f571a0596f10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:04:38.066486 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-38b717dc-c781-46d9-8b16-5f68e970fcaf tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] 10.222.0.48 "GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7" status: 200 len: 1224 microversion: 2.1 time: 0.085542 Jun 17 13:04:38.067053 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 334/678] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:04:37 2022] GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:04:39.084399 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-2db0a0fa-6a51-4eba-9c09-98323e6f8ca8 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:04:39.085195 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-2db0a0fa-6a51-4eba-9c09-98323e6f8ca8 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] [instance: 72889057-861c-42f3-8629-32fff8f5dab7] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:04:39.092743 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2db0a0fa-6a51-4eba-9c09-98323e6f8ca8 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:39.093201 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2db0a0fa-6a51-4eba-9c09-98323e6f8ca8 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:39.093967 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2db0a0fa-6a51-4eba-9c09-98323e6f8ca8 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:39.094435 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2db0a0fa-6a51-4eba-9c09-98323e6f8ca8 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:39.166010 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-2db0a0fa-6a51-4eba-9c09-98323e6f8ca8 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18195083037046bd99166f68690c3dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bf442df39b4f5cbc18f571a0596f10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:04:39.173777 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-2db0a0fa-6a51-4eba-9c09-98323e6f8ca8 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] 10.222.0.48 "GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7" status: 200 len: 1224 microversion: 2.1 time: 0.093347 Jun 17 13:04:39.174396 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 335/679] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:04:39 2022] GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7 => generated 1224 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:04:40.198361 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-133457db-d47e-4a06-92cd-1a3c4951dd85 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:04:40.199156 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-133457db-d47e-4a06-92cd-1a3c4951dd85 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] [instance: 72889057-861c-42f3-8629-32fff8f5dab7] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:04:40.208700 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-133457db-d47e-4a06-92cd-1a3c4951dd85 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:40.209322 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-133457db-d47e-4a06-92cd-1a3c4951dd85 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:40.210479 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-133457db-d47e-4a06-92cd-1a3c4951dd85 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:40.211100 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-133457db-d47e-4a06-92cd-1a3c4951dd85 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:40.286959 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-133457db-d47e-4a06-92cd-1a3c4951dd85 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18195083037046bd99166f68690c3dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bf442df39b4f5cbc18f571a0596f10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:04:40.294977 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-133457db-d47e-4a06-92cd-1a3c4951dd85 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] 10.222.0.48 "GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7" status: 200 len: 1224 microversion: 2.1 time: 0.103269 Jun 17 13:04:40.295548 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 336/680] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:04:40 2022] GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7 => generated 1224 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:04:41.271262 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_api:SELECT=63 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:04:41.295651 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=22 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:04:41.314155 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-806d9d5e-db7e-4429-9417-d5d4a9968835 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:04:41.314555 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-806d9d5e-db7e-4429-9417-d5d4a9968835 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] [instance: 72889057-861c-42f3-8629-32fff8f5dab7] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:04:41.317498 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_api:SELECT=72 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:04:41.324021 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-806d9d5e-db7e-4429-9417-d5d4a9968835 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:41.324467 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-806d9d5e-db7e-4429-9417-d5d4a9968835 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:41.325239 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-806d9d5e-db7e-4429-9417-d5d4a9968835 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:41.325680 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-806d9d5e-db7e-4429-9417-d5d4a9968835 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:41.395001 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-806d9d5e-db7e-4429-9417-d5d4a9968835 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18195083037046bd99166f68690c3dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bf442df39b4f5cbc18f571a0596f10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:04:41.403526 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-806d9d5e-db7e-4429-9417-d5d4a9968835 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] 10.222.0.48 "GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7" status: 200 len: 1224 microversion: 2.1 time: 0.094958 Jun 17 13:04:41.404116 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 337/681] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:04:41 2022] GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7 => generated 1224 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:04:42.424116 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-904b991a-9773-49a0-ab34-38e6e277a89b tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:04:42.424812 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-904b991a-9773-49a0-ab34-38e6e277a89b tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] [instance: 72889057-861c-42f3-8629-32fff8f5dab7] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:04:42.431700 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-904b991a-9773-49a0-ab34-38e6e277a89b tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:42.432497 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-904b991a-9773-49a0-ab34-38e6e277a89b tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:42.432886 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-904b991a-9773-49a0-ab34-38e6e277a89b tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:42.433315 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-904b991a-9773-49a0-ab34-38e6e277a89b tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:42.506396 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-904b991a-9773-49a0-ab34-38e6e277a89b tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18195083037046bd99166f68690c3dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bf442df39b4f5cbc18f571a0596f10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:04:42.518597 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-904b991a-9773-49a0-ab34-38e6e277a89b tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] 10.222.0.48 "GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7" status: 200 len: 1224 microversion: 2.1 time: 0.098009 Jun 17 13:04:42.519352 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 338/682] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:04:42 2022] GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7 => generated 1224 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:04:43.539794 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-547def7e-6065-4068-8e11-80143626eb8b tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:04:43.540912 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-547def7e-6065-4068-8e11-80143626eb8b tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] [instance: 72889057-861c-42f3-8629-32fff8f5dab7] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:04:43.548218 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-547def7e-6065-4068-8e11-80143626eb8b tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:43.548667 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-547def7e-6065-4068-8e11-80143626eb8b tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:43.549418 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-547def7e-6065-4068-8e11-80143626eb8b tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:43.549847 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-547def7e-6065-4068-8e11-80143626eb8b tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:43.623797 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-547def7e-6065-4068-8e11-80143626eb8b tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18195083037046bd99166f68690c3dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bf442df39b4f5cbc18f571a0596f10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:04:43.632436 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-547def7e-6065-4068-8e11-80143626eb8b tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] 10.222.0.48 "GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7" status: 200 len: 1224 microversion: 2.1 time: 0.098866 Jun 17 13:04:43.633011 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 339/683] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:04:43 2022] GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7 => generated 1224 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:04:44.649085 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-05823494-8b40-4730-8332-01654c1179e6 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:04:44.649777 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-05823494-8b40-4730-8332-01654c1179e6 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] [instance: 72889057-861c-42f3-8629-32fff8f5dab7] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:04:44.657508 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-05823494-8b40-4730-8332-01654c1179e6 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:44.657956 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-05823494-8b40-4730-8332-01654c1179e6 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:44.658845 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-05823494-8b40-4730-8332-01654c1179e6 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:44.659272 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-05823494-8b40-4730-8332-01654c1179e6 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:44.723474 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-05823494-8b40-4730-8332-01654c1179e6 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18195083037046bd99166f68690c3dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bf442df39b4f5cbc18f571a0596f10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:04:44.726897 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_cell1:SELECT=100 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:04:44.731968 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-05823494-8b40-4730-8332-01654c1179e6 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] 10.222.0.48 "GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7" status: 200 len: 1224 microversion: 2.1 time: 0.086828 Jun 17 13:04:44.732537 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 340/684] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:04:44 2022] GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:04:45.749558 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-fb4b9574-f6c8-46d5-b921-fa213b9b8585 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:04:45.750320 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-fb4b9574-f6c8-46d5-b921-fa213b9b8585 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] [instance: 72889057-861c-42f3-8629-32fff8f5dab7] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:04:45.757762 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-fb4b9574-f6c8-46d5-b921-fa213b9b8585 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:45.758250 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-fb4b9574-f6c8-46d5-b921-fa213b9b8585 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:45.759010 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-fb4b9574-f6c8-46d5-b921-fa213b9b8585 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:45.759443 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-fb4b9574-f6c8-46d5-b921-fa213b9b8585 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:45.833025 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-fb4b9574-f6c8-46d5-b921-fa213b9b8585 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18195083037046bd99166f68690c3dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bf442df39b4f5cbc18f571a0596f10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:04:45.844386 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-fb4b9574-f6c8-46d5-b921-fa213b9b8585 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] 10.222.0.48 "GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7" status: 200 len: 1224 microversion: 2.1 time: 0.098829 Jun 17 13:04:45.845265 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 341/685] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:04:45 2022] GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7 => generated 1224 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:04:46.865978 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-dacbd64e-9d92-4411-ad87-434f37bfdfc7 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:04:46.866688 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-dacbd64e-9d92-4411-ad87-434f37bfdfc7 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] [instance: 72889057-861c-42f3-8629-32fff8f5dab7] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:04:46.874412 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-dacbd64e-9d92-4411-ad87-434f37bfdfc7 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:46.874864 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-dacbd64e-9d92-4411-ad87-434f37bfdfc7 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:46.875638 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-dacbd64e-9d92-4411-ad87-434f37bfdfc7 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:46.876075 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-dacbd64e-9d92-4411-ad87-434f37bfdfc7 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:46.950257 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-dacbd64e-9d92-4411-ad87-434f37bfdfc7 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18195083037046bd99166f68690c3dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bf442df39b4f5cbc18f571a0596f10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:04:46.963380 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-dacbd64e-9d92-4411-ad87-434f37bfdfc7 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] 10.222.0.48 "GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7" status: 200 len: 1224 microversion: 2.1 time: 0.101068 Jun 17 13:04:46.964291 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 342/686] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:04:46 2022] GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7 => generated 1224 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:04:47.981037 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-d8d02331-101e-438d-b48d-838ef98b4155 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:04:47.982043 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-d8d02331-101e-438d-b48d-838ef98b4155 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] [instance: 72889057-861c-42f3-8629-32fff8f5dab7] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:04:47.989062 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d8d02331-101e-438d-b48d-838ef98b4155 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:47.989516 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d8d02331-101e-438d-b48d-838ef98b4155 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:47.990321 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d8d02331-101e-438d-b48d-838ef98b4155 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:47.990752 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d8d02331-101e-438d-b48d-838ef98b4155 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:48.061898 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-d8d02331-101e-438d-b48d-838ef98b4155 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18195083037046bd99166f68690c3dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bf442df39b4f5cbc18f571a0596f10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:04:48.073342 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-d8d02331-101e-438d-b48d-838ef98b4155 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] 10.222.0.48 "GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7" status: 200 len: 1224 microversion: 2.1 time: 0.095984 Jun 17 13:04:48.074078 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 343/687] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:04:47 2022] GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7 => generated 1224 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:04:49.094121 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-53deb547-a88e-45ec-ad71-131575049574 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:04:49.094823 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-53deb547-a88e-45ec-ad71-131575049574 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] [instance: 72889057-861c-42f3-8629-32fff8f5dab7] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:04:49.101644 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-53deb547-a88e-45ec-ad71-131575049574 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:49.102112 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-53deb547-a88e-45ec-ad71-131575049574 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:49.102866 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-53deb547-a88e-45ec-ad71-131575049574 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:49.103295 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-53deb547-a88e-45ec-ad71-131575049574 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:49.166025 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-53deb547-a88e-45ec-ad71-131575049574 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18195083037046bd99166f68690c3dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bf442df39b4f5cbc18f571a0596f10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:04:49.173936 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-53deb547-a88e-45ec-ad71-131575049574 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] 10.222.0.48 "GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7" status: 200 len: 1224 microversion: 2.1 time: 0.083799 Jun 17 13:04:49.174536 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 344/688] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:04:49 2022] GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:04:50.192969 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-edc9fd87-7982-4cb0-9ee8-1dcca75c229a tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:04:50.193707 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-edc9fd87-7982-4cb0-9ee8-1dcca75c229a tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] [instance: 72889057-861c-42f3-8629-32fff8f5dab7] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:04:50.200592 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-edc9fd87-7982-4cb0-9ee8-1dcca75c229a tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:50.201238 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-edc9fd87-7982-4cb0-9ee8-1dcca75c229a tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:50.202126 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-edc9fd87-7982-4cb0-9ee8-1dcca75c229a tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:50.202569 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-edc9fd87-7982-4cb0-9ee8-1dcca75c229a tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:50.269549 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-edc9fd87-7982-4cb0-9ee8-1dcca75c229a tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18195083037046bd99166f68690c3dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bf442df39b4f5cbc18f571a0596f10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:04:50.277452 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-edc9fd87-7982-4cb0-9ee8-1dcca75c229a tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] 10.222.0.48 "GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7" status: 200 len: 1224 microversion: 2.1 time: 0.090638 Jun 17 13:04:50.278025 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 345/689] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:04:50 2022] GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7 => generated 1224 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:04:51.295344 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-d8c11938-27bd-4bed-9996-d9bbbeee9397 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:04:51.296136 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-d8c11938-27bd-4bed-9996-d9bbbeee9397 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] [instance: 72889057-861c-42f3-8629-32fff8f5dab7] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:04:51.302854 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d8c11938-27bd-4bed-9996-d9bbbeee9397 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:51.303268 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d8c11938-27bd-4bed-9996-d9bbbeee9397 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:51.304048 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d8c11938-27bd-4bed-9996-d9bbbeee9397 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:51.304481 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d8c11938-27bd-4bed-9996-d9bbbeee9397 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:51.369021 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-d8c11938-27bd-4bed-9996-d9bbbeee9397 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18195083037046bd99166f68690c3dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bf442df39b4f5cbc18f571a0596f10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:04:51.378867 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-d8c11938-27bd-4bed-9996-d9bbbeee9397 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] 10.222.0.48 "GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7" status: 200 len: 1224 microversion: 2.1 time: 0.087480 Jun 17 13:04:51.379502 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 346/690] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:04:51 2022] GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7 => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:04:52.396676 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-35263d8e-eb88-48f0-89a3-224976412400 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:04:52.397363 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-35263d8e-eb88-48f0-89a3-224976412400 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] [instance: 72889057-861c-42f3-8629-32fff8f5dab7] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:04:52.404078 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-35263d8e-eb88-48f0-89a3-224976412400 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:52.404514 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-35263d8e-eb88-48f0-89a3-224976412400 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:52.405256 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-35263d8e-eb88-48f0-89a3-224976412400 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:52.405686 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-35263d8e-eb88-48f0-89a3-224976412400 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:52.475983 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-35263d8e-eb88-48f0-89a3-224976412400 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18195083037046bd99166f68690c3dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bf442df39b4f5cbc18f571a0596f10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:04:52.486427 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-35263d8e-eb88-48f0-89a3-224976412400 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] 10.222.0.48 "GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7" status: 200 len: 1224 microversion: 2.1 time: 0.093414 Jun 17 13:04:52.487079 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 347/691] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:04:52 2022] GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7 => generated 1224 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 13:04:53.509288 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-d74222fe-b588-413e-81fe-005913c2d3a5 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:04:53.510432 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-d74222fe-b588-413e-81fe-005913c2d3a5 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] [instance: 72889057-861c-42f3-8629-32fff8f5dab7] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:04:53.520110 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d74222fe-b588-413e-81fe-005913c2d3a5 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:53.520711 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d74222fe-b588-413e-81fe-005913c2d3a5 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:53.521824 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d74222fe-b588-413e-81fe-005913c2d3a5 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:53.522394 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d74222fe-b588-413e-81fe-005913c2d3a5 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:53.600461 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-d74222fe-b588-413e-81fe-005913c2d3a5 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18195083037046bd99166f68690c3dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bf442df39b4f5cbc18f571a0596f10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:04:53.608521 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-d74222fe-b588-413e-81fe-005913c2d3a5 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] 10.222.0.48 "GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7" status: 200 len: 1224 microversion: 2.1 time: 0.105714 Jun 17 13:04:53.609077 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 348/692] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:04:53 2022] GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7 => generated 1224 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 13:04:54.625255 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-03a4383e-6e0e-4449-92ef-2c69e8eb4f8d tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:04:54.626388 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-03a4383e-6e0e-4449-92ef-2c69e8eb4f8d tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] [instance: 72889057-861c-42f3-8629-32fff8f5dab7] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:04:54.635036 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-03a4383e-6e0e-4449-92ef-2c69e8eb4f8d tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:54.635568 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-03a4383e-6e0e-4449-92ef-2c69e8eb4f8d tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:54.636736 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-03a4383e-6e0e-4449-92ef-2c69e8eb4f8d tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:54.637353 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-03a4383e-6e0e-4449-92ef-2c69e8eb4f8d tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:54.703490 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-03a4383e-6e0e-4449-92ef-2c69e8eb4f8d tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18195083037046bd99166f68690c3dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bf442df39b4f5cbc18f571a0596f10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:04:54.711786 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-03a4383e-6e0e-4449-92ef-2c69e8eb4f8d tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] 10.222.0.48 "GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7" status: 200 len: 1224 microversion: 2.1 time: 0.090579 Jun 17 13:04:54.712366 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 349/693] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:04:54 2022] GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7 => generated 1224 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:04:55.729154 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-e2011200-fd75-489b-bcc2-0a7d5419fafb tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:04:55.729885 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-e2011200-fd75-489b-bcc2-0a7d5419fafb tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] [instance: 72889057-861c-42f3-8629-32fff8f5dab7] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:04:55.736605 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e2011200-fd75-489b-bcc2-0a7d5419fafb tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:55.737045 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e2011200-fd75-489b-bcc2-0a7d5419fafb tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:55.737798 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e2011200-fd75-489b-bcc2-0a7d5419fafb tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:55.738270 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e2011200-fd75-489b-bcc2-0a7d5419fafb tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:55.810747 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-e2011200-fd75-489b-bcc2-0a7d5419fafb tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18195083037046bd99166f68690c3dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bf442df39b4f5cbc18f571a0596f10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:04:55.818860 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-e2011200-fd75-489b-bcc2-0a7d5419fafb tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] 10.222.0.48 "GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7" status: 200 len: 1224 microversion: 2.1 time: 0.093697 Jun 17 13:04:55.819444 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 350/694] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:04:55 2022] GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7 => generated 1224 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 13:04:56.837636 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-3226ca98-fba9-436a-b54f-b029fc97128b tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:04:56.838414 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-3226ca98-fba9-436a-b54f-b029fc97128b tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] [instance: 72889057-861c-42f3-8629-32fff8f5dab7] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:04:56.845409 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-3226ca98-fba9-436a-b54f-b029fc97128b tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:56.845859 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-3226ca98-fba9-436a-b54f-b029fc97128b tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:56.846659 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-3226ca98-fba9-436a-b54f-b029fc97128b tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:56.847095 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-3226ca98-fba9-436a-b54f-b029fc97128b tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:56.920419 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-3226ca98-fba9-436a-b54f-b029fc97128b tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18195083037046bd99166f68690c3dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bf442df39b4f5cbc18f571a0596f10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:04:56.929723 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-3226ca98-fba9-436a-b54f-b029fc97128b tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] 10.222.0.48 "GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7" status: 200 len: 1224 microversion: 2.1 time: 0.096094 Jun 17 13:04:56.930327 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 351/695] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:04:56 2022] GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7 => generated 1224 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:04:57.947413 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-1002e6e3-612d-47ec-8016-fa8b9108458b tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:04:57.948110 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-1002e6e3-612d-47ec-8016-fa8b9108458b tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] [instance: 72889057-861c-42f3-8629-32fff8f5dab7] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:04:57.954773 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-1002e6e3-612d-47ec-8016-fa8b9108458b tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:57.955222 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-1002e6e3-612d-47ec-8016-fa8b9108458b tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:57.955985 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-1002e6e3-612d-47ec-8016-fa8b9108458b tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:57.956418 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-1002e6e3-612d-47ec-8016-fa8b9108458b tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:58.026694 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-1002e6e3-612d-47ec-8016-fa8b9108458b tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18195083037046bd99166f68690c3dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bf442df39b4f5cbc18f571a0596f10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:04:58.036487 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-1002e6e3-612d-47ec-8016-fa8b9108458b tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] 10.222.0.48 "GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7" status: 200 len: 1224 microversion: 2.1 time: 0.093573 Jun 17 13:04:58.037075 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 352/696] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:04:57 2022] GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7 => generated 1224 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:04:59.057013 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-b4dd30fe-348c-4c11-a7df-88ba6cf9a5c1 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:04:59.057862 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-b4dd30fe-348c-4c11-a7df-88ba6cf9a5c1 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] [instance: 72889057-861c-42f3-8629-32fff8f5dab7] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:04:59.064826 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b4dd30fe-348c-4c11-a7df-88ba6cf9a5c1 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:59.065280 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b4dd30fe-348c-4c11-a7df-88ba6cf9a5c1 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:59.066069 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b4dd30fe-348c-4c11-a7df-88ba6cf9a5c1 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:04:59.066554 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b4dd30fe-348c-4c11-a7df-88ba6cf9a5c1 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:04:59.140202 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-b4dd30fe-348c-4c11-a7df-88ba6cf9a5c1 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18195083037046bd99166f68690c3dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bf442df39b4f5cbc18f571a0596f10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:04:59.148472 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-b4dd30fe-348c-4c11-a7df-88ba6cf9a5c1 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] 10.222.0.48 "GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7" status: 200 len: 1224 microversion: 2.1 time: 0.098385 Jun 17 13:04:59.149150 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 353/697] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:04:59 2022] GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7 => generated 1224 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:05:00.165397 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-2cc17984-d098-43c5-bcde-145fcd256b56 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:05:00.166164 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-2cc17984-d098-43c5-bcde-145fcd256b56 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] [instance: 72889057-861c-42f3-8629-32fff8f5dab7] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:05:00.173022 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2cc17984-d098-43c5-bcde-145fcd256b56 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:05:00.173463 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2cc17984-d098-43c5-bcde-145fcd256b56 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:05:00.174244 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2cc17984-d098-43c5-bcde-145fcd256b56 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:05:00.174678 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2cc17984-d098-43c5-bcde-145fcd256b56 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:05:00.247369 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-2cc17984-d098-43c5-bcde-145fcd256b56 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18195083037046bd99166f68690c3dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bf442df39b4f5cbc18f571a0596f10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:05:00.256279 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-2cc17984-d098-43c5-bcde-145fcd256b56 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] 10.222.0.48 "GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7" status: 200 len: 1224 microversion: 2.1 time: 0.094807 Jun 17 13:05:00.256852 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 354/698] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:05:00 2022] GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7 => generated 1224 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:05:01.273576 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-1314e27e-63be-4d23-bd36-015a29916f49 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:05:01.274253 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-1314e27e-63be-4d23-bd36-015a29916f49 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] [instance: 72889057-861c-42f3-8629-32fff8f5dab7] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:05:01.280816 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-1314e27e-63be-4d23-bd36-015a29916f49 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:05:01.281259 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-1314e27e-63be-4d23-bd36-015a29916f49 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:05:01.282006 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-1314e27e-63be-4d23-bd36-015a29916f49 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:05:01.282469 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-1314e27e-63be-4d23-bd36-015a29916f49 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:05:01.347756 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-1314e27e-63be-4d23-bd36-015a29916f49 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18195083037046bd99166f68690c3dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bf442df39b4f5cbc18f571a0596f10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:05:01.359565 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-1314e27e-63be-4d23-bd36-015a29916f49 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] 10.222.0.48 "GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7" status: 200 len: 1224 microversion: 2.1 time: 0.089833 Jun 17 13:05:01.360298 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 355/699] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:05:01 2022] GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7 => generated 1224 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:05:02.377870 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-de354683-9a71-4e24-bf14-6d07b613660a tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:05:02.378642 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-de354683-9a71-4e24-bf14-6d07b613660a tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] [instance: 72889057-861c-42f3-8629-32fff8f5dab7] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:05:02.386898 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-de354683-9a71-4e24-bf14-6d07b613660a tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:05:02.387345 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-de354683-9a71-4e24-bf14-6d07b613660a tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:05:02.388119 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-de354683-9a71-4e24-bf14-6d07b613660a tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:05:02.388552 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-de354683-9a71-4e24-bf14-6d07b613660a tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:05:02.452288 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-de354683-9a71-4e24-bf14-6d07b613660a tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18195083037046bd99166f68690c3dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bf442df39b4f5cbc18f571a0596f10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:05:02.464252 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-de354683-9a71-4e24-bf14-6d07b613660a tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] 10.222.0.48 "GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7" status: 200 len: 1224 microversion: 2.1 time: 0.090788 Jun 17 13:05:02.465180 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 356/700] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:05:02 2022] GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7 => generated 1224 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:05:03.488127 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-b9a060fd-59ef-457e-bcaa-74b5872a0111 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:05:03.488827 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-b9a060fd-59ef-457e-bcaa-74b5872a0111 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] [instance: 72889057-861c-42f3-8629-32fff8f5dab7] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:05:03.496057 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b9a060fd-59ef-457e-bcaa-74b5872a0111 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:05:03.496379 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b9a060fd-59ef-457e-bcaa-74b5872a0111 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:05:03.497142 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b9a060fd-59ef-457e-bcaa-74b5872a0111 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:05:03.497566 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b9a060fd-59ef-457e-bcaa-74b5872a0111 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:05:03.516420 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_cell1:SELECT=100 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:05:03.561390 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-b9a060fd-59ef-457e-bcaa-74b5872a0111 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18195083037046bd99166f68690c3dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bf442df39b4f5cbc18f571a0596f10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:05:03.569703 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-b9a060fd-59ef-457e-bcaa-74b5872a0111 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] 10.222.0.48 "GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7" status: 200 len: 1224 microversion: 2.1 time: 0.087635 Jun 17 13:05:03.570298 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 357/701] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:05:03 2022] GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7 => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:05:04.586871 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-27d4e848-fa0e-4db8-bead-0ab98e894d86 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:05:04.587547 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-27d4e848-fa0e-4db8-bead-0ab98e894d86 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] [instance: 72889057-861c-42f3-8629-32fff8f5dab7] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:05:04.594528 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-27d4e848-fa0e-4db8-bead-0ab98e894d86 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:05:04.594982 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-27d4e848-fa0e-4db8-bead-0ab98e894d86 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:05:04.595739 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-27d4e848-fa0e-4db8-bead-0ab98e894d86 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:05:04.596174 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-27d4e848-fa0e-4db8-bead-0ab98e894d86 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:05:04.661759 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-27d4e848-fa0e-4db8-bead-0ab98e894d86 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18195083037046bd99166f68690c3dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bf442df39b4f5cbc18f571a0596f10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:05:04.669640 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-27d4e848-fa0e-4db8-bead-0ab98e894d86 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] 10.222.0.48 "GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7" status: 200 len: 1224 microversion: 2.1 time: 0.086957 Jun 17 13:05:04.670235 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 358/702] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:05:04 2022] GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:05:05.688347 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-6e560566-9d5c-4fb4-a22e-570f867ed432 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:05:05.689137 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-6e560566-9d5c-4fb4-a22e-570f867ed432 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] [instance: 72889057-861c-42f3-8629-32fff8f5dab7] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:05:05.698364 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6e560566-9d5c-4fb4-a22e-570f867ed432 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:05:05.698870 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6e560566-9d5c-4fb4-a22e-570f867ed432 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:05:05.699956 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6e560566-9d5c-4fb4-a22e-570f867ed432 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:05:05.700387 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6e560566-9d5c-4fb4-a22e-570f867ed432 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:05:05.770166 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-6e560566-9d5c-4fb4-a22e-570f867ed432 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18195083037046bd99166f68690c3dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bf442df39b4f5cbc18f571a0596f10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:05:05.778479 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-6e560566-9d5c-4fb4-a22e-570f867ed432 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] 10.222.0.48 "GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7" status: 200 len: 1224 microversion: 2.1 time: 0.095678 Jun 17 13:05:05.779277 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 359/703] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:05:05 2022] GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7 => generated 1224 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:05:06.796119 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-ad06a3a7-e5f7-4d9b-8b50-5db8fa666166 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:05:06.796874 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-ad06a3a7-e5f7-4d9b-8b50-5db8fa666166 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] [instance: 72889057-861c-42f3-8629-32fff8f5dab7] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:05:06.804222 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ad06a3a7-e5f7-4d9b-8b50-5db8fa666166 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:05:06.804670 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ad06a3a7-e5f7-4d9b-8b50-5db8fa666166 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:05:06.805426 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ad06a3a7-e5f7-4d9b-8b50-5db8fa666166 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:05:06.805861 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ad06a3a7-e5f7-4d9b-8b50-5db8fa666166 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:05:06.870853 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-ad06a3a7-e5f7-4d9b-8b50-5db8fa666166 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18195083037046bd99166f68690c3dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bf442df39b4f5cbc18f571a0596f10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:05:06.878994 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-ad06a3a7-e5f7-4d9b-8b50-5db8fa666166 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] 10.222.0.48 "GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7" status: 200 len: 1224 microversion: 2.1 time: 0.086796 Jun 17 13:05:06.879579 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 360/704] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:05:06 2022] GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:05:07.896247 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-05ab5dfb-a142-479c-81f0-3d28140ce172 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:05:07.897256 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-05ab5dfb-a142-479c-81f0-3d28140ce172 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] [instance: 72889057-861c-42f3-8629-32fff8f5dab7] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:05:07.903943 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-05ab5dfb-a142-479c-81f0-3d28140ce172 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:05:07.904391 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-05ab5dfb-a142-479c-81f0-3d28140ce172 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:05:07.905154 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-05ab5dfb-a142-479c-81f0-3d28140ce172 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:05:07.905604 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-05ab5dfb-a142-479c-81f0-3d28140ce172 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:05:07.971443 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-05ab5dfb-a142-479c-81f0-3d28140ce172 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18195083037046bd99166f68690c3dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bf442df39b4f5cbc18f571a0596f10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:05:07.979674 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-05ab5dfb-a142-479c-81f0-3d28140ce172 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] 10.222.0.48 "GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7" status: 200 len: 1224 microversion: 2.1 time: 0.087316 Jun 17 13:05:07.980244 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 361/705] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:05:07 2022] GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7 => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:05:08.999911 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-a2a73707-2abd-469f-b9fd-80637fa7b2a3 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:05:09.000759 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-a2a73707-2abd-469f-b9fd-80637fa7b2a3 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] [instance: 72889057-861c-42f3-8629-32fff8f5dab7] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:05:09.009680 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a2a73707-2abd-469f-b9fd-80637fa7b2a3 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:05:09.010388 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a2a73707-2abd-469f-b9fd-80637fa7b2a3 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:05:09.010949 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a2a73707-2abd-469f-b9fd-80637fa7b2a3 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:05:09.011376 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a2a73707-2abd-469f-b9fd-80637fa7b2a3 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:05:09.082437 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-a2a73707-2abd-469f-b9fd-80637fa7b2a3 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18195083037046bd99166f68690c3dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bf442df39b4f5cbc18f571a0596f10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:05:09.090606 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-a2a73707-2abd-469f-b9fd-80637fa7b2a3 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] 10.222.0.48 "GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7" status: 200 len: 1224 microversion: 2.1 time: 0.097157 Jun 17 13:05:09.091172 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 362/706] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:05:08 2022] GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7 => generated 1224 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:05:10.112822 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-85431513-01c7-4275-a6b4-a24e07fb3f28 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:05:10.113524 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-85431513-01c7-4275-a6b4-a24e07fb3f28 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] [instance: 72889057-861c-42f3-8629-32fff8f5dab7] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:05:10.121407 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-85431513-01c7-4275-a6b4-a24e07fb3f28 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:05:10.121967 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-85431513-01c7-4275-a6b4-a24e07fb3f28 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:05:10.123173 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-85431513-01c7-4275-a6b4-a24e07fb3f28 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:05:10.123725 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-85431513-01c7-4275-a6b4-a24e07fb3f28 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:05:10.195146 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-85431513-01c7-4275-a6b4-a24e07fb3f28 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18195083037046bd99166f68690c3dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bf442df39b4f5cbc18f571a0596f10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:05:10.204141 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-85431513-01c7-4275-a6b4-a24e07fb3f28 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] 10.222.0.48 "GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7" status: 200 len: 1224 microversion: 2.1 time: 0.096471 Jun 17 13:05:10.204724 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 363/707] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:05:10 2022] GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7 => generated 1224 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:05:11.223819 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-8cb47b7c-1fea-4ee0-b39a-df9b422bd637 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:05:11.224520 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-8cb47b7c-1fea-4ee0-b39a-df9b422bd637 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] [instance: 72889057-861c-42f3-8629-32fff8f5dab7] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:05:11.232242 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8cb47b7c-1fea-4ee0-b39a-df9b422bd637 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:05:11.232615 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8cb47b7c-1fea-4ee0-b39a-df9b422bd637 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:05:11.233385 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8cb47b7c-1fea-4ee0-b39a-df9b422bd637 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:05:11.233828 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8cb47b7c-1fea-4ee0-b39a-df9b422bd637 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:05:11.320732 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-8cb47b7c-1fea-4ee0-b39a-df9b422bd637 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18195083037046bd99166f68690c3dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bf442df39b4f5cbc18f571a0596f10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:05:11.328536 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-8cb47b7c-1fea-4ee0-b39a-df9b422bd637 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] 10.222.0.48 "GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7" status: 200 len: 1224 microversion: 2.1 time: 0.110165 Jun 17 13:05:11.329107 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 364/708] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:05:11 2022] GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7 => generated 1224 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:05:12.345775 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-ff30eadd-8661-4275-b220-b52ca1e06572 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:05:12.346517 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-ff30eadd-8661-4275-b220-b52ca1e06572 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] [instance: 72889057-861c-42f3-8629-32fff8f5dab7] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:05:12.348877 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_api:SELECT=56 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:05:12.355106 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ff30eadd-8661-4275-b220-b52ca1e06572 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:05:12.355553 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ff30eadd-8661-4275-b220-b52ca1e06572 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:05:12.356353 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ff30eadd-8661-4275-b220-b52ca1e06572 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:05:12.356789 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ff30eadd-8661-4275-b220-b52ca1e06572 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:05:12.432993 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-ff30eadd-8661-4275-b220-b52ca1e06572 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18195083037046bd99166f68690c3dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bf442df39b4f5cbc18f571a0596f10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:05:12.445417 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-ff30eadd-8661-4275-b220-b52ca1e06572 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] 10.222.0.48 "GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7" status: 200 len: 1224 microversion: 2.1 time: 0.103373 Jun 17 13:05:12.445892 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 365/709] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:05:12 2022] GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7 => generated 1224 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:05:13.463232 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-6c99990b-12ba-492b-bd28-8d13edd36f29 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:05:13.463896 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-6c99990b-12ba-492b-bd28-8d13edd36f29 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] [instance: 72889057-861c-42f3-8629-32fff8f5dab7] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:05:13.470832 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6c99990b-12ba-492b-bd28-8d13edd36f29 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:05:13.471282 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6c99990b-12ba-492b-bd28-8d13edd36f29 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:05:13.472038 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6c99990b-12ba-492b-bd28-8d13edd36f29 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:05:13.472474 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6c99990b-12ba-492b-bd28-8d13edd36f29 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:05:13.537368 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-6c99990b-12ba-492b-bd28-8d13edd36f29 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18195083037046bd99166f68690c3dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bf442df39b4f5cbc18f571a0596f10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:05:13.545550 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-6c99990b-12ba-492b-bd28-8d13edd36f29 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] 10.222.0.48 "GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7" status: 200 len: 1224 microversion: 2.1 time: 0.086664 Jun 17 13:05:13.546174 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 366/710] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:05:13 2022] GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:05:14.565029 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-df77ac7b-7fca-4caf-bbb8-f01345185bba tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:05:14.565694 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-df77ac7b-7fca-4caf-bbb8-f01345185bba tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] [instance: 72889057-861c-42f3-8629-32fff8f5dab7] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:05:14.573905 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-df77ac7b-7fca-4caf-bbb8-f01345185bba tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:05:14.574387 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-df77ac7b-7fca-4caf-bbb8-f01345185bba tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:05:14.575164 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-df77ac7b-7fca-4caf-bbb8-f01345185bba tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:05:14.575597 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-df77ac7b-7fca-4caf-bbb8-f01345185bba tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:05:14.642887 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-df77ac7b-7fca-4caf-bbb8-f01345185bba tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18195083037046bd99166f68690c3dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bf442df39b4f5cbc18f571a0596f10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:05:14.650798 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-df77ac7b-7fca-4caf-bbb8-f01345185bba tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] 10.222.0.48 "GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7" status: 200 len: 1224 microversion: 2.1 time: 0.091771 Jun 17 13:05:14.651464 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 367/711] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:05:14 2022] GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7 => generated 1224 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:05:15.669491 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-47b9502c-d864-4daf-a204-56bda37b4a12 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:05:15.670236 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-47b9502c-d864-4daf-a204-56bda37b4a12 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] [instance: 72889057-861c-42f3-8629-32fff8f5dab7] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:05:15.677474 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-47b9502c-d864-4daf-a204-56bda37b4a12 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:05:15.677925 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-47b9502c-d864-4daf-a204-56bda37b4a12 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:05:15.678735 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-47b9502c-d864-4daf-a204-56bda37b4a12 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:05:15.679165 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-47b9502c-d864-4daf-a204-56bda37b4a12 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:05:15.747572 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-47b9502c-d864-4daf-a204-56bda37b4a12 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18195083037046bd99166f68690c3dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bf442df39b4f5cbc18f571a0596f10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:05:15.759163 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-47b9502c-d864-4daf-a204-56bda37b4a12 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] 10.222.0.48 "GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7" status: 200 len: 1224 microversion: 2.1 time: 0.093801 Jun 17 13:05:15.760144 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 368/712] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:05:15 2022] GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7 => generated 1224 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:05:16.781096 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-2e627d9f-4d36-430c-abd4-0b8a26e57590 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:05:16.781859 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-2e627d9f-4d36-430c-abd4-0b8a26e57590 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] [instance: 72889057-861c-42f3-8629-32fff8f5dab7] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:05:16.789454 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2e627d9f-4d36-430c-abd4-0b8a26e57590 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:05:16.789969 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2e627d9f-4d36-430c-abd4-0b8a26e57590 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:05:16.790844 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2e627d9f-4d36-430c-abd4-0b8a26e57590 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:05:16.791492 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2e627d9f-4d36-430c-abd4-0b8a26e57590 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:05:16.859846 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-2e627d9f-4d36-430c-abd4-0b8a26e57590 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18195083037046bd99166f68690c3dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bf442df39b4f5cbc18f571a0596f10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:05:16.867525 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-2e627d9f-4d36-430c-abd4-0b8a26e57590 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] 10.222.0.48 "GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7" status: 200 len: 1224 microversion: 2.1 time: 0.090811 Jun 17 13:05:16.868139 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 369/713] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:05:16 2022] GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7 => generated 1224 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:05:17.889326 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-97b48d0b-6f28-4303-8d76-c7bdbfd5a827 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:05:17.890038 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-97b48d0b-6f28-4303-8d76-c7bdbfd5a827 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] [instance: 72889057-861c-42f3-8629-32fff8f5dab7] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:05:17.896931 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-97b48d0b-6f28-4303-8d76-c7bdbfd5a827 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:05:17.897377 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-97b48d0b-6f28-4303-8d76-c7bdbfd5a827 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:05:17.898208 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-97b48d0b-6f28-4303-8d76-c7bdbfd5a827 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:05:17.898590 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-97b48d0b-6f28-4303-8d76-c7bdbfd5a827 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:05:17.967177 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-97b48d0b-6f28-4303-8d76-c7bdbfd5a827 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18195083037046bd99166f68690c3dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bf442df39b4f5cbc18f571a0596f10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:05:17.975693 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-97b48d0b-6f28-4303-8d76-c7bdbfd5a827 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] 10.222.0.48 "GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7" status: 200 len: 1224 microversion: 2.1 time: 0.090283 Jun 17 13:05:17.976323 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 370/714] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:05:17 2022] GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7 => generated 1224 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:05:18.997007 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-1ffe5a77-70d5-4e7b-8e0a-e1d5af9e42a7 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:05:18.997781 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-1ffe5a77-70d5-4e7b-8e0a-e1d5af9e42a7 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] [instance: 72889057-861c-42f3-8629-32fff8f5dab7] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:05:19.009031 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-1ffe5a77-70d5-4e7b-8e0a-e1d5af9e42a7 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:05:19.009723 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-1ffe5a77-70d5-4e7b-8e0a-e1d5af9e42a7 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:05:19.010814 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-1ffe5a77-70d5-4e7b-8e0a-e1d5af9e42a7 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:05:19.011543 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-1ffe5a77-70d5-4e7b-8e0a-e1d5af9e42a7 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:05:19.093718 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-1ffe5a77-70d5-4e7b-8e0a-e1d5af9e42a7 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18195083037046bd99166f68690c3dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bf442df39b4f5cbc18f571a0596f10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:05:19.105251 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-1ffe5a77-70d5-4e7b-8e0a-e1d5af9e42a7 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] 10.222.0.48 "GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7" status: 200 len: 1224 microversion: 2.1 time: 0.114535 Jun 17 13:05:19.105952 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 371/715] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:05:18 2022] GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7 => generated 1224 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:05:20.124390 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-655ef75e-c07c-441c-8432-3cd5e041d8f8 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:05:20.125110 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-655ef75e-c07c-441c-8432-3cd5e041d8f8 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] [instance: 72889057-861c-42f3-8629-32fff8f5dab7] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:05:20.132273 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-655ef75e-c07c-441c-8432-3cd5e041d8f8 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:05:20.132715 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-655ef75e-c07c-441c-8432-3cd5e041d8f8 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:05:20.133478 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-655ef75e-c07c-441c-8432-3cd5e041d8f8 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:05:20.133913 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-655ef75e-c07c-441c-8432-3cd5e041d8f8 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:05:20.204039 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-655ef75e-c07c-441c-8432-3cd5e041d8f8 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18195083037046bd99166f68690c3dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bf442df39b4f5cbc18f571a0596f10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:05:20.216147 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-655ef75e-c07c-441c-8432-3cd5e041d8f8 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] 10.222.0.48 "GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7" status: 200 len: 1224 microversion: 2.1 time: 0.096806 Jun 17 13:05:20.216720 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 372/716] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:05:20 2022] GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7 => generated 1224 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:05:21.235660 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-d0f7f847-c6e1-4779-aa29-44165cae2c37 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:05:21.236337 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-d0f7f847-c6e1-4779-aa29-44165cae2c37 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] [instance: 72889057-861c-42f3-8629-32fff8f5dab7] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:05:21.243039 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d0f7f847-c6e1-4779-aa29-44165cae2c37 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:05:21.243516 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d0f7f847-c6e1-4779-aa29-44165cae2c37 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:05:21.244276 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d0f7f847-c6e1-4779-aa29-44165cae2c37 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:05:21.244709 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d0f7f847-c6e1-4779-aa29-44165cae2c37 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:05:21.312357 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-d0f7f847-c6e1-4779-aa29-44165cae2c37 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18195083037046bd99166f68690c3dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bf442df39b4f5cbc18f571a0596f10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:05:21.320270 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-d0f7f847-c6e1-4779-aa29-44165cae2c37 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] 10.222.0.48 "GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7" status: 200 len: 1224 microversion: 2.1 time: 0.088891 Jun 17 13:05:21.320832 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 373/717] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:05:21 2022] GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7 => generated 1224 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 13:05:22.340402 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-c89f1755-aee5-4c13-b5bb-f6a704efc49c tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:05:22.341127 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-c89f1755-aee5-4c13-b5bb-f6a704efc49c tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] [instance: 72889057-861c-42f3-8629-32fff8f5dab7] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:05:22.347864 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c89f1755-aee5-4c13-b5bb-f6a704efc49c tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:05:22.348310 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c89f1755-aee5-4c13-b5bb-f6a704efc49c tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:05:22.349070 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c89f1755-aee5-4c13-b5bb-f6a704efc49c tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:05:22.349504 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c89f1755-aee5-4c13-b5bb-f6a704efc49c tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:05:22.354293 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_cell1:SELECT=100 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:05:22.417239 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-c89f1755-aee5-4c13-b5bb-f6a704efc49c tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18195083037046bd99166f68690c3dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bf442df39b4f5cbc18f571a0596f10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:05:22.429755 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-c89f1755-aee5-4c13-b5bb-f6a704efc49c tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] 10.222.0.48 "GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7" status: 200 len: 1224 microversion: 2.1 time: 0.094587 Jun 17 13:05:22.430559 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 374/718] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:05:22 2022] GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7 => generated 1224 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:05:23.449065 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-e8c1ee5f-19b5-45b2-ada0-89c612a0cdba tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:05:23.449888 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-e8c1ee5f-19b5-45b2-ada0-89c612a0cdba tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] [instance: 72889057-861c-42f3-8629-32fff8f5dab7] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:05:23.457413 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e8c1ee5f-19b5-45b2-ada0-89c612a0cdba tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:05:23.457841 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e8c1ee5f-19b5-45b2-ada0-89c612a0cdba tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:05:23.458629 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e8c1ee5f-19b5-45b2-ada0-89c612a0cdba tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:05:23.459050 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e8c1ee5f-19b5-45b2-ada0-89c612a0cdba tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:05:23.533206 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-e8c1ee5f-19b5-45b2-ada0-89c612a0cdba tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18195083037046bd99166f68690c3dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bf442df39b4f5cbc18f571a0596f10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:05:23.543759 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-e8c1ee5f-19b5-45b2-ada0-89c612a0cdba tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] 10.222.0.48 "GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7" status: 200 len: 1224 microversion: 2.1 time: 0.098646 Jun 17 13:05:23.544351 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 375/719] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:05:23 2022] GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7 => generated 1224 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:05:24.565826 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-cda2ebdb-c01c-4e86-b3ac-d8de77c7d016 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:05:24.566523 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-cda2ebdb-c01c-4e86-b3ac-d8de77c7d016 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] [instance: 72889057-861c-42f3-8629-32fff8f5dab7] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:05:24.573430 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-cda2ebdb-c01c-4e86-b3ac-d8de77c7d016 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:05:24.573885 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-cda2ebdb-c01c-4e86-b3ac-d8de77c7d016 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:05:24.575393 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-cda2ebdb-c01c-4e86-b3ac-d8de77c7d016 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:05:24.575843 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-cda2ebdb-c01c-4e86-b3ac-d8de77c7d016 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:05:24.641589 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-cda2ebdb-c01c-4e86-b3ac-d8de77c7d016 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18195083037046bd99166f68690c3dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bf442df39b4f5cbc18f571a0596f10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:05:24.649825 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-cda2ebdb-c01c-4e86-b3ac-d8de77c7d016 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] 10.222.0.48 "GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7" status: 200 len: 1224 microversion: 2.1 time: 0.088019 Jun 17 13:05:24.650407 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 376/720] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:05:24 2022] GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7 => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:05:25.667451 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-b4fa2321-20ac-41c6-bca6-5106437253e5 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:05:25.668172 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-b4fa2321-20ac-41c6-bca6-5106437253e5 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] [instance: 72889057-861c-42f3-8629-32fff8f5dab7] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:05:25.675247 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b4fa2321-20ac-41c6-bca6-5106437253e5 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:05:25.675688 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b4fa2321-20ac-41c6-bca6-5106437253e5 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:05:25.676441 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b4fa2321-20ac-41c6-bca6-5106437253e5 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:05:25.676867 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b4fa2321-20ac-41c6-bca6-5106437253e5 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:05:25.742349 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-b4fa2321-20ac-41c6-bca6-5106437253e5 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18195083037046bd99166f68690c3dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bf442df39b4f5cbc18f571a0596f10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:05:25.750936 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-b4fa2321-20ac-41c6-bca6-5106437253e5 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] 10.222.0.48 "GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7" status: 200 len: 1224 microversion: 2.1 time: 0.087356 Jun 17 13:05:25.751508 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 377/721] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:05:25 2022] GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7 => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:05:26.774953 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-d30f52f5-a81d-4ab3-9aff-d96f76376af5 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:05:26.775651 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-d30f52f5-a81d-4ab3-9aff-d96f76376af5 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] [instance: 72889057-861c-42f3-8629-32fff8f5dab7] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:05:26.783583 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d30f52f5-a81d-4ab3-9aff-d96f76376af5 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:05:26.784028 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d30f52f5-a81d-4ab3-9aff-d96f76376af5 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:05:26.784799 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d30f52f5-a81d-4ab3-9aff-d96f76376af5 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:05:26.785215 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d30f52f5-a81d-4ab3-9aff-d96f76376af5 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:05:26.852230 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-d30f52f5-a81d-4ab3-9aff-d96f76376af5 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18195083037046bd99166f68690c3dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bf442df39b4f5cbc18f571a0596f10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:05:26.864800 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-d30f52f5-a81d-4ab3-9aff-d96f76376af5 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] 10.222.0.48 "GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7" status: 200 len: 1224 microversion: 2.1 time: 0.093524 Jun 17 13:05:26.865669 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 378/722] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:05:26 2022] GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7 => generated 1224 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:05:27.882595 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-b8085ace-d830-49bb-a735-68ebbf62a4b6 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:05:27.883321 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-b8085ace-d830-49bb-a735-68ebbf62a4b6 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] [instance: 72889057-861c-42f3-8629-32fff8f5dab7] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:05:27.890076 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b8085ace-d830-49bb-a735-68ebbf62a4b6 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:05:27.890547 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b8085ace-d830-49bb-a735-68ebbf62a4b6 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:05:27.891319 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b8085ace-d830-49bb-a735-68ebbf62a4b6 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:05:27.891765 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b8085ace-d830-49bb-a735-68ebbf62a4b6 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:05:27.958959 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-b8085ace-d830-49bb-a735-68ebbf62a4b6 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18195083037046bd99166f68690c3dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bf442df39b4f5cbc18f571a0596f10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:05:27.968079 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-b8085ace-d830-49bb-a735-68ebbf62a4b6 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] 10.222.0.48 "GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7" status: 200 len: 1224 microversion: 2.1 time: 0.089082 Jun 17 13:05:27.968669 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 379/723] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:05:27 2022] GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7 => generated 1224 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:05:28.990303 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-6929c6c4-eacd-42c9-b441-54ee95e6fe48 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:05:28.991027 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-6929c6c4-eacd-42c9-b441-54ee95e6fe48 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] [instance: 72889057-861c-42f3-8629-32fff8f5dab7] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:05:28.998278 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6929c6c4-eacd-42c9-b441-54ee95e6fe48 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:05:28.998725 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6929c6c4-eacd-42c9-b441-54ee95e6fe48 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:05:28.999467 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6929c6c4-eacd-42c9-b441-54ee95e6fe48 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:05:28.999917 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6929c6c4-eacd-42c9-b441-54ee95e6fe48 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:05:29.065966 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-6929c6c4-eacd-42c9-b441-54ee95e6fe48 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18195083037046bd99166f68690c3dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bf442df39b4f5cbc18f571a0596f10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:05:29.077264 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-6929c6c4-eacd-42c9-b441-54ee95e6fe48 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] 10.222.0.48 "GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7" status: 200 len: 1224 microversion: 2.1 time: 0.090638 Jun 17 13:05:29.077939 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 380/724] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:05:28 2022] GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7 => generated 1224 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:05:30.102551 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-22a6a7ce-5ccc-4c6b-8ec4-b5c8a085c6d8 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:05:30.103562 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-22a6a7ce-5ccc-4c6b-8ec4-b5c8a085c6d8 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] [instance: 72889057-861c-42f3-8629-32fff8f5dab7] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:05:30.113659 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-22a6a7ce-5ccc-4c6b-8ec4-b5c8a085c6d8 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:05:30.114392 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-22a6a7ce-5ccc-4c6b-8ec4-b5c8a085c6d8 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:05:30.115411 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-22a6a7ce-5ccc-4c6b-8ec4-b5c8a085c6d8 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:05:30.115890 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-22a6a7ce-5ccc-4c6b-8ec4-b5c8a085c6d8 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:05:30.183449 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-22a6a7ce-5ccc-4c6b-8ec4-b5c8a085c6d8 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18195083037046bd99166f68690c3dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bf442df39b4f5cbc18f571a0596f10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:05:30.191554 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-22a6a7ce-5ccc-4c6b-8ec4-b5c8a085c6d8 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] 10.222.0.48 "GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7" status: 200 len: 1224 microversion: 2.1 time: 0.095433 Jun 17 13:05:30.192121 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 381/725] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:05:30 2022] GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7 => generated 1224 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:05:31.208453 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-b4d7ec5e-38b9-4e19-9a9e-582d24241167 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:05:31.209265 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-b4d7ec5e-38b9-4e19-9a9e-582d24241167 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] [instance: 72889057-861c-42f3-8629-32fff8f5dab7] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:05:31.217059 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b4d7ec5e-38b9-4e19-9a9e-582d24241167 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:05:31.217721 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b4d7ec5e-38b9-4e19-9a9e-582d24241167 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:05:31.219079 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b4d7ec5e-38b9-4e19-9a9e-582d24241167 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:05:31.219584 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b4d7ec5e-38b9-4e19-9a9e-582d24241167 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:05:31.294245 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-b4d7ec5e-38b9-4e19-9a9e-582d24241167 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18195083037046bd99166f68690c3dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bf442df39b4f5cbc18f571a0596f10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:05:31.303069 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-b4d7ec5e-38b9-4e19-9a9e-582d24241167 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] 10.222.0.48 "GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7" status: 200 len: 1224 microversion: 2.1 time: 0.099041 Jun 17 13:05:31.303604 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 382/726] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:05:31 2022] GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7 => generated 1224 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:05:31.328165 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-468ef002-e5e9-4a86-9ffd-2d66c7b7d8c4 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:05:31.328667 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-468ef002-e5e9-4a86-9ffd-2d66c7b7d8c4 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:05:31.335272 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-468ef002-e5e9-4a86-9ffd-2d66c7b7d8c4 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:05:31.335747 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-468ef002-e5e9-4a86-9ffd-2d66c7b7d8c4 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:05:31.336504 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-468ef002-e5e9-4a86-9ffd-2d66c7b7d8c4 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:05:31.336968 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-468ef002-e5e9-4a86-9ffd-2d66c7b7d8c4 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:05:41.187318 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 13:05:41.188027 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Fri Jun 17 13:05:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments/b470fcd5-08d3-4611-a67d-1260c71b9b10 (ip 10.222.0.48) !!! Jun 17 13:05:41.332500 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_api:SELECT=37 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:05:41.399711 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_cell1:SELECT=56 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:05:47.778951 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 13:05:47.779627 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Fri Jun 17 13:05:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments/b470fcd5-08d3-4611-a67d-1260c71b9b10 (ip 10.222.0.48) !!! Jun 17 13:06:09.807846 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.wsgi [None req-89e2b2e4-b594-4533-886c-f2806881dcfa tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] HTTP exception thrown: Cannot 'detach_volume' instance 29d26a8a-a734-4531-b9ee-04506c852fe2 while it is in vm_state rescued Jun 17 13:06:09.809583 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-89e2b2e4-b594-4533-886c-f2806881dcfa tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Request method failure captured: Jun 17 13:06:09.809583 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: request: DELETE /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments/b470fcd5-08d3-4611-a67d-1260c71b9b10 HTTP/1.1 Jun 17 13:06:09.809583 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Accept: application/json Jun 17 13:06:09.809583 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Accept-Encoding: identity Jun 17 13:06:09.809583 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Connection: close Jun 17 13:06:09.809583 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Content-Length: 0 Jun 17 13:06:09.809583 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Content-Type: application/json Jun 17 13:06:09.809583 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Host: 10.222.0.48 Jun 17 13:06:09.809583 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Openstack-System-Scope: None Jun 17 13:06:09.809583 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: User-Agent: python-urllib3/1.26.9 Jun 17 13:06:09.809583 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Auth-Token: gAAAAABirHoxM0oq9BgeHLRFPYzXBHG5U4OV8ZU-A1ymANbGzbLAnLt205Q4DLlvW5I3ZQK2kg4ViraZvfMlofkEkYssplETqKLDgpV_0cDAupkiyxxXo0oRMQ1NOAKA18FF8OZJnb5Gs-d_9R_XYIMft4Dwgbdu5CEqMFZ9aQiMHSbSwXIg9SU Jun 17 13:06:09.809583 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Domain-Id: None Jun 17 13:06:09.809583 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Domain-Name: None Jun 17 13:06:09.809583 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Identity-Status: Confirmed Jun 17 13:06:09.809583 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Is-Admin-Project: True Jun 17 13:06:09.809583 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Project-Domain-Id: default Jun 17 13:06:09.809583 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Project-Domain-Name: Default Jun 17 13:06:09.809583 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Project-Id: 17ea6f9d80f345dbb3b2bf75e0138fd3 Jun 17 13:06:09.809583 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1652483342 Jun 17 13:06:09.809583 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Role: member,reader Jun 17 13:06:09.809583 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Roles: member,reader Jun 17 13:06:09.811309 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_17ea6f9d80f345dbb3b2bf75e0138fd3", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/17ea6f9d80f345dbb3b2bf75e0138fd3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/17ea6f9d80f345dbb3b2bf75e0138fd3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/17ea6f9d80f345dbb3b2bf75e0138fd3"}]}] Jun 17 13:06:09.811309 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1652483342 Jun 17 13:06:09.811309 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Tenant-Id: 17ea6f9d80f345dbb3b2bf75e0138fd3 Jun 17 13:06:09.811309 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1652483342 Jun 17 13:06:09.811309 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-User: tempest-ServerRescueNegativeTestJSON-1652483342-project Jun 17 13:06:09.811309 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-User-Domain-Id: default Jun 17 13:06:09.811309 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-User-Domain-Name: Default Jun 17 13:06:09.811309 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-User-Id: b75243e37f2342c0a428d39e193e0d4b Jun 17 13:06:09.811309 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1652483342-project Jun 17 13:06:09.811309 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: method: > Jun 17 13:06:09.811309 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: exception: Cannot 'detach_volume' instance 29d26a8a-a734-4531-b9ee-04506c852fe2 while it is in vm_state rescued Jun 17 13:06:09.812143 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: action_args: {'server_id': '29d26a8a-a734-4531-b9ee-04506c852fe2', 'id': 'b470fcd5-08d3-4611-a67d-1260c71b9b10'} Jun 17 13:06:09.812143 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 13:06:09.812143 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:06:09.812143 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 17 13:06:09.812143 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 17 13:06:09.812143 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 17 13:06:09.812143 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 17 13:06:09.812143 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 17 13:06:09.812143 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 17 13:06:09.812143 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 29d26a8a-a734-4531-b9ee-04506c852fe2 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jun 17 13:06:09.812143 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 13:06:09.812143 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:06:09.812143 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 13:06:09.812143 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:06:09.812143 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:06:09.812143 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:06:09.812143 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 13:06:09.812143 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 13:06:09.812143 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 13:06:09.812143 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 13:06:09.813656 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jun 17 13:06:09.813656 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 17 13:06:09.813656 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 17 13:06:09.813656 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 17 13:06:09.813656 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 29d26a8a-a734-4531-b9ee-04506c852fe2 while it is in vm_state rescued Jun 17 13:06:09.813656 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 13:06:09.813656 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:06:09.813656 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 13:06:09.813656 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:06:09.813656 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:06:09.813656 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:06:09.813656 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 13:06:09.813656 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 13:06:09.813656 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 29d26a8a-a734-4531-b9ee-04506c852fe2 while it is in vm_state rescued Jun 17 13:06:09.813656 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 13:06:09.813656 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-89e2b2e4-b594-4533-886c-f2806881dcfa tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Returning 409 to user: Cannot 'detach_volume' instance 29d26a8a-a734-4531-b9ee-04506c852fe2 while it is in vm_state rescued {{(pid=117660) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 13:06:09.814870 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-89e2b2e4-b594-4533-886c-f2806881dcfa tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "DELETE /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments/b470fcd5-08d3-4611-a67d-1260c71b9b10" status: 409 len: 152 microversion: 2.1 time: 98.548064 Jun 17 13:06:09.814870 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 345/727] 10.222.0.48 () {58 vars in 1415 bytes} [Fri Jun 17 13:04:31 2022] DELETE /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments/b470fcd5-08d3-4611-a67d-1260c71b9b10 => generated 152 bytes in 98550 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jun 17 13:06:09.817374 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-8058d3ab-9cbb-4952-ad3a-f0a80b03d344 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:06:09.817972 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-8058d3ab-9cbb-4952-ad3a-f0a80b03d344 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] [instance: 72889057-861c-42f3-8629-32fff8f5dab7] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:06:09.824647 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8058d3ab-9cbb-4952-ad3a-f0a80b03d344 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:06:09.825097 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8058d3ab-9cbb-4952-ad3a-f0a80b03d344 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:06:09.825838 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8058d3ab-9cbb-4952-ad3a-f0a80b03d344 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:06:09.826600 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8058d3ab-9cbb-4952-ad3a-f0a80b03d344 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:06:09.891927 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-8058d3ab-9cbb-4952-ad3a-f0a80b03d344 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18195083037046bd99166f68690c3dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bf442df39b4f5cbc18f571a0596f10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:06:09.899484 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-8058d3ab-9cbb-4952-ad3a-f0a80b03d344 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] 10.222.0.48 "GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7" status: 200 len: 1224 microversion: 2.1 time: 0.086525 Jun 17 13:06:09.899949 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 346/728] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:06:09 2022] GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:06:09.905070 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-a211a51f-5a9d-483f-a1ec-5ef5621f3b29 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-918340478"}} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:06:09.905595 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-a211a51f-5a9d-483f-a1ec-5ef5621f3b29 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:06:09.920247 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a211a51f-5a9d-483f-a1ec-5ef5621f3b29 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:06:09.920247 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a211a51f-5a9d-483f-a1ec-5ef5621f3b29 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:06:09.920247 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a211a51f-5a9d-483f-a1ec-5ef5621f3b29 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:06:09.920247 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a211a51f-5a9d-483f-a1ec-5ef5621f3b29 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:06:09.964997 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.wsgi [None req-468ef002-e5e9-4a86-9ffd-2d66c7b7d8c4 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] HTTP exception thrown: Cannot 'detach_volume' instance 29d26a8a-a734-4531-b9ee-04506c852fe2 while it is in vm_state rescued Jun 17 13:06:09.967612 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-468ef002-e5e9-4a86-9ffd-2d66c7b7d8c4 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Request method failure captured: Jun 17 13:06:09.967612 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: request: DELETE /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments/b470fcd5-08d3-4611-a67d-1260c71b9b10 HTTP/1.1 Jun 17 13:06:09.967612 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Accept: application/json Jun 17 13:06:09.967612 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Accept-Encoding: identity Jun 17 13:06:09.967612 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Connection: close Jun 17 13:06:09.967612 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Content-Length: 0 Jun 17 13:06:09.967612 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Content-Type: application/json Jun 17 13:06:09.967612 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Host: 10.222.0.48 Jun 17 13:06:09.967612 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Openstack-System-Scope: None Jun 17 13:06:09.967612 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: User-Agent: python-urllib3/1.26.9 Jun 17 13:06:09.967612 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Auth-Token: gAAAAABirHoxM0oq9BgeHLRFPYzXBHG5U4OV8ZU-A1ymANbGzbLAnLt205Q4DLlvW5I3ZQK2kg4ViraZvfMlofkEkYssplETqKLDgpV_0cDAupkiyxxXo0oRMQ1NOAKA18FF8OZJnb5Gs-d_9R_XYIMft4Dwgbdu5CEqMFZ9aQiMHSbSwXIg9SU Jun 17 13:06:09.967612 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Domain-Id: None Jun 17 13:06:09.967612 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Domain-Name: None Jun 17 13:06:09.967612 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Identity-Status: Confirmed Jun 17 13:06:09.967612 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Is-Admin-Project: True Jun 17 13:06:09.967612 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Project-Domain-Id: default Jun 17 13:06:09.967612 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Project-Domain-Name: Default Jun 17 13:06:09.967612 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Project-Id: 17ea6f9d80f345dbb3b2bf75e0138fd3 Jun 17 13:06:09.967612 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1652483342 Jun 17 13:06:09.967612 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Role: member,reader Jun 17 13:06:09.967612 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Roles: member,reader Jun 17 13:06:09.968960 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_17ea6f9d80f345dbb3b2bf75e0138fd3", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/17ea6f9d80f345dbb3b2bf75e0138fd3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/17ea6f9d80f345dbb3b2bf75e0138fd3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/17ea6f9d80f345dbb3b2bf75e0138fd3"}]}] Jun 17 13:06:09.968960 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1652483342 Jun 17 13:06:09.968960 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Tenant-Id: 17ea6f9d80f345dbb3b2bf75e0138fd3 Jun 17 13:06:09.968960 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1652483342 Jun 17 13:06:09.968960 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User: tempest-ServerRescueNegativeTestJSON-1652483342-project Jun 17 13:06:09.968960 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User-Domain-Id: default Jun 17 13:06:09.968960 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User-Domain-Name: Default Jun 17 13:06:09.968960 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User-Id: b75243e37f2342c0a428d39e193e0d4b Jun 17 13:06:09.968960 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1652483342-project Jun 17 13:06:09.968960 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: method: > Jun 17 13:06:09.968960 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: exception: Cannot 'detach_volume' instance 29d26a8a-a734-4531-b9ee-04506c852fe2 while it is in vm_state rescued Jun 17 13:06:09.969628 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: action_args: {'server_id': '29d26a8a-a734-4531-b9ee-04506c852fe2', 'id': 'b470fcd5-08d3-4611-a67d-1260c71b9b10'} Jun 17 13:06:09.969628 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 13:06:09.969628 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:06:09.969628 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 17 13:06:09.969628 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 17 13:06:09.969628 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 17 13:06:09.969628 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 17 13:06:09.969628 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 17 13:06:09.969628 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 17 13:06:09.969628 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 29d26a8a-a734-4531-b9ee-04506c852fe2 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jun 17 13:06:09.969628 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:06:09.969628 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:06:09.969628 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:06:09.969628 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:06:09.969628 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:06:09.969628 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:06:09.969628 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 13:06:09.969628 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 13:06:09.969628 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 13:06:09.969628 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 13:06:09.970831 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jun 17 13:06:09.970831 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 17 13:06:09.970831 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 17 13:06:09.970831 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 17 13:06:09.970831 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 29d26a8a-a734-4531-b9ee-04506c852fe2 while it is in vm_state rescued Jun 17 13:06:09.970831 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:06:09.970831 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:06:09.970831 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:06:09.970831 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:06:09.970831 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:06:09.970831 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:06:09.970831 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 13:06:09.970831 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 13:06:09.970831 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 29d26a8a-a734-4531-b9ee-04506c852fe2 while it is in vm_state rescued Jun 17 13:06:09.970831 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:06:09.970831 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-468ef002-e5e9-4a86-9ffd-2d66c7b7d8c4 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Returning 409 to user: Cannot 'detach_volume' instance 29d26a8a-a734-4531-b9ee-04506c852fe2 while it is in vm_state rescued {{(pid=117659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 13:06:09.971797 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-468ef002-e5e9-4a86-9ffd-2d66c7b7d8c4 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "DELETE /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments/b470fcd5-08d3-4611-a67d-1260c71b9b10" status: 409 len: 152 microversion: 2.1 time: 38.645123 Jun 17 13:06:09.971797 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 383/729] 10.222.0.48 () {58 vars in 1415 bytes} [Fri Jun 17 13:05:31 2022] DELETE /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments/b470fcd5-08d3-4611-a67d-1260c71b9b10 => generated 152 bytes in 38646 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jun 17 13:06:09.977379 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-85db6152-1068-4451-8a6e-a77bc7396bf3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:06:09.977855 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-85db6152-1068-4451-8a6e-a77bc7396bf3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:06:09.985320 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-85db6152-1068-4451-8a6e-a77bc7396bf3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:06:09.985750 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-85db6152-1068-4451-8a6e-a77bc7396bf3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:06:09.986559 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-85db6152-1068-4451-8a6e-a77bc7396bf3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:06:09.987131 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-85db6152-1068-4451-8a6e-a77bc7396bf3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:06:10.048479 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.network.security_group_api [None req-a211a51f-5a9d-483f-a1ec-5ef5621f3b29 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Removing security group 1605cae9-9619-43de-8eb3-959972c2e68c from port 78029a46-f1c7-4b92-ba08-7045080d5b08 Jun 17 13:06:10.187362 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.objects.instance [None req-85db6152-1068-4451-8a6e-a77bc7396bf3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lazy-loading 'services' on Instance uuid c8fdea98-917f-4c4d-aaba-d4f5df4622d6 {{(pid=117659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 13:06:10.429934 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-a211a51f-5a9d-483f-a1ec-5ef5621f3b29 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "POST /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a/action" status: 202 len: 0 microversion: 2.1 time: 0.528876 Jun 17 13:06:10.434672 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 347/730] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Jun 17 13:06:09 2022] POST /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a/action => generated 0 bytes in 534 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 13:06:10.440788 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-94ceebe4-bd1b-4380-9cd2-77a1d77da47e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:06:10.441688 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-94ceebe4-bd1b-4380-9cd2-77a1d77da47e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:06:10.449032 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-94ceebe4-bd1b-4380-9cd2-77a1d77da47e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:06:10.449968 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-94ceebe4-bd1b-4380-9cd2-77a1d77da47e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:06:10.451120 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-94ceebe4-bd1b-4380-9cd2-77a1d77da47e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:06:10.455116 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-94ceebe4-bd1b-4380-9cd2-77a1d77da47e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:06:10.617676 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-94ceebe4-bd1b-4380-9cd2-77a1d77da47e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "POST /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/action" status: 202 len: 0 microversion: 2.1 time: 0.180524 Jun 17 13:06:10.618361 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 348/731] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Jun 17 13:06:10 2022] POST /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/action => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 13:06:10.724320 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [req-adf5e8e5-b74a-4cd6-a329-dde24deaf142 req-511914e2-57a2-49da-b8fb-bafa42dc3bed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a408151-81c8-4490-9190-5e4fa2d98e8a", "tag": "78029a46-f1c7-4b92-ba08-7045080d5b08"}]} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:06:10.747617 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-adf5e8e5-b74a-4cd6-a329-dde24deaf142 req-511914e2-57a2-49da-b8fb-bafa42dc3bed service nova] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:06:10.748079 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-adf5e8e5-b74a-4cd6-a329-dde24deaf142 req-511914e2-57a2-49da-b8fb-bafa42dc3bed service nova] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:06:10.773291 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.compute.server_external_events [req-adf5e8e5-b74a-4cd6-a329-dde24deaf142 req-511914e2-57a2-49da-b8fb-bafa42dc3bed service nova] Creating event network-changed:78029a46-f1c7-4b92-ba08-7045080d5b08 for instance 8a408151-81c8-4490-9190-5e4fa2d98e8a on hv-cinder-83754 Jun 17 13:06:10.781629 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [req-adf5e8e5-b74a-4cd6-a329-dde24deaf142 req-511914e2-57a2-49da-b8fb-bafa42dc3bed service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.161414 Jun 17 13:06:10.782914 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 349/732] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 13:06:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:06:10.789048 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-4dfbfe50-cb3c-4019-9c2d-b916a9c8e679 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:06:10.790339 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-4dfbfe50-cb3c-4019-9c2d-b916a9c8e679 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:06:10.798355 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4dfbfe50-cb3c-4019-9c2d-b916a9c8e679 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:06:10.800197 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4dfbfe50-cb3c-4019-9c2d-b916a9c8e679 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:06:10.802406 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4dfbfe50-cb3c-4019-9c2d-b916a9c8e679 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:06:10.803119 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4dfbfe50-cb3c-4019-9c2d-b916a9c8e679 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:06:11.181949 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-4dfbfe50-cb3c-4019-9c2d-b916a9c8e679 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:06:11.192760 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-4dfbfe50-cb3c-4019-9c2d-b916a9c8e679 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1723 microversion: 2.1 time: 0.408320 Jun 17 13:06:11.198557 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 350/733] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:06:10 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1723 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:06:11.204746 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-4dc99ce8-a758-4bcf-86db-05dd2ebe7a31 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:06:11.205457 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-4dc99ce8-a758-4bcf-86db-05dd2ebe7a31 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] [instance: 72889057-861c-42f3-8629-32fff8f5dab7] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:06:11.212880 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4dc99ce8-a758-4bcf-86db-05dd2ebe7a31 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:06:11.213505 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4dc99ce8-a758-4bcf-86db-05dd2ebe7a31 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:06:11.214603 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4dc99ce8-a758-4bcf-86db-05dd2ebe7a31 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:06:11.215162 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4dc99ce8-a758-4bcf-86db-05dd2ebe7a31 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:06:11.383824 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-4dc99ce8-a758-4bcf-86db-05dd2ebe7a31 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18195083037046bd99166f68690c3dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bf442df39b4f5cbc18f571a0596f10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:06:11.395833 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-4dc99ce8-a758-4bcf-86db-05dd2ebe7a31 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] 10.222.0.48 "GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7" status: 200 len: 1224 microversion: 2.1 time: 0.201236 Jun 17 13:06:11.396798 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 351/734] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:06:11 2022] GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7 => generated 1224 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:06:12.211062 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-08bb7cb3-a7d2-4d16-99ab-ccad024e988f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:06:12.212414 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-08bb7cb3-a7d2-4d16-99ab-ccad024e988f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:06:12.227418 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-08bb7cb3-a7d2-4d16-99ab-ccad024e988f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:06:12.227418 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-08bb7cb3-a7d2-4d16-99ab-ccad024e988f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:06:12.227418 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-08bb7cb3-a7d2-4d16-99ab-ccad024e988f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:06:12.227418 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-08bb7cb3-a7d2-4d16-99ab-ccad024e988f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:06:12.471028 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-08bb7cb3-a7d2-4d16-99ab-ccad024e988f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:06:12.479443 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-08bb7cb3-a7d2-4d16-99ab-ccad024e988f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1723 microversion: 2.1 time: 0.272232 Jun 17 13:06:12.480113 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 352/735] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:06:12 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1723 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 13:06:12.484908 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-65739533-68ac-4de4-a0f4-1dc67aae524a tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:06:12.485505 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-65739533-68ac-4de4-a0f4-1dc67aae524a tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] [instance: 72889057-861c-42f3-8629-32fff8f5dab7] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:06:12.491973 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-65739533-68ac-4de4-a0f4-1dc67aae524a tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:06:12.492413 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-65739533-68ac-4de4-a0f4-1dc67aae524a tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:06:12.493208 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-65739533-68ac-4de4-a0f4-1dc67aae524a tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:06:12.493636 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-65739533-68ac-4de4-a0f4-1dc67aae524a tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:06:12.589235 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-65739533-68ac-4de4-a0f4-1dc67aae524a tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18195083037046bd99166f68690c3dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bf442df39b4f5cbc18f571a0596f10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:06:12.597146 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-65739533-68ac-4de4-a0f4-1dc67aae524a tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] 10.222.0.48 "GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7" status: 200 len: 1224 microversion: 2.1 time: 0.115921 Jun 17 13:06:12.597744 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 353/736] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:06:12 2022] GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7 => generated 1224 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:06:12.657548 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-630d449c-0aea-4233-8b7b-c2bad0c3cb01 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:06:12.658032 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-630d449c-0aea-4233-8b7b-c2bad0c3cb01 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:06:12.664432 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-630d449c-0aea-4233-8b7b-c2bad0c3cb01 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:06:12.664878 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-630d449c-0aea-4233-8b7b-c2bad0c3cb01 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:06:12.665654 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-630d449c-0aea-4233-8b7b-c2bad0c3cb01 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:06:12.666104 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-630d449c-0aea-4233-8b7b-c2bad0c3cb01 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:06:19.982056 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_api:SELECT=2 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:06:20.245014 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_cell1:SELECT=10 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:06:22.662598 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_api:SELECT=18 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:06:22.687558 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:07:18.801667 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 13:07:18.802455 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Fri Jun 17 13:07:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a/os-volume_attachments/520bf7f4-5382-4c9c-81be-934670e0f29c (ip 10.222.0.48) !!! Jun 17 13:07:29.555613 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 13:07:29.556520 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Fri Jun 17 13:07:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments/dc0d8f94-669d-473e-b967-103b03ff07d8 (ip 10.222.0.48) !!! Jun 17 13:08:10.168387 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-85db6152-1068-4451-8a6e-a77bc7396bf3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "DELETE /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments/dc0d8f94-669d-473e-b967-103b03ff07d8" status: 202 len: 0 microversion: 2.20 time: 120.197393 Jun 17 13:08:10.169195 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 384/737] 10.222.0.48 () {60 vars in 1456 bytes} [Fri Jun 17 13:06:09 2022] DELETE /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments/dc0d8f94-669d-473e-b967-103b03ff07d8 => generated 0 bytes in 120199 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 17 13:08:10.175058 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [req-e031d7c8-5e57-405f-8c47-6cde38512c29 req-4c7e13b2-367a-4301-9210-16854335a9bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a408151-81c8-4490-9190-5e4fa2d98e8a", "tag": "78029a46-f1c7-4b92-ba08-7045080d5b08"}]} {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:08:10.184757 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [req-e031d7c8-5e57-405f-8c47-6cde38512c29 req-4c7e13b2-367a-4301-9210-16854335a9bd service nova] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:08:10.185278 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [req-e031d7c8-5e57-405f-8c47-6cde38512c29 req-4c7e13b2-367a-4301-9210-16854335a9bd service nova] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:08:10.197937 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.compute.server_external_events [req-e031d7c8-5e57-405f-8c47-6cde38512c29 req-4c7e13b2-367a-4301-9210-16854335a9bd service nova] Creating event network-changed:78029a46-f1c7-4b92-ba08-7045080d5b08 for instance 8a408151-81c8-4490-9190-5e4fa2d98e8a on hv-cinder-83754 Jun 17 13:08:10.203345 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [req-e031d7c8-5e57-405f-8c47-6cde38512c29 req-4c7e13b2-367a-4301-9210-16854335a9bd service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032775 Jun 17 13:08:10.212923 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 385/738] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 13:08:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:08:10.315420 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-acafe612-d16a-4223-9171-6436b8215428 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:08:10.316171 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-acafe612-d16a-4223-9171-6436b8215428 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:08:10.323803 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-acafe612-d16a-4223-9171-6436b8215428 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:08:10.324245 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-acafe612-d16a-4223-9171-6436b8215428 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:08:10.326488 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-acafe612-d16a-4223-9171-6436b8215428 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:08:10.326921 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-acafe612-d16a-4223-9171-6436b8215428 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:08:10.498123 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.objects.instance [None req-630d449c-0aea-4233-8b7b-c2bad0c3cb01 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lazy-loading 'services' on Instance uuid 8a408151-81c8-4490-9190-5e4fa2d98e8a {{(pid=117660) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 13:08:10.612057 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-acafe612-d16a-4223-9171-6436b8215428 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:08:10.621259 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-acafe612-d16a-4223-9171-6436b8215428 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1729 microversion: 2.1 time: 0.415321 Jun 17 13:08:10.621611 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 386/739] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:08:10 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1729 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:08:10.626881 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-dcf8c2e1-ecd4-4382-8229-875586500fd7 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:08:10.627493 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-dcf8c2e1-ecd4-4382-8229-875586500fd7 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] [instance: 72889057-861c-42f3-8629-32fff8f5dab7] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:08:10.634073 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-dcf8c2e1-ecd4-4382-8229-875586500fd7 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:08:10.634559 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-dcf8c2e1-ecd4-4382-8229-875586500fd7 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:08:10.635334 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-dcf8c2e1-ecd4-4382-8229-875586500fd7 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:08:10.635789 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-dcf8c2e1-ecd4-4382-8229-875586500fd7 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:08:10.729089 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-dcf8c2e1-ecd4-4382-8229-875586500fd7 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18195083037046bd99166f68690c3dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bf442df39b4f5cbc18f571a0596f10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:08:10.737137 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-dcf8c2e1-ecd4-4382-8229-875586500fd7 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] 10.222.0.48 "GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7" status: 200 len: 1224 microversion: 2.1 time: 0.114355 Jun 17 13:08:10.737738 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 387/740] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:08:10 2022] GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7 => generated 1224 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:08:10.742620 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-1cd18e81-9698-4ab5-88e8-9f992fe79fa8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:08:10.743098 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-1cd18e81-9698-4ab5-88e8-9f992fe79fa8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:08:10.749548 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-1cd18e81-9698-4ab5-88e8-9f992fe79fa8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:08:10.750354 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-1cd18e81-9698-4ab5-88e8-9f992fe79fa8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:08:10.751121 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-1cd18e81-9698-4ab5-88e8-9f992fe79fa8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:08:10.751578 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-1cd18e81-9698-4ab5-88e8-9f992fe79fa8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:08:20.502876 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=4 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:08:20.747608 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_api:SELECT=8 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:08:20.780578 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_cell1:SELECT=19,nova_cell1:INSERT=1 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:09:01.197922 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 13:09:01.198909 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Fri Jun 17 13:09:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments/dc0d8f94-669d-473e-b967-103b03ff07d8 (ip 10.222.0.48) !!! Jun 17 13:09:07.789242 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 13:09:07.789916 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Fri Jun 17 13:09:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a/os-volume_attachments/520bf7f4-5382-4c9c-81be-934670e0f29c (ip 10.222.0.48) !!! Jun 17 13:09:24.586070 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 13:09:24.587051 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Fri Jun 17 13:09:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a/os-volume_attachments/520bf7f4-5382-4c9c-81be-934670e0f29c (ip 10.222.0.48) !!! Jun 17 13:10:10.505734 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-630d449c-0aea-4233-8b7b-c2bad0c3cb01 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "DELETE /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a/os-volume_attachments/520bf7f4-5382-4c9c-81be-934670e0f29c" status: 202 len: 0 microversion: 2.1 time: 237.852342 Jun 17 13:10:10.506769 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 354/741] 10.222.0.48 () {58 vars in 1415 bytes} [Fri Jun 17 13:06:12 2022] DELETE /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a/os-volume_attachments/520bf7f4-5382-4c9c-81be-934670e0f29c => generated 0 bytes in 237854 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 13:10:10.512756 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-5ab734a0-f265-4cb7-b0fd-001dcab1fe2e tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:10:10.513342 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-5ab734a0-f265-4cb7-b0fd-001dcab1fe2e tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:10:10.519604 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5ab734a0-f265-4cb7-b0fd-001dcab1fe2e tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:10:10.520039 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5ab734a0-f265-4cb7-b0fd-001dcab1fe2e tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:10:10.520991 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5ab734a0-f265-4cb7-b0fd-001dcab1fe2e tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:10:10.521597 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5ab734a0-f265-4cb7-b0fd-001dcab1fe2e tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:10:10.559420 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.objects.instance [None req-1cd18e81-9698-4ab5-88e8-9f992fe79fa8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lazy-loading 'services' on Instance uuid c8fdea98-917f-4c4d-aaba-d4f5df4622d6 {{(pid=117659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 13:10:20.517132 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_api:SELECT=2 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:10:20.545294 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=5,nova_cell1:INSERT=1 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:10:20.574126 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_cell1:SELECT=4 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:10:38.810940 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 13:10:38.811548 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Fri Jun 17 13:10:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a/os-volume_attachments/520bf7f4-5382-4c9c-81be-934670e0f29c (ip 10.222.0.48) !!! Jun 17 13:10:49.567488 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 13:10:49.568099 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Fri Jun 17 13:10:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments/dc0d8f94-669d-473e-b967-103b03ff07d8 (ip 10.222.0.48) !!! Jun 17 13:11:08.381866 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 13:11:08.382619 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Fri Jun 17 13:11:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments/dc0d8f94-669d-473e-b967-103b03ff07d8 (ip 10.222.0.48) !!! Jun 17 13:12:10.787022 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.objects.instance [None req-5ab734a0-f265-4cb7-b0fd-001dcab1fe2e tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lazy-loading 'services' on Instance uuid 8a408151-81c8-4490-9190-5e4fa2d98e8a {{(pid=117660) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 13:12:10.828125 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.wsgi [None req-1cd18e81-9698-4ab5-88e8-9f992fe79fa8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e85d1558-33b2-4d7c-bd71-5f7eb7846d85) Jun 17 13:12:10.830339 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-1cd18e81-9698-4ab5-88e8-9f992fe79fa8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Request method failure captured: Jun 17 13:12:10.830339 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: request: DELETE /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments/dc0d8f94-669d-473e-b967-103b03ff07d8 HTTP/1.1 Jun 17 13:12:10.830339 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Accept: application/json Jun 17 13:12:10.830339 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Accept-Encoding: identity Jun 17 13:12:10.830339 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Connection: close Jun 17 13:12:10.830339 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Content-Length: 0 Jun 17 13:12:10.830339 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Content-Type: application/json Jun 17 13:12:10.830339 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Host: 10.222.0.48 Jun 17 13:12:10.830339 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Openstack-System-Scope: None Jun 17 13:12:10.830339 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: User-Agent: python-urllib3/1.26.9 Jun 17 13:12:10.830339 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Auth-Token: gAAAAABirHovuSKXhsYnyM1ICQHfCBnAkcBbRuuwZgxhkoNNkDDA8V46u4bM0d1Ij3mDA-GnbWHcDVDPBrFR3gqwdKLqUjwJvDZ_b3brdODlYgnHT8j_9TL2kWiym-dIXC0QOJO96MqfgUwsdiseafc9vSwBlwUt2XH_DR7FE-ChC01iKCOrpX0 Jun 17 13:12:10.830339 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Domain-Id: None Jun 17 13:12:10.830339 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Domain-Name: None Jun 17 13:12:10.830339 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Identity-Status: Confirmed Jun 17 13:12:10.830339 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Is-Admin-Project: True Jun 17 13:12:10.830339 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Openstack-Nova-Api-Version: 2.20 Jun 17 13:12:10.830339 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Project-Domain-Id: default Jun 17 13:12:10.830339 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Project-Domain-Name: Default Jun 17 13:12:10.830339 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Project-Id: c777f8f104af4d37a3b89ff9a57d2218 Jun 17 13:12:10.830339 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1116672173 Jun 17 13:12:10.830339 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Role: member,reader Jun 17 13:12:10.830339 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Roles: member,reader Jun 17 13:12:10.831786 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c777f8f104af4d37a3b89ff9a57d2218", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c777f8f104af4d37a3b89ff9a57d2218"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c777f8f104af4d37a3b89ff9a57d2218"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c777f8f104af4d37a3b89ff9a57d2218"}]}] Jun 17 13:12:10.831786 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1116672173 Jun 17 13:12:10.831786 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Tenant-Id: c777f8f104af4d37a3b89ff9a57d2218 Jun 17 13:12:10.831786 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1116672173 Jun 17 13:12:10.831786 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User: tempest-AttachVolumeShelveTestJSON-1116672173-project Jun 17 13:12:10.831786 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User-Domain-Id: default Jun 17 13:12:10.831786 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User-Domain-Name: Default Jun 17 13:12:10.831786 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User-Id: 847c39439e874e68b72e07c311a53bec Jun 17 13:12:10.831786 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1116672173-project Jun 17 13:12:10.831786 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: method: > Jun 17 13:12:10.832592 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e85d1558-33b2-4d7c-bd71-5f7eb7846d85) Jun 17 13:12:10.832592 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: action_args: {'server_id': 'c8fdea98-917f-4c4d-aaba-d4f5df4622d6', 'id': 'dc0d8f94-669d-473e-b967-103b03ff07d8'} Jun 17 13:12:10.832592 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 13:12:10.832592 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:12:10.832592 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 13:12:10.832592 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 13:12:10.832592 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 13:12:10.832592 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 13:12:10.832592 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 17 13:12:10.832592 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 17 13:12:10.832592 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 17 13:12:10.832592 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 17 13:12:10.832592 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 17 13:12:10.832592 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 17 13:12:10.832592 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 17 13:12:10.832592 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 17 13:12:10.832592 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 13:12:10.833734 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 13:12:10.833734 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 13:12:10.833734 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 13:12:10.833734 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e85d1558-33b2-4d7c-bd71-5f7eb7846d85) Jun 17 13:12:10.833734 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:12:10.833734 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:12:10.833734 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:12:10.833734 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:12:10.833734 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jun 17 13:12:10.833734 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jun 17 13:12:10.833734 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jun 17 13:12:10.833734 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jun 17 13:12:10.833734 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 17 13:12:10.833734 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 17 13:12:10.833734 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 13:12:10.833734 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 13:12:10.833734 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 13:12:10.833734 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 13:12:10.833734 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 17 13:12:10.835253 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 17 13:12:10.835253 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 17 13:12:10.835253 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 17 13:12:10.835253 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 17 13:12:10.835253 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 17 13:12:10.835253 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 17 13:12:10.835253 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 17 13:12:10.835253 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 13:12:10.835253 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 13:12:10.835253 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 13:12:10.835253 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 13:12:10.835253 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e85d1558-33b2-4d7c-bd71-5f7eb7846d85) Jun 17 13:12:10.835253 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:12:10.835253 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:12:10.835253 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:12:10.835253 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:12:10.835253 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 17 13:12:10.839084 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 17 13:12:10.839084 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 17 13:12:10.839084 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 17 13:12:10.839084 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 17 13:12:10.839084 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 17 13:12:10.839084 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jun 17 13:12:10.839084 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jun 17 13:12:10.839084 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jun 17 13:12:10.839084 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 17 13:12:10.839084 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jun 17 13:12:10.839084 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jun 17 13:12:10.839084 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e85d1558-33b2-4d7c-bd71-5f7eb7846d85) Jun 17 13:12:10.839084 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:12:10.839084 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:12:10.839084 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:12:10.839084 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:12:10.839084 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:12:10.839084 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:12:10.843354 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 13:12:10.843354 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 13:12:10.843354 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 13:12:10.843354 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 13:12:10.843354 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jun 17 13:12:10.843354 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 17 13:12:10.843354 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e85d1558-33b2-4d7c-bd71-5f7eb7846d85) Jun 17 13:12:10.843354 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:12:10.843354 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:12:10.843354 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:12:10.843354 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:12:10.843354 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:12:10.843354 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:12:10.843354 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 13:12:10.843354 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 13:12:10.843354 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e85d1558-33b2-4d7c-bd71-5f7eb7846d85) Jun 17 13:12:10.843354 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:12:10.844677 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-1cd18e81-9698-4ab5-88e8-9f992fe79fa8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e85d1558-33b2-4d7c-bd71-5f7eb7846d85) {{(pid=117659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 13:12:10.844677 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-1cd18e81-9698-4ab5-88e8-9f992fe79fa8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "DELETE /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments/dc0d8f94-669d-473e-b967-103b03ff07d8" status: 400 len: 269 microversion: 2.20 time: 240.093078 Jun 17 13:12:10.844677 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Fri Jun 17 13:12:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments/dc0d8f94-669d-473e-b967-103b03ff07d8 (ip 10.222.0.48) !!! Jun 17 13:12:10.844677 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Fri Jun 17 13:12:10 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments/dc0d8f94-669d-473e-b967-103b03ff07d8 (10.222.0.48) Jun 17 13:12:10.844677 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: CRITICAL nova [None req-1cd18e81-9698-4ab5-88e8-9f992fe79fa8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Unhandled error: OSError: write error Jun 17 13:12:10.844677 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova OSError: write error Jun 17 13:12:10.844677 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova Jun 17 13:12:10.845310 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 388/742] 10.222.0.48 () {60 vars in 1456 bytes} [Fri Jun 17 13:08:10 2022] DELETE /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments/dc0d8f94-669d-473e-b967-103b03ff07d8 => generated 0 bytes in 240095 msecs (HTTP/1.1 400) 9 headers in 0 bytes (0 switches on core 0) Jun 17 13:12:10.845310 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-ef1eaccb-1644-4eb9-a6cb-1f9c9a010e11 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:12:10.845310 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-ef1eaccb-1644-4eb9-a6cb-1f9c9a010e11 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:12:10.846054 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ef1eaccb-1644-4eb9-a6cb-1f9c9a010e11 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:12:10.846532 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ef1eaccb-1644-4eb9-a6cb-1f9c9a010e11 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:12:10.847637 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ef1eaccb-1644-4eb9-a6cb-1f9c9a010e11 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:12:10.848066 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ef1eaccb-1644-4eb9-a6cb-1f9c9a010e11 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:12:10.952806 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.wsgi [None req-5ab734a0-f265-4cb7-b0fd-001dcab1fe2e tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-2210faeb-2cf2-41d3-8e77-8358acd3b622) Jun 17 13:12:10.955265 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-5ab734a0-f265-4cb7-b0fd-001dcab1fe2e tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Request method failure captured: Jun 17 13:12:10.955265 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: request: DELETE /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a/os-volume_attachments/520bf7f4-5382-4c9c-81be-934670e0f29c HTTP/1.1 Jun 17 13:12:10.955265 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Accept: application/json Jun 17 13:12:10.955265 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Accept-Encoding: identity Jun 17 13:12:10.955265 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Connection: close Jun 17 13:12:10.955265 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Content-Length: 0 Jun 17 13:12:10.955265 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Content-Type: application/json Jun 17 13:12:10.955265 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Host: 10.222.0.48 Jun 17 13:12:10.955265 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Openstack-System-Scope: None Jun 17 13:12:10.955265 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: User-Agent: python-urllib3/1.26.9 Jun 17 13:12:10.955265 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Auth-Token: gAAAAABirHsRs0DVoIJTEPizfQxUzLDy-cAxnoVq8pWwVU2lDEHfxotVouYNtPnQqMCXDF_Skn8Rxq-oKMB46_vj80swmohZmWUzc-BQzgQQhfPTpXwWUX9acE_q4zXSw5Kb4Ruqe_0ls_p0iCyuchKIOqXgyPR4tZ62Zn4QfTGY95co2HqCR5s Jun 17 13:12:10.955265 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Domain-Id: None Jun 17 13:12:10.955265 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Domain-Name: None Jun 17 13:12:10.955265 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Identity-Status: Confirmed Jun 17 13:12:10.955265 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Is-Admin-Project: True Jun 17 13:12:10.955265 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Project-Domain-Id: default Jun 17 13:12:10.955265 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Project-Domain-Name: Default Jun 17 13:12:10.955265 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Project-Id: 1686ea199c5442958f97102a61ce41aa Jun 17 13:12:10.955265 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Project-Name: tempest-TestMinimumBasicScenario-1188150813 Jun 17 13:12:10.955265 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Role: member,reader Jun 17 13:12:10.955265 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Roles: member,reader Jun 17 13:12:10.956994 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_1686ea199c5442958f97102a61ce41aa", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1686ea199c5442958f97102a61ce41aa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1686ea199c5442958f97102a61ce41aa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/1686ea199c5442958f97102a61ce41aa"}]}] Jun 17 13:12:10.956994 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Tenant: tempest-TestMinimumBasicScenario-1188150813 Jun 17 13:12:10.956994 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Tenant-Id: 1686ea199c5442958f97102a61ce41aa Jun 17 13:12:10.956994 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1188150813 Jun 17 13:12:10.956994 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-User: tempest-TestMinimumBasicScenario-1188150813-project Jun 17 13:12:10.956994 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-User-Domain-Id: default Jun 17 13:12:10.956994 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-User-Domain-Name: Default Jun 17 13:12:10.956994 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-User-Id: e7a99ccc238943a098833d03c6233413 Jun 17 13:12:10.956994 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-User-Name: tempest-TestMinimumBasicScenario-1188150813-project Jun 17 13:12:10.956994 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: method: > Jun 17 13:12:10.957895 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-2210faeb-2cf2-41d3-8e77-8358acd3b622) Jun 17 13:12:10.957895 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: action_args: {'server_id': '8a408151-81c8-4490-9190-5e4fa2d98e8a', 'id': '520bf7f4-5382-4c9c-81be-934670e0f29c'} Jun 17 13:12:10.957895 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 13:12:10.957895 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:12:10.957895 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 13:12:10.957895 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 13:12:10.957895 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 13:12:10.957895 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 13:12:10.957895 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 17 13:12:10.957895 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 17 13:12:10.957895 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 17 13:12:10.957895 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 17 13:12:10.957895 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 17 13:12:10.957895 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 17 13:12:10.957895 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 17 13:12:10.957895 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 17 13:12:10.957895 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 13:12:10.959205 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 13:12:10.959205 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 13:12:10.959205 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 13:12:10.959205 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-2210faeb-2cf2-41d3-8e77-8358acd3b622) Jun 17 13:12:10.959205 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 13:12:10.959205 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:12:10.959205 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 13:12:10.959205 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:12:10.959205 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jun 17 13:12:10.959205 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jun 17 13:12:10.959205 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jun 17 13:12:10.959205 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jun 17 13:12:10.959205 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 17 13:12:10.959205 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 17 13:12:10.959205 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 13:12:10.959205 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 13:12:10.959205 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 13:12:10.959205 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 13:12:10.959205 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 17 13:12:10.960492 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 17 13:12:10.960492 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 17 13:12:10.960492 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 17 13:12:10.960492 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 17 13:12:10.960492 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 17 13:12:10.960492 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 17 13:12:10.960492 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 17 13:12:10.960492 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 13:12:10.960492 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 13:12:10.960492 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 13:12:10.960492 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 13:12:10.960492 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-2210faeb-2cf2-41d3-8e77-8358acd3b622) Jun 17 13:12:10.960492 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 13:12:10.960492 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:12:10.960492 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 13:12:10.960492 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:12:10.960492 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 17 13:12:10.961673 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 17 13:12:10.961673 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 17 13:12:10.961673 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 17 13:12:10.961673 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 17 13:12:10.961673 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 17 13:12:10.961673 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jun 17 13:12:10.961673 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jun 17 13:12:10.961673 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jun 17 13:12:10.961673 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 17 13:12:10.961673 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jun 17 13:12:10.961673 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jun 17 13:12:10.961673 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-2210faeb-2cf2-41d3-8e77-8358acd3b622) Jun 17 13:12:10.961673 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 13:12:10.961673 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:12:10.961673 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 13:12:10.961673 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:12:10.961673 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:12:10.961673 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:12:10.963605 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 13:12:10.963605 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 13:12:10.963605 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 13:12:10.963605 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 13:12:10.963605 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jun 17 13:12:10.963605 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 17 13:12:10.963605 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-2210faeb-2cf2-41d3-8e77-8358acd3b622) Jun 17 13:12:10.963605 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 13:12:10.963605 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:12:10.963605 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 13:12:10.963605 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:12:10.963605 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:12:10.963605 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:12:10.963605 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 13:12:10.963605 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 13:12:10.963605 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-2210faeb-2cf2-41d3-8e77-8358acd3b622) Jun 17 13:12:10.963605 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 13:12:10.966065 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-5ab734a0-f265-4cb7-b0fd-001dcab1fe2e tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-2210faeb-2cf2-41d3-8e77-8358acd3b622) {{(pid=117660) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 13:12:10.966065 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-5ab734a0-f265-4cb7-b0fd-001dcab1fe2e tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "DELETE /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a/os-volume_attachments/520bf7f4-5382-4c9c-81be-934670e0f29c" status: 400 len: 269 microversion: 2.1 time: 120.448740 Jun 17 13:12:10.966065 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 355/743] 10.222.0.48 () {58 vars in 1415 bytes} [Fri Jun 17 13:10:10 2022] DELETE /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a/os-volume_attachments/520bf7f4-5382-4c9c-81be-934670e0f29c => generated 269 bytes in 120450 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 17 13:12:10.966065 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-e43d7fcd-e38a-4121-a92a-1a7f97ea7436 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:12:10.966630 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-e43d7fcd-e38a-4121-a92a-1a7f97ea7436 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] [instance: 72889057-861c-42f3-8629-32fff8f5dab7] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:12:10.969933 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e43d7fcd-e38a-4121-a92a-1a7f97ea7436 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:12:10.970420 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e43d7fcd-e38a-4121-a92a-1a7f97ea7436 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:12:10.971266 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e43d7fcd-e38a-4121-a92a-1a7f97ea7436 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:12:10.971794 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e43d7fcd-e38a-4121-a92a-1a7f97ea7436 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:12:11.004541 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-ef1eaccb-1644-4eb9-a6cb-1f9c9a010e11 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:12:11.013880 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-ef1eaccb-1644-4eb9-a6cb-1f9c9a010e11 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1729 microversion: 2.1 time: 0.179824 Jun 17 13:12:11.016762 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 389/744] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:12:10 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1729 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:12:11.021856 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-b371bbe5-aab0-4cc9-982e-f1177423a064 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:12:11.022376 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-b371bbe5-aab0-4cc9-982e-f1177423a064 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:12:11.028934 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b371bbe5-aab0-4cc9-982e-f1177423a064 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:12:11.029610 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b371bbe5-aab0-4cc9-982e-f1177423a064 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:12:11.030412 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b371bbe5-aab0-4cc9-982e-f1177423a064 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:12:11.030829 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b371bbe5-aab0-4cc9-982e-f1177423a064 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:12:11.037902 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-e43d7fcd-e38a-4121-a92a-1a7f97ea7436 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18195083037046bd99166f68690c3dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bf442df39b4f5cbc18f571a0596f10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:12:11.045779 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-e43d7fcd-e38a-4121-a92a-1a7f97ea7436 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] 10.222.0.48 "GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7" status: 200 len: 1224 microversion: 2.1 time: 0.087297 Jun 17 13:12:11.046449 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 356/745] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:12:10 2022] GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:12:11.051800 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-6c7bcf07-dc82-4c28-bf9d-64c83d2d6953 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:12:11.052554 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-6c7bcf07-dc82-4c28-bf9d-64c83d2d6953 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:12:11.058506 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6c7bcf07-dc82-4c28-bf9d-64c83d2d6953 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:12:11.059180 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6c7bcf07-dc82-4c28-bf9d-64c83d2d6953 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:12:11.059934 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6c7bcf07-dc82-4c28-bf9d-64c83d2d6953 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:12:11.060577 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6c7bcf07-dc82-4c28-bf9d-64c83d2d6953 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:12:21.026419 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_api:SELECT=4 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:12:21.054026 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_cell1:SELECT=10 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:12:21.056798 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_api:SELECT=4 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:12:21.080454 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=14 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:12:21.207721 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 13:12:21.207946 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Fri Jun 17 13:12:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments/dc0d8f94-669d-473e-b967-103b03ff07d8 (ip 10.222.0.48) !!! Jun 17 13:12:27.798857 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 13:12:27.799504 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Fri Jun 17 13:12:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a/os-volume_attachments/520bf7f4-5382-4c9c-81be-934670e0f29c (ip 10.222.0.48) !!! Jun 17 13:12:44.596138 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 13:12:44.597047 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Fri Jun 17 13:12:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a/os-volume_attachments/520bf7f4-5382-4c9c-81be-934670e0f29c (ip 10.222.0.48) !!! Jun 17 13:13:58.822489 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 13:13:58.823251 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Fri Jun 17 13:13:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a/os-volume_attachments/520bf7f4-5382-4c9c-81be-934670e0f29c (ip 10.222.0.48) !!! Jun 17 13:14:09.576801 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 13:14:09.577400 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Fri Jun 17 13:14:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments/dc0d8f94-669d-473e-b967-103b03ff07d8 (ip 10.222.0.48) !!! Jun 17 13:14:11.245460 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.objects.instance [None req-6c7bcf07-dc82-4c28-bf9d-64c83d2d6953 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lazy-loading 'services' on Instance uuid 8a408151-81c8-4490-9190-5e4fa2d98e8a {{(pid=117660) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 13:14:11.289115 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.objects.instance [None req-b371bbe5-aab0-4cc9-982e-f1177423a064 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lazy-loading 'services' on Instance uuid c8fdea98-917f-4c4d-aaba-d4f5df4622d6 {{(pid=117659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 13:14:11.301826 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.wsgi [None req-6c7bcf07-dc82-4c28-bf9d-64c83d2d6953 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e2c8c7ba-4796-4e21-8b7a-7f64081cb3c0) Jun 17 13:14:11.304420 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-6c7bcf07-dc82-4c28-bf9d-64c83d2d6953 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Request method failure captured: Jun 17 13:14:11.304420 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: request: DELETE /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a/os-volume_attachments/520bf7f4-5382-4c9c-81be-934670e0f29c HTTP/1.1 Jun 17 13:14:11.304420 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Accept: application/json Jun 17 13:14:11.304420 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Accept-Encoding: identity Jun 17 13:14:11.304420 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Connection: close Jun 17 13:14:11.304420 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Content-Length: 0 Jun 17 13:14:11.304420 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Content-Type: application/json Jun 17 13:14:11.304420 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Host: 10.222.0.48 Jun 17 13:14:11.304420 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Openstack-System-Scope: None Jun 17 13:14:11.304420 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: User-Agent: python-urllib3/1.26.9 Jun 17 13:14:11.304420 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Auth-Token: gAAAAABirHsRs0DVoIJTEPizfQxUzLDy-cAxnoVq8pWwVU2lDEHfxotVouYNtPnQqMCXDF_Skn8Rxq-oKMB46_vj80swmohZmWUzc-BQzgQQhfPTpXwWUX9acE_q4zXSw5Kb4Ruqe_0ls_p0iCyuchKIOqXgyPR4tZ62Zn4QfTGY95co2HqCR5s Jun 17 13:14:11.304420 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Domain-Id: None Jun 17 13:14:11.304420 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Domain-Name: None Jun 17 13:14:11.304420 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Identity-Status: Confirmed Jun 17 13:14:11.304420 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Is-Admin-Project: True Jun 17 13:14:11.304420 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Project-Domain-Id: default Jun 17 13:14:11.304420 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Project-Domain-Name: Default Jun 17 13:14:11.304420 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Project-Id: 1686ea199c5442958f97102a61ce41aa Jun 17 13:14:11.304420 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Project-Name: tempest-TestMinimumBasicScenario-1188150813 Jun 17 13:14:11.304420 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Role: member,reader Jun 17 13:14:11.304420 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Roles: member,reader Jun 17 13:14:11.306335 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_1686ea199c5442958f97102a61ce41aa", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1686ea199c5442958f97102a61ce41aa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1686ea199c5442958f97102a61ce41aa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/1686ea199c5442958f97102a61ce41aa"}]}] Jun 17 13:14:11.306335 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Tenant: tempest-TestMinimumBasicScenario-1188150813 Jun 17 13:14:11.306335 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Tenant-Id: 1686ea199c5442958f97102a61ce41aa Jun 17 13:14:11.306335 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1188150813 Jun 17 13:14:11.306335 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-User: tempest-TestMinimumBasicScenario-1188150813-project Jun 17 13:14:11.306335 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-User-Domain-Id: default Jun 17 13:14:11.306335 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-User-Domain-Name: Default Jun 17 13:14:11.306335 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-User-Id: e7a99ccc238943a098833d03c6233413 Jun 17 13:14:11.306335 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-User-Name: tempest-TestMinimumBasicScenario-1188150813-project Jun 17 13:14:11.306335 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: method: > Jun 17 13:14:11.307059 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e2c8c7ba-4796-4e21-8b7a-7f64081cb3c0) Jun 17 13:14:11.307059 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: action_args: {'server_id': '8a408151-81c8-4490-9190-5e4fa2d98e8a', 'id': '520bf7f4-5382-4c9c-81be-934670e0f29c'} Jun 17 13:14:11.307059 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 13:14:11.307059 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:14:11.307059 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 13:14:11.307059 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 13:14:11.307059 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 13:14:11.307059 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 13:14:11.307059 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 17 13:14:11.307059 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 17 13:14:11.307059 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 17 13:14:11.307059 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 17 13:14:11.307059 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 17 13:14:11.307059 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 17 13:14:11.307059 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 17 13:14:11.307059 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 17 13:14:11.307059 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 13:14:11.308570 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 13:14:11.308570 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 13:14:11.308570 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 13:14:11.308570 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e2c8c7ba-4796-4e21-8b7a-7f64081cb3c0) Jun 17 13:14:11.308570 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 13:14:11.308570 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:14:11.308570 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 13:14:11.308570 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:14:11.308570 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jun 17 13:14:11.308570 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jun 17 13:14:11.308570 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jun 17 13:14:11.308570 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jun 17 13:14:11.308570 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 17 13:14:11.308570 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 17 13:14:11.308570 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 13:14:11.308570 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 13:14:11.308570 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 13:14:11.308570 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 13:14:11.308570 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 17 13:14:11.310156 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 17 13:14:11.310156 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 17 13:14:11.310156 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 17 13:14:11.310156 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 17 13:14:11.310156 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 17 13:14:11.310156 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 17 13:14:11.310156 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 17 13:14:11.310156 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 13:14:11.310156 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 13:14:11.310156 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 13:14:11.310156 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 13:14:11.310156 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e2c8c7ba-4796-4e21-8b7a-7f64081cb3c0) Jun 17 13:14:11.310156 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 13:14:11.310156 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:14:11.310156 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 13:14:11.310156 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:14:11.310156 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 17 13:14:11.311347 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 17 13:14:11.311347 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 17 13:14:11.311347 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 17 13:14:11.311347 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 17 13:14:11.311347 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 17 13:14:11.311347 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jun 17 13:14:11.311347 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jun 17 13:14:11.311347 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jun 17 13:14:11.311347 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 17 13:14:11.311347 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jun 17 13:14:11.311347 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jun 17 13:14:11.311347 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e2c8c7ba-4796-4e21-8b7a-7f64081cb3c0) Jun 17 13:14:11.311347 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 13:14:11.311347 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:14:11.311347 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 13:14:11.311347 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:14:11.311347 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:14:11.311347 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:14:11.312664 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 13:14:11.312664 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 13:14:11.312664 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 13:14:11.312664 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 13:14:11.312664 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jun 17 13:14:11.312664 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 17 13:14:11.312664 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e2c8c7ba-4796-4e21-8b7a-7f64081cb3c0) Jun 17 13:14:11.312664 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 13:14:11.312664 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:14:11.312664 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 13:14:11.312664 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:14:11.312664 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:14:11.312664 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:14:11.312664 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 13:14:11.312664 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 13:14:11.312664 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e2c8c7ba-4796-4e21-8b7a-7f64081cb3c0) Jun 17 13:14:11.312664 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 13:14:11.313978 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-6c7bcf07-dc82-4c28-bf9d-64c83d2d6953 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e2c8c7ba-4796-4e21-8b7a-7f64081cb3c0) {{(pid=117660) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 13:14:11.313978 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-6c7bcf07-dc82-4c28-bf9d-64c83d2d6953 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "DELETE /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a/os-volume_attachments/520bf7f4-5382-4c9c-81be-934670e0f29c" status: 400 len: 269 microversion: 2.1 time: 120.258294 Jun 17 13:14:11.313978 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Fri Jun 17 13:14:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a/os-volume_attachments/520bf7f4-5382-4c9c-81be-934670e0f29c (ip 10.222.0.48) !!! Jun 17 13:14:11.313978 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Fri Jun 17 13:14:11 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a/os-volume_attachments/520bf7f4-5382-4c9c-81be-934670e0f29c (10.222.0.48) Jun 17 13:14:11.313978 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: CRITICAL nova [None req-6c7bcf07-dc82-4c28-bf9d-64c83d2d6953 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Unhandled error: OSError: write error Jun 17 13:14:11.313978 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova OSError: write error Jun 17 13:14:11.313978 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova Jun 17 13:14:11.314677 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 357/746] 10.222.0.48 () {58 vars in 1415 bytes} [Fri Jun 17 13:12:11 2022] DELETE /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a/os-volume_attachments/520bf7f4-5382-4c9c-81be-934670e0f29c => generated 0 bytes in 120260 msecs (HTTP/1.1 400) 9 headers in 0 bytes (0 switches on core 0) Jun 17 13:14:11.352873 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.wsgi [None req-b371bbe5-aab0-4cc9-982e-f1177423a064 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-cf16da80-d8b1-4339-99de-18c15597bcbf) Jun 17 13:14:11.355842 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-b371bbe5-aab0-4cc9-982e-f1177423a064 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Request method failure captured: Jun 17 13:14:11.355842 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: request: DELETE /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments/dc0d8f94-669d-473e-b967-103b03ff07d8 HTTP/1.1 Jun 17 13:14:11.355842 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Accept: application/json Jun 17 13:14:11.355842 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Accept-Encoding: identity Jun 17 13:14:11.355842 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Connection: close Jun 17 13:14:11.355842 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Content-Length: 0 Jun 17 13:14:11.355842 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Content-Type: application/json Jun 17 13:14:11.355842 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Host: 10.222.0.48 Jun 17 13:14:11.355842 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Openstack-System-Scope: None Jun 17 13:14:11.355842 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: User-Agent: python-urllib3/1.26.9 Jun 17 13:14:11.355842 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Auth-Token: gAAAAABirHovuSKXhsYnyM1ICQHfCBnAkcBbRuuwZgxhkoNNkDDA8V46u4bM0d1Ij3mDA-GnbWHcDVDPBrFR3gqwdKLqUjwJvDZ_b3brdODlYgnHT8j_9TL2kWiym-dIXC0QOJO96MqfgUwsdiseafc9vSwBlwUt2XH_DR7FE-ChC01iKCOrpX0 Jun 17 13:14:11.355842 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Domain-Id: None Jun 17 13:14:11.355842 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Domain-Name: None Jun 17 13:14:11.355842 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Identity-Status: Confirmed Jun 17 13:14:11.355842 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Is-Admin-Project: True Jun 17 13:14:11.355842 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Openstack-Nova-Api-Version: 2.20 Jun 17 13:14:11.355842 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Project-Domain-Id: default Jun 17 13:14:11.355842 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Project-Domain-Name: Default Jun 17 13:14:11.355842 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Project-Id: c777f8f104af4d37a3b89ff9a57d2218 Jun 17 13:14:11.355842 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1116672173 Jun 17 13:14:11.355842 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Role: member,reader Jun 17 13:14:11.355842 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Roles: member,reader Jun 17 13:14:11.357763 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c777f8f104af4d37a3b89ff9a57d2218", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c777f8f104af4d37a3b89ff9a57d2218"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c777f8f104af4d37a3b89ff9a57d2218"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c777f8f104af4d37a3b89ff9a57d2218"}]}] Jun 17 13:14:11.357763 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1116672173 Jun 17 13:14:11.357763 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Tenant-Id: c777f8f104af4d37a3b89ff9a57d2218 Jun 17 13:14:11.357763 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1116672173 Jun 17 13:14:11.357763 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User: tempest-AttachVolumeShelveTestJSON-1116672173-project Jun 17 13:14:11.357763 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User-Domain-Id: default Jun 17 13:14:11.357763 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User-Domain-Name: Default Jun 17 13:14:11.357763 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User-Id: 847c39439e874e68b72e07c311a53bec Jun 17 13:14:11.357763 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1116672173-project Jun 17 13:14:11.357763 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: method: > Jun 17 13:14:11.358728 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-cf16da80-d8b1-4339-99de-18c15597bcbf) Jun 17 13:14:11.358728 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: action_args: {'server_id': 'c8fdea98-917f-4c4d-aaba-d4f5df4622d6', 'id': 'dc0d8f94-669d-473e-b967-103b03ff07d8'} Jun 17 13:14:11.358728 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 13:14:11.358728 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:14:11.358728 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 13:14:11.358728 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 13:14:11.358728 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 13:14:11.358728 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 13:14:11.358728 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 17 13:14:11.358728 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 17 13:14:11.358728 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 17 13:14:11.358728 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 17 13:14:11.358728 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 17 13:14:11.358728 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 17 13:14:11.358728 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 17 13:14:11.358728 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 17 13:14:11.358728 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 13:14:11.360101 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 13:14:11.360101 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 13:14:11.360101 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 13:14:11.360101 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-cf16da80-d8b1-4339-99de-18c15597bcbf) Jun 17 13:14:11.360101 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:14:11.360101 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:14:11.360101 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:14:11.360101 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:14:11.360101 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jun 17 13:14:11.360101 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jun 17 13:14:11.360101 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jun 17 13:14:11.360101 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jun 17 13:14:11.360101 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 17 13:14:11.360101 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 17 13:14:11.360101 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 13:14:11.360101 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 13:14:11.360101 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 13:14:11.360101 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 13:14:11.360101 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 17 13:14:11.361920 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 17 13:14:11.361920 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 17 13:14:11.361920 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 17 13:14:11.361920 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 17 13:14:11.361920 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 17 13:14:11.361920 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 17 13:14:11.361920 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 17 13:14:11.361920 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 13:14:11.361920 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 13:14:11.361920 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 13:14:11.361920 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 13:14:11.361920 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-cf16da80-d8b1-4339-99de-18c15597bcbf) Jun 17 13:14:11.361920 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:14:11.361920 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:14:11.361920 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:14:11.361920 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:14:11.361920 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 17 13:14:11.363424 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 17 13:14:11.363424 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 17 13:14:11.363424 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 17 13:14:11.363424 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 17 13:14:11.363424 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 17 13:14:11.363424 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jun 17 13:14:11.363424 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jun 17 13:14:11.363424 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jun 17 13:14:11.363424 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 17 13:14:11.363424 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jun 17 13:14:11.363424 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jun 17 13:14:11.363424 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-cf16da80-d8b1-4339-99de-18c15597bcbf) Jun 17 13:14:11.363424 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:14:11.363424 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:14:11.363424 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:14:11.363424 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:14:11.363424 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:14:11.363424 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:14:11.364780 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 13:14:11.364780 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 13:14:11.364780 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 13:14:11.364780 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 13:14:11.364780 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jun 17 13:14:11.364780 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 17 13:14:11.364780 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-cf16da80-d8b1-4339-99de-18c15597bcbf) Jun 17 13:14:11.364780 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:14:11.364780 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:14:11.364780 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:14:11.364780 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:14:11.364780 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:14:11.364780 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:14:11.364780 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 13:14:11.364780 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 13:14:11.364780 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-cf16da80-d8b1-4339-99de-18c15597bcbf) Jun 17 13:14:11.364780 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:14:11.366196 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-b371bbe5-aab0-4cc9-982e-f1177423a064 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-cf16da80-d8b1-4339-99de-18c15597bcbf) {{(pid=117659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 13:14:11.366196 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-b371bbe5-aab0-4cc9-982e-f1177423a064 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "DELETE /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments/dc0d8f94-669d-473e-b967-103b03ff07d8" status: 400 len: 269 microversion: 2.20 time: 120.339800 Jun 17 13:14:11.366196 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Fri Jun 17 13:14:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments/dc0d8f94-669d-473e-b967-103b03ff07d8 (ip 10.222.0.48) !!! Jun 17 13:14:11.366196 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Fri Jun 17 13:14:11 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments/dc0d8f94-669d-473e-b967-103b03ff07d8 (10.222.0.48) Jun 17 13:14:11.366196 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: CRITICAL nova [None req-b371bbe5-aab0-4cc9-982e-f1177423a064 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Unhandled error: OSError: write error Jun 17 13:14:11.366196 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova OSError: write error Jun 17 13:14:11.366196 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova Jun 17 13:14:11.366813 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 390/747] 10.222.0.48 () {60 vars in 1456 bytes} [Fri Jun 17 13:12:11 2022] DELETE /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments/dc0d8f94-669d-473e-b967-103b03ff07d8 => generated 0 bytes in 120341 msecs (HTTP/1.1 400) 9 headers in 0 bytes (0 switches on core 0) Jun 17 13:14:11.366813 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-e0a459cb-e47e-4482-b54a-3d1988c8220f tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:11.366813 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-e0a459cb-e47e-4482-b54a-3d1988c8220f tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] [instance: 72889057-861c-42f3-8629-32fff8f5dab7] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:11.372199 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e0a459cb-e47e-4482-b54a-3d1988c8220f tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:11.372705 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e0a459cb-e47e-4482-b54a-3d1988c8220f tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:11.373422 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e0a459cb-e47e-4482-b54a-3d1988c8220f tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:11.373860 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e0a459cb-e47e-4482-b54a-3d1988c8220f tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:11.452231 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-e0a459cb-e47e-4482-b54a-3d1988c8220f tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18195083037046bd99166f68690c3dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bf442df39b4f5cbc18f571a0596f10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:14:11.460312 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-e0a459cb-e47e-4482-b54a-3d1988c8220f tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] 10.222.0.48 "GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7" status: 200 len: 1224 microversion: 2.1 time: 0.100456 Jun 17 13:14:11.460841 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Fri Jun 17 13:14:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7 (ip 10.222.0.48) !!! Jun 17 13:14:11.460841 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Fri Jun 17 13:14:11 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7 (10.222.0.48) Jun 17 13:14:11.461433 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: CRITICAL nova [None req-e0a459cb-e47e-4482-b54a-3d1988c8220f tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Unhandled error: OSError: write error Jun 17 13:14:11.461433 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova OSError: write error Jun 17 13:14:11.461433 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova Jun 17 13:14:11.461701 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 391/748] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:14:11 2022] GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7 => generated 0 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 0 bytes (0 switches on core 0) Jun 17 13:14:11.461795 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-c2e2f188-4aa2-4095-b7f2-86c3aba07eac tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:11.462313 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-c2e2f188-4aa2-4095-b7f2-86c3aba07eac tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:11.466635 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-dcdb11d6-4760-4e62-98c9-2b867c33147e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:11.467130 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-dcdb11d6-4760-4e62-98c9-2b867c33147e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:11.469258 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c2e2f188-4aa2-4095-b7f2-86c3aba07eac tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:11.469703 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c2e2f188-4aa2-4095-b7f2-86c3aba07eac tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:11.470494 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c2e2f188-4aa2-4095-b7f2-86c3aba07eac tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:11.470923 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c2e2f188-4aa2-4095-b7f2-86c3aba07eac tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:11.473080 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-dcdb11d6-4760-4e62-98c9-2b867c33147e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:11.473529 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-dcdb11d6-4760-4e62-98c9-2b867c33147e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:11.474322 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-dcdb11d6-4760-4e62-98c9-2b867c33147e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:11.474762 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-dcdb11d6-4760-4e62-98c9-2b867c33147e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:11.566456 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.objects.instance [None req-dcdb11d6-4760-4e62-98c9-2b867c33147e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lazy-loading 'services' on Instance uuid c8fdea98-917f-4c4d-aaba-d4f5df4622d6 {{(pid=117659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 13:14:11.618071 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-c2e2f188-4aa2-4095-b7f2-86c3aba07eac tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:14:11.627907 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-c2e2f188-4aa2-4095-b7f2-86c3aba07eac tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1729 microversion: 2.1 time: 0.319245 Jun 17 13:14:11.628585 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Fri Jun 17 13:14:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 (ip 10.222.0.48) !!! Jun 17 13:14:11.628585 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Fri Jun 17 13:14:11 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 (10.222.0.48) Jun 17 13:14:11.629295 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: CRITICAL nova [None req-c2e2f188-4aa2-4095-b7f2-86c3aba07eac tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Unhandled error: OSError: write error Jun 17 13:14:11.629295 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova OSError: write error Jun 17 13:14:11.629295 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova Jun 17 13:14:11.629614 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 358/749] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:14:11 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 0 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 0 bytes (0 switches on core 0) Jun 17 13:14:11.635511 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-49b1443a-4deb-4e6c-8344-076b2dd783ec tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:11.636317 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-49b1443a-4deb-4e6c-8344-076b2dd783ec tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:11.638710 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.wsgi [None req-dcdb11d6-4760-4e62-98c9-2b867c33147e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d03f49cd-7e0f-4f67-9c30-1576a2f6d732) Jun 17 13:14:11.642372 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-dcdb11d6-4760-4e62-98c9-2b867c33147e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Request method failure captured: Jun 17 13:14:11.642372 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: request: DELETE /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments/dc0d8f94-669d-473e-b967-103b03ff07d8 HTTP/1.1 Jun 17 13:14:11.642372 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Accept: application/json Jun 17 13:14:11.642372 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Accept-Encoding: identity Jun 17 13:14:11.642372 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Connection: close Jun 17 13:14:11.642372 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Content-Length: 0 Jun 17 13:14:11.642372 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Content-Type: application/json Jun 17 13:14:11.642372 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Host: 10.222.0.48 Jun 17 13:14:11.642372 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Openstack-System-Scope: None Jun 17 13:14:11.642372 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: User-Agent: python-urllib3/1.26.9 Jun 17 13:14:11.642372 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Auth-Token: gAAAAABirHovuSKXhsYnyM1ICQHfCBnAkcBbRuuwZgxhkoNNkDDA8V46u4bM0d1Ij3mDA-GnbWHcDVDPBrFR3gqwdKLqUjwJvDZ_b3brdODlYgnHT8j_9TL2kWiym-dIXC0QOJO96MqfgUwsdiseafc9vSwBlwUt2XH_DR7FE-ChC01iKCOrpX0 Jun 17 13:14:11.642372 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Domain-Id: None Jun 17 13:14:11.642372 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Domain-Name: None Jun 17 13:14:11.642372 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Identity-Status: Confirmed Jun 17 13:14:11.642372 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Is-Admin-Project: True Jun 17 13:14:11.642372 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Openstack-Nova-Api-Version: 2.20 Jun 17 13:14:11.642372 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Project-Domain-Id: default Jun 17 13:14:11.642372 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Project-Domain-Name: Default Jun 17 13:14:11.642372 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Project-Id: c777f8f104af4d37a3b89ff9a57d2218 Jun 17 13:14:11.642372 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1116672173 Jun 17 13:14:11.642372 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Role: member,reader Jun 17 13:14:11.642372 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Roles: member,reader Jun 17 13:14:11.643991 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c777f8f104af4d37a3b89ff9a57d2218", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c777f8f104af4d37a3b89ff9a57d2218"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c777f8f104af4d37a3b89ff9a57d2218"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c777f8f104af4d37a3b89ff9a57d2218"}]}] Jun 17 13:14:11.643991 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1116672173 Jun 17 13:14:11.643991 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Tenant-Id: c777f8f104af4d37a3b89ff9a57d2218 Jun 17 13:14:11.643991 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1116672173 Jun 17 13:14:11.643991 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User: tempest-AttachVolumeShelveTestJSON-1116672173-project Jun 17 13:14:11.643991 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User-Domain-Id: default Jun 17 13:14:11.643991 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User-Domain-Name: Default Jun 17 13:14:11.643991 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User-Id: 847c39439e874e68b72e07c311a53bec Jun 17 13:14:11.643991 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1116672173-project Jun 17 13:14:11.643991 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: method: > Jun 17 13:14:11.644721 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d03f49cd-7e0f-4f67-9c30-1576a2f6d732) Jun 17 13:14:11.644721 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: action_args: {'server_id': 'c8fdea98-917f-4c4d-aaba-d4f5df4622d6', 'id': 'dc0d8f94-669d-473e-b967-103b03ff07d8'} Jun 17 13:14:11.644721 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 13:14:11.644721 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:14:11.644721 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 13:14:11.644721 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 13:14:11.644721 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 13:14:11.644721 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 13:14:11.644721 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 17 13:14:11.644721 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 17 13:14:11.644721 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 17 13:14:11.644721 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 17 13:14:11.644721 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 17 13:14:11.644721 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 17 13:14:11.644721 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 17 13:14:11.644721 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 17 13:14:11.644721 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 13:14:11.645990 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 13:14:11.645990 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 13:14:11.645990 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 13:14:11.645990 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d03f49cd-7e0f-4f67-9c30-1576a2f6d732) Jun 17 13:14:11.645990 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:14:11.645990 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:14:11.645990 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:14:11.645990 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:14:11.645990 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jun 17 13:14:11.645990 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jun 17 13:14:11.645990 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jun 17 13:14:11.645990 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jun 17 13:14:11.645990 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 17 13:14:11.645990 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 17 13:14:11.645990 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 13:14:11.645990 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 13:14:11.645990 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 13:14:11.645990 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 13:14:11.645990 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 17 13:14:11.648957 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 17 13:14:11.648957 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 17 13:14:11.648957 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 17 13:14:11.648957 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 17 13:14:11.648957 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 17 13:14:11.648957 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 17 13:14:11.648957 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 17 13:14:11.648957 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 13:14:11.648957 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 13:14:11.648957 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 13:14:11.648957 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 13:14:11.648957 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d03f49cd-7e0f-4f67-9c30-1576a2f6d732) Jun 17 13:14:11.648957 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:14:11.648957 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:14:11.648957 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:14:11.648957 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:14:11.648957 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 17 13:14:11.650708 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 17 13:14:11.650708 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 17 13:14:11.650708 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 17 13:14:11.650708 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 17 13:14:11.650708 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 17 13:14:11.650708 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jun 17 13:14:11.650708 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jun 17 13:14:11.650708 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jun 17 13:14:11.650708 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 17 13:14:11.650708 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jun 17 13:14:11.650708 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jun 17 13:14:11.650708 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d03f49cd-7e0f-4f67-9c30-1576a2f6d732) Jun 17 13:14:11.650708 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:14:11.650708 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:14:11.650708 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:14:11.650708 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:14:11.650708 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:14:11.650708 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:14:11.652109 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 13:14:11.652109 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 13:14:11.652109 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 13:14:11.652109 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 13:14:11.652109 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jun 17 13:14:11.652109 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 17 13:14:11.652109 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d03f49cd-7e0f-4f67-9c30-1576a2f6d732) Jun 17 13:14:11.652109 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:14:11.652109 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:14:11.652109 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:14:11.652109 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:14:11.652109 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:14:11.652109 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:14:11.652109 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 13:14:11.652109 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 13:14:11.652109 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d03f49cd-7e0f-4f67-9c30-1576a2f6d732) Jun 17 13:14:11.652109 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:14:11.653323 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-dcdb11d6-4760-4e62-98c9-2b867c33147e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d03f49cd-7e0f-4f67-9c30-1576a2f6d732) {{(pid=117659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 13:14:11.653429 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-49b1443a-4deb-4e6c-8344-076b2dd783ec tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:11.653532 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-dcdb11d6-4760-4e62-98c9-2b867c33147e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "DELETE /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments/dc0d8f94-669d-473e-b967-103b03ff07d8" status: 400 len: 269 microversion: 2.20 time: 0.181408 Jun 17 13:14:11.653628 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-49b1443a-4deb-4e6c-8344-076b2dd783ec tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:11.653735 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Fri Jun 17 13:14:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments/dc0d8f94-669d-473e-b967-103b03ff07d8 (ip 10.222.0.48) !!! Jun 17 13:14:11.653832 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-49b1443a-4deb-4e6c-8344-076b2dd783ec tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:11.653921 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Fri Jun 17 13:14:11 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments/dc0d8f94-669d-473e-b967-103b03ff07d8 (10.222.0.48) Jun 17 13:14:11.654007 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-49b1443a-4deb-4e6c-8344-076b2dd783ec tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:11.654112 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: CRITICAL nova [None req-dcdb11d6-4760-4e62-98c9-2b867c33147e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Unhandled error: OSError: write error Jun 17 13:14:11.654112 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova OSError: write error Jun 17 13:14:11.654112 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova Jun 17 13:14:11.654112 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 392/750] 10.222.0.48 () {60 vars in 1456 bytes} [Fri Jun 17 13:14:11 2022] DELETE /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments/dc0d8f94-669d-473e-b967-103b03ff07d8 => generated 0 bytes in 184 msecs (HTTP/1.1 400) 9 headers in 0 bytes (0 switches on core 0) Jun 17 13:14:11.654112 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-a3d3384e-aae6-409a-b21d-9617496d099b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:11.654112 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-a3d3384e-aae6-409a-b21d-9617496d099b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:11.660015 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a3d3384e-aae6-409a-b21d-9617496d099b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:11.660469 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a3d3384e-aae6-409a-b21d-9617496d099b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:11.661238 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a3d3384e-aae6-409a-b21d-9617496d099b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:11.661672 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a3d3384e-aae6-409a-b21d-9617496d099b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:11.740717 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.objects.instance [None req-49b1443a-4deb-4e6c-8344-076b2dd783ec tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lazy-loading 'services' on Instance uuid 8a408151-81c8-4490-9190-5e4fa2d98e8a {{(pid=117660) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 13:14:11.799230 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.wsgi [None req-49b1443a-4deb-4e6c-8344-076b2dd783ec tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-32eb5e42-1a22-4a25-b595-1649dfd33c40) Jun 17 13:14:11.799457 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-a3d3384e-aae6-409a-b21d-9617496d099b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:14:11.801363 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-49b1443a-4deb-4e6c-8344-076b2dd783ec tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Request method failure captured: Jun 17 13:14:11.801363 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: request: DELETE /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a/os-volume_attachments/520bf7f4-5382-4c9c-81be-934670e0f29c HTTP/1.1 Jun 17 13:14:11.801363 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Accept: application/json Jun 17 13:14:11.801363 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Accept-Encoding: identity Jun 17 13:14:11.801363 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Connection: close Jun 17 13:14:11.801363 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Content-Length: 0 Jun 17 13:14:11.801363 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Content-Type: application/json Jun 17 13:14:11.801363 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Host: 10.222.0.48 Jun 17 13:14:11.801363 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Openstack-System-Scope: None Jun 17 13:14:11.801363 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: User-Agent: python-urllib3/1.26.9 Jun 17 13:14:11.801363 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Auth-Token: gAAAAABirHsRs0DVoIJTEPizfQxUzLDy-cAxnoVq8pWwVU2lDEHfxotVouYNtPnQqMCXDF_Skn8Rxq-oKMB46_vj80swmohZmWUzc-BQzgQQhfPTpXwWUX9acE_q4zXSw5Kb4Ruqe_0ls_p0iCyuchKIOqXgyPR4tZ62Zn4QfTGY95co2HqCR5s Jun 17 13:14:11.801363 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Domain-Id: None Jun 17 13:14:11.801363 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Domain-Name: None Jun 17 13:14:11.801363 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Identity-Status: Confirmed Jun 17 13:14:11.801363 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Is-Admin-Project: True Jun 17 13:14:11.801363 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Project-Domain-Id: default Jun 17 13:14:11.801363 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Project-Domain-Name: Default Jun 17 13:14:11.801363 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Project-Id: 1686ea199c5442958f97102a61ce41aa Jun 17 13:14:11.801363 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Project-Name: tempest-TestMinimumBasicScenario-1188150813 Jun 17 13:14:11.801363 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Role: member,reader Jun 17 13:14:11.801363 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Roles: member,reader Jun 17 13:14:11.802941 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_1686ea199c5442958f97102a61ce41aa", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1686ea199c5442958f97102a61ce41aa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1686ea199c5442958f97102a61ce41aa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/1686ea199c5442958f97102a61ce41aa"}]}] Jun 17 13:14:11.802941 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Tenant: tempest-TestMinimumBasicScenario-1188150813 Jun 17 13:14:11.802941 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Tenant-Id: 1686ea199c5442958f97102a61ce41aa Jun 17 13:14:11.802941 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1188150813 Jun 17 13:14:11.802941 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-User: tempest-TestMinimumBasicScenario-1188150813-project Jun 17 13:14:11.802941 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-User-Domain-Id: default Jun 17 13:14:11.802941 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-User-Domain-Name: Default Jun 17 13:14:11.802941 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-User-Id: e7a99ccc238943a098833d03c6233413 Jun 17 13:14:11.802941 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-User-Name: tempest-TestMinimumBasicScenario-1188150813-project Jun 17 13:14:11.802941 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: method: > Jun 17 13:14:11.803668 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-32eb5e42-1a22-4a25-b595-1649dfd33c40) Jun 17 13:14:11.803668 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: action_args: {'server_id': '8a408151-81c8-4490-9190-5e4fa2d98e8a', 'id': '520bf7f4-5382-4c9c-81be-934670e0f29c'} Jun 17 13:14:11.803668 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 13:14:11.803668 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:14:11.803668 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 13:14:11.803668 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 13:14:11.803668 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 13:14:11.803668 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 13:14:11.803668 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 17 13:14:11.803668 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 17 13:14:11.803668 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 17 13:14:11.803668 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 17 13:14:11.803668 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 17 13:14:11.803668 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 17 13:14:11.803668 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 17 13:14:11.803668 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 17 13:14:11.803668 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 13:14:11.805065 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 13:14:11.805065 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 13:14:11.805065 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 13:14:11.805065 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-32eb5e42-1a22-4a25-b595-1649dfd33c40) Jun 17 13:14:11.805065 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 13:14:11.805065 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:14:11.805065 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 13:14:11.805065 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:14:11.805065 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jun 17 13:14:11.805065 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jun 17 13:14:11.805065 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jun 17 13:14:11.805065 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jun 17 13:14:11.805065 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 17 13:14:11.805065 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 17 13:14:11.805065 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 13:14:11.805065 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 13:14:11.805065 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 13:14:11.805065 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 13:14:11.805065 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 17 13:14:11.806599 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 17 13:14:11.806599 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 17 13:14:11.806599 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 17 13:14:11.806599 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 17 13:14:11.806599 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 17 13:14:11.806599 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 17 13:14:11.806599 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 17 13:14:11.806599 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 13:14:11.806599 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 13:14:11.806599 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 13:14:11.806599 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 13:14:11.806599 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-32eb5e42-1a22-4a25-b595-1649dfd33c40) Jun 17 13:14:11.806599 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 13:14:11.806599 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:14:11.806599 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 13:14:11.806599 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:14:11.806599 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 17 13:14:11.807737 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 17 13:14:11.807737 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 17 13:14:11.807737 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 17 13:14:11.807737 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 17 13:14:11.807737 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 17 13:14:11.807737 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jun 17 13:14:11.807737 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jun 17 13:14:11.807737 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jun 17 13:14:11.807737 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 17 13:14:11.807737 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jun 17 13:14:11.807737 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jun 17 13:14:11.807737 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-32eb5e42-1a22-4a25-b595-1649dfd33c40) Jun 17 13:14:11.807737 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 13:14:11.807737 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:14:11.807737 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 13:14:11.807737 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:14:11.807737 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:14:11.807737 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:14:11.809081 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 13:14:11.809081 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 13:14:11.809081 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 13:14:11.809081 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 13:14:11.809081 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jun 17 13:14:11.809081 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 17 13:14:11.809081 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-32eb5e42-1a22-4a25-b595-1649dfd33c40) Jun 17 13:14:11.809081 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 13:14:11.809081 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:14:11.809081 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 13:14:11.809081 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:14:11.809081 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:14:11.809081 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:14:11.809081 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 13:14:11.809081 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 13:14:11.809081 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-32eb5e42-1a22-4a25-b595-1649dfd33c40) Jun 17 13:14:11.809081 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 13:14:11.810553 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-49b1443a-4deb-4e6c-8344-076b2dd783ec tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-32eb5e42-1a22-4a25-b595-1649dfd33c40) {{(pid=117660) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 13:14:11.810553 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-49b1443a-4deb-4e6c-8344-076b2dd783ec tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "DELETE /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a/os-volume_attachments/520bf7f4-5382-4c9c-81be-934670e0f29c" status: 400 len: 269 microversion: 2.1 time: 0.172735 Jun 17 13:14:11.810553 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 359/751] 10.222.0.48 () {58 vars in 1415 bytes} [Fri Jun 17 13:14:11 2022] DELETE /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a/os-volume_attachments/520bf7f4-5382-4c9c-81be-934670e0f29c => generated 269 bytes in 174 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 17 13:14:11.810553 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-8a715854-d6fc-40ca-9f58-100145854469 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:11.810899 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-8a715854-d6fc-40ca-9f58-100145854469 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] [instance: 72889057-861c-42f3-8629-32fff8f5dab7] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:11.810992 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-a3d3384e-aae6-409a-b21d-9617496d099b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1729 microversion: 2.1 time: 0.164215 Jun 17 13:14:11.811452 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 393/752] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:14:11 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1729 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:14:11.815586 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8a715854-d6fc-40ca-9f58-100145854469 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:11.816025 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8a715854-d6fc-40ca-9f58-100145854469 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:11.816140 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-c6f38d22-614b-47f1-a4d6-e542cbd86f51 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:11.816637 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-c6f38d22-614b-47f1-a4d6-e542cbd86f51 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:11.816782 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8a715854-d6fc-40ca-9f58-100145854469 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:11.817214 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8a715854-d6fc-40ca-9f58-100145854469 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:11.823063 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c6f38d22-614b-47f1-a4d6-e542cbd86f51 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:11.823514 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c6f38d22-614b-47f1-a4d6-e542cbd86f51 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:11.824276 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c6f38d22-614b-47f1-a4d6-e542cbd86f51 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:11.824710 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c6f38d22-614b-47f1-a4d6-e542cbd86f51 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:11.850794 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8a715854-d6fc-40ca-9f58-100145854469 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:11.851232 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8a715854-d6fc-40ca-9f58-100145854469 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:11.851672 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.objects.instance [None req-8a715854-d6fc-40ca-9f58-100145854469 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lazy-loading 'fault' on Instance uuid 72889057-861c-42f3-8629-32fff8f5dab7 {{(pid=117660) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 13:14:11.902252 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-8a715854-d6fc-40ca-9f58-100145854469 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18195083037046bd99166f68690c3dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bf442df39b4f5cbc18f571a0596f10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:14:11.908433 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.objects.instance [None req-c6f38d22-614b-47f1-a4d6-e542cbd86f51 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lazy-loading 'services' on Instance uuid c8fdea98-917f-4c4d-aaba-d4f5df4622d6 {{(pid=117659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 13:14:11.910530 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-8a715854-d6fc-40ca-9f58-100145854469 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] 10.222.0.48 "GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7" status: 200 len: 1229 microversion: 2.1 time: 0.105564 Jun 17 13:14:11.911113 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 360/753] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:14:11 2022] GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7 => generated 1229 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:14:11.972481 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.wsgi [None req-c6f38d22-614b-47f1-a4d6-e542cbd86f51 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c8324831-bdf7-4c72-ad95-ae0f691b5a47) Jun 17 13:14:11.974948 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-c6f38d22-614b-47f1-a4d6-e542cbd86f51 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Request method failure captured: Jun 17 13:14:11.974948 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: request: DELETE /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments/dc0d8f94-669d-473e-b967-103b03ff07d8 HTTP/1.1 Jun 17 13:14:11.974948 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Accept: application/json Jun 17 13:14:11.974948 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Accept-Encoding: identity Jun 17 13:14:11.974948 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Connection: close Jun 17 13:14:11.974948 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Content-Length: 0 Jun 17 13:14:11.974948 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Content-Type: application/json Jun 17 13:14:11.974948 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Host: 10.222.0.48 Jun 17 13:14:11.974948 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Openstack-System-Scope: None Jun 17 13:14:11.974948 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: User-Agent: python-urllib3/1.26.9 Jun 17 13:14:11.974948 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Auth-Token: gAAAAABirHovuSKXhsYnyM1ICQHfCBnAkcBbRuuwZgxhkoNNkDDA8V46u4bM0d1Ij3mDA-GnbWHcDVDPBrFR3gqwdKLqUjwJvDZ_b3brdODlYgnHT8j_9TL2kWiym-dIXC0QOJO96MqfgUwsdiseafc9vSwBlwUt2XH_DR7FE-ChC01iKCOrpX0 Jun 17 13:14:11.974948 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Domain-Id: None Jun 17 13:14:11.974948 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Domain-Name: None Jun 17 13:14:11.974948 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Identity-Status: Confirmed Jun 17 13:14:11.974948 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Is-Admin-Project: True Jun 17 13:14:11.974948 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Openstack-Nova-Api-Version: 2.20 Jun 17 13:14:11.974948 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Project-Domain-Id: default Jun 17 13:14:11.974948 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Project-Domain-Name: Default Jun 17 13:14:11.974948 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Project-Id: c777f8f104af4d37a3b89ff9a57d2218 Jun 17 13:14:11.974948 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1116672173 Jun 17 13:14:11.974948 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Role: member,reader Jun 17 13:14:11.974948 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Roles: member,reader Jun 17 13:14:11.976531 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c777f8f104af4d37a3b89ff9a57d2218", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c777f8f104af4d37a3b89ff9a57d2218"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c777f8f104af4d37a3b89ff9a57d2218"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c777f8f104af4d37a3b89ff9a57d2218"}]}] Jun 17 13:14:11.976531 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1116672173 Jun 17 13:14:11.976531 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Tenant-Id: c777f8f104af4d37a3b89ff9a57d2218 Jun 17 13:14:11.976531 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1116672173 Jun 17 13:14:11.976531 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User: tempest-AttachVolumeShelveTestJSON-1116672173-project Jun 17 13:14:11.976531 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User-Domain-Id: default Jun 17 13:14:11.976531 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User-Domain-Name: Default Jun 17 13:14:11.976531 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User-Id: 847c39439e874e68b72e07c311a53bec Jun 17 13:14:11.976531 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1116672173-project Jun 17 13:14:11.976531 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: method: > Jun 17 13:14:11.977225 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c8324831-bdf7-4c72-ad95-ae0f691b5a47) Jun 17 13:14:11.977225 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: action_args: {'server_id': 'c8fdea98-917f-4c4d-aaba-d4f5df4622d6', 'id': 'dc0d8f94-669d-473e-b967-103b03ff07d8'} Jun 17 13:14:11.977225 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 13:14:11.977225 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:14:11.977225 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 13:14:11.977225 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 13:14:11.977225 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 13:14:11.977225 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 13:14:11.977225 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 17 13:14:11.977225 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 17 13:14:11.977225 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 17 13:14:11.977225 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 17 13:14:11.977225 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 17 13:14:11.977225 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 17 13:14:11.977225 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 17 13:14:11.977225 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 17 13:14:11.977225 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 13:14:11.978797 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 13:14:11.978797 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 13:14:11.978797 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 13:14:11.978797 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c8324831-bdf7-4c72-ad95-ae0f691b5a47) Jun 17 13:14:11.978797 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:14:11.978797 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:14:11.978797 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:14:11.978797 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:14:11.978797 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jun 17 13:14:11.978797 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jun 17 13:14:11.978797 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jun 17 13:14:11.978797 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jun 17 13:14:11.978797 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 17 13:14:11.978797 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 17 13:14:11.978797 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 13:14:11.978797 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 13:14:11.978797 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 13:14:11.978797 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 13:14:11.978797 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 17 13:14:11.980428 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 17 13:14:11.980428 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 17 13:14:11.980428 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 17 13:14:11.980428 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 17 13:14:11.980428 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 17 13:14:11.980428 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 17 13:14:11.980428 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 17 13:14:11.980428 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 13:14:11.980428 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 13:14:11.980428 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 13:14:11.980428 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 13:14:11.980428 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c8324831-bdf7-4c72-ad95-ae0f691b5a47) Jun 17 13:14:11.980428 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:14:11.980428 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:14:11.980428 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:14:11.980428 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:14:11.980428 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 17 13:14:11.981741 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 17 13:14:11.981741 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 17 13:14:11.981741 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 17 13:14:11.981741 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 17 13:14:11.981741 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 17 13:14:11.981741 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jun 17 13:14:11.981741 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jun 17 13:14:11.981741 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jun 17 13:14:11.981741 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 17 13:14:11.981741 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jun 17 13:14:11.981741 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jun 17 13:14:11.981741 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c8324831-bdf7-4c72-ad95-ae0f691b5a47) Jun 17 13:14:11.981741 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:14:11.981741 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:14:11.981741 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:14:11.981741 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:14:11.981741 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:14:11.981741 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:14:11.983731 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 13:14:11.983731 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 13:14:11.983731 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 13:14:11.983731 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 13:14:11.983731 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jun 17 13:14:11.983731 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 17 13:14:11.983731 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c8324831-bdf7-4c72-ad95-ae0f691b5a47) Jun 17 13:14:11.983731 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:14:11.983731 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:14:11.983731 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:14:11.983731 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:14:11.983731 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:14:11.983731 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:14:11.983731 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 13:14:11.983731 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 13:14:11.983731 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c8324831-bdf7-4c72-ad95-ae0f691b5a47) Jun 17 13:14:11.983731 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:14:11.987067 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-c6f38d22-614b-47f1-a4d6-e542cbd86f51 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c8324831-bdf7-4c72-ad95-ae0f691b5a47) {{(pid=117659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 13:14:11.987067 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-c6f38d22-614b-47f1-a4d6-e542cbd86f51 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "DELETE /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments/dc0d8f94-669d-473e-b967-103b03ff07d8" status: 400 len: 269 microversion: 2.20 time: 0.164056 Jun 17 13:14:11.987067 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 394/754] 10.222.0.48 () {60 vars in 1456 bytes} [Fri Jun 17 13:14:11 2022] DELETE /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments/dc0d8f94-669d-473e-b967-103b03ff07d8 => generated 269 bytes in 165 msecs (HTTP/1.1 400) 9 headers in 383 bytes (1 switches on core 0) Jun 17 13:14:11.987067 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-4b011073-5887-4af6-8dc2-374354986a72 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:11.987657 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-4b011073-5887-4af6-8dc2-374354986a72 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:11.989656 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4b011073-5887-4af6-8dc2-374354986a72 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:11.990187 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4b011073-5887-4af6-8dc2-374354986a72 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:11.990947 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4b011073-5887-4af6-8dc2-374354986a72 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:11.991428 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4b011073-5887-4af6-8dc2-374354986a72 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:12.084312 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.objects.instance [None req-4b011073-5887-4af6-8dc2-374354986a72 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lazy-loading 'services' on Instance uuid 8a408151-81c8-4490-9190-5e4fa2d98e8a {{(pid=117659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 13:14:12.094236 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-8b55989b-b24c-4d09-abd7-84973c611ad5 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:12.094738 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-8b55989b-b24c-4d09-abd7-84973c611ad5 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:12.101043 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8b55989b-b24c-4d09-abd7-84973c611ad5 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:12.101484 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8b55989b-b24c-4d09-abd7-84973c611ad5 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:12.102364 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8b55989b-b24c-4d09-abd7-84973c611ad5 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:12.102931 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8b55989b-b24c-4d09-abd7-84973c611ad5 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:12.144523 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.wsgi [None req-4b011073-5887-4af6-8dc2-374354986a72 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-73894606-6a0f-4e07-a44f-c6058dba88eb) Jun 17 13:14:12.146745 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-4b011073-5887-4af6-8dc2-374354986a72 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Request method failure captured: Jun 17 13:14:12.146745 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: request: DELETE /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a/os-volume_attachments/520bf7f4-5382-4c9c-81be-934670e0f29c HTTP/1.1 Jun 17 13:14:12.146745 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Accept: application/json Jun 17 13:14:12.146745 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Accept-Encoding: identity Jun 17 13:14:12.146745 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Connection: close Jun 17 13:14:12.146745 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Content-Length: 0 Jun 17 13:14:12.146745 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Content-Type: application/json Jun 17 13:14:12.146745 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Host: 10.222.0.48 Jun 17 13:14:12.146745 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Openstack-System-Scope: None Jun 17 13:14:12.146745 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: User-Agent: python-urllib3/1.26.9 Jun 17 13:14:12.146745 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Auth-Token: gAAAAABirHsRs0DVoIJTEPizfQxUzLDy-cAxnoVq8pWwVU2lDEHfxotVouYNtPnQqMCXDF_Skn8Rxq-oKMB46_vj80swmohZmWUzc-BQzgQQhfPTpXwWUX9acE_q4zXSw5Kb4Ruqe_0ls_p0iCyuchKIOqXgyPR4tZ62Zn4QfTGY95co2HqCR5s Jun 17 13:14:12.146745 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Domain-Id: None Jun 17 13:14:12.146745 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Domain-Name: None Jun 17 13:14:12.146745 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Identity-Status: Confirmed Jun 17 13:14:12.146745 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Is-Admin-Project: True Jun 17 13:14:12.146745 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Project-Domain-Id: default Jun 17 13:14:12.146745 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Project-Domain-Name: Default Jun 17 13:14:12.146745 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Project-Id: 1686ea199c5442958f97102a61ce41aa Jun 17 13:14:12.146745 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Project-Name: tempest-TestMinimumBasicScenario-1188150813 Jun 17 13:14:12.146745 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Role: member,reader Jun 17 13:14:12.146745 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Roles: member,reader Jun 17 13:14:12.148298 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_1686ea199c5442958f97102a61ce41aa", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1686ea199c5442958f97102a61ce41aa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1686ea199c5442958f97102a61ce41aa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/1686ea199c5442958f97102a61ce41aa"}]}] Jun 17 13:14:12.148298 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Tenant: tempest-TestMinimumBasicScenario-1188150813 Jun 17 13:14:12.148298 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Tenant-Id: 1686ea199c5442958f97102a61ce41aa Jun 17 13:14:12.148298 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1188150813 Jun 17 13:14:12.148298 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User: tempest-TestMinimumBasicScenario-1188150813-project Jun 17 13:14:12.148298 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User-Domain-Id: default Jun 17 13:14:12.148298 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User-Domain-Name: Default Jun 17 13:14:12.148298 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User-Id: e7a99ccc238943a098833d03c6233413 Jun 17 13:14:12.148298 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User-Name: tempest-TestMinimumBasicScenario-1188150813-project Jun 17 13:14:12.148298 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: method: > Jun 17 13:14:12.149296 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-73894606-6a0f-4e07-a44f-c6058dba88eb) Jun 17 13:14:12.149296 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: action_args: {'server_id': '8a408151-81c8-4490-9190-5e4fa2d98e8a', 'id': '520bf7f4-5382-4c9c-81be-934670e0f29c'} Jun 17 13:14:12.149296 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 13:14:12.149296 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:14:12.149296 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 13:14:12.149296 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 13:14:12.149296 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 13:14:12.149296 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 13:14:12.149296 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 17 13:14:12.149296 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 17 13:14:12.149296 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 17 13:14:12.149296 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 17 13:14:12.149296 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 17 13:14:12.149296 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 17 13:14:12.149296 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 17 13:14:12.149296 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 17 13:14:12.149296 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 13:14:12.150673 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 13:14:12.150673 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 13:14:12.150673 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 13:14:12.150673 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-73894606-6a0f-4e07-a44f-c6058dba88eb) Jun 17 13:14:12.150673 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:14:12.150673 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:14:12.150673 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:14:12.150673 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:14:12.150673 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jun 17 13:14:12.150673 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jun 17 13:14:12.150673 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jun 17 13:14:12.150673 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jun 17 13:14:12.150673 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 17 13:14:12.150673 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 17 13:14:12.150673 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 13:14:12.150673 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 13:14:12.150673 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 13:14:12.150673 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 13:14:12.150673 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 17 13:14:12.152182 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 17 13:14:12.152182 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 17 13:14:12.152182 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 17 13:14:12.152182 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 17 13:14:12.152182 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 17 13:14:12.152182 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 17 13:14:12.152182 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 17 13:14:12.152182 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 13:14:12.152182 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 13:14:12.152182 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 13:14:12.152182 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 13:14:12.152182 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-73894606-6a0f-4e07-a44f-c6058dba88eb) Jun 17 13:14:12.152182 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:14:12.152182 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:14:12.152182 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:14:12.152182 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:14:12.152182 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 17 13:14:12.153397 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 17 13:14:12.153397 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 17 13:14:12.153397 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 17 13:14:12.153397 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 17 13:14:12.153397 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 17 13:14:12.153397 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jun 17 13:14:12.153397 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jun 17 13:14:12.153397 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jun 17 13:14:12.153397 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 17 13:14:12.153397 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jun 17 13:14:12.153397 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jun 17 13:14:12.153397 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-73894606-6a0f-4e07-a44f-c6058dba88eb) Jun 17 13:14:12.153397 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:14:12.153397 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:14:12.153397 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:14:12.153397 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:14:12.153397 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:14:12.153397 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:14:12.154753 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 13:14:12.154753 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 13:14:12.154753 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 13:14:12.154753 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 13:14:12.154753 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jun 17 13:14:12.154753 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 17 13:14:12.154753 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-73894606-6a0f-4e07-a44f-c6058dba88eb) Jun 17 13:14:12.154753 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:14:12.154753 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:14:12.154753 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:14:12.154753 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:14:12.154753 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:14:12.154753 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:14:12.154753 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 13:14:12.154753 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 13:14:12.154753 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-73894606-6a0f-4e07-a44f-c6058dba88eb) Jun 17 13:14:12.154753 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:14:12.156100 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-4b011073-5887-4af6-8dc2-374354986a72 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-73894606-6a0f-4e07-a44f-c6058dba88eb) {{(pid=117659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 13:14:12.156100 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-4b011073-5887-4af6-8dc2-374354986a72 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "DELETE /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a/os-volume_attachments/520bf7f4-5382-4c9c-81be-934670e0f29c" status: 400 len: 269 microversion: 2.1 time: 0.170220 Jun 17 13:14:12.156100 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 395/755] 10.222.0.48 () {58 vars in 1415 bytes} [Fri Jun 17 13:14:11 2022] DELETE /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a/os-volume_attachments/520bf7f4-5382-4c9c-81be-934670e0f29c => generated 269 bytes in 171 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 17 13:14:12.156100 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-8c70e1f2-333d-44a7-b68a-43c671a6d9ad tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:12.156450 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-8c70e1f2-333d-44a7-b68a-43c671a6d9ad tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:12.162049 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8c70e1f2-333d-44a7-b68a-43c671a6d9ad tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:12.162525 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8c70e1f2-333d-44a7-b68a-43c671a6d9ad tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:12.163290 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8c70e1f2-333d-44a7-b68a-43c671a6d9ad tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:12.163723 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8c70e1f2-333d-44a7-b68a-43c671a6d9ad tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:12.195505 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.objects.instance [None req-8b55989b-b24c-4d09-abd7-84973c611ad5 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lazy-loading 'services' on Instance uuid 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 {{(pid=117660) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 13:14:12.273086 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-8b55989b-b24c-4d09-abd7-84973c611ad5 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "DELETE /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6/os-volume_attachments/10a44f8a-7ada-45e4-9859-29dfb17185e5" status: 202 len: 0 microversion: 2.1 time: 0.360537 Jun 17 13:14:12.273983 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 361/756] 10.222.0.48 () {58 vars in 1415 bytes} [Fri Jun 17 13:14:11 2022] DELETE /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6/os-volume_attachments/10a44f8a-7ada-45e4-9859-29dfb17185e5 => generated 0 bytes in 362 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 13:14:12.280073 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-b15caa85-d1f3-49d7-830d-707dd1400941 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:12.280776 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-b15caa85-d1f3-49d7-830d-707dd1400941 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] [instance: 72889057-861c-42f3-8629-32fff8f5dab7] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:12.287646 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b15caa85-d1f3-49d7-830d-707dd1400941 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:12.288092 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b15caa85-d1f3-49d7-830d-707dd1400941 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:12.289121 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b15caa85-d1f3-49d7-830d-707dd1400941 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:12.289558 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b15caa85-d1f3-49d7-830d-707dd1400941 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:12.303725 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.wsgi [None req-b15caa85-d1f3-49d7-830d-707dd1400941 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] HTTP exception thrown: Instance 72889057-861c-42f3-8629-32fff8f5dab7 could not be found. Jun 17 13:14:12.305367 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-b15caa85-d1f3-49d7-830d-707dd1400941 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Request method failure captured: Jun 17 13:14:12.305367 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: request: GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7 HTTP/1.1 Jun 17 13:14:12.305367 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Accept: application/json Jun 17 13:14:12.305367 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Accept-Encoding: identity Jun 17 13:14:12.305367 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Connection: close Jun 17 13:14:12.305367 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Content-Length: 0 Jun 17 13:14:12.305367 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Content-Type: application/json Jun 17 13:14:12.305367 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Host: 10.222.0.48 Jun 17 13:14:12.305367 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Openstack-System-Scope: None Jun 17 13:14:12.305367 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: User-Agent: python-urllib3/1.26.9 Jun 17 13:14:12.305367 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Auth-Token: gAAAAABirHqEx4r7VJZS1KTqV6cW2vQccb_IRBLE2I-MwuSn21ho_K-dRWF1uVgRyQIZHeMExtI3sTUExJ-tMOhrn_AtxYX-TqPeVNt2rGozsEHhlqJigdGgQ5mahtim2VRDJVKlMxKsEEgBPPs80_ciUR1XDYL1iD86G64Sh-zsTsvnzC4-u38 Jun 17 13:14:12.305367 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Domain-Id: None Jun 17 13:14:12.305367 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Domain-Name: None Jun 17 13:14:12.305367 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Identity-Status: Confirmed Jun 17 13:14:12.305367 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Is-Admin-Project: True Jun 17 13:14:12.305367 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Project-Domain-Id: default Jun 17 13:14:12.305367 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Project-Domain-Name: Default Jun 17 13:14:12.305367 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Project-Id: 73bf442df39b4f5cbc18f571a0596f10 Jun 17 13:14:12.305367 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Project-Name: tempest-TestVolumeBootPattern-1633287944 Jun 17 13:14:12.305367 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Role: member,reader Jun 17 13:14:12.305367 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Roles: member,reader Jun 17 13:14:12.307082 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_73bf442df39b4f5cbc18f571a0596f10", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/73bf442df39b4f5cbc18f571a0596f10"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/73bf442df39b4f5cbc18f571a0596f10"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/73bf442df39b4f5cbc18f571a0596f10"}]}] Jun 17 13:14:12.307082 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Tenant: tempest-TestVolumeBootPattern-1633287944 Jun 17 13:14:12.307082 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Tenant-Id: 73bf442df39b4f5cbc18f571a0596f10 Jun 17 13:14:12.307082 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Tenant-Name: tempest-TestVolumeBootPattern-1633287944 Jun 17 13:14:12.307082 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-User: tempest-TestVolumeBootPattern-1633287944-project Jun 17 13:14:12.307082 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-User-Domain-Id: default Jun 17 13:14:12.307082 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-User-Domain-Name: Default Jun 17 13:14:12.307082 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-User-Id: 18195083037046bd99166f68690c3dce Jun 17 13:14:12.307082 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-User-Name: tempest-TestVolumeBootPattern-1633287944-project Jun 17 13:14:12.307082 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: method: > Jun 17 13:14:12.307082 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: exception: Instance 72889057-861c-42f3-8629-32fff8f5dab7 could not be found. Jun 17 13:14:12.307082 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: action_args: {'id': '72889057-861c-42f3-8629-32fff8f5dab7'} Jun 17 13:14:12.307989 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 13:14:12.307989 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:14:12.307989 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 13:14:12.307989 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 13:14:12.307989 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 13:14:12.307989 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 13:14:12.307989 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 13:14:12.307989 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 13:14:12.307989 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 13:14:12.307989 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 13:14:12.307989 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 72889057-861c-42f3-8629-32fff8f5dab7 could not be found. Jun 17 13:14:12.307989 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 13:14:12.307989 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:14:12.307989 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 13:14:12.307989 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:14:12.307989 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:14:12.307989 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:14:12.307989 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 13:14:12.307989 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 13:14:12.307989 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 13:14:12.309958 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 13:14:12.309958 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 13:14:12.309958 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 13:14:12.309958 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 13:14:12.309958 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 13:14:12.309958 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 13:14:12.309958 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 13:14:12.309958 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 72889057-861c-42f3-8629-32fff8f5dab7 could not be found. Jun 17 13:14:12.309958 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 13:14:12.309958 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:14:12.309958 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 13:14:12.309958 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:14:12.309958 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:14:12.309958 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:14:12.309958 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 13:14:12.309958 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 13:14:12.309958 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 72889057-861c-42f3-8629-32fff8f5dab7 could not be found. Jun 17 13:14:12.309958 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 13:14:12.311583 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-b15caa85-d1f3-49d7-830d-707dd1400941 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Returning 404 to user: Instance 72889057-861c-42f3-8629-32fff8f5dab7 could not be found. {{(pid=117660) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 13:14:12.311687 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-8c70e1f2-333d-44a7-b68a-43c671a6d9ad tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:14:12.314998 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-b15caa85-d1f3-49d7-830d-707dd1400941 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] 10.222.0.48 "GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7" status: 404 len: 111 microversion: 2.1 time: 0.039730 Jun 17 13:14:12.315747 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 362/757] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:14:12 2022] GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 13:14:12.322795 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-8c70e1f2-333d-44a7-b68a-43c671a6d9ad tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1729 microversion: 2.1 time: 0.172524 Jun 17 13:14:12.323759 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 396/758] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:14:12 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1729 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:14:12.324011 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-52f4427f-23ea-4db3-9135-5b341994c543 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:12.325314 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-52f4427f-23ea-4db3-9135-5b341994c543 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:12.328842 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-e92337a2-64ac-4e69-9487-40206d171657 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:12.329335 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-e92337a2-64ac-4e69-9487-40206d171657 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:12.332780 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-52f4427f-23ea-4db3-9135-5b341994c543 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:12.333225 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-52f4427f-23ea-4db3-9135-5b341994c543 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:12.334020 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-52f4427f-23ea-4db3-9135-5b341994c543 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:12.334473 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-52f4427f-23ea-4db3-9135-5b341994c543 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:12.335375 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e92337a2-64ac-4e69-9487-40206d171657 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:12.335826 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e92337a2-64ac-4e69-9487-40206d171657 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:12.336608 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e92337a2-64ac-4e69-9487-40206d171657 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:12.337041 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e92337a2-64ac-4e69-9487-40206d171657 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:12.467329 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.objects.instance [None req-52f4427f-23ea-4db3-9135-5b341994c543 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lazy-loading 'services' on Instance uuid c8fdea98-917f-4c4d-aaba-d4f5df4622d6 {{(pid=117660) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 13:14:12.516191 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.objects.instance [None req-e92337a2-64ac-4e69-9487-40206d171657 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lazy-loading 'services' on Instance uuid 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 {{(pid=117659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 13:14:12.546355 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.wsgi [None req-52f4427f-23ea-4db3-9135-5b341994c543 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-77c5ef20-a47d-4558-92d4-897567a49be2) Jun 17 13:14:12.548634 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-52f4427f-23ea-4db3-9135-5b341994c543 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Request method failure captured: Jun 17 13:14:12.548634 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: request: DELETE /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments/dc0d8f94-669d-473e-b967-103b03ff07d8 HTTP/1.1 Jun 17 13:14:12.548634 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Accept: application/json Jun 17 13:14:12.548634 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Accept-Encoding: identity Jun 17 13:14:12.548634 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Connection: close Jun 17 13:14:12.548634 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Content-Length: 0 Jun 17 13:14:12.548634 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Content-Type: application/json Jun 17 13:14:12.548634 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Host: 10.222.0.48 Jun 17 13:14:12.548634 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Openstack-System-Scope: None Jun 17 13:14:12.548634 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: User-Agent: python-urllib3/1.26.9 Jun 17 13:14:12.548634 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Auth-Token: gAAAAABirHovuSKXhsYnyM1ICQHfCBnAkcBbRuuwZgxhkoNNkDDA8V46u4bM0d1Ij3mDA-GnbWHcDVDPBrFR3gqwdKLqUjwJvDZ_b3brdODlYgnHT8j_9TL2kWiym-dIXC0QOJO96MqfgUwsdiseafc9vSwBlwUt2XH_DR7FE-ChC01iKCOrpX0 Jun 17 13:14:12.548634 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Domain-Id: None Jun 17 13:14:12.548634 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Domain-Name: None Jun 17 13:14:12.548634 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Identity-Status: Confirmed Jun 17 13:14:12.548634 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Is-Admin-Project: True Jun 17 13:14:12.548634 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Openstack-Nova-Api-Version: 2.20 Jun 17 13:14:12.548634 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Project-Domain-Id: default Jun 17 13:14:12.548634 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Project-Domain-Name: Default Jun 17 13:14:12.548634 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Project-Id: c777f8f104af4d37a3b89ff9a57d2218 Jun 17 13:14:12.548634 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1116672173 Jun 17 13:14:12.548634 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Role: member,reader Jun 17 13:14:12.548634 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Roles: member,reader Jun 17 13:14:12.550279 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c777f8f104af4d37a3b89ff9a57d2218", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c777f8f104af4d37a3b89ff9a57d2218"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c777f8f104af4d37a3b89ff9a57d2218"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c777f8f104af4d37a3b89ff9a57d2218"}]}] Jun 17 13:14:12.550279 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1116672173 Jun 17 13:14:12.550279 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Tenant-Id: c777f8f104af4d37a3b89ff9a57d2218 Jun 17 13:14:12.550279 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1116672173 Jun 17 13:14:12.550279 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-User: tempest-AttachVolumeShelveTestJSON-1116672173-project Jun 17 13:14:12.550279 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-User-Domain-Id: default Jun 17 13:14:12.550279 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-User-Domain-Name: Default Jun 17 13:14:12.550279 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-User-Id: 847c39439e874e68b72e07c311a53bec Jun 17 13:14:12.550279 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1116672173-project Jun 17 13:14:12.550279 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: method: > Jun 17 13:14:12.551349 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-77c5ef20-a47d-4558-92d4-897567a49be2) Jun 17 13:14:12.551349 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: action_args: {'server_id': 'c8fdea98-917f-4c4d-aaba-d4f5df4622d6', 'id': 'dc0d8f94-669d-473e-b967-103b03ff07d8'} Jun 17 13:14:12.551349 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 13:14:12.551349 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:14:12.551349 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 13:14:12.551349 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 13:14:12.551349 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 13:14:12.551349 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 13:14:12.551349 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 17 13:14:12.551349 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 17 13:14:12.551349 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 17 13:14:12.551349 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 17 13:14:12.551349 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 17 13:14:12.551349 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 17 13:14:12.551349 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 17 13:14:12.551349 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 17 13:14:12.551349 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 13:14:12.552644 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 13:14:12.552644 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 13:14:12.552644 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 13:14:12.552644 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-77c5ef20-a47d-4558-92d4-897567a49be2) Jun 17 13:14:12.552644 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 13:14:12.552644 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:14:12.552644 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 13:14:12.552644 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:14:12.552644 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jun 17 13:14:12.552644 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jun 17 13:14:12.552644 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jun 17 13:14:12.552644 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jun 17 13:14:12.552644 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 17 13:14:12.552644 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 17 13:14:12.552644 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 13:14:12.552644 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 13:14:12.552644 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 13:14:12.552644 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 13:14:12.552644 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 17 13:14:12.554209 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 17 13:14:12.554209 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 17 13:14:12.554209 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 17 13:14:12.554209 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 17 13:14:12.554209 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 17 13:14:12.554209 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 17 13:14:12.554209 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 17 13:14:12.554209 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 13:14:12.554209 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 13:14:12.554209 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 13:14:12.554209 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 13:14:12.554209 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-77c5ef20-a47d-4558-92d4-897567a49be2) Jun 17 13:14:12.554209 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 13:14:12.554209 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:14:12.554209 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 13:14:12.554209 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:14:12.554209 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 17 13:14:12.555423 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 17 13:14:12.555423 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 17 13:14:12.555423 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 17 13:14:12.555423 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 17 13:14:12.555423 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 17 13:14:12.555423 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jun 17 13:14:12.555423 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jun 17 13:14:12.555423 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jun 17 13:14:12.555423 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 17 13:14:12.555423 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jun 17 13:14:12.555423 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jun 17 13:14:12.555423 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-77c5ef20-a47d-4558-92d4-897567a49be2) Jun 17 13:14:12.555423 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 13:14:12.555423 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:14:12.555423 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 13:14:12.555423 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:14:12.555423 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:14:12.555423 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:14:12.557151 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 13:14:12.557151 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 13:14:12.557151 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 13:14:12.557151 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 13:14:12.557151 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jun 17 13:14:12.557151 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 17 13:14:12.557151 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-77c5ef20-a47d-4558-92d4-897567a49be2) Jun 17 13:14:12.557151 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 13:14:12.557151 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:14:12.557151 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 13:14:12.557151 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:14:12.557151 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:14:12.557151 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:14:12.557151 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 13:14:12.557151 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 13:14:12.557151 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-77c5ef20-a47d-4558-92d4-897567a49be2) Jun 17 13:14:12.557151 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 13:14:12.558415 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-52f4427f-23ea-4db3-9135-5b341994c543 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-77c5ef20-a47d-4558-92d4-897567a49be2) {{(pid=117660) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 13:14:12.558415 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-52f4427f-23ea-4db3-9135-5b341994c543 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "DELETE /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments/dc0d8f94-669d-473e-b967-103b03ff07d8" status: 400 len: 269 microversion: 2.20 time: 0.234464 Jun 17 13:14:12.558415 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 363/759] 10.222.0.48 () {60 vars in 1456 bytes} [Fri Jun 17 13:14:12 2022] DELETE /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments/dc0d8f94-669d-473e-b967-103b03ff07d8 => generated 269 bytes in 236 msecs (HTTP/1.1 400) 9 headers in 383 bytes (1 switches on core 0) Jun 17 13:14:12.560211 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-0f2af594-8be3-4d43-8eaf-4ce9c534bd8c tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:12.560793 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-0f2af594-8be3-4d43-8eaf-4ce9c534bd8c tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:12.567153 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0f2af594-8be3-4d43-8eaf-4ce9c534bd8c tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:12.567593 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0f2af594-8be3-4d43-8eaf-4ce9c534bd8c tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:12.568355 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0f2af594-8be3-4d43-8eaf-4ce9c534bd8c tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:12.568780 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0f2af594-8be3-4d43-8eaf-4ce9c534bd8c tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:12.586180 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.wsgi [None req-e92337a2-64ac-4e69-9487-40206d171657 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0f51a021-23b2-4656-a126-701bd12bfccf) Jun 17 13:14:12.588440 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-e92337a2-64ac-4e69-9487-40206d171657 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Request method failure captured: Jun 17 13:14:12.588440 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: request: DELETE /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6/os-volume_attachments/10a44f8a-7ada-45e4-9859-29dfb17185e5 HTTP/1.1 Jun 17 13:14:12.588440 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Accept: application/json Jun 17 13:14:12.588440 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Accept-Encoding: identity Jun 17 13:14:12.588440 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Connection: close Jun 17 13:14:12.588440 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Content-Length: 0 Jun 17 13:14:12.588440 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Content-Type: application/json Jun 17 13:14:12.588440 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Host: 10.222.0.48 Jun 17 13:14:12.588440 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Openstack-System-Scope: None Jun 17 13:14:12.588440 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: User-Agent: python-urllib3/1.26.9 Jun 17 13:14:12.588440 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Auth-Token: gAAAAABirHtJLCe2LP9MRlJDle7vvcWMIS_cCFhmeW5lXWgl7DKiqidAB5tTXlYaElJ2a_UVwuEPiK1yoTFws0P3TFX2eFYka44vecr0bPBwst2ud9dcIMeb-f70G8jqnmiPJkvqd5D0pAagP8LY3L5m32ekpx4SCjzJ2BGPGVtPjt3hN_62p7g Jun 17 13:14:12.588440 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Domain-Id: None Jun 17 13:14:12.588440 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Domain-Name: None Jun 17 13:14:12.588440 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Identity-Status: Confirmed Jun 17 13:14:12.588440 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Is-Admin-Project: True Jun 17 13:14:12.588440 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Project-Domain-Id: default Jun 17 13:14:12.588440 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Project-Domain-Name: Default Jun 17 13:14:12.588440 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Project-Id: 834ac53907e54975851947e5f653c688 Jun 17 13:14:12.588440 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1799690958 Jun 17 13:14:12.588440 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Role: member,reader Jun 17 13:14:12.588440 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Roles: member,reader Jun 17 13:14:12.590150 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_834ac53907e54975851947e5f653c688", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/834ac53907e54975851947e5f653c688"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/834ac53907e54975851947e5f653c688"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/834ac53907e54975851947e5f653c688"}]}] Jun 17 13:14:12.590150 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Tenant: tempest-VolumesSnapshotTestJSON-1799690958 Jun 17 13:14:12.590150 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Tenant-Id: 834ac53907e54975851947e5f653c688 Jun 17 13:14:12.590150 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1799690958 Jun 17 13:14:12.590150 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User: tempest-VolumesSnapshotTestJSON-1799690958-project Jun 17 13:14:12.590150 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User-Domain-Id: default Jun 17 13:14:12.590150 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User-Domain-Name: Default Jun 17 13:14:12.590150 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User-Id: c6bc5146c28948c5859cd9eb3d09e0cf Jun 17 13:14:12.590150 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User-Name: tempest-VolumesSnapshotTestJSON-1799690958-project Jun 17 13:14:12.590150 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: method: > Jun 17 13:14:12.590923 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0f51a021-23b2-4656-a126-701bd12bfccf) Jun 17 13:14:12.590923 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: action_args: {'server_id': '0a983e3a-9451-4a00-b4f3-b6b2e5a003d6', 'id': '10a44f8a-7ada-45e4-9859-29dfb17185e5'} Jun 17 13:14:12.590923 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 13:14:12.590923 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:14:12.590923 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 13:14:12.590923 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 13:14:12.590923 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 13:14:12.590923 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 13:14:12.590923 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 17 13:14:12.590923 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 17 13:14:12.590923 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 17 13:14:12.590923 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 17 13:14:12.590923 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 17 13:14:12.590923 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 17 13:14:12.590923 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 17 13:14:12.590923 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 17 13:14:12.590923 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 13:14:12.592170 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 13:14:12.592170 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 13:14:12.592170 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 13:14:12.592170 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0f51a021-23b2-4656-a126-701bd12bfccf) Jun 17 13:14:12.592170 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:14:12.592170 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:14:12.592170 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:14:12.592170 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:14:12.592170 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jun 17 13:14:12.592170 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jun 17 13:14:12.592170 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jun 17 13:14:12.592170 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jun 17 13:14:12.592170 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 17 13:14:12.592170 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 17 13:14:12.592170 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 13:14:12.592170 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 13:14:12.592170 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 13:14:12.592170 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 13:14:12.592170 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 17 13:14:12.593508 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 17 13:14:12.593508 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 17 13:14:12.593508 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 17 13:14:12.593508 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 17 13:14:12.593508 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 17 13:14:12.593508 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 17 13:14:12.593508 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 17 13:14:12.593508 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 13:14:12.593508 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 13:14:12.593508 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 13:14:12.593508 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 13:14:12.593508 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0f51a021-23b2-4656-a126-701bd12bfccf) Jun 17 13:14:12.593508 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:14:12.593508 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:14:12.593508 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:14:12.593508 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:14:12.593508 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 17 13:14:12.594707 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 17 13:14:12.594707 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 17 13:14:12.594707 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 17 13:14:12.594707 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 17 13:14:12.594707 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 17 13:14:12.594707 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jun 17 13:14:12.594707 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jun 17 13:14:12.594707 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jun 17 13:14:12.594707 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 17 13:14:12.594707 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jun 17 13:14:12.594707 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jun 17 13:14:12.594707 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0f51a021-23b2-4656-a126-701bd12bfccf) Jun 17 13:14:12.594707 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:14:12.594707 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:14:12.594707 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:14:12.594707 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:14:12.594707 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:14:12.594707 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:14:12.596244 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 13:14:12.596244 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 13:14:12.596244 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 13:14:12.596244 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 13:14:12.596244 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jun 17 13:14:12.596244 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 17 13:14:12.596244 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0f51a021-23b2-4656-a126-701bd12bfccf) Jun 17 13:14:12.596244 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:14:12.596244 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:14:12.596244 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:14:12.596244 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:14:12.596244 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:14:12.596244 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:14:12.596244 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 13:14:12.596244 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 13:14:12.596244 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0f51a021-23b2-4656-a126-701bd12bfccf) Jun 17 13:14:12.596244 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:14:12.597456 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-e92337a2-64ac-4e69-9487-40206d171657 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0f51a021-23b2-4656-a126-701bd12bfccf) {{(pid=117659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 13:14:12.597456 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-e92337a2-64ac-4e69-9487-40206d171657 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "DELETE /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6/os-volume_attachments/10a44f8a-7ada-45e4-9859-29dfb17185e5" status: 400 len: 269 microversion: 2.1 time: 0.266782 Jun 17 13:14:12.597456 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 397/760] 10.222.0.48 () {58 vars in 1415 bytes} [Fri Jun 17 13:14:12 2022] DELETE /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6/os-volume_attachments/10a44f8a-7ada-45e4-9859-29dfb17185e5 => generated 269 bytes in 269 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 17 13:14:12.600396 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-f056616f-855e-489c-8be5-289c2b293e8a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:12.601005 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-f056616f-855e-489c-8be5-289c2b293e8a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:12.607650 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f056616f-855e-489c-8be5-289c2b293e8a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:12.608071 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f056616f-855e-489c-8be5-289c2b293e8a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:12.610412 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f056616f-855e-489c-8be5-289c2b293e8a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:12.610412 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f056616f-855e-489c-8be5-289c2b293e8a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:12.654579 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.objects.instance [None req-0f2af594-8be3-4d43-8eaf-4ce9c534bd8c tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lazy-loading 'services' on Instance uuid 8a408151-81c8-4490-9190-5e4fa2d98e8a {{(pid=117660) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 13:14:12.713805 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.wsgi [None req-0f2af594-8be3-4d43-8eaf-4ce9c534bd8c tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-328a0fb9-30e8-46cb-bf1c-0a950f46b129) Jun 17 13:14:12.716112 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-0f2af594-8be3-4d43-8eaf-4ce9c534bd8c tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Request method failure captured: Jun 17 13:14:12.716112 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: request: DELETE /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a/os-volume_attachments/520bf7f4-5382-4c9c-81be-934670e0f29c HTTP/1.1 Jun 17 13:14:12.716112 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Accept: application/json Jun 17 13:14:12.716112 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Accept-Encoding: identity Jun 17 13:14:12.716112 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Connection: close Jun 17 13:14:12.716112 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Content-Length: 0 Jun 17 13:14:12.716112 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Content-Type: application/json Jun 17 13:14:12.716112 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Host: 10.222.0.48 Jun 17 13:14:12.716112 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Openstack-System-Scope: None Jun 17 13:14:12.716112 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: User-Agent: python-urllib3/1.26.9 Jun 17 13:14:12.716112 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Auth-Token: gAAAAABirHsRs0DVoIJTEPizfQxUzLDy-cAxnoVq8pWwVU2lDEHfxotVouYNtPnQqMCXDF_Skn8Rxq-oKMB46_vj80swmohZmWUzc-BQzgQQhfPTpXwWUX9acE_q4zXSw5Kb4Ruqe_0ls_p0iCyuchKIOqXgyPR4tZ62Zn4QfTGY95co2HqCR5s Jun 17 13:14:12.716112 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Domain-Id: None Jun 17 13:14:12.716112 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Domain-Name: None Jun 17 13:14:12.716112 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Identity-Status: Confirmed Jun 17 13:14:12.716112 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Is-Admin-Project: True Jun 17 13:14:12.716112 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Project-Domain-Id: default Jun 17 13:14:12.716112 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Project-Domain-Name: Default Jun 17 13:14:12.716112 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Project-Id: 1686ea199c5442958f97102a61ce41aa Jun 17 13:14:12.716112 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Project-Name: tempest-TestMinimumBasicScenario-1188150813 Jun 17 13:14:12.716112 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Role: member,reader Jun 17 13:14:12.716112 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Roles: member,reader Jun 17 13:14:12.717651 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_1686ea199c5442958f97102a61ce41aa", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1686ea199c5442958f97102a61ce41aa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1686ea199c5442958f97102a61ce41aa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/1686ea199c5442958f97102a61ce41aa"}]}] Jun 17 13:14:12.717651 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Tenant: tempest-TestMinimumBasicScenario-1188150813 Jun 17 13:14:12.717651 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Tenant-Id: 1686ea199c5442958f97102a61ce41aa Jun 17 13:14:12.717651 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1188150813 Jun 17 13:14:12.717651 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-User: tempest-TestMinimumBasicScenario-1188150813-project Jun 17 13:14:12.717651 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-User-Domain-Id: default Jun 17 13:14:12.717651 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-User-Domain-Name: Default Jun 17 13:14:12.717651 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-User-Id: e7a99ccc238943a098833d03c6233413 Jun 17 13:14:12.717651 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-User-Name: tempest-TestMinimumBasicScenario-1188150813-project Jun 17 13:14:12.717651 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: method: > Jun 17 13:14:12.718741 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-328a0fb9-30e8-46cb-bf1c-0a950f46b129) Jun 17 13:14:12.718741 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: action_args: {'server_id': '8a408151-81c8-4490-9190-5e4fa2d98e8a', 'id': '520bf7f4-5382-4c9c-81be-934670e0f29c'} Jun 17 13:14:12.718741 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 13:14:12.718741 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:14:12.718741 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 13:14:12.718741 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 13:14:12.718741 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 13:14:12.718741 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 13:14:12.718741 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 17 13:14:12.718741 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 17 13:14:12.718741 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 17 13:14:12.718741 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 17 13:14:12.718741 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 17 13:14:12.718741 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 17 13:14:12.718741 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 17 13:14:12.718741 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 17 13:14:12.718741 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 13:14:12.720470 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 13:14:12.720470 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 13:14:12.720470 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 13:14:12.720470 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-328a0fb9-30e8-46cb-bf1c-0a950f46b129) Jun 17 13:14:12.720470 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 13:14:12.720470 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:14:12.720470 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 13:14:12.720470 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:14:12.720470 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jun 17 13:14:12.720470 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jun 17 13:14:12.720470 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jun 17 13:14:12.720470 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jun 17 13:14:12.720470 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 17 13:14:12.720470 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 17 13:14:12.720470 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 13:14:12.720470 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 13:14:12.720470 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 13:14:12.720470 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 13:14:12.720470 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 17 13:14:12.722561 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 17 13:14:12.722561 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 17 13:14:12.722561 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 17 13:14:12.722561 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 17 13:14:12.722561 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 17 13:14:12.722561 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 17 13:14:12.722561 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 17 13:14:12.722561 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 13:14:12.722561 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 13:14:12.722561 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 13:14:12.722561 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 13:14:12.722561 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-328a0fb9-30e8-46cb-bf1c-0a950f46b129) Jun 17 13:14:12.722561 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 13:14:12.722561 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:14:12.722561 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 13:14:12.722561 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:14:12.722561 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 17 13:14:12.723737 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 17 13:14:12.723737 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 17 13:14:12.723737 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 17 13:14:12.723737 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 17 13:14:12.723737 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 17 13:14:12.723737 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jun 17 13:14:12.723737 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jun 17 13:14:12.723737 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jun 17 13:14:12.723737 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 17 13:14:12.723737 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jun 17 13:14:12.723737 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jun 17 13:14:12.723737 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-328a0fb9-30e8-46cb-bf1c-0a950f46b129) Jun 17 13:14:12.723737 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 13:14:12.723737 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:14:12.723737 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 13:14:12.723737 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:14:12.723737 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:14:12.723737 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:14:12.725206 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 13:14:12.725206 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 13:14:12.725206 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 13:14:12.725206 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 13:14:12.725206 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jun 17 13:14:12.725206 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 17 13:14:12.725206 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-328a0fb9-30e8-46cb-bf1c-0a950f46b129) Jun 17 13:14:12.725206 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 13:14:12.725206 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:14:12.725206 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 13:14:12.725206 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:14:12.725206 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:14:12.725206 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:14:12.725206 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 13:14:12.725206 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 13:14:12.725206 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-328a0fb9-30e8-46cb-bf1c-0a950f46b129) Jun 17 13:14:12.725206 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 13:14:12.726921 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-0f2af594-8be3-4d43-8eaf-4ce9c534bd8c tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-328a0fb9-30e8-46cb-bf1c-0a950f46b129) {{(pid=117660) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 13:14:12.726921 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-0f2af594-8be3-4d43-8eaf-4ce9c534bd8c tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "DELETE /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a/os-volume_attachments/520bf7f4-5382-4c9c-81be-934670e0f29c" status: 400 len: 269 microversion: 2.1 time: 0.161949 Jun 17 13:14:12.726921 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 364/761] 10.222.0.48 () {58 vars in 1415 bytes} [Fri Jun 17 13:14:12 2022] DELETE /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a/os-volume_attachments/520bf7f4-5382-4c9c-81be-934670e0f29c => generated 269 bytes in 164 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 17 13:14:12.729929 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-e811c3da-985c-4b3c-afba-c3b3585b10f4 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:12.730633 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-e811c3da-985c-4b3c-afba-c3b3585b10f4 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] [instance: 72889057-861c-42f3-8629-32fff8f5dab7] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:12.737987 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e811c3da-985c-4b3c-afba-c3b3585b10f4 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:12.738463 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e811c3da-985c-4b3c-afba-c3b3585b10f4 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:12.739219 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e811c3da-985c-4b3c-afba-c3b3585b10f4 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:12.739657 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e811c3da-985c-4b3c-afba-c3b3585b10f4 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:12.749049 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-f056616f-855e-489c-8be5-289c2b293e8a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:14:12.755833 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.wsgi [None req-e811c3da-985c-4b3c-afba-c3b3585b10f4 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] HTTP exception thrown: Instance 72889057-861c-42f3-8629-32fff8f5dab7 could not be found. Jun 17 13:14:12.757228 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-f056616f-855e-489c-8be5-289c2b293e8a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1729 microversion: 2.1 time: 0.162272 Jun 17 13:14:12.757478 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-e811c3da-985c-4b3c-afba-c3b3585b10f4 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Request method failure captured: Jun 17 13:14:12.757478 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: request: GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7 HTTP/1.1 Jun 17 13:14:12.757478 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Accept: application/json Jun 17 13:14:12.757478 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Accept-Encoding: identity Jun 17 13:14:12.757478 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Connection: close Jun 17 13:14:12.757478 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Content-Length: 0 Jun 17 13:14:12.757478 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Content-Type: application/json Jun 17 13:14:12.757478 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Host: 10.222.0.48 Jun 17 13:14:12.757478 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Openstack-System-Scope: None Jun 17 13:14:12.757478 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: User-Agent: python-urllib3/1.26.9 Jun 17 13:14:12.757478 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Auth-Token: gAAAAABirHqEx4r7VJZS1KTqV6cW2vQccb_IRBLE2I-MwuSn21ho_K-dRWF1uVgRyQIZHeMExtI3sTUExJ-tMOhrn_AtxYX-TqPeVNt2rGozsEHhlqJigdGgQ5mahtim2VRDJVKlMxKsEEgBPPs80_ciUR1XDYL1iD86G64Sh-zsTsvnzC4-u38 Jun 17 13:14:12.757478 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Domain-Id: None Jun 17 13:14:12.757478 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Domain-Name: None Jun 17 13:14:12.757478 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Identity-Status: Confirmed Jun 17 13:14:12.757478 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Is-Admin-Project: True Jun 17 13:14:12.757478 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Project-Domain-Id: default Jun 17 13:14:12.757478 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Project-Domain-Name: Default Jun 17 13:14:12.757478 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Project-Id: 73bf442df39b4f5cbc18f571a0596f10 Jun 17 13:14:12.757478 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Project-Name: tempest-TestVolumeBootPattern-1633287944 Jun 17 13:14:12.757478 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Role: member,reader Jun 17 13:14:12.757478 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Roles: member,reader Jun 17 13:14:12.759100 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_73bf442df39b4f5cbc18f571a0596f10", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/73bf442df39b4f5cbc18f571a0596f10"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/73bf442df39b4f5cbc18f571a0596f10"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/73bf442df39b4f5cbc18f571a0596f10"}]}] Jun 17 13:14:12.759100 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Tenant: tempest-TestVolumeBootPattern-1633287944 Jun 17 13:14:12.759100 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Tenant-Id: 73bf442df39b4f5cbc18f571a0596f10 Jun 17 13:14:12.759100 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Tenant-Name: tempest-TestVolumeBootPattern-1633287944 Jun 17 13:14:12.759100 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-User: tempest-TestVolumeBootPattern-1633287944-project Jun 17 13:14:12.759100 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-User-Domain-Id: default Jun 17 13:14:12.759100 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-User-Domain-Name: Default Jun 17 13:14:12.759100 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-User-Id: 18195083037046bd99166f68690c3dce Jun 17 13:14:12.759100 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-User-Name: tempest-TestVolumeBootPattern-1633287944-project Jun 17 13:14:12.759100 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: method: > Jun 17 13:14:12.759100 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: exception: Instance 72889057-861c-42f3-8629-32fff8f5dab7 could not be found. Jun 17 13:14:12.759100 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: action_args: {'id': '72889057-861c-42f3-8629-32fff8f5dab7'} Jun 17 13:14:12.760745 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 13:14:12.760745 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:14:12.760745 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 13:14:12.760745 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 13:14:12.760745 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 13:14:12.760745 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 13:14:12.760745 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 13:14:12.760745 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 13:14:12.760745 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 13:14:12.760745 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 13:14:12.760745 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 72889057-861c-42f3-8629-32fff8f5dab7 could not be found. Jun 17 13:14:12.760745 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 13:14:12.760745 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:14:12.760745 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 13:14:12.760745 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:14:12.760745 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:14:12.760745 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:14:12.760745 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 13:14:12.760745 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 13:14:12.760745 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 13:14:12.762262 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 13:14:12.762262 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 13:14:12.762262 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 13:14:12.762262 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 13:14:12.762262 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 13:14:12.762262 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 13:14:12.762262 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 13:14:12.762262 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 72889057-861c-42f3-8629-32fff8f5dab7 could not be found. Jun 17 13:14:12.762262 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 13:14:12.762262 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:14:12.762262 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 13:14:12.762262 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:14:12.762262 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:14:12.762262 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:14:12.762262 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 13:14:12.762262 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 13:14:12.762262 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 72889057-861c-42f3-8629-32fff8f5dab7 could not be found. Jun 17 13:14:12.762262 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 13:14:12.763566 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 398/762] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:14:12 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1729 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:14:12.763685 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-e811c3da-985c-4b3c-afba-c3b3585b10f4 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Returning 404 to user: Instance 72889057-861c-42f3-8629-32fff8f5dab7 could not be found. {{(pid=117660) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 13:14:12.763685 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-e811c3da-985c-4b3c-afba-c3b3585b10f4 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] 10.222.0.48 "GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7" status: 404 len: 111 microversion: 2.1 time: 0.040064 Jun 17 13:14:12.763685 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 365/763] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:14:12 2022] GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 13:14:12.764595 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-6cf8cdc4-3239-4f44-a0e5-107182d02d72 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:12.765079 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-6cf8cdc4-3239-4f44-a0e5-107182d02d72 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:12.767869 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-7f6ce5ce-0768-4cc9-a0c7-5a6e832dbda4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:12.768485 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-7f6ce5ce-0768-4cc9-a0c7-5a6e832dbda4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:12.771104 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6cf8cdc4-3239-4f44-a0e5-107182d02d72 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:12.771546 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6cf8cdc4-3239-4f44-a0e5-107182d02d72 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:12.772302 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6cf8cdc4-3239-4f44-a0e5-107182d02d72 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:12.772726 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6cf8cdc4-3239-4f44-a0e5-107182d02d72 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:12.775482 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7f6ce5ce-0768-4cc9-a0c7-5a6e832dbda4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:12.775922 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7f6ce5ce-0768-4cc9-a0c7-5a6e832dbda4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:12.776682 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7f6ce5ce-0768-4cc9-a0c7-5a6e832dbda4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:12.777107 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7f6ce5ce-0768-4cc9-a0c7-5a6e832dbda4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:12.855520 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.objects.instance [None req-6cf8cdc4-3239-4f44-a0e5-107182d02d72 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lazy-loading 'services' on Instance uuid 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 {{(pid=117660) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 13:14:12.900720 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.objects.instance [None req-7f6ce5ce-0768-4cc9-a0c7-5a6e832dbda4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lazy-loading 'services' on Instance uuid c8fdea98-917f-4c4d-aaba-d4f5df4622d6 {{(pid=117659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 13:14:12.930192 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.wsgi [None req-6cf8cdc4-3239-4f44-a0e5-107182d02d72 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-5b3f607c-65c3-4bc6-8734-c2c77679b6de) Jun 17 13:14:12.932375 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-6cf8cdc4-3239-4f44-a0e5-107182d02d72 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Request method failure captured: Jun 17 13:14:12.932375 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: request: DELETE /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6/os-volume_attachments/10a44f8a-7ada-45e4-9859-29dfb17185e5 HTTP/1.1 Jun 17 13:14:12.932375 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Accept: application/json Jun 17 13:14:12.932375 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Accept-Encoding: identity Jun 17 13:14:12.932375 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Connection: close Jun 17 13:14:12.932375 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Content-Length: 0 Jun 17 13:14:12.932375 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Content-Type: application/json Jun 17 13:14:12.932375 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Host: 10.222.0.48 Jun 17 13:14:12.932375 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Openstack-System-Scope: None Jun 17 13:14:12.932375 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: User-Agent: python-urllib3/1.26.9 Jun 17 13:14:12.932375 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Auth-Token: gAAAAABirHtJLCe2LP9MRlJDle7vvcWMIS_cCFhmeW5lXWgl7DKiqidAB5tTXlYaElJ2a_UVwuEPiK1yoTFws0P3TFX2eFYka44vecr0bPBwst2ud9dcIMeb-f70G8jqnmiPJkvqd5D0pAagP8LY3L5m32ekpx4SCjzJ2BGPGVtPjt3hN_62p7g Jun 17 13:14:12.932375 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Domain-Id: None Jun 17 13:14:12.932375 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Domain-Name: None Jun 17 13:14:12.932375 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Identity-Status: Confirmed Jun 17 13:14:12.932375 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Is-Admin-Project: True Jun 17 13:14:12.932375 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Project-Domain-Id: default Jun 17 13:14:12.932375 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Project-Domain-Name: Default Jun 17 13:14:12.932375 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Project-Id: 834ac53907e54975851947e5f653c688 Jun 17 13:14:12.932375 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1799690958 Jun 17 13:14:12.932375 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Role: member,reader Jun 17 13:14:12.932375 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Roles: member,reader Jun 17 13:14:12.934139 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_834ac53907e54975851947e5f653c688", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/834ac53907e54975851947e5f653c688"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/834ac53907e54975851947e5f653c688"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/834ac53907e54975851947e5f653c688"}]}] Jun 17 13:14:12.934139 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Tenant: tempest-VolumesSnapshotTestJSON-1799690958 Jun 17 13:14:12.934139 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Tenant-Id: 834ac53907e54975851947e5f653c688 Jun 17 13:14:12.934139 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1799690958 Jun 17 13:14:12.934139 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-User: tempest-VolumesSnapshotTestJSON-1799690958-project Jun 17 13:14:12.934139 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-User-Domain-Id: default Jun 17 13:14:12.934139 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-User-Domain-Name: Default Jun 17 13:14:12.934139 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-User-Id: c6bc5146c28948c5859cd9eb3d09e0cf Jun 17 13:14:12.934139 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-User-Name: tempest-VolumesSnapshotTestJSON-1799690958-project Jun 17 13:14:12.934139 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: method: > Jun 17 13:14:12.935164 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-5b3f607c-65c3-4bc6-8734-c2c77679b6de) Jun 17 13:14:12.935164 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: action_args: {'server_id': '0a983e3a-9451-4a00-b4f3-b6b2e5a003d6', 'id': '10a44f8a-7ada-45e4-9859-29dfb17185e5'} Jun 17 13:14:12.935164 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 13:14:12.935164 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:14:12.935164 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 13:14:12.935164 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 13:14:12.935164 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 13:14:12.935164 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 13:14:12.935164 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 17 13:14:12.935164 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 17 13:14:12.935164 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 17 13:14:12.935164 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 17 13:14:12.935164 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 17 13:14:12.935164 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 17 13:14:12.935164 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 17 13:14:12.935164 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 17 13:14:12.935164 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 13:14:12.936400 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 13:14:12.936400 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 13:14:12.936400 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 13:14:12.936400 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-5b3f607c-65c3-4bc6-8734-c2c77679b6de) Jun 17 13:14:12.936400 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 13:14:12.936400 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:14:12.936400 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 13:14:12.936400 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:14:12.936400 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jun 17 13:14:12.936400 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jun 17 13:14:12.936400 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jun 17 13:14:12.936400 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jun 17 13:14:12.936400 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 17 13:14:12.936400 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 17 13:14:12.936400 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 13:14:12.936400 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 13:14:12.936400 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 13:14:12.936400 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 13:14:12.936400 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 17 13:14:12.938186 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 17 13:14:12.938186 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 17 13:14:12.938186 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 17 13:14:12.938186 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 17 13:14:12.938186 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 17 13:14:12.938186 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 17 13:14:12.938186 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 17 13:14:12.938186 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 13:14:12.938186 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 13:14:12.938186 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 13:14:12.938186 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 13:14:12.938186 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-5b3f607c-65c3-4bc6-8734-c2c77679b6de) Jun 17 13:14:12.938186 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 13:14:12.938186 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:14:12.938186 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 13:14:12.938186 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:14:12.938186 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 17 13:14:12.939619 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 17 13:14:12.939619 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 17 13:14:12.939619 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 17 13:14:12.939619 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 17 13:14:12.939619 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 17 13:14:12.939619 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jun 17 13:14:12.939619 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jun 17 13:14:12.939619 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jun 17 13:14:12.939619 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 17 13:14:12.939619 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jun 17 13:14:12.939619 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jun 17 13:14:12.939619 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-5b3f607c-65c3-4bc6-8734-c2c77679b6de) Jun 17 13:14:12.939619 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 13:14:12.939619 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:14:12.939619 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 13:14:12.939619 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:14:12.939619 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:14:12.939619 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:14:12.940960 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 13:14:12.940960 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 13:14:12.940960 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 13:14:12.940960 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 13:14:12.940960 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jun 17 13:14:12.940960 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 17 13:14:12.940960 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-5b3f607c-65c3-4bc6-8734-c2c77679b6de) Jun 17 13:14:12.940960 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 13:14:12.940960 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:14:12.940960 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 13:14:12.940960 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:14:12.940960 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:14:12.940960 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:14:12.940960 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 13:14:12.940960 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 13:14:12.940960 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-5b3f607c-65c3-4bc6-8734-c2c77679b6de) Jun 17 13:14:12.940960 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 13:14:12.942356 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-6cf8cdc4-3239-4f44-a0e5-107182d02d72 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-5b3f607c-65c3-4bc6-8734-c2c77679b6de) {{(pid=117660) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 13:14:12.942356 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-6cf8cdc4-3239-4f44-a0e5-107182d02d72 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "DELETE /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6/os-volume_attachments/10a44f8a-7ada-45e4-9859-29dfb17185e5" status: 400 len: 269 microversion: 2.1 time: 0.172918 Jun 17 13:14:12.942356 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 366/764] 10.222.0.48 () {58 vars in 1415 bytes} [Fri Jun 17 13:14:12 2022] DELETE /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6/os-volume_attachments/10a44f8a-7ada-45e4-9859-29dfb17185e5 => generated 269 bytes in 174 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 17 13:14:12.942356 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-042e9daf-d467-4d1a-9c8e-ef60302ff456 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:12.943048 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-042e9daf-d467-4d1a-9c8e-ef60302ff456 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:12.949593 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-042e9daf-d467-4d1a-9c8e-ef60302ff456 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:12.950425 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-042e9daf-d467-4d1a-9c8e-ef60302ff456 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:12.950804 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-042e9daf-d467-4d1a-9c8e-ef60302ff456 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:12.951227 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-042e9daf-d467-4d1a-9c8e-ef60302ff456 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:12.967860 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.wsgi [None req-7f6ce5ce-0768-4cc9-a0c7-5a6e832dbda4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0d49dd6e-d4ad-47cf-9976-8a28af21b8ab) Jun 17 13:14:12.970121 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-7f6ce5ce-0768-4cc9-a0c7-5a6e832dbda4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Request method failure captured: Jun 17 13:14:12.970121 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: request: DELETE /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments/dc0d8f94-669d-473e-b967-103b03ff07d8 HTTP/1.1 Jun 17 13:14:12.970121 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Accept: application/json Jun 17 13:14:12.970121 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Accept-Encoding: identity Jun 17 13:14:12.970121 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Connection: close Jun 17 13:14:12.970121 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Content-Length: 0 Jun 17 13:14:12.970121 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Content-Type: application/json Jun 17 13:14:12.970121 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Host: 10.222.0.48 Jun 17 13:14:12.970121 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Openstack-System-Scope: None Jun 17 13:14:12.970121 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: User-Agent: python-urllib3/1.26.9 Jun 17 13:14:12.970121 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Auth-Token: gAAAAABirHovuSKXhsYnyM1ICQHfCBnAkcBbRuuwZgxhkoNNkDDA8V46u4bM0d1Ij3mDA-GnbWHcDVDPBrFR3gqwdKLqUjwJvDZ_b3brdODlYgnHT8j_9TL2kWiym-dIXC0QOJO96MqfgUwsdiseafc9vSwBlwUt2XH_DR7FE-ChC01iKCOrpX0 Jun 17 13:14:12.970121 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Domain-Id: None Jun 17 13:14:12.970121 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Domain-Name: None Jun 17 13:14:12.970121 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Identity-Status: Confirmed Jun 17 13:14:12.970121 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Is-Admin-Project: True Jun 17 13:14:12.970121 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Openstack-Nova-Api-Version: 2.20 Jun 17 13:14:12.970121 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Project-Domain-Id: default Jun 17 13:14:12.970121 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Project-Domain-Name: Default Jun 17 13:14:12.970121 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Project-Id: c777f8f104af4d37a3b89ff9a57d2218 Jun 17 13:14:12.970121 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1116672173 Jun 17 13:14:12.970121 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Role: member,reader Jun 17 13:14:12.970121 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Roles: member,reader Jun 17 13:14:12.971757 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c777f8f104af4d37a3b89ff9a57d2218", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c777f8f104af4d37a3b89ff9a57d2218"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c777f8f104af4d37a3b89ff9a57d2218"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c777f8f104af4d37a3b89ff9a57d2218"}]}] Jun 17 13:14:12.971757 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1116672173 Jun 17 13:14:12.971757 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Tenant-Id: c777f8f104af4d37a3b89ff9a57d2218 Jun 17 13:14:12.971757 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1116672173 Jun 17 13:14:12.971757 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User: tempest-AttachVolumeShelveTestJSON-1116672173-project Jun 17 13:14:12.971757 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User-Domain-Id: default Jun 17 13:14:12.971757 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User-Domain-Name: Default Jun 17 13:14:12.971757 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User-Id: 847c39439e874e68b72e07c311a53bec Jun 17 13:14:12.971757 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1116672173-project Jun 17 13:14:12.971757 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: method: > Jun 17 13:14:12.972480 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0d49dd6e-d4ad-47cf-9976-8a28af21b8ab) Jun 17 13:14:12.972480 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: action_args: {'server_id': 'c8fdea98-917f-4c4d-aaba-d4f5df4622d6', 'id': 'dc0d8f94-669d-473e-b967-103b03ff07d8'} Jun 17 13:14:12.972480 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 13:14:12.972480 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:14:12.972480 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 13:14:12.972480 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 13:14:12.972480 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 13:14:12.972480 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 13:14:12.972480 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 17 13:14:12.972480 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 17 13:14:12.972480 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 17 13:14:12.972480 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 17 13:14:12.972480 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 17 13:14:12.972480 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 17 13:14:12.972480 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 17 13:14:12.972480 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 17 13:14:12.972480 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 13:14:12.973925 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 13:14:12.973925 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 13:14:12.973925 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 13:14:12.973925 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0d49dd6e-d4ad-47cf-9976-8a28af21b8ab) Jun 17 13:14:12.973925 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:14:12.973925 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:14:12.973925 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:14:12.973925 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:14:12.973925 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jun 17 13:14:12.973925 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jun 17 13:14:12.973925 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jun 17 13:14:12.973925 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jun 17 13:14:12.973925 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 17 13:14:12.973925 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 17 13:14:12.973925 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 13:14:12.973925 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 13:14:12.973925 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 13:14:12.973925 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 13:14:12.973925 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 17 13:14:12.975284 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 17 13:14:12.975284 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 17 13:14:12.975284 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 17 13:14:12.975284 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 17 13:14:12.975284 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 17 13:14:12.975284 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 17 13:14:12.975284 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 17 13:14:12.975284 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 13:14:12.975284 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 13:14:12.975284 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 13:14:12.975284 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 13:14:12.975284 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0d49dd6e-d4ad-47cf-9976-8a28af21b8ab) Jun 17 13:14:12.975284 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:14:12.975284 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:14:12.975284 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:14:12.975284 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:14:12.975284 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 17 13:14:12.976465 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 17 13:14:12.976465 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 17 13:14:12.976465 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 17 13:14:12.976465 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 17 13:14:12.976465 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 17 13:14:12.976465 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jun 17 13:14:12.976465 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jun 17 13:14:12.976465 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jun 17 13:14:12.976465 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 17 13:14:12.976465 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jun 17 13:14:12.976465 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jun 17 13:14:12.976465 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0d49dd6e-d4ad-47cf-9976-8a28af21b8ab) Jun 17 13:14:12.976465 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:14:12.976465 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:14:12.976465 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:14:12.976465 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:14:12.976465 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:14:12.976465 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:14:12.977734 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 13:14:12.977734 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 13:14:12.977734 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 13:14:12.977734 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 13:14:12.977734 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jun 17 13:14:12.977734 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 17 13:14:12.977734 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0d49dd6e-d4ad-47cf-9976-8a28af21b8ab) Jun 17 13:14:12.977734 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:14:12.977734 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:14:12.977734 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:14:12.977734 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:14:12.977734 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:14:12.977734 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:14:12.977734 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 13:14:12.977734 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 13:14:12.977734 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0d49dd6e-d4ad-47cf-9976-8a28af21b8ab) Jun 17 13:14:12.977734 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:14:12.979504 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-7f6ce5ce-0768-4cc9-a0c7-5a6e832dbda4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0d49dd6e-d4ad-47cf-9976-8a28af21b8ab) {{(pid=117659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 13:14:12.979504 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-7f6ce5ce-0768-4cc9-a0c7-5a6e832dbda4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "DELETE /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments/dc0d8f94-669d-473e-b967-103b03ff07d8" status: 400 len: 269 microversion: 2.20 time: 0.213111 Jun 17 13:14:12.979504 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 399/765] 10.222.0.48 () {60 vars in 1456 bytes} [Fri Jun 17 13:14:12 2022] DELETE /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments/dc0d8f94-669d-473e-b967-103b03ff07d8 => generated 269 bytes in 214 msecs (HTTP/1.1 400) 9 headers in 383 bytes (1 switches on core 0) Jun 17 13:14:12.979504 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-b1228008-b02d-4248-a927-7e12bad9d0c2 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:12.979836 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-b1228008-b02d-4248-a927-7e12bad9d0c2 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:12.981830 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-042e9daf-d467-4d1a-9c8e-ef60302ff456 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046126 Jun 17 13:14:12.982364 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 367/766] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:12 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:12.985442 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b1228008-b02d-4248-a927-7e12bad9d0c2 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:12.985907 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b1228008-b02d-4248-a927-7e12bad9d0c2 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:12.987055 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b1228008-b02d-4248-a927-7e12bad9d0c2 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:12.987212 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-bef450d3-d0f3-45a8-961c-1467e6e495fb tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:12.987493 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b1228008-b02d-4248-a927-7e12bad9d0c2 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:12.987760 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-bef450d3-d0f3-45a8-961c-1467e6e495fb tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:12.993806 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bef450d3-d0f3-45a8-961c-1467e6e495fb tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:12.994198 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bef450d3-d0f3-45a8-961c-1467e6e495fb tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:12.995142 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bef450d3-d0f3-45a8-961c-1467e6e495fb tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:12.995567 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bef450d3-d0f3-45a8-961c-1467e6e495fb tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:13.072645 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.objects.instance [None req-b1228008-b02d-4248-a927-7e12bad9d0c2 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lazy-loading 'services' on Instance uuid 8a408151-81c8-4490-9190-5e4fa2d98e8a {{(pid=117659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 13:14:13.129794 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.wsgi [None req-b1228008-b02d-4248-a927-7e12bad9d0c2 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-816e4ec6-ca64-4413-a5e4-572c0ea75e57) Jun 17 13:14:13.130567 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-bef450d3-d0f3-45a8-961c-1467e6e495fb tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:14:13.132034 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-b1228008-b02d-4248-a927-7e12bad9d0c2 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Request method failure captured: Jun 17 13:14:13.132034 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: request: DELETE /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a/os-volume_attachments/520bf7f4-5382-4c9c-81be-934670e0f29c HTTP/1.1 Jun 17 13:14:13.132034 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Accept: application/json Jun 17 13:14:13.132034 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Accept-Encoding: identity Jun 17 13:14:13.132034 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Connection: close Jun 17 13:14:13.132034 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Content-Length: 0 Jun 17 13:14:13.132034 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Content-Type: application/json Jun 17 13:14:13.132034 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Host: 10.222.0.48 Jun 17 13:14:13.132034 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Openstack-System-Scope: None Jun 17 13:14:13.132034 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: User-Agent: python-urllib3/1.26.9 Jun 17 13:14:13.132034 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Auth-Token: gAAAAABirHsRs0DVoIJTEPizfQxUzLDy-cAxnoVq8pWwVU2lDEHfxotVouYNtPnQqMCXDF_Skn8Rxq-oKMB46_vj80swmohZmWUzc-BQzgQQhfPTpXwWUX9acE_q4zXSw5Kb4Ruqe_0ls_p0iCyuchKIOqXgyPR4tZ62Zn4QfTGY95co2HqCR5s Jun 17 13:14:13.132034 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Domain-Id: None Jun 17 13:14:13.132034 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Domain-Name: None Jun 17 13:14:13.132034 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Identity-Status: Confirmed Jun 17 13:14:13.132034 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Is-Admin-Project: True Jun 17 13:14:13.132034 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Project-Domain-Id: default Jun 17 13:14:13.132034 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Project-Domain-Name: Default Jun 17 13:14:13.132034 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Project-Id: 1686ea199c5442958f97102a61ce41aa Jun 17 13:14:13.132034 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Project-Name: tempest-TestMinimumBasicScenario-1188150813 Jun 17 13:14:13.132034 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Role: member,reader Jun 17 13:14:13.132034 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Roles: member,reader Jun 17 13:14:13.133632 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_1686ea199c5442958f97102a61ce41aa", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1686ea199c5442958f97102a61ce41aa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1686ea199c5442958f97102a61ce41aa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/1686ea199c5442958f97102a61ce41aa"}]}] Jun 17 13:14:13.133632 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Tenant: tempest-TestMinimumBasicScenario-1188150813 Jun 17 13:14:13.133632 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Tenant-Id: 1686ea199c5442958f97102a61ce41aa Jun 17 13:14:13.133632 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1188150813 Jun 17 13:14:13.133632 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User: tempest-TestMinimumBasicScenario-1188150813-project Jun 17 13:14:13.133632 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User-Domain-Id: default Jun 17 13:14:13.133632 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User-Domain-Name: Default Jun 17 13:14:13.133632 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User-Id: e7a99ccc238943a098833d03c6233413 Jun 17 13:14:13.133632 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User-Name: tempest-TestMinimumBasicScenario-1188150813-project Jun 17 13:14:13.133632 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: method: > Jun 17 13:14:13.134419 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-816e4ec6-ca64-4413-a5e4-572c0ea75e57) Jun 17 13:14:13.134419 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: action_args: {'server_id': '8a408151-81c8-4490-9190-5e4fa2d98e8a', 'id': '520bf7f4-5382-4c9c-81be-934670e0f29c'} Jun 17 13:14:13.134419 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 13:14:13.134419 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:14:13.134419 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 13:14:13.134419 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 13:14:13.134419 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 13:14:13.134419 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 13:14:13.134419 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 17 13:14:13.134419 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 17 13:14:13.134419 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 17 13:14:13.134419 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 17 13:14:13.134419 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 17 13:14:13.134419 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 17 13:14:13.134419 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 17 13:14:13.134419 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 17 13:14:13.134419 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 13:14:13.135749 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 13:14:13.135749 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 13:14:13.135749 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 13:14:13.135749 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-816e4ec6-ca64-4413-a5e4-572c0ea75e57) Jun 17 13:14:13.135749 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:14:13.135749 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:14:13.135749 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:14:13.135749 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:14:13.135749 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jun 17 13:14:13.135749 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jun 17 13:14:13.135749 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jun 17 13:14:13.135749 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jun 17 13:14:13.135749 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 17 13:14:13.135749 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 17 13:14:13.135749 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 13:14:13.135749 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 13:14:13.135749 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 13:14:13.135749 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 13:14:13.135749 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 17 13:14:13.137304 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 17 13:14:13.137304 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 17 13:14:13.137304 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 17 13:14:13.137304 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 17 13:14:13.137304 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 17 13:14:13.137304 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 17 13:14:13.137304 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 17 13:14:13.137304 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 13:14:13.137304 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 13:14:13.137304 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 13:14:13.137304 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 13:14:13.137304 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-816e4ec6-ca64-4413-a5e4-572c0ea75e57) Jun 17 13:14:13.137304 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:14:13.137304 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:14:13.137304 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:14:13.137304 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:14:13.137304 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 17 13:14:13.138562 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 17 13:14:13.138562 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 17 13:14:13.138562 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 17 13:14:13.138562 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 17 13:14:13.138562 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 17 13:14:13.138562 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jun 17 13:14:13.138562 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jun 17 13:14:13.138562 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jun 17 13:14:13.138562 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 17 13:14:13.138562 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jun 17 13:14:13.138562 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jun 17 13:14:13.138562 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-816e4ec6-ca64-4413-a5e4-572c0ea75e57) Jun 17 13:14:13.138562 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:14:13.138562 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:14:13.138562 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:14:13.138562 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:14:13.138562 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:14:13.138562 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:14:13.139859 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 13:14:13.139859 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 13:14:13.139859 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 13:14:13.139859 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 13:14:13.139859 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jun 17 13:14:13.139859 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 17 13:14:13.139859 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-816e4ec6-ca64-4413-a5e4-572c0ea75e57) Jun 17 13:14:13.139859 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:14:13.139859 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:14:13.139859 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:14:13.139859 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:14:13.139859 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:14:13.139859 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:14:13.139859 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 13:14:13.139859 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 13:14:13.139859 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-816e4ec6-ca64-4413-a5e4-572c0ea75e57) Jun 17 13:14:13.139859 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:14:13.141093 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-b1228008-b02d-4248-a927-7e12bad9d0c2 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-816e4ec6-ca64-4413-a5e4-572c0ea75e57) {{(pid=117659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 13:14:13.141093 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-b1228008-b02d-4248-a927-7e12bad9d0c2 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "DELETE /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a/os-volume_attachments/520bf7f4-5382-4c9c-81be-934670e0f29c" status: 400 len: 269 microversion: 2.1 time: 0.159828 Jun 17 13:14:13.141093 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 400/767] 10.222.0.48 () {58 vars in 1415 bytes} [Fri Jun 17 13:14:12 2022] DELETE /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a/os-volume_attachments/520bf7f4-5382-4c9c-81be-934670e0f29c => generated 269 bytes in 161 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 17 13:14:13.141093 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-58073396-c905-4c84-a3e0-af24aebf5215 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:13.141438 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-58073396-c905-4c84-a3e0-af24aebf5215 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] [instance: 72889057-861c-42f3-8629-32fff8f5dab7] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:13.145704 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-bef450d3-d0f3-45a8-961c-1467e6e495fb tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1729 microversion: 2.1 time: 0.162293 Jun 17 13:14:13.145957 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-58073396-c905-4c84-a3e0-af24aebf5215 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:13.146437 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-58073396-c905-4c84-a3e0-af24aebf5215 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:13.146550 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 368/768] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:14:12 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1729 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:14:13.147264 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-58073396-c905-4c84-a3e0-af24aebf5215 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:13.147730 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-58073396-c905-4c84-a3e0-af24aebf5215 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:13.151326 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-95d356b8-727c-4f7d-935e-511c38afbcaf tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:13.151816 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-95d356b8-727c-4f7d-935e-511c38afbcaf tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:13.157648 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-95d356b8-727c-4f7d-935e-511c38afbcaf tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:13.158150 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-95d356b8-727c-4f7d-935e-511c38afbcaf tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:13.158911 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-95d356b8-727c-4f7d-935e-511c38afbcaf tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:13.159336 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-95d356b8-727c-4f7d-935e-511c38afbcaf tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:13.161455 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.wsgi [None req-58073396-c905-4c84-a3e0-af24aebf5215 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] HTTP exception thrown: Instance 72889057-861c-42f3-8629-32fff8f5dab7 could not be found. Jun 17 13:14:13.163097 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-58073396-c905-4c84-a3e0-af24aebf5215 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Request method failure captured: Jun 17 13:14:13.163097 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: request: GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7 HTTP/1.1 Jun 17 13:14:13.163097 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Accept: application/json Jun 17 13:14:13.163097 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Accept-Encoding: identity Jun 17 13:14:13.163097 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Connection: close Jun 17 13:14:13.163097 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Content-Length: 0 Jun 17 13:14:13.163097 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Content-Type: application/json Jun 17 13:14:13.163097 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Host: 10.222.0.48 Jun 17 13:14:13.163097 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Openstack-System-Scope: None Jun 17 13:14:13.163097 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: User-Agent: python-urllib3/1.26.9 Jun 17 13:14:13.163097 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Auth-Token: gAAAAABirHqEx4r7VJZS1KTqV6cW2vQccb_IRBLE2I-MwuSn21ho_K-dRWF1uVgRyQIZHeMExtI3sTUExJ-tMOhrn_AtxYX-TqPeVNt2rGozsEHhlqJigdGgQ5mahtim2VRDJVKlMxKsEEgBPPs80_ciUR1XDYL1iD86G64Sh-zsTsvnzC4-u38 Jun 17 13:14:13.163097 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Domain-Id: None Jun 17 13:14:13.163097 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Domain-Name: None Jun 17 13:14:13.163097 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Identity-Status: Confirmed Jun 17 13:14:13.163097 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Is-Admin-Project: True Jun 17 13:14:13.163097 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Project-Domain-Id: default Jun 17 13:14:13.163097 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Project-Domain-Name: Default Jun 17 13:14:13.163097 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Project-Id: 73bf442df39b4f5cbc18f571a0596f10 Jun 17 13:14:13.163097 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Project-Name: tempest-TestVolumeBootPattern-1633287944 Jun 17 13:14:13.163097 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Role: member,reader Jun 17 13:14:13.163097 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Roles: member,reader Jun 17 13:14:13.164464 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_73bf442df39b4f5cbc18f571a0596f10", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/73bf442df39b4f5cbc18f571a0596f10"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/73bf442df39b4f5cbc18f571a0596f10"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/73bf442df39b4f5cbc18f571a0596f10"}]}] Jun 17 13:14:13.164464 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Tenant: tempest-TestVolumeBootPattern-1633287944 Jun 17 13:14:13.164464 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Tenant-Id: 73bf442df39b4f5cbc18f571a0596f10 Jun 17 13:14:13.164464 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Tenant-Name: tempest-TestVolumeBootPattern-1633287944 Jun 17 13:14:13.164464 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User: tempest-TestVolumeBootPattern-1633287944-project Jun 17 13:14:13.164464 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User-Domain-Id: default Jun 17 13:14:13.164464 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User-Domain-Name: Default Jun 17 13:14:13.164464 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User-Id: 18195083037046bd99166f68690c3dce Jun 17 13:14:13.164464 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User-Name: tempest-TestVolumeBootPattern-1633287944-project Jun 17 13:14:13.164464 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: method: > Jun 17 13:14:13.164464 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: exception: Instance 72889057-861c-42f3-8629-32fff8f5dab7 could not be found. Jun 17 13:14:13.164464 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: action_args: {'id': '72889057-861c-42f3-8629-32fff8f5dab7'} Jun 17 13:14:13.165364 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 13:14:13.165364 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:14:13.165364 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 13:14:13.165364 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 13:14:13.165364 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 13:14:13.165364 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 13:14:13.165364 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 13:14:13.165364 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 13:14:13.165364 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 13:14:13.165364 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 13:14:13.165364 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 72889057-861c-42f3-8629-32fff8f5dab7 could not be found. Jun 17 13:14:13.165364 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:14:13.165364 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:14:13.165364 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:14:13.165364 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:14:13.165364 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:14:13.165364 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:14:13.165364 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 13:14:13.165364 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 13:14:13.165364 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 13:14:13.167047 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 13:14:13.167047 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 13:14:13.167047 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 13:14:13.167047 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 13:14:13.167047 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 13:14:13.167047 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 13:14:13.167047 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 13:14:13.167047 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 72889057-861c-42f3-8629-32fff8f5dab7 could not be found. Jun 17 13:14:13.167047 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:14:13.167047 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:14:13.167047 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:14:13.167047 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:14:13.167047 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:14:13.167047 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:14:13.167047 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 13:14:13.167047 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 13:14:13.167047 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 72889057-861c-42f3-8629-32fff8f5dab7 could not be found. Jun 17 13:14:13.167047 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:14:13.168352 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-58073396-c905-4c84-a3e0-af24aebf5215 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Returning 404 to user: Instance 72889057-861c-42f3-8629-32fff8f5dab7 could not be found. {{(pid=117659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 13:14:13.168352 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-58073396-c905-4c84-a3e0-af24aebf5215 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] 10.222.0.48 "GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7" status: 404 len: 111 microversion: 2.1 time: 0.028914 Jun 17 13:14:13.168352 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 401/769] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:14:13 2022] GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 13:14:13.170114 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-ef6c37c3-19d7-407b-b2c3-918e26c3f7b3 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:13.170608 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-ef6c37c3-19d7-407b-b2c3-918e26c3f7b3 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:13.176469 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ef6c37c3-19d7-407b-b2c3-918e26c3f7b3 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:13.176919 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ef6c37c3-19d7-407b-b2c3-918e26c3f7b3 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:13.177679 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ef6c37c3-19d7-407b-b2c3-918e26c3f7b3 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:13.178172 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ef6c37c3-19d7-407b-b2c3-918e26c3f7b3 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:13.241270 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.objects.instance [None req-95d356b8-727c-4f7d-935e-511c38afbcaf tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lazy-loading 'services' on Instance uuid c8fdea98-917f-4c4d-aaba-d4f5df4622d6 {{(pid=117660) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 13:14:13.285002 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.objects.instance [None req-ef6c37c3-19d7-407b-b2c3-918e26c3f7b3 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lazy-loading 'services' on Instance uuid 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 {{(pid=117659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 13:14:13.315753 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.wsgi [None req-95d356b8-727c-4f7d-935e-511c38afbcaf tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-cadf419f-42ff-4959-9b4e-cc73536d646b) Jun 17 13:14:13.317945 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-95d356b8-727c-4f7d-935e-511c38afbcaf tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Request method failure captured: Jun 17 13:14:13.317945 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: request: DELETE /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments/dc0d8f94-669d-473e-b967-103b03ff07d8 HTTP/1.1 Jun 17 13:14:13.317945 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Accept: application/json Jun 17 13:14:13.317945 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Accept-Encoding: identity Jun 17 13:14:13.317945 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Connection: close Jun 17 13:14:13.317945 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Content-Length: 0 Jun 17 13:14:13.317945 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Content-Type: application/json Jun 17 13:14:13.317945 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Host: 10.222.0.48 Jun 17 13:14:13.317945 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Openstack-System-Scope: None Jun 17 13:14:13.317945 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: User-Agent: python-urllib3/1.26.9 Jun 17 13:14:13.317945 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Auth-Token: gAAAAABirHovuSKXhsYnyM1ICQHfCBnAkcBbRuuwZgxhkoNNkDDA8V46u4bM0d1Ij3mDA-GnbWHcDVDPBrFR3gqwdKLqUjwJvDZ_b3brdODlYgnHT8j_9TL2kWiym-dIXC0QOJO96MqfgUwsdiseafc9vSwBlwUt2XH_DR7FE-ChC01iKCOrpX0 Jun 17 13:14:13.317945 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Domain-Id: None Jun 17 13:14:13.317945 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Domain-Name: None Jun 17 13:14:13.317945 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Identity-Status: Confirmed Jun 17 13:14:13.317945 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Is-Admin-Project: True Jun 17 13:14:13.317945 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Openstack-Nova-Api-Version: 2.20 Jun 17 13:14:13.317945 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Project-Domain-Id: default Jun 17 13:14:13.317945 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Project-Domain-Name: Default Jun 17 13:14:13.317945 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Project-Id: c777f8f104af4d37a3b89ff9a57d2218 Jun 17 13:14:13.317945 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1116672173 Jun 17 13:14:13.317945 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Role: member,reader Jun 17 13:14:13.317945 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Roles: member,reader Jun 17 13:14:13.319646 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c777f8f104af4d37a3b89ff9a57d2218", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c777f8f104af4d37a3b89ff9a57d2218"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c777f8f104af4d37a3b89ff9a57d2218"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c777f8f104af4d37a3b89ff9a57d2218"}]}] Jun 17 13:14:13.319646 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1116672173 Jun 17 13:14:13.319646 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Tenant-Id: c777f8f104af4d37a3b89ff9a57d2218 Jun 17 13:14:13.319646 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1116672173 Jun 17 13:14:13.319646 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-User: tempest-AttachVolumeShelveTestJSON-1116672173-project Jun 17 13:14:13.319646 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-User-Domain-Id: default Jun 17 13:14:13.319646 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-User-Domain-Name: Default Jun 17 13:14:13.319646 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-User-Id: 847c39439e874e68b72e07c311a53bec Jun 17 13:14:13.319646 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1116672173-project Jun 17 13:14:13.319646 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: method: > Jun 17 13:14:13.320717 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-cadf419f-42ff-4959-9b4e-cc73536d646b) Jun 17 13:14:13.320717 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: action_args: {'server_id': 'c8fdea98-917f-4c4d-aaba-d4f5df4622d6', 'id': 'dc0d8f94-669d-473e-b967-103b03ff07d8'} Jun 17 13:14:13.320717 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 13:14:13.320717 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:14:13.320717 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 13:14:13.320717 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 13:14:13.320717 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 13:14:13.320717 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 13:14:13.320717 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 17 13:14:13.320717 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 17 13:14:13.320717 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 17 13:14:13.320717 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 17 13:14:13.320717 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 17 13:14:13.320717 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 17 13:14:13.320717 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 17 13:14:13.320717 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 17 13:14:13.320717 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 13:14:13.322058 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 13:14:13.322058 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 13:14:13.322058 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 13:14:13.322058 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-cadf419f-42ff-4959-9b4e-cc73536d646b) Jun 17 13:14:13.322058 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 13:14:13.322058 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:14:13.322058 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 13:14:13.322058 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:14:13.322058 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jun 17 13:14:13.322058 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jun 17 13:14:13.322058 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jun 17 13:14:13.322058 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jun 17 13:14:13.322058 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 17 13:14:13.322058 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 17 13:14:13.322058 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 13:14:13.322058 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 13:14:13.322058 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 13:14:13.322058 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 13:14:13.322058 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 17 13:14:13.323630 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 17 13:14:13.323630 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 17 13:14:13.323630 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 17 13:14:13.323630 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 17 13:14:13.323630 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 17 13:14:13.323630 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 17 13:14:13.323630 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 17 13:14:13.323630 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 13:14:13.323630 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 13:14:13.323630 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 13:14:13.323630 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 13:14:13.323630 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-cadf419f-42ff-4959-9b4e-cc73536d646b) Jun 17 13:14:13.323630 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 13:14:13.323630 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:14:13.323630 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 13:14:13.323630 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:14:13.323630 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 17 13:14:13.324820 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 17 13:14:13.324820 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 17 13:14:13.324820 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 17 13:14:13.324820 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 17 13:14:13.324820 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 17 13:14:13.324820 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jun 17 13:14:13.324820 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jun 17 13:14:13.324820 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jun 17 13:14:13.324820 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 17 13:14:13.324820 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jun 17 13:14:13.324820 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jun 17 13:14:13.324820 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-cadf419f-42ff-4959-9b4e-cc73536d646b) Jun 17 13:14:13.324820 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 13:14:13.324820 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:14:13.324820 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 13:14:13.324820 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:14:13.324820 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:14:13.324820 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:14:13.326058 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 13:14:13.326058 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 13:14:13.326058 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 13:14:13.326058 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 13:14:13.326058 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jun 17 13:14:13.326058 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 17 13:14:13.326058 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-cadf419f-42ff-4959-9b4e-cc73536d646b) Jun 17 13:14:13.326058 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 13:14:13.326058 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:14:13.326058 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 13:14:13.326058 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:14:13.326058 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:14:13.326058 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:14:13.326058 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 13:14:13.326058 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 13:14:13.326058 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-cadf419f-42ff-4959-9b4e-cc73536d646b) Jun 17 13:14:13.326058 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 13:14:13.327320 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-95d356b8-727c-4f7d-935e-511c38afbcaf tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-cadf419f-42ff-4959-9b4e-cc73536d646b) {{(pid=117660) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 13:14:13.327320 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-95d356b8-727c-4f7d-935e-511c38afbcaf tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "DELETE /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments/dc0d8f94-669d-473e-b967-103b03ff07d8" status: 400 len: 269 microversion: 2.20 time: 0.172127 Jun 17 13:14:13.327320 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 369/770] 10.222.0.48 () {60 vars in 1456 bytes} [Fri Jun 17 13:14:13 2022] DELETE /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments/dc0d8f94-669d-473e-b967-103b03ff07d8 => generated 269 bytes in 173 msecs (HTTP/1.1 400) 9 headers in 383 bytes (1 switches on core 0) Jun 17 13:14:13.327689 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-012cc4ff-f077-43c3-9039-7673fa730e35 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:13.328687 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-012cc4ff-f077-43c3-9039-7673fa730e35 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:13.335350 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-012cc4ff-f077-43c3-9039-7673fa730e35 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:13.335632 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-012cc4ff-f077-43c3-9039-7673fa730e35 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:13.336524 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-012cc4ff-f077-43c3-9039-7673fa730e35 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:13.337443 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-012cc4ff-f077-43c3-9039-7673fa730e35 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:13.353612 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.wsgi [None req-ef6c37c3-19d7-407b-b2c3-918e26c3f7b3 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e6080fea-eba4-4f42-9a3f-ca57426247d4) Jun 17 13:14:13.356028 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-ef6c37c3-19d7-407b-b2c3-918e26c3f7b3 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Request method failure captured: Jun 17 13:14:13.356028 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: request: DELETE /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6/os-volume_attachments/10a44f8a-7ada-45e4-9859-29dfb17185e5 HTTP/1.1 Jun 17 13:14:13.356028 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Accept: application/json Jun 17 13:14:13.356028 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Accept-Encoding: identity Jun 17 13:14:13.356028 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Connection: close Jun 17 13:14:13.356028 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Content-Length: 0 Jun 17 13:14:13.356028 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Content-Type: application/json Jun 17 13:14:13.356028 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Host: 10.222.0.48 Jun 17 13:14:13.356028 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Openstack-System-Scope: None Jun 17 13:14:13.356028 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: User-Agent: python-urllib3/1.26.9 Jun 17 13:14:13.356028 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Auth-Token: gAAAAABirHtJLCe2LP9MRlJDle7vvcWMIS_cCFhmeW5lXWgl7DKiqidAB5tTXlYaElJ2a_UVwuEPiK1yoTFws0P3TFX2eFYka44vecr0bPBwst2ud9dcIMeb-f70G8jqnmiPJkvqd5D0pAagP8LY3L5m32ekpx4SCjzJ2BGPGVtPjt3hN_62p7g Jun 17 13:14:13.356028 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Domain-Id: None Jun 17 13:14:13.356028 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Domain-Name: None Jun 17 13:14:13.356028 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Identity-Status: Confirmed Jun 17 13:14:13.356028 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Is-Admin-Project: True Jun 17 13:14:13.356028 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Project-Domain-Id: default Jun 17 13:14:13.356028 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Project-Domain-Name: Default Jun 17 13:14:13.356028 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Project-Id: 834ac53907e54975851947e5f653c688 Jun 17 13:14:13.356028 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1799690958 Jun 17 13:14:13.356028 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Role: member,reader Jun 17 13:14:13.356028 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Roles: member,reader Jun 17 13:14:13.357665 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_834ac53907e54975851947e5f653c688", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/834ac53907e54975851947e5f653c688"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/834ac53907e54975851947e5f653c688"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/834ac53907e54975851947e5f653c688"}]}] Jun 17 13:14:13.357665 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Tenant: tempest-VolumesSnapshotTestJSON-1799690958 Jun 17 13:14:13.357665 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Tenant-Id: 834ac53907e54975851947e5f653c688 Jun 17 13:14:13.357665 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1799690958 Jun 17 13:14:13.357665 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User: tempest-VolumesSnapshotTestJSON-1799690958-project Jun 17 13:14:13.357665 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User-Domain-Id: default Jun 17 13:14:13.357665 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User-Domain-Name: Default Jun 17 13:14:13.357665 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User-Id: c6bc5146c28948c5859cd9eb3d09e0cf Jun 17 13:14:13.357665 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User-Name: tempest-VolumesSnapshotTestJSON-1799690958-project Jun 17 13:14:13.357665 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: method: > Jun 17 13:14:13.358614 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e6080fea-eba4-4f42-9a3f-ca57426247d4) Jun 17 13:14:13.358614 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: action_args: {'server_id': '0a983e3a-9451-4a00-b4f3-b6b2e5a003d6', 'id': '10a44f8a-7ada-45e4-9859-29dfb17185e5'} Jun 17 13:14:13.358614 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 13:14:13.358614 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:14:13.358614 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 13:14:13.358614 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 13:14:13.358614 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 13:14:13.358614 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 13:14:13.358614 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 17 13:14:13.358614 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 17 13:14:13.358614 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 17 13:14:13.358614 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 17 13:14:13.358614 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 17 13:14:13.358614 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 17 13:14:13.358614 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 17 13:14:13.358614 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 17 13:14:13.358614 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 13:14:13.359858 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 13:14:13.359858 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 13:14:13.359858 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 13:14:13.359858 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e6080fea-eba4-4f42-9a3f-ca57426247d4) Jun 17 13:14:13.359858 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:14:13.359858 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:14:13.359858 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:14:13.359858 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:14:13.359858 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jun 17 13:14:13.359858 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jun 17 13:14:13.359858 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jun 17 13:14:13.359858 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jun 17 13:14:13.359858 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 17 13:14:13.359858 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 17 13:14:13.359858 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 13:14:13.359858 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 13:14:13.359858 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 13:14:13.359858 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 13:14:13.359858 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 17 13:14:13.361216 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 17 13:14:13.361216 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 17 13:14:13.361216 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 17 13:14:13.361216 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 17 13:14:13.361216 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 17 13:14:13.361216 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 17 13:14:13.361216 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 17 13:14:13.361216 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 13:14:13.361216 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 13:14:13.361216 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 13:14:13.361216 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 13:14:13.361216 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e6080fea-eba4-4f42-9a3f-ca57426247d4) Jun 17 13:14:13.361216 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:14:13.361216 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:14:13.361216 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:14:13.361216 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:14:13.361216 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 17 13:14:13.362914 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 17 13:14:13.362914 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 17 13:14:13.362914 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 17 13:14:13.362914 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 17 13:14:13.362914 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 17 13:14:13.362914 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jun 17 13:14:13.362914 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jun 17 13:14:13.362914 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jun 17 13:14:13.362914 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 17 13:14:13.362914 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jun 17 13:14:13.362914 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jun 17 13:14:13.362914 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e6080fea-eba4-4f42-9a3f-ca57426247d4) Jun 17 13:14:13.362914 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:14:13.362914 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:14:13.362914 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:14:13.362914 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:14:13.362914 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:14:13.362914 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:14:13.364202 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 13:14:13.364202 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 13:14:13.364202 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 13:14:13.364202 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 13:14:13.364202 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jun 17 13:14:13.364202 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 17 13:14:13.364202 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e6080fea-eba4-4f42-9a3f-ca57426247d4) Jun 17 13:14:13.364202 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:14:13.364202 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:14:13.364202 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:14:13.364202 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:14:13.364202 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:14:13.364202 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:14:13.364202 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 13:14:13.364202 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 13:14:13.364202 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e6080fea-eba4-4f42-9a3f-ca57426247d4) Jun 17 13:14:13.364202 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:14:13.365700 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-ef6c37c3-19d7-407b-b2c3-918e26c3f7b3 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e6080fea-eba4-4f42-9a3f-ca57426247d4) {{(pid=117659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 13:14:13.365700 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-ef6c37c3-19d7-407b-b2c3-918e26c3f7b3 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "DELETE /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6/os-volume_attachments/10a44f8a-7ada-45e4-9859-29dfb17185e5" status: 400 len: 269 microversion: 2.1 time: 0.191065 Jun 17 13:14:13.365700 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 402/771] 10.222.0.48 () {58 vars in 1415 bytes} [Fri Jun 17 13:14:13 2022] DELETE /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6/os-volume_attachments/10a44f8a-7ada-45e4-9859-29dfb17185e5 => generated 269 bytes in 192 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 17 13:14:13.365700 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-2d28b84a-88bd-4481-a3bc-fa31af058633 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:13.366115 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-2d28b84a-88bd-4481-a3bc-fa31af058633 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:13.370133 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2d28b84a-88bd-4481-a3bc-fa31af058633 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:13.370587 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2d28b84a-88bd-4481-a3bc-fa31af058633 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:13.371076 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-012cc4ff-f077-43c3-9039-7673fa730e35 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049771 Jun 17 13:14:13.371366 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2d28b84a-88bd-4481-a3bc-fa31af058633 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:13.371644 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 370/772] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:13 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:13.371834 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2d28b84a-88bd-4481-a3bc-fa31af058633 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:13.376149 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-cc19d246-e882-4dfe-8dab-4c4318827beb tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:13.376745 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-cc19d246-e882-4dfe-8dab-4c4318827beb tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:13.382564 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cc19d246-e882-4dfe-8dab-4c4318827beb tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:13.383053 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cc19d246-e882-4dfe-8dab-4c4318827beb tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:13.383894 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cc19d246-e882-4dfe-8dab-4c4318827beb tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:13.384381 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cc19d246-e882-4dfe-8dab-4c4318827beb tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:13.457684 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.objects.instance [None req-2d28b84a-88bd-4481-a3bc-fa31af058633 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lazy-loading 'services' on Instance uuid 8a408151-81c8-4490-9190-5e4fa2d98e8a {{(pid=117659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 13:14:13.516506 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.wsgi [None req-2d28b84a-88bd-4481-a3bc-fa31af058633 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-8d6afac1-14bc-4d68-9434-84452706b9be) Jun 17 13:14:13.519393 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-2d28b84a-88bd-4481-a3bc-fa31af058633 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Request method failure captured: Jun 17 13:14:13.519393 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: request: DELETE /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a/os-volume_attachments/520bf7f4-5382-4c9c-81be-934670e0f29c HTTP/1.1 Jun 17 13:14:13.519393 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Accept: application/json Jun 17 13:14:13.519393 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Accept-Encoding: identity Jun 17 13:14:13.519393 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Connection: close Jun 17 13:14:13.519393 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Content-Length: 0 Jun 17 13:14:13.519393 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Content-Type: application/json Jun 17 13:14:13.519393 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Host: 10.222.0.48 Jun 17 13:14:13.519393 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Openstack-System-Scope: None Jun 17 13:14:13.519393 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: User-Agent: python-urllib3/1.26.9 Jun 17 13:14:13.519393 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Auth-Token: gAAAAABirHsRs0DVoIJTEPizfQxUzLDy-cAxnoVq8pWwVU2lDEHfxotVouYNtPnQqMCXDF_Skn8Rxq-oKMB46_vj80swmohZmWUzc-BQzgQQhfPTpXwWUX9acE_q4zXSw5Kb4Ruqe_0ls_p0iCyuchKIOqXgyPR4tZ62Zn4QfTGY95co2HqCR5s Jun 17 13:14:13.519393 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Domain-Id: None Jun 17 13:14:13.519393 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Domain-Name: None Jun 17 13:14:13.519393 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Identity-Status: Confirmed Jun 17 13:14:13.519393 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Is-Admin-Project: True Jun 17 13:14:13.519393 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Project-Domain-Id: default Jun 17 13:14:13.519393 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Project-Domain-Name: Default Jun 17 13:14:13.519393 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Project-Id: 1686ea199c5442958f97102a61ce41aa Jun 17 13:14:13.519393 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Project-Name: tempest-TestMinimumBasicScenario-1188150813 Jun 17 13:14:13.519393 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Role: member,reader Jun 17 13:14:13.519393 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Roles: member,reader Jun 17 13:14:13.520893 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_1686ea199c5442958f97102a61ce41aa", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1686ea199c5442958f97102a61ce41aa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1686ea199c5442958f97102a61ce41aa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/1686ea199c5442958f97102a61ce41aa"}]}] Jun 17 13:14:13.520893 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Tenant: tempest-TestMinimumBasicScenario-1188150813 Jun 17 13:14:13.520893 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Tenant-Id: 1686ea199c5442958f97102a61ce41aa Jun 17 13:14:13.520893 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1188150813 Jun 17 13:14:13.520893 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User: tempest-TestMinimumBasicScenario-1188150813-project Jun 17 13:14:13.520893 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User-Domain-Id: default Jun 17 13:14:13.520893 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User-Domain-Name: Default Jun 17 13:14:13.520893 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User-Id: e7a99ccc238943a098833d03c6233413 Jun 17 13:14:13.520893 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User-Name: tempest-TestMinimumBasicScenario-1188150813-project Jun 17 13:14:13.520893 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: method: > Jun 17 13:14:13.521651 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-8d6afac1-14bc-4d68-9434-84452706b9be) Jun 17 13:14:13.521651 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: action_args: {'server_id': '8a408151-81c8-4490-9190-5e4fa2d98e8a', 'id': '520bf7f4-5382-4c9c-81be-934670e0f29c'} Jun 17 13:14:13.521651 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 13:14:13.521651 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:14:13.521651 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 13:14:13.521651 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 13:14:13.521651 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 13:14:13.521651 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 13:14:13.521651 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 17 13:14:13.521651 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 17 13:14:13.521651 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 17 13:14:13.521651 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 17 13:14:13.521651 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 17 13:14:13.521651 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 17 13:14:13.521651 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 17 13:14:13.521651 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 17 13:14:13.521651 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 13:14:13.522834 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 13:14:13.522834 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 13:14:13.522834 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 13:14:13.522834 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-8d6afac1-14bc-4d68-9434-84452706b9be) Jun 17 13:14:13.522834 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:14:13.522834 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:14:13.522834 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:14:13.522834 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:14:13.522834 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jun 17 13:14:13.522834 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jun 17 13:14:13.522834 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jun 17 13:14:13.522834 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jun 17 13:14:13.522834 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 17 13:14:13.522834 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 17 13:14:13.522834 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 13:14:13.522834 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 13:14:13.522834 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 13:14:13.522834 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 13:14:13.522834 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 17 13:14:13.524003 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 17 13:14:13.524003 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 17 13:14:13.524003 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 17 13:14:13.524003 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 17 13:14:13.524003 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 17 13:14:13.524003 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 17 13:14:13.524003 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 17 13:14:13.524003 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 13:14:13.524003 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 13:14:13.524003 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 13:14:13.524003 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 13:14:13.524003 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-8d6afac1-14bc-4d68-9434-84452706b9be) Jun 17 13:14:13.524003 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:14:13.524003 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:14:13.524003 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:14:13.524003 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:14:13.524003 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 17 13:14:13.525089 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 17 13:14:13.525089 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 17 13:14:13.525089 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 17 13:14:13.525089 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 17 13:14:13.525089 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 17 13:14:13.525089 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jun 17 13:14:13.525089 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jun 17 13:14:13.525089 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jun 17 13:14:13.525089 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 17 13:14:13.525089 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jun 17 13:14:13.525089 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jun 17 13:14:13.525089 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-8d6afac1-14bc-4d68-9434-84452706b9be) Jun 17 13:14:13.525089 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:14:13.525089 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:14:13.525089 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:14:13.525089 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:14:13.525089 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:14:13.525089 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:14:13.526646 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 13:14:13.526646 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 13:14:13.526646 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 13:14:13.526646 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 13:14:13.526646 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jun 17 13:14:13.526646 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 17 13:14:13.526646 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-8d6afac1-14bc-4d68-9434-84452706b9be) Jun 17 13:14:13.526646 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:14:13.526646 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:14:13.526646 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:14:13.526646 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:14:13.526646 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:14:13.526646 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:14:13.526646 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 13:14:13.526646 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 13:14:13.526646 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-8d6afac1-14bc-4d68-9434-84452706b9be) Jun 17 13:14:13.526646 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:14:13.527818 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-2d28b84a-88bd-4481-a3bc-fa31af058633 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-8d6afac1-14bc-4d68-9434-84452706b9be) {{(pid=117659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 13:14:13.527818 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-2d28b84a-88bd-4481-a3bc-fa31af058633 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "DELETE /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a/os-volume_attachments/520bf7f4-5382-4c9c-81be-934670e0f29c" status: 400 len: 269 microversion: 2.1 time: 0.161405 Jun 17 13:14:13.527818 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 403/773] 10.222.0.48 () {58 vars in 1415 bytes} [Fri Jun 17 13:14:13 2022] DELETE /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a/os-volume_attachments/520bf7f4-5382-4c9c-81be-934670e0f29c => generated 269 bytes in 163 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 17 13:14:13.528793 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-cc19d246-e882-4dfe-8dab-4c4318827beb tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:14:13.528959 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-41bd041f-a070-4289-909d-d509391624aa tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:13.528959 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-41bd041f-a070-4289-909d-d509391624aa tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] [instance: 72889057-861c-42f3-8629-32fff8f5dab7] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:13.534142 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-cc19d246-e882-4dfe-8dab-4c4318827beb tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1729 microversion: 2.1 time: 0.161351 Jun 17 13:14:13.534737 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 371/774] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:14:13 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1729 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:14:13.534856 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-41bd041f-a070-4289-909d-d509391624aa tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:13.535244 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-41bd041f-a070-4289-909d-d509391624aa tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:13.536109 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-41bd041f-a070-4289-909d-d509391624aa tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:13.536439 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-41bd041f-a070-4289-909d-d509391624aa tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:13.539590 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-5740aaf1-34d5-4e57-b0ab-ab4a3509b1aa tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:13.540086 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-5740aaf1-34d5-4e57-b0ab-ab4a3509b1aa tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:13.546962 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5740aaf1-34d5-4e57-b0ab-ab4a3509b1aa tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:13.547403 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5740aaf1-34d5-4e57-b0ab-ab4a3509b1aa tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:13.548178 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5740aaf1-34d5-4e57-b0ab-ab4a3509b1aa tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:13.548610 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5740aaf1-34d5-4e57-b0ab-ab4a3509b1aa tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:13.550961 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.wsgi [None req-41bd041f-a070-4289-909d-d509391624aa tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] HTTP exception thrown: Instance 72889057-861c-42f3-8629-32fff8f5dab7 could not be found. Jun 17 13:14:13.552493 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-41bd041f-a070-4289-909d-d509391624aa tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Request method failure captured: Jun 17 13:14:13.552493 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: request: GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7 HTTP/1.1 Jun 17 13:14:13.552493 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Accept: application/json Jun 17 13:14:13.552493 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Accept-Encoding: identity Jun 17 13:14:13.552493 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Connection: close Jun 17 13:14:13.552493 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Content-Length: 0 Jun 17 13:14:13.552493 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Content-Type: application/json Jun 17 13:14:13.552493 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Host: 10.222.0.48 Jun 17 13:14:13.552493 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Openstack-System-Scope: None Jun 17 13:14:13.552493 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: User-Agent: python-urllib3/1.26.9 Jun 17 13:14:13.552493 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Auth-Token: gAAAAABirHqEx4r7VJZS1KTqV6cW2vQccb_IRBLE2I-MwuSn21ho_K-dRWF1uVgRyQIZHeMExtI3sTUExJ-tMOhrn_AtxYX-TqPeVNt2rGozsEHhlqJigdGgQ5mahtim2VRDJVKlMxKsEEgBPPs80_ciUR1XDYL1iD86G64Sh-zsTsvnzC4-u38 Jun 17 13:14:13.552493 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Domain-Id: None Jun 17 13:14:13.552493 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Domain-Name: None Jun 17 13:14:13.552493 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Identity-Status: Confirmed Jun 17 13:14:13.552493 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Is-Admin-Project: True Jun 17 13:14:13.552493 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Project-Domain-Id: default Jun 17 13:14:13.552493 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Project-Domain-Name: Default Jun 17 13:14:13.552493 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Project-Id: 73bf442df39b4f5cbc18f571a0596f10 Jun 17 13:14:13.552493 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Project-Name: tempest-TestVolumeBootPattern-1633287944 Jun 17 13:14:13.552493 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Role: member,reader Jun 17 13:14:13.552493 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Roles: member,reader Jun 17 13:14:13.554124 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_73bf442df39b4f5cbc18f571a0596f10", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/73bf442df39b4f5cbc18f571a0596f10"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/73bf442df39b4f5cbc18f571a0596f10"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/73bf442df39b4f5cbc18f571a0596f10"}]}] Jun 17 13:14:13.554124 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Tenant: tempest-TestVolumeBootPattern-1633287944 Jun 17 13:14:13.554124 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Tenant-Id: 73bf442df39b4f5cbc18f571a0596f10 Jun 17 13:14:13.554124 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Tenant-Name: tempest-TestVolumeBootPattern-1633287944 Jun 17 13:14:13.554124 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User: tempest-TestVolumeBootPattern-1633287944-project Jun 17 13:14:13.554124 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User-Domain-Id: default Jun 17 13:14:13.554124 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User-Domain-Name: Default Jun 17 13:14:13.554124 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User-Id: 18195083037046bd99166f68690c3dce Jun 17 13:14:13.554124 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User-Name: tempest-TestVolumeBootPattern-1633287944-project Jun 17 13:14:13.554124 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: method: > Jun 17 13:14:13.554124 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: exception: Instance 72889057-861c-42f3-8629-32fff8f5dab7 could not be found. Jun 17 13:14:13.554124 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: action_args: {'id': '72889057-861c-42f3-8629-32fff8f5dab7'} Jun 17 13:14:13.554986 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 13:14:13.554986 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:14:13.554986 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 13:14:13.554986 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 13:14:13.554986 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 13:14:13.554986 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 13:14:13.554986 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 13:14:13.554986 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 13:14:13.554986 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 13:14:13.554986 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 13:14:13.554986 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 72889057-861c-42f3-8629-32fff8f5dab7 could not be found. Jun 17 13:14:13.554986 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:14:13.554986 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:14:13.554986 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:14:13.554986 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:14:13.554986 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:14:13.554986 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:14:13.554986 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 13:14:13.554986 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 13:14:13.554986 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 13:14:13.556166 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 13:14:13.556166 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 13:14:13.556166 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 13:14:13.556166 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 13:14:13.556166 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 13:14:13.556166 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 13:14:13.556166 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 13:14:13.556166 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 72889057-861c-42f3-8629-32fff8f5dab7 could not be found. Jun 17 13:14:13.556166 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:14:13.556166 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:14:13.556166 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:14:13.556166 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:14:13.556166 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:14:13.556166 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:14:13.556166 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 13:14:13.556166 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 13:14:13.556166 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 72889057-861c-42f3-8629-32fff8f5dab7 could not be found. Jun 17 13:14:13.556166 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:14:13.557877 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-41bd041f-a070-4289-909d-d509391624aa tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Returning 404 to user: Instance 72889057-861c-42f3-8629-32fff8f5dab7 could not be found. {{(pid=117659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 13:14:13.557877 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-41bd041f-a070-4289-909d-d509391624aa tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] 10.222.0.48 "GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7" status: 404 len: 111 microversion: 2.1 time: 0.031154 Jun 17 13:14:13.557877 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 404/775] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:14:13 2022] GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 13:14:13.567556 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-c6238d2f-c15b-4554-92c7-bc54ea04d7a6 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:13.568054 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-c6238d2f-c15b-4554-92c7-bc54ea04d7a6 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:13.569199 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:14:13.574906 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c6238d2f-c15b-4554-92c7-bc54ea04d7a6 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:13.575358 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c6238d2f-c15b-4554-92c7-bc54ea04d7a6 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:13.576157 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c6238d2f-c15b-4554-92c7-bc54ea04d7a6 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:13.576787 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c6238d2f-c15b-4554-92c7-bc54ea04d7a6 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:13.600135 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_cell1:SELECT=100 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:14:13.646275 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.objects.instance [None req-5740aaf1-34d5-4e57-b0ab-ab4a3509b1aa tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lazy-loading 'services' on Instance uuid c8fdea98-917f-4c4d-aaba-d4f5df4622d6 {{(pid=117660) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 13:14:13.692413 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.objects.instance [None req-c6238d2f-c15b-4554-92c7-bc54ea04d7a6 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lazy-loading 'services' on Instance uuid 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 {{(pid=117659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 13:14:13.720239 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.wsgi [None req-5740aaf1-34d5-4e57-b0ab-ab4a3509b1aa tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-5f544612-a806-44d2-b8df-1e0b05a1c31d) Jun 17 13:14:13.722479 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-5740aaf1-34d5-4e57-b0ab-ab4a3509b1aa tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Request method failure captured: Jun 17 13:14:13.722479 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: request: DELETE /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments/dc0d8f94-669d-473e-b967-103b03ff07d8 HTTP/1.1 Jun 17 13:14:13.722479 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Accept: application/json Jun 17 13:14:13.722479 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Accept-Encoding: identity Jun 17 13:14:13.722479 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Connection: close Jun 17 13:14:13.722479 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Content-Length: 0 Jun 17 13:14:13.722479 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Content-Type: application/json Jun 17 13:14:13.722479 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Host: 10.222.0.48 Jun 17 13:14:13.722479 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Openstack-System-Scope: None Jun 17 13:14:13.722479 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: User-Agent: python-urllib3/1.26.9 Jun 17 13:14:13.722479 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Auth-Token: gAAAAABirHovuSKXhsYnyM1ICQHfCBnAkcBbRuuwZgxhkoNNkDDA8V46u4bM0d1Ij3mDA-GnbWHcDVDPBrFR3gqwdKLqUjwJvDZ_b3brdODlYgnHT8j_9TL2kWiym-dIXC0QOJO96MqfgUwsdiseafc9vSwBlwUt2XH_DR7FE-ChC01iKCOrpX0 Jun 17 13:14:13.722479 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Domain-Id: None Jun 17 13:14:13.722479 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Domain-Name: None Jun 17 13:14:13.722479 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Identity-Status: Confirmed Jun 17 13:14:13.722479 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Is-Admin-Project: True Jun 17 13:14:13.722479 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Openstack-Nova-Api-Version: 2.20 Jun 17 13:14:13.722479 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Project-Domain-Id: default Jun 17 13:14:13.722479 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Project-Domain-Name: Default Jun 17 13:14:13.722479 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Project-Id: c777f8f104af4d37a3b89ff9a57d2218 Jun 17 13:14:13.722479 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1116672173 Jun 17 13:14:13.722479 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Role: member,reader Jun 17 13:14:13.722479 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Roles: member,reader Jun 17 13:14:13.723913 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c777f8f104af4d37a3b89ff9a57d2218", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c777f8f104af4d37a3b89ff9a57d2218"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c777f8f104af4d37a3b89ff9a57d2218"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c777f8f104af4d37a3b89ff9a57d2218"}]}] Jun 17 13:14:13.723913 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1116672173 Jun 17 13:14:13.723913 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Tenant-Id: c777f8f104af4d37a3b89ff9a57d2218 Jun 17 13:14:13.723913 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1116672173 Jun 17 13:14:13.723913 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-User: tempest-AttachVolumeShelveTestJSON-1116672173-project Jun 17 13:14:13.723913 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-User-Domain-Id: default Jun 17 13:14:13.723913 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-User-Domain-Name: Default Jun 17 13:14:13.723913 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-User-Id: 847c39439e874e68b72e07c311a53bec Jun 17 13:14:13.723913 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1116672173-project Jun 17 13:14:13.723913 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: method: > Jun 17 13:14:13.724805 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-5f544612-a806-44d2-b8df-1e0b05a1c31d) Jun 17 13:14:13.724805 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: action_args: {'server_id': 'c8fdea98-917f-4c4d-aaba-d4f5df4622d6', 'id': 'dc0d8f94-669d-473e-b967-103b03ff07d8'} Jun 17 13:14:13.724805 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 13:14:13.724805 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:14:13.724805 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 13:14:13.724805 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 13:14:13.724805 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 13:14:13.724805 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 13:14:13.724805 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 17 13:14:13.724805 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 17 13:14:13.724805 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 17 13:14:13.724805 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 17 13:14:13.724805 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 17 13:14:13.724805 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 17 13:14:13.724805 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 17 13:14:13.724805 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 17 13:14:13.724805 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 13:14:13.726252 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 13:14:13.726252 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 13:14:13.726252 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 13:14:13.726252 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-5f544612-a806-44d2-b8df-1e0b05a1c31d) Jun 17 13:14:13.726252 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 13:14:13.726252 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:14:13.726252 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 13:14:13.726252 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:14:13.726252 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jun 17 13:14:13.726252 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jun 17 13:14:13.726252 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jun 17 13:14:13.726252 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jun 17 13:14:13.726252 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 17 13:14:13.726252 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 17 13:14:13.726252 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 13:14:13.726252 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 13:14:13.726252 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 13:14:13.726252 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 13:14:13.726252 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 17 13:14:13.727527 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 17 13:14:13.727527 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 17 13:14:13.727527 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 17 13:14:13.727527 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 17 13:14:13.727527 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 17 13:14:13.727527 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 17 13:14:13.727527 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 17 13:14:13.727527 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 13:14:13.727527 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 13:14:13.727527 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 13:14:13.727527 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 13:14:13.727527 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-5f544612-a806-44d2-b8df-1e0b05a1c31d) Jun 17 13:14:13.727527 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 13:14:13.727527 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:14:13.727527 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 13:14:13.727527 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:14:13.727527 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 17 13:14:13.728549 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 17 13:14:13.728549 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 17 13:14:13.728549 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 17 13:14:13.728549 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 17 13:14:13.728549 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 17 13:14:13.728549 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jun 17 13:14:13.728549 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jun 17 13:14:13.728549 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jun 17 13:14:13.728549 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 17 13:14:13.728549 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jun 17 13:14:13.728549 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jun 17 13:14:13.728549 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-5f544612-a806-44d2-b8df-1e0b05a1c31d) Jun 17 13:14:13.728549 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 13:14:13.728549 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:14:13.728549 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 13:14:13.728549 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:14:13.728549 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:14:13.728549 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:14:13.730915 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 13:14:13.730915 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 13:14:13.730915 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 13:14:13.730915 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 13:14:13.730915 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jun 17 13:14:13.730915 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 17 13:14:13.730915 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-5f544612-a806-44d2-b8df-1e0b05a1c31d) Jun 17 13:14:13.730915 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 13:14:13.730915 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:14:13.730915 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 13:14:13.730915 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:14:13.730915 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:14:13.730915 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:14:13.730915 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 13:14:13.730915 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 13:14:13.730915 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-5f544612-a806-44d2-b8df-1e0b05a1c31d) Jun 17 13:14:13.730915 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 13:14:13.732767 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-5740aaf1-34d5-4e57-b0ab-ab4a3509b1aa tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-5f544612-a806-44d2-b8df-1e0b05a1c31d) {{(pid=117660) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 13:14:13.732767 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-5740aaf1-34d5-4e57-b0ab-ab4a3509b1aa tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "DELETE /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments/dc0d8f94-669d-473e-b967-103b03ff07d8" status: 400 len: 269 microversion: 2.20 time: 0.188234 Jun 17 13:14:13.732767 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 372/776] 10.222.0.48 () {60 vars in 1456 bytes} [Fri Jun 17 13:14:13 2022] DELETE /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments/dc0d8f94-669d-473e-b967-103b03ff07d8 => generated 269 bytes in 189 msecs (HTTP/1.1 400) 9 headers in 383 bytes (1 switches on core 0) Jun 17 13:14:13.733276 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-eb94cf3c-2c23-45b7-9db9-5f6766429493 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:13.734051 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-eb94cf3c-2c23-45b7-9db9-5f6766429493 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:13.740706 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-eb94cf3c-2c23-45b7-9db9-5f6766429493 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:13.741149 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-eb94cf3c-2c23-45b7-9db9-5f6766429493 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:13.741918 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-eb94cf3c-2c23-45b7-9db9-5f6766429493 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:13.742389 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-eb94cf3c-2c23-45b7-9db9-5f6766429493 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:13.757682 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.wsgi [None req-c6238d2f-c15b-4554-92c7-bc54ea04d7a6 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-ac42d06e-3e1f-4696-aca9-61c1e7b9478f) Jun 17 13:14:13.759862 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-c6238d2f-c15b-4554-92c7-bc54ea04d7a6 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Request method failure captured: Jun 17 13:14:13.759862 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: request: DELETE /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6/os-volume_attachments/10a44f8a-7ada-45e4-9859-29dfb17185e5 HTTP/1.1 Jun 17 13:14:13.759862 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Accept: application/json Jun 17 13:14:13.759862 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Accept-Encoding: identity Jun 17 13:14:13.759862 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Connection: close Jun 17 13:14:13.759862 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Content-Length: 0 Jun 17 13:14:13.759862 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Content-Type: application/json Jun 17 13:14:13.759862 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Host: 10.222.0.48 Jun 17 13:14:13.759862 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Openstack-System-Scope: None Jun 17 13:14:13.759862 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: User-Agent: python-urllib3/1.26.9 Jun 17 13:14:13.759862 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Auth-Token: gAAAAABirHtJLCe2LP9MRlJDle7vvcWMIS_cCFhmeW5lXWgl7DKiqidAB5tTXlYaElJ2a_UVwuEPiK1yoTFws0P3TFX2eFYka44vecr0bPBwst2ud9dcIMeb-f70G8jqnmiPJkvqd5D0pAagP8LY3L5m32ekpx4SCjzJ2BGPGVtPjt3hN_62p7g Jun 17 13:14:13.759862 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Domain-Id: None Jun 17 13:14:13.759862 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Domain-Name: None Jun 17 13:14:13.759862 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Identity-Status: Confirmed Jun 17 13:14:13.759862 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Is-Admin-Project: True Jun 17 13:14:13.759862 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Project-Domain-Id: default Jun 17 13:14:13.759862 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Project-Domain-Name: Default Jun 17 13:14:13.759862 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Project-Id: 834ac53907e54975851947e5f653c688 Jun 17 13:14:13.759862 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1799690958 Jun 17 13:14:13.759862 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Role: member,reader Jun 17 13:14:13.759862 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Roles: member,reader Jun 17 13:14:13.761843 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_834ac53907e54975851947e5f653c688", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/834ac53907e54975851947e5f653c688"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/834ac53907e54975851947e5f653c688"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/834ac53907e54975851947e5f653c688"}]}] Jun 17 13:14:13.761843 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Tenant: tempest-VolumesSnapshotTestJSON-1799690958 Jun 17 13:14:13.761843 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Tenant-Id: 834ac53907e54975851947e5f653c688 Jun 17 13:14:13.761843 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1799690958 Jun 17 13:14:13.761843 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User: tempest-VolumesSnapshotTestJSON-1799690958-project Jun 17 13:14:13.761843 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User-Domain-Id: default Jun 17 13:14:13.761843 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User-Domain-Name: Default Jun 17 13:14:13.761843 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User-Id: c6bc5146c28948c5859cd9eb3d09e0cf Jun 17 13:14:13.761843 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User-Name: tempest-VolumesSnapshotTestJSON-1799690958-project Jun 17 13:14:13.761843 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: method: > Jun 17 13:14:13.763216 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-ac42d06e-3e1f-4696-aca9-61c1e7b9478f) Jun 17 13:14:13.763216 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: action_args: {'server_id': '0a983e3a-9451-4a00-b4f3-b6b2e5a003d6', 'id': '10a44f8a-7ada-45e4-9859-29dfb17185e5'} Jun 17 13:14:13.763216 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 13:14:13.763216 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:14:13.763216 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 13:14:13.763216 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 13:14:13.763216 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 13:14:13.763216 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 13:14:13.763216 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 17 13:14:13.763216 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 17 13:14:13.763216 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 17 13:14:13.763216 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 17 13:14:13.763216 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 17 13:14:13.763216 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 17 13:14:13.763216 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 17 13:14:13.763216 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 17 13:14:13.763216 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 13:14:13.765761 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 13:14:13.765761 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 13:14:13.765761 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 13:14:13.765761 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-ac42d06e-3e1f-4696-aca9-61c1e7b9478f) Jun 17 13:14:13.765761 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:14:13.765761 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:14:13.765761 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:14:13.765761 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:14:13.765761 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jun 17 13:14:13.765761 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jun 17 13:14:13.765761 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jun 17 13:14:13.765761 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jun 17 13:14:13.765761 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 17 13:14:13.765761 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 17 13:14:13.765761 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 13:14:13.765761 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 13:14:13.765761 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 13:14:13.765761 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 13:14:13.765761 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 17 13:14:13.768425 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 17 13:14:13.768425 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 17 13:14:13.768425 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 17 13:14:13.768425 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 17 13:14:13.768425 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 17 13:14:13.768425 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 17 13:14:13.768425 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 17 13:14:13.768425 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 13:14:13.768425 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 13:14:13.768425 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 13:14:13.768425 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 13:14:13.768425 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-ac42d06e-3e1f-4696-aca9-61c1e7b9478f) Jun 17 13:14:13.768425 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:14:13.768425 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:14:13.768425 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:14:13.768425 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:14:13.768425 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 17 13:14:13.770842 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 17 13:14:13.770842 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 17 13:14:13.770842 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 17 13:14:13.770842 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 17 13:14:13.770842 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 17 13:14:13.770842 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jun 17 13:14:13.770842 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jun 17 13:14:13.770842 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jun 17 13:14:13.770842 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 17 13:14:13.770842 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jun 17 13:14:13.770842 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jun 17 13:14:13.770842 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-ac42d06e-3e1f-4696-aca9-61c1e7b9478f) Jun 17 13:14:13.770842 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:14:13.770842 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:14:13.770842 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:14:13.770842 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:14:13.770842 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:14:13.770842 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:14:13.773795 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 13:14:13.773795 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 13:14:13.773795 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 13:14:13.773795 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 13:14:13.773795 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jun 17 13:14:13.773795 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 17 13:14:13.773795 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-ac42d06e-3e1f-4696-aca9-61c1e7b9478f) Jun 17 13:14:13.773795 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:14:13.773795 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:14:13.773795 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:14:13.773795 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:14:13.773795 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:14:13.773795 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:14:13.773795 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 13:14:13.773795 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 13:14:13.773795 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-ac42d06e-3e1f-4696-aca9-61c1e7b9478f) Jun 17 13:14:13.773795 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:14:13.777045 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-c6238d2f-c15b-4554-92c7-bc54ea04d7a6 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-ac42d06e-3e1f-4696-aca9-61c1e7b9478f) {{(pid=117659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 13:14:13.777045 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-c6238d2f-c15b-4554-92c7-bc54ea04d7a6 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "DELETE /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6/os-volume_attachments/10a44f8a-7ada-45e4-9859-29dfb17185e5" status: 400 len: 269 microversion: 2.1 time: 0.198020 Jun 17 13:14:13.777045 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 405/777] 10.222.0.48 () {58 vars in 1415 bytes} [Fri Jun 17 13:14:13 2022] DELETE /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6/os-volume_attachments/10a44f8a-7ada-45e4-9859-29dfb17185e5 => generated 269 bytes in 207 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 17 13:14:13.777045 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-2917ca46-4fe9-4ba2-b645-8aa69a6cf32f tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:13.777684 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-2917ca46-4fe9-4ba2-b645-8aa69a6cf32f tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:13.777684 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2917ca46-4fe9-4ba2-b645-8aa69a6cf32f tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:13.777684 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2917ca46-4fe9-4ba2-b645-8aa69a6cf32f tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:13.777684 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2917ca46-4fe9-4ba2-b645-8aa69a6cf32f tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:13.778615 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2917ca46-4fe9-4ba2-b645-8aa69a6cf32f tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:13.783092 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-eb94cf3c-2c23-45b7-9db9-5f6766429493 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057651 Jun 17 13:14:13.783771 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 373/778] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:13 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:13.791409 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-bf58b74d-17a7-4f84-904e-96989e0c3e47 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:13.792034 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-bf58b74d-17a7-4f84-904e-96989e0c3e47 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:13.798552 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bf58b74d-17a7-4f84-904e-96989e0c3e47 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:13.799000 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bf58b74d-17a7-4f84-904e-96989e0c3e47 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:13.799773 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bf58b74d-17a7-4f84-904e-96989e0c3e47 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:13.800203 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bf58b74d-17a7-4f84-904e-96989e0c3e47 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:13.873835 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.objects.instance [None req-2917ca46-4fe9-4ba2-b645-8aa69a6cf32f tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lazy-loading 'services' on Instance uuid 8a408151-81c8-4490-9190-5e4fa2d98e8a {{(pid=117659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 13:14:13.882931 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-bf58b74d-17a7-4f84-904e-96989e0c3e47 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.098026 Jun 17 13:14:13.883603 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 374/779] 10.222.0.48 () {58 vars in 1274 bytes} [Fri Jun 17 13:14:13 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-interface => generated 284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:13.888370 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-b3ad1cc9-2daa-4028-bf5d-18e822bae2aa tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-951738599", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-892142400", "security_groups": [{"name": "tempest-secgroup-smoke-831135846"}], "block_device_mapping_v2": [{"uuid": "628e9f17-0617-436f-be26-663dcef02f0b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "d80e5346-cf3e-4443-a63e-37e0e88a82d9"}]}} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:14:13.933242 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.wsgi [None req-2917ca46-4fe9-4ba2-b645-8aa69a6cf32f tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-900d9717-83e5-4e8b-bf79-c299183d9c0f) Jun 17 13:14:13.935706 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-2917ca46-4fe9-4ba2-b645-8aa69a6cf32f tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Request method failure captured: Jun 17 13:14:13.935706 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: request: DELETE /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a/os-volume_attachments/520bf7f4-5382-4c9c-81be-934670e0f29c HTTP/1.1 Jun 17 13:14:13.935706 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Accept: application/json Jun 17 13:14:13.935706 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Accept-Encoding: identity Jun 17 13:14:13.935706 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Connection: close Jun 17 13:14:13.935706 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Content-Length: 0 Jun 17 13:14:13.935706 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Content-Type: application/json Jun 17 13:14:13.935706 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Host: 10.222.0.48 Jun 17 13:14:13.935706 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Openstack-System-Scope: None Jun 17 13:14:13.935706 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: User-Agent: python-urllib3/1.26.9 Jun 17 13:14:13.935706 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Auth-Token: gAAAAABirHsRs0DVoIJTEPizfQxUzLDy-cAxnoVq8pWwVU2lDEHfxotVouYNtPnQqMCXDF_Skn8Rxq-oKMB46_vj80swmohZmWUzc-BQzgQQhfPTpXwWUX9acE_q4zXSw5Kb4Ruqe_0ls_p0iCyuchKIOqXgyPR4tZ62Zn4QfTGY95co2HqCR5s Jun 17 13:14:13.935706 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Domain-Id: None Jun 17 13:14:13.935706 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Domain-Name: None Jun 17 13:14:13.935706 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Identity-Status: Confirmed Jun 17 13:14:13.935706 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Is-Admin-Project: True Jun 17 13:14:13.935706 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Project-Domain-Id: default Jun 17 13:14:13.935706 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Project-Domain-Name: Default Jun 17 13:14:13.935706 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Project-Id: 1686ea199c5442958f97102a61ce41aa Jun 17 13:14:13.935706 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Project-Name: tempest-TestMinimumBasicScenario-1188150813 Jun 17 13:14:13.935706 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Role: member,reader Jun 17 13:14:13.935706 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Roles: member,reader Jun 17 13:14:13.937046 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_1686ea199c5442958f97102a61ce41aa", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1686ea199c5442958f97102a61ce41aa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1686ea199c5442958f97102a61ce41aa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/1686ea199c5442958f97102a61ce41aa"}]}] Jun 17 13:14:13.937046 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Tenant: tempest-TestMinimumBasicScenario-1188150813 Jun 17 13:14:13.937046 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Tenant-Id: 1686ea199c5442958f97102a61ce41aa Jun 17 13:14:13.937046 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1188150813 Jun 17 13:14:13.937046 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User: tempest-TestMinimumBasicScenario-1188150813-project Jun 17 13:14:13.937046 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User-Domain-Id: default Jun 17 13:14:13.937046 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User-Domain-Name: Default Jun 17 13:14:13.937046 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User-Id: e7a99ccc238943a098833d03c6233413 Jun 17 13:14:13.937046 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User-Name: tempest-TestMinimumBasicScenario-1188150813-project Jun 17 13:14:13.937046 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: method: > Jun 17 13:14:13.937878 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-900d9717-83e5-4e8b-bf79-c299183d9c0f) Jun 17 13:14:13.937878 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: action_args: {'server_id': '8a408151-81c8-4490-9190-5e4fa2d98e8a', 'id': '520bf7f4-5382-4c9c-81be-934670e0f29c'} Jun 17 13:14:13.937878 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 13:14:13.937878 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:14:13.937878 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 13:14:13.937878 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 13:14:13.937878 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 13:14:13.937878 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 13:14:13.937878 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 17 13:14:13.937878 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 17 13:14:13.937878 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 17 13:14:13.937878 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 17 13:14:13.937878 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 17 13:14:13.937878 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 17 13:14:13.937878 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 17 13:14:13.937878 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 17 13:14:13.937878 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 13:14:13.938951 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 13:14:13.938951 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 13:14:13.938951 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 13:14:13.938951 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-900d9717-83e5-4e8b-bf79-c299183d9c0f) Jun 17 13:14:13.938951 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:14:13.938951 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:14:13.938951 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:14:13.938951 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:14:13.938951 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jun 17 13:14:13.938951 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jun 17 13:14:13.938951 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jun 17 13:14:13.938951 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jun 17 13:14:13.938951 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 17 13:14:13.938951 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 17 13:14:13.938951 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 13:14:13.938951 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 13:14:13.938951 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 13:14:13.938951 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 13:14:13.938951 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 17 13:14:13.940087 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 17 13:14:13.940087 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 17 13:14:13.940087 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 17 13:14:13.940087 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 17 13:14:13.940087 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 17 13:14:13.940087 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 17 13:14:13.940087 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 17 13:14:13.940087 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 13:14:13.940087 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 13:14:13.940087 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 13:14:13.940087 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 13:14:13.940087 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-900d9717-83e5-4e8b-bf79-c299183d9c0f) Jun 17 13:14:13.940087 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:14:13.940087 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:14:13.940087 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:14:13.940087 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:14:13.940087 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 17 13:14:13.941110 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 17 13:14:13.941110 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 17 13:14:13.941110 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 17 13:14:13.941110 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 17 13:14:13.941110 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 17 13:14:13.941110 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jun 17 13:14:13.941110 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jun 17 13:14:13.941110 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jun 17 13:14:13.941110 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 17 13:14:13.941110 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jun 17 13:14:13.941110 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jun 17 13:14:13.941110 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-900d9717-83e5-4e8b-bf79-c299183d9c0f) Jun 17 13:14:13.941110 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:14:13.941110 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:14:13.941110 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:14:13.941110 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:14:13.941110 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:14:13.941110 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:14:13.942246 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 13:14:13.942246 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 13:14:13.942246 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 13:14:13.942246 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 13:14:13.942246 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jun 17 13:14:13.942246 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 17 13:14:13.942246 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-900d9717-83e5-4e8b-bf79-c299183d9c0f) Jun 17 13:14:13.942246 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:14:13.942246 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:14:13.942246 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:14:13.942246 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:14:13.942246 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:14:13.942246 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:14:13.942246 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 13:14:13.942246 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 13:14:13.942246 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-900d9717-83e5-4e8b-bf79-c299183d9c0f) Jun 17 13:14:13.942246 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:14:13.943603 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-2917ca46-4fe9-4ba2-b645-8aa69a6cf32f tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-900d9717-83e5-4e8b-bf79-c299183d9c0f) {{(pid=117659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 13:14:13.943603 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-2917ca46-4fe9-4ba2-b645-8aa69a6cf32f tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "DELETE /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a/os-volume_attachments/520bf7f4-5382-4c9c-81be-934670e0f29c" status: 400 len: 269 microversion: 2.1 time: 0.175064 Jun 17 13:14:13.943603 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 406/780] 10.222.0.48 () {58 vars in 1415 bytes} [Fri Jun 17 13:14:13 2022] DELETE /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a/os-volume_attachments/520bf7f4-5382-4c9c-81be-934670e0f29c => generated 269 bytes in 176 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 17 13:14:13.947272 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-bf23cfe4-cb8e-426d-b90a-2fd1a73ed212 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:13.948473 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-bf23cfe4-cb8e-426d-b90a-2fd1a73ed212 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:13.956649 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-bf23cfe4-cb8e-426d-b90a-2fd1a73ed212 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:13.957193 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-bf23cfe4-cb8e-426d-b90a-2fd1a73ed212 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:13.958198 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-bf23cfe4-cb8e-426d-b90a-2fd1a73ed212 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:13.959030 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-bf23cfe4-cb8e-426d-b90a-2fd1a73ed212 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:13.993255 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-bf23cfe4-cb8e-426d-b90a-2fd1a73ed212 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053107 Jun 17 13:14:13.993976 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 407/781] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:14:13 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:14:13.999422 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-a8feac6b-0b31-4281-a349-ab386b6089c9 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:13.999985 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-a8feac6b-0b31-4281-a349-ab386b6089c9 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:14.006308 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a8feac6b-0b31-4281-a349-ab386b6089c9 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:14.006758 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a8feac6b-0b31-4281-a349-ab386b6089c9 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:14.007523 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a8feac6b-0b31-4281-a349-ab386b6089c9 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:14.007952 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a8feac6b-0b31-4281-a349-ab386b6089c9 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:14.092449 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.objects.instance [None req-a8feac6b-0b31-4281-a349-ab386b6089c9 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lazy-loading 'services' on Instance uuid 8a408151-81c8-4490-9190-5e4fa2d98e8a {{(pid=117659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 13:14:14.095956 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.network.neutron [None req-b3ad1cc9-2daa-4028-bf5d-18e822bae2aa tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] validate_networks() for [('d80e5346-cf3e-4443-a63e-37e0e88a82d9', None, None, None, None, None)] {{(pid=117660) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 17 13:14:14.152141 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.wsgi [None req-a8feac6b-0b31-4281-a349-ab386b6089c9 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-93939d5b-be37-4ab3-b25e-cce0f946c270) Jun 17 13:14:14.154344 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-a8feac6b-0b31-4281-a349-ab386b6089c9 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Request method failure captured: Jun 17 13:14:14.154344 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: request: DELETE /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a/os-volume_attachments/520bf7f4-5382-4c9c-81be-934670e0f29c HTTP/1.1 Jun 17 13:14:14.154344 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Accept: application/json Jun 17 13:14:14.154344 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Accept-Encoding: identity Jun 17 13:14:14.154344 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Connection: close Jun 17 13:14:14.154344 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Content-Length: 0 Jun 17 13:14:14.154344 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Content-Type: application/json Jun 17 13:14:14.154344 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Host: 10.222.0.48 Jun 17 13:14:14.154344 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Openstack-System-Scope: None Jun 17 13:14:14.154344 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: User-Agent: python-urllib3/1.26.9 Jun 17 13:14:14.154344 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Auth-Token: gAAAAABirHsRs0DVoIJTEPizfQxUzLDy-cAxnoVq8pWwVU2lDEHfxotVouYNtPnQqMCXDF_Skn8Rxq-oKMB46_vj80swmohZmWUzc-BQzgQQhfPTpXwWUX9acE_q4zXSw5Kb4Ruqe_0ls_p0iCyuchKIOqXgyPR4tZ62Zn4QfTGY95co2HqCR5s Jun 17 13:14:14.154344 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Domain-Id: None Jun 17 13:14:14.154344 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Domain-Name: None Jun 17 13:14:14.154344 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Identity-Status: Confirmed Jun 17 13:14:14.154344 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Is-Admin-Project: True Jun 17 13:14:14.154344 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Project-Domain-Id: default Jun 17 13:14:14.154344 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Project-Domain-Name: Default Jun 17 13:14:14.154344 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Project-Id: 1686ea199c5442958f97102a61ce41aa Jun 17 13:14:14.154344 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Project-Name: tempest-TestMinimumBasicScenario-1188150813 Jun 17 13:14:14.154344 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Role: member,reader Jun 17 13:14:14.154344 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Roles: member,reader Jun 17 13:14:14.156103 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_1686ea199c5442958f97102a61ce41aa", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1686ea199c5442958f97102a61ce41aa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1686ea199c5442958f97102a61ce41aa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/1686ea199c5442958f97102a61ce41aa"}]}] Jun 17 13:14:14.156103 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Tenant: tempest-TestMinimumBasicScenario-1188150813 Jun 17 13:14:14.156103 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Tenant-Id: 1686ea199c5442958f97102a61ce41aa Jun 17 13:14:14.156103 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1188150813 Jun 17 13:14:14.156103 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User: tempest-TestMinimumBasicScenario-1188150813-project Jun 17 13:14:14.156103 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User-Domain-Id: default Jun 17 13:14:14.156103 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User-Domain-Name: Default Jun 17 13:14:14.156103 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User-Id: e7a99ccc238943a098833d03c6233413 Jun 17 13:14:14.156103 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User-Name: tempest-TestMinimumBasicScenario-1188150813-project Jun 17 13:14:14.156103 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: method: > Jun 17 13:14:14.156862 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-93939d5b-be37-4ab3-b25e-cce0f946c270) Jun 17 13:14:14.156862 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: action_args: {'server_id': '8a408151-81c8-4490-9190-5e4fa2d98e8a', 'id': '520bf7f4-5382-4c9c-81be-934670e0f29c'} Jun 17 13:14:14.156862 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 13:14:14.156862 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:14:14.156862 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 13:14:14.156862 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 13:14:14.156862 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 13:14:14.156862 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 13:14:14.156862 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 17 13:14:14.156862 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 17 13:14:14.156862 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 17 13:14:14.156862 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 17 13:14:14.156862 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 17 13:14:14.156862 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 17 13:14:14.156862 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 17 13:14:14.156862 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 17 13:14:14.156862 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 13:14:14.159007 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 13:14:14.159007 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 13:14:14.159007 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 13:14:14.159007 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-93939d5b-be37-4ab3-b25e-cce0f946c270) Jun 17 13:14:14.159007 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:14:14.159007 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:14:14.159007 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:14:14.159007 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:14:14.159007 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jun 17 13:14:14.159007 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jun 17 13:14:14.159007 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jun 17 13:14:14.159007 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jun 17 13:14:14.159007 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 17 13:14:14.159007 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 17 13:14:14.159007 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 13:14:14.159007 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 13:14:14.159007 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 13:14:14.159007 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 13:14:14.159007 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 17 13:14:14.160469 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 17 13:14:14.160469 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 17 13:14:14.160469 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 17 13:14:14.160469 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 17 13:14:14.160469 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 17 13:14:14.160469 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 17 13:14:14.160469 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 17 13:14:14.160469 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 13:14:14.160469 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 13:14:14.160469 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 13:14:14.160469 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 13:14:14.160469 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-93939d5b-be37-4ab3-b25e-cce0f946c270) Jun 17 13:14:14.160469 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:14:14.160469 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:14:14.160469 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:14:14.160469 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:14:14.160469 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 17 13:14:14.161704 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 17 13:14:14.161704 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 17 13:14:14.161704 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 17 13:14:14.161704 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 17 13:14:14.161704 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 17 13:14:14.161704 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jun 17 13:14:14.161704 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jun 17 13:14:14.161704 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jun 17 13:14:14.161704 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 17 13:14:14.161704 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jun 17 13:14:14.161704 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jun 17 13:14:14.161704 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-93939d5b-be37-4ab3-b25e-cce0f946c270) Jun 17 13:14:14.161704 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:14:14.161704 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:14:14.161704 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:14:14.161704 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:14:14.161704 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:14:14.161704 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:14:14.163074 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 13:14:14.163074 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 13:14:14.163074 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 13:14:14.163074 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 13:14:14.163074 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jun 17 13:14:14.163074 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 17 13:14:14.163074 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-93939d5b-be37-4ab3-b25e-cce0f946c270) Jun 17 13:14:14.163074 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:14:14.163074 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:14:14.163074 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:14:14.163074 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:14:14.163074 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:14:14.163074 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:14:14.163074 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 13:14:14.163074 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 13:14:14.163074 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-93939d5b-be37-4ab3-b25e-cce0f946c270) Jun 17 13:14:14.163074 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:14:14.164359 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-a8feac6b-0b31-4281-a349-ab386b6089c9 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-93939d5b-be37-4ab3-b25e-cce0f946c270) {{(pid=117659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 13:14:14.164359 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-a8feac6b-0b31-4281-a349-ab386b6089c9 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "DELETE /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a/os-volume_attachments/520bf7f4-5382-4c9c-81be-934670e0f29c" status: 400 len: 269 microversion: 2.1 time: 0.160858 Jun 17 13:14:14.164359 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 408/782] 10.222.0.48 () {58 vars in 1415 bytes} [Fri Jun 17 13:14:13 2022] DELETE /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a/os-volume_attachments/520bf7f4-5382-4c9c-81be-934670e0f29c => generated 269 bytes in 166 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 17 13:14:14.797176 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-018f691e-6254-4721-9d01-43081af54b23 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:14.798052 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-018f691e-6254-4721-9d01-43081af54b23 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:14.805110 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-018f691e-6254-4721-9d01-43081af54b23 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:14.805553 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-018f691e-6254-4721-9d01-43081af54b23 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:14.806492 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-018f691e-6254-4721-9d01-43081af54b23 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:14.807460 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-018f691e-6254-4721-9d01-43081af54b23 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:14.839116 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-018f691e-6254-4721-9d01-43081af54b23 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047163 Jun 17 13:14:14.842912 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 409/783] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:14 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:14.890152 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.virt.hardware [None req-b3ad1cc9-2daa-4028-bf5d-18e822bae2aa tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Flavor limits 0:0:0 {{(pid=117660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 17 13:14:14.891328 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.virt.hardware [None req-b3ad1cc9-2daa-4028-bf5d-18e822bae2aa tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Image limits 0:0:0 {{(pid=117660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 17 13:14:14.891810 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.virt.hardware [None req-b3ad1cc9-2daa-4028-bf5d-18e822bae2aa tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Flavor pref 0:0:0 {{(pid=117660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 17 13:14:14.892218 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.virt.hardware [None req-b3ad1cc9-2daa-4028-bf5d-18e822bae2aa tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Image pref 0:0:0 {{(pid=117660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 17 13:14:14.892631 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.virt.hardware [None req-b3ad1cc9-2daa-4028-bf5d-18e822bae2aa tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 17 13:14:14.902456 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b3ad1cc9-2daa-4028-bf5d-18e822bae2aa tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:14.902894 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b3ad1cc9-2daa-4028-bf5d-18e822bae2aa tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:14.903748 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b3ad1cc9-2daa-4028-bf5d-18e822bae2aa tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:14.904191 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b3ad1cc9-2daa-4028-bf5d-18e822bae2aa tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:14.922712 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.quota [None req-b3ad1cc9-2daa-4028-bf5d-18e822bae2aa tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Getting quotas for project 73bf442df39b4f5cbc18f571a0596f10. Resources: {'ram', 'cores', 'instances'} {{(pid=117660) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 13:14:14.926875 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.quota [None req-b3ad1cc9-2daa-4028-bf5d-18e822bae2aa tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Getting quotas for user 18195083037046bd99166f68690c3dce and project 73bf442df39b4f5cbc18f571a0596f10. Resources: {'ram', 'cores', 'instances'} {{(pid=117660) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 13:14:14.998915 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-b3ad1cc9-2daa-4028-bf5d-18e822bae2aa tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Going to run 1 instances... {{(pid=117660) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 17 13:14:15.001420 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-b3ad1cc9-2daa-4028-bf5d-18e822bae2aa tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] [instance: 12d1d30e-1607-4074-a589-87e51a61559d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='628e9f17-0617-436f-be26-663dcef02f0b',volume_size=None,volume_type=None)] {{(pid=117660) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 17 13:14:15.007937 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-8a81726e-0c3d-4e7e-b5cd-9a4c545a972c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:15.008902 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-8a81726e-0c3d-4e7e-b5cd-9a4c545a972c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:15.016714 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8a81726e-0c3d-4e7e-b5cd-9a4c545a972c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:15.017168 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8a81726e-0c3d-4e7e-b5cd-9a4c545a972c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:15.017940 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8a81726e-0c3d-4e7e-b5cd-9a4c545a972c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:15.018427 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8a81726e-0c3d-4e7e-b5cd-9a4c545a972c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:15.054749 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-8a81726e-0c3d-4e7e-b5cd-9a4c545a972c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053342 Jun 17 13:14:15.055311 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 410/784] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:14:15 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:14:15.083962 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.wsgi [None req-b3ad1cc9-2daa-4028-bf5d-18e822bae2aa tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Volume 628e9f17-0617-436f-be26-663dcef02f0b status must be available or downloading to reserve, but the current status is in-use. (HTTP 400) (Request-ID: req-9c208344-e8d9-4de2-9c9f-78b695c58008) Jun 17 13:14:15.096360 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-b3ad1cc9-2daa-4028-bf5d-18e822bae2aa tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Request method failure captured: Jun 17 13:14:15.096360 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 17 13:14:15.096360 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Accept: application/json Jun 17 13:14:15.096360 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Accept-Encoding: identity Jun 17 13:14:15.096360 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Connection: close Jun 17 13:14:15.096360 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Content-Length: 475 Jun 17 13:14:15.096360 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Content-Type: application/json Jun 17 13:14:15.096360 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Host: 10.222.0.48 Jun 17 13:14:15.096360 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Openstack-System-Scope: None Jun 17 13:14:15.096360 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: User-Agent: python-urllib3/1.26.9 Jun 17 13:14:15.096360 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Auth-Token: gAAAAABirHqEx4r7VJZS1KTqV6cW2vQccb_IRBLE2I-MwuSn21ho_K-dRWF1uVgRyQIZHeMExtI3sTUExJ-tMOhrn_AtxYX-TqPeVNt2rGozsEHhlqJigdGgQ5mahtim2VRDJVKlMxKsEEgBPPs80_ciUR1XDYL1iD86G64Sh-zsTsvnzC4-u38 Jun 17 13:14:15.096360 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Domain-Id: None Jun 17 13:14:15.096360 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Domain-Name: None Jun 17 13:14:15.096360 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Identity-Status: Confirmed Jun 17 13:14:15.096360 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Is-Admin-Project: True Jun 17 13:14:15.096360 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Project-Domain-Id: default Jun 17 13:14:15.096360 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Project-Domain-Name: Default Jun 17 13:14:15.096360 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Project-Id: 73bf442df39b4f5cbc18f571a0596f10 Jun 17 13:14:15.096360 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Project-Name: tempest-TestVolumeBootPattern-1633287944 Jun 17 13:14:15.096360 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Role: member,reader Jun 17 13:14:15.096360 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Roles: member,reader Jun 17 13:14:15.098060 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_73bf442df39b4f5cbc18f571a0596f10", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/73bf442df39b4f5cbc18f571a0596f10"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/73bf442df39b4f5cbc18f571a0596f10"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/73bf442df39b4f5cbc18f571a0596f10"}]}] Jun 17 13:14:15.098060 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Tenant: tempest-TestVolumeBootPattern-1633287944 Jun 17 13:14:15.098060 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Tenant-Id: 73bf442df39b4f5cbc18f571a0596f10 Jun 17 13:14:15.098060 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Tenant-Name: tempest-TestVolumeBootPattern-1633287944 Jun 17 13:14:15.098060 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-User: tempest-TestVolumeBootPattern-1633287944-project Jun 17 13:14:15.098060 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-User-Domain-Id: default Jun 17 13:14:15.098060 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-User-Domain-Name: Default Jun 17 13:14:15.098060 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-User-Id: 18195083037046bd99166f68690c3dce Jun 17 13:14:15.098060 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-User-Name: tempest-TestVolumeBootPattern-1633287944-project Jun 17 13:14:15.098060 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Jun 17 13:14:15.098853 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: {"server": {"name": "tempest-TestVolumeBootPattern-server-951738599", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-892142400", "security_groups": [{"name": "tempest-secgroup-smoke-831135846"}], "block_device_mapping_v2": [{"uuid": "628e9f17-0617-436f-be26-663dcef02f0b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "d80e5346-cf3e-4443-a63e-37e0e88a82d9"}]}} Jun 17 13:14:15.098853 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: method: > Jun 17 13:14:15.098853 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: exception: Invalid volume: Invalid input received: Invalid volume: Volume 628e9f17-0617-436f-be26-663dcef02f0b status must be available or downloading to reserve, but the current status is in-use. (HTTP 400) (Request-ID: req-9c208344-e8d9-4de2-9c9f-78b695c58008) Jun 17 13:14:15.098853 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: action_args: {'body': {'server': {'name': 'tempest-TestVolumeBootPattern-server-951738599', 'imageRef': '', 'flavorRef': '452', 'key_name': 'tempest-TestVolumeBootPattern-892142400', 'security_groups': [{'name': 'tempest-secgroup-smoke-831135846'}], 'block_device_mapping_v2': [{'source_type': 'volume', 'destination_type': 'volume', 'boot_index': 0, 'delete_on_termination': False, 'volume_id': '628e9f17-0617-436f-be26-663dcef02f0b'}], 'networks': [{'uuid': 'd80e5346-cf3e-4443-a63e-37e0e88a82d9'}]}}} Jun 17 13:14:15.098853 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 13:14:15.098853 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:14:15.098853 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 13:14:15.098853 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 13:14:15.098853 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 13:14:15.098853 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 13:14:15.099499 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 808, in attachment_create Jun 17 13:14:15.099499 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi LOG.error('Create attachment failed for volume ' Jun 17 13:14:15.099499 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 17 13:14:15.099499 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 17 13:14:15.099499 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 17 13:14:15.099499 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise self.value Jun 17 13:14:15.099499 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 800, in attachment_create Jun 17 13:14:15.099499 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi attachment_ref = cinderclient(context, '3.44').attachments.create( Jun 17 13:14:15.099499 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/api_versions.py", line 421, in substitution Jun 17 13:14:15.099499 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return method.func(obj, *args, **kwargs) Jun 17 13:14:15.099499 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/attachments.py", line 39, in create Jun 17 13:14:15.099499 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi retval = self._create('/attachments', body, 'attachment') Jun 17 13:14:15.099499 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 306, in _create Jun 17 13:14:15.099499 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 17 13:14:15.099499 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 17 13:14:15.099499 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 17 13:14:15.099499 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 13:14:15.099499 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 13:14:15.100622 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 13:14:15.100622 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 13:14:15.100622 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Volume 628e9f17-0617-436f-be26-663dcef02f0b status must be available or downloading to reserve, but the current status is in-use. (HTTP 400) (Request-ID: req-9c208344-e8d9-4de2-9c9f-78b695c58008) Jun 17 13:14:15.100622 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 13:14:15.100622 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:14:15.100622 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 13:14:15.100622 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:14:15.100622 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1914, in _validate_bdm Jun 17 13:14:15.100622 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi self._check_attach_and_reserve_volume( Jun 17 13:14:15.100622 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4858, in _check_attach_and_reserve_volume Jun 17 13:14:15.100622 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi attachment_id = self.volume_api.attachment_create( Jun 17 13:14:15.100622 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jun 17 13:14:15.100622 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jun 17 13:14:15.100622 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 17 13:14:15.100622 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 17 13:14:15.100622 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 13:14:15.100622 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 13:14:15.100622 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 13:14:15.101685 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 13:14:15.101685 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 808, in attachment_create Jun 17 13:14:15.101685 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi LOG.error('Create attachment failed for volume ' Jun 17 13:14:15.101685 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 17 13:14:15.101685 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 17 13:14:15.101685 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 17 13:14:15.101685 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise self.value Jun 17 13:14:15.101685 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 800, in attachment_create Jun 17 13:14:15.101685 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi attachment_ref = cinderclient(context, '3.44').attachments.create( Jun 17 13:14:15.101685 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/api_versions.py", line 421, in substitution Jun 17 13:14:15.101685 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return method.func(obj, *args, **kwargs) Jun 17 13:14:15.101685 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/attachments.py", line 39, in create Jun 17 13:14:15.101685 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi retval = self._create('/attachments', body, 'attachment') Jun 17 13:14:15.101685 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 306, in _create Jun 17 13:14:15.101685 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 17 13:14:15.101685 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 17 13:14:15.101685 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 17 13:14:15.101685 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 13:14:15.102816 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 13:14:15.102816 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 13:14:15.102816 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 13:14:15.102816 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Volume 628e9f17-0617-436f-be26-663dcef02f0b status must be available or downloading to reserve, but the current status is in-use. (HTTP 400) (Request-ID: req-9c208344-e8d9-4de2-9c9f-78b695c58008) Jun 17 13:14:15.102816 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 13:14:15.102816 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:14:15.102816 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 13:14:15.102816 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:14:15.102816 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jun 17 13:14:15.102816 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jun 17 13:14:15.102816 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jun 17 13:14:15.102816 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return self._create_instance( Jun 17 13:14:15.102816 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1676, in _create_instance Jun 17 13:14:15.102816 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Jun 17 13:14:15.102816 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1536, in _provision_instances Jun 17 13:14:15.102816 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi self._cleanup_build_artifacts(None, instances_to_build) Jun 17 13:14:15.102816 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 17 13:14:15.102816 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 17 13:14:15.104722 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 17 13:14:15.104722 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise self.value Jun 17 13:14:15.104722 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1446, in _provision_instances Jun 17 13:14:15.104722 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi self._bdm_validate_set_size_and_instance(context, Jun 17 13:14:15.104722 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1809, in _bdm_validate_set_size_and_instance Jun 17 13:14:15.104722 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi self._validate_bdm( Jun 17 13:14:15.104722 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1923, in _validate_bdm Jun 17 13:14:15.104722 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jun 17 13:14:15.104722 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Volume 628e9f17-0617-436f-be26-663dcef02f0b status must be available or downloading to reserve, but the current status is in-use. (HTTP 400) (Request-ID: req-9c208344-e8d9-4de2-9c9f-78b695c58008) Jun 17 13:14:15.104722 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 13:14:15.104722 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:14:15.104722 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 13:14:15.104722 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:14:15.104722 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:14:15.104722 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:14:15.104722 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 13:14:15.104722 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 13:14:15.104722 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 13:14:15.105865 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 13:14:15.105865 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 17 13:14:15.105865 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 17 13:14:15.105865 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 17 13:14:15.105865 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 17 13:14:15.105865 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 17 13:14:15.105865 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 17 13:14:15.105865 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jun 17 13:14:15.105865 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Jun 17 13:14:15.105865 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Jun 17 13:14:15.105865 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Volume 628e9f17-0617-436f-be26-663dcef02f0b status must be available or downloading to reserve, but the current status is in-use. (HTTP 400) (Request-ID: req-9c208344-e8d9-4de2-9c9f-78b695c58008) Jun 17 13:14:15.105865 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 13:14:15.105865 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:14:15.105865 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 13:14:15.105865 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:14:15.105865 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:14:15.105865 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:14:15.105865 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 13:14:15.105865 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 13:14:15.107782 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Volume 628e9f17-0617-436f-be26-663dcef02f0b status must be available or downloading to reserve, but the current status is in-use. (HTTP 400) (Request-ID: req-9c208344-e8d9-4de2-9c9f-78b695c58008) Jun 17 13:14:15.107782 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 13:14:15.107782 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-b3ad1cc9-2daa-4028-bf5d-18e822bae2aa tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Volume 628e9f17-0617-436f-be26-663dcef02f0b status must be available or downloading to reserve, but the current status is in-use. (HTTP 400) (Request-ID: req-9c208344-e8d9-4de2-9c9f-78b695c58008) {{(pid=117660) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 13:14:15.107782 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-b3ad1cc9-2daa-4028-bf5d-18e822bae2aa tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 400 len: 295 microversion: 2.1 time: 1.213295 Jun 17 13:14:15.107782 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 375/785] 10.222.0.48 () {60 vars in 1146 bytes} [Fri Jun 17 13:14:13 2022] POST /compute/v2.1/servers => generated 295 bytes in 1215 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 17 13:14:15.496598 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [req-a76f8c35-f97b-4d52-86e1-bf5781113ea6 req-1291a5c2-6717-4208-a17d-cc06e8a57642 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29d26a8a-a734-4531-b9ee-04506c852fe2", "tag": "4ae50ebd-a268-4596-8c67-1e7de84bfb9e"}]} {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:14:15.505194 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [req-a76f8c35-f97b-4d52-86e1-bf5781113ea6 req-1291a5c2-6717-4208-a17d-cc06e8a57642 service nova] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:15.505650 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [req-a76f8c35-f97b-4d52-86e1-bf5781113ea6 req-1291a5c2-6717-4208-a17d-cc06e8a57642 service nova] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:15.517936 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.compute.server_external_events [req-a76f8c35-f97b-4d52-86e1-bf5781113ea6 req-1291a5c2-6717-4208-a17d-cc06e8a57642 service nova] Creating event network-changed:4ae50ebd-a268-4596-8c67-1e7de84bfb9e for instance 29d26a8a-a734-4531-b9ee-04506c852fe2 on hv-cinder-83754 Jun 17 13:14:15.521713 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR oslo.messaging._drivers.impl_rabbit [req-a76f8c35-f97b-4d52-86e1-bf5781113ea6 req-1291a5c2-6717-4208-a17d-cc06e8a57642 service nova] [54b5a2bb-8f74-4d96-a68a-b3b4ae55fb33] AMQP server on 10.222.0.48:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 17 13:14:15.755042 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-888e893d-7659-4971-bfa1-93853c92f955 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:15.755765 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-888e893d-7659-4971-bfa1-93853c92f955 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:15.764662 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-888e893d-7659-4971-bfa1-93853c92f955 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:15.765548 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-888e893d-7659-4971-bfa1-93853c92f955 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:15.766591 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-888e893d-7659-4971-bfa1-93853c92f955 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:15.767179 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-888e893d-7659-4971-bfa1-93853c92f955 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:15.863421 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.objects.instance [None req-888e893d-7659-4971-bfa1-93853c92f955 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lazy-loading 'services' on Instance uuid 29d26a8a-a734-4531-b9ee-04506c852fe2 {{(pid=117660) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 13:14:15.944465 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-888e893d-7659-4971-bfa1-93853c92f955 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "DELETE /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments/b470fcd5-08d3-4611-a67d-1260c71b9b10" status: 202 len: 0 microversion: 2.1 time: 0.202779 Jun 17 13:14:15.945194 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 376/786] 10.222.0.48 () {58 vars in 1415 bytes} [Fri Jun 17 13:14:15 2022] DELETE /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments/b470fcd5-08d3-4611-a67d-1260c71b9b10 => generated 0 bytes in 204 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 13:14:15.951915 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-3f75bcb3-a766-4367-9405-d9f7932b93b5 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:15.954022 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-3f75bcb3-a766-4367-9405-d9f7932b93b5 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:15.961634 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3f75bcb3-a766-4367-9405-d9f7932b93b5 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:15.963097 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3f75bcb3-a766-4367-9405-d9f7932b93b5 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:15.964392 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3f75bcb3-a766-4367-9405-d9f7932b93b5 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:15.965063 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3f75bcb3-a766-4367-9405-d9f7932b93b5 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:16.002488 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-3f75bcb3-a766-4367-9405-d9f7932b93b5 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055706 Jun 17 13:14:16.003273 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 377/787] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:15 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:16.007495 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-29334b31-da71-4fd5-997f-5acfa4c4f161 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:16.007982 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-29334b31-da71-4fd5-997f-5acfa4c4f161 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] [instance: 72889057-861c-42f3-8629-32fff8f5dab7] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:16.018901 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-29334b31-da71-4fd5-997f-5acfa4c4f161 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:16.019345 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-29334b31-da71-4fd5-997f-5acfa4c4f161 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:16.020123 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-29334b31-da71-4fd5-997f-5acfa4c4f161 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:16.020550 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-29334b31-da71-4fd5-997f-5acfa4c4f161 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:16.036196 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.wsgi [None req-29334b31-da71-4fd5-997f-5acfa4c4f161 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] HTTP exception thrown: Instance 72889057-861c-42f3-8629-32fff8f5dab7 could not be found. Jun 17 13:14:16.037815 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-29334b31-da71-4fd5-997f-5acfa4c4f161 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Request method failure captured: Jun 17 13:14:16.037815 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: request: DELETE /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7 HTTP/1.1 Jun 17 13:14:16.037815 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Accept: application/json Jun 17 13:14:16.037815 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Accept-Encoding: identity Jun 17 13:14:16.037815 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Connection: close Jun 17 13:14:16.037815 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Content-Length: 0 Jun 17 13:14:16.037815 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Content-Type: application/json Jun 17 13:14:16.037815 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Host: 10.222.0.48 Jun 17 13:14:16.037815 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Openstack-System-Scope: None Jun 17 13:14:16.037815 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: User-Agent: python-urllib3/1.26.9 Jun 17 13:14:16.037815 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Auth-Token: gAAAAABirHqEx4r7VJZS1KTqV6cW2vQccb_IRBLE2I-MwuSn21ho_K-dRWF1uVgRyQIZHeMExtI3sTUExJ-tMOhrn_AtxYX-TqPeVNt2rGozsEHhlqJigdGgQ5mahtim2VRDJVKlMxKsEEgBPPs80_ciUR1XDYL1iD86G64Sh-zsTsvnzC4-u38 Jun 17 13:14:16.037815 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Domain-Id: None Jun 17 13:14:16.037815 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Domain-Name: None Jun 17 13:14:16.037815 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Identity-Status: Confirmed Jun 17 13:14:16.037815 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Is-Admin-Project: True Jun 17 13:14:16.037815 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Project-Domain-Id: default Jun 17 13:14:16.037815 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Project-Domain-Name: Default Jun 17 13:14:16.037815 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Project-Id: 73bf442df39b4f5cbc18f571a0596f10 Jun 17 13:14:16.037815 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Project-Name: tempest-TestVolumeBootPattern-1633287944 Jun 17 13:14:16.037815 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Role: member,reader Jun 17 13:14:16.037815 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Roles: member,reader Jun 17 13:14:16.039416 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_73bf442df39b4f5cbc18f571a0596f10", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/73bf442df39b4f5cbc18f571a0596f10"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/73bf442df39b4f5cbc18f571a0596f10"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/73bf442df39b4f5cbc18f571a0596f10"}]}] Jun 17 13:14:16.039416 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Tenant: tempest-TestVolumeBootPattern-1633287944 Jun 17 13:14:16.039416 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Tenant-Id: 73bf442df39b4f5cbc18f571a0596f10 Jun 17 13:14:16.039416 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Tenant-Name: tempest-TestVolumeBootPattern-1633287944 Jun 17 13:14:16.039416 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-User: tempest-TestVolumeBootPattern-1633287944-project Jun 17 13:14:16.039416 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-User-Domain-Id: default Jun 17 13:14:16.039416 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-User-Domain-Name: Default Jun 17 13:14:16.039416 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-User-Id: 18195083037046bd99166f68690c3dce Jun 17 13:14:16.039416 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-User-Name: tempest-TestVolumeBootPattern-1633287944-project Jun 17 13:14:16.039416 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: method: > Jun 17 13:14:16.039416 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: exception: Instance 72889057-861c-42f3-8629-32fff8f5dab7 could not be found. Jun 17 13:14:16.039416 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: action_args: {'id': '72889057-861c-42f3-8629-32fff8f5dab7'} Jun 17 13:14:16.040237 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 13:14:16.040237 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:14:16.040237 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 13:14:16.040237 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 13:14:16.040237 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 13:14:16.040237 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 13:14:16.040237 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 13:14:16.040237 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 13:14:16.040237 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 13:14:16.040237 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 13:14:16.040237 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 72889057-861c-42f3-8629-32fff8f5dab7 could not be found. Jun 17 13:14:16.040237 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 13:14:16.040237 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:14:16.040237 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 13:14:16.040237 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:14:16.040237 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:14:16.040237 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:14:16.040237 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 13:14:16.040237 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 13:14:16.040237 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 13:14:16.042209 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 13:14:16.042209 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 17 13:14:16.042209 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 17 13:14:16.042209 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 17 13:14:16.042209 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 17 13:14:16.042209 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 13:14:16.042209 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 13:14:16.042209 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 13:14:16.042209 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 13:14:16.042209 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 72889057-861c-42f3-8629-32fff8f5dab7 could not be found. Jun 17 13:14:16.042209 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 13:14:16.042209 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:14:16.042209 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 13:14:16.042209 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:14:16.042209 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:14:16.042209 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:14:16.042209 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 13:14:16.042209 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 13:14:16.042209 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 72889057-861c-42f3-8629-32fff8f5dab7 could not be found. Jun 17 13:14:16.042209 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 13:14:16.044897 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-29334b31-da71-4fd5-997f-5acfa4c4f161 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Returning 404 to user: Instance 72889057-861c-42f3-8629-32fff8f5dab7 could not be found. {{(pid=117660) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 13:14:16.044897 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-29334b31-da71-4fd5-997f-5acfa4c4f161 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] 10.222.0.48 "DELETE /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7" status: 404 len: 111 microversion: 2.1 time: 0.035186 Jun 17 13:14:16.044897 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 378/788] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Jun 17 13:14:16 2022] DELETE /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 13:14:16.044897 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-2de9e603-1123-4e02-97a6-789bbdda49c8 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:16.045902 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-2de9e603-1123-4e02-97a6-789bbdda49c8 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:16.051830 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2de9e603-1123-4e02-97a6-789bbdda49c8 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:16.052283 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2de9e603-1123-4e02-97a6-789bbdda49c8 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:16.053047 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2de9e603-1123-4e02-97a6-789bbdda49c8 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:16.053481 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2de9e603-1123-4e02-97a6-789bbdda49c8 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:16.085970 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-2de9e603-1123-4e02-97a6-789bbdda49c8 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045200 Jun 17 13:14:16.086755 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 379/789] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:16 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:16.091728 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-46610a0f-dbdd-465d-9f09-3f108f8d5ca9 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:16.092310 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-46610a0f-dbdd-465d-9f09-3f108f8d5ca9 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] [instance: 72889057-861c-42f3-8629-32fff8f5dab7] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:16.098826 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-46610a0f-dbdd-465d-9f09-3f108f8d5ca9 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:16.099257 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-46610a0f-dbdd-465d-9f09-3f108f8d5ca9 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:16.100040 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-46610a0f-dbdd-465d-9f09-3f108f8d5ca9 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:16.100465 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-46610a0f-dbdd-465d-9f09-3f108f8d5ca9 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:16.114605 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.wsgi [None req-46610a0f-dbdd-465d-9f09-3f108f8d5ca9 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] HTTP exception thrown: Instance 72889057-861c-42f3-8629-32fff8f5dab7 could not be found. Jun 17 13:14:16.116133 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-46610a0f-dbdd-465d-9f09-3f108f8d5ca9 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Request method failure captured: Jun 17 13:14:16.116133 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: request: GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7 HTTP/1.1 Jun 17 13:14:16.116133 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Accept: application/json Jun 17 13:14:16.116133 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Accept-Encoding: identity Jun 17 13:14:16.116133 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Connection: close Jun 17 13:14:16.116133 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Content-Length: 0 Jun 17 13:14:16.116133 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Content-Type: application/json Jun 17 13:14:16.116133 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Host: 10.222.0.48 Jun 17 13:14:16.116133 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Openstack-System-Scope: None Jun 17 13:14:16.116133 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: User-Agent: python-urllib3/1.26.9 Jun 17 13:14:16.116133 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Auth-Token: gAAAAABirHqEx4r7VJZS1KTqV6cW2vQccb_IRBLE2I-MwuSn21ho_K-dRWF1uVgRyQIZHeMExtI3sTUExJ-tMOhrn_AtxYX-TqPeVNt2rGozsEHhlqJigdGgQ5mahtim2VRDJVKlMxKsEEgBPPs80_ciUR1XDYL1iD86G64Sh-zsTsvnzC4-u38 Jun 17 13:14:16.116133 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Domain-Id: None Jun 17 13:14:16.116133 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Domain-Name: None Jun 17 13:14:16.116133 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Identity-Status: Confirmed Jun 17 13:14:16.116133 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Is-Admin-Project: True Jun 17 13:14:16.116133 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Project-Domain-Id: default Jun 17 13:14:16.116133 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Project-Domain-Name: Default Jun 17 13:14:16.116133 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Project-Id: 73bf442df39b4f5cbc18f571a0596f10 Jun 17 13:14:16.116133 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Project-Name: tempest-TestVolumeBootPattern-1633287944 Jun 17 13:14:16.116133 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Role: member,reader Jun 17 13:14:16.116133 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Roles: member,reader Jun 17 13:14:16.117690 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_73bf442df39b4f5cbc18f571a0596f10", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/73bf442df39b4f5cbc18f571a0596f10"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/73bf442df39b4f5cbc18f571a0596f10"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/73bf442df39b4f5cbc18f571a0596f10"}]}] Jun 17 13:14:16.117690 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Tenant: tempest-TestVolumeBootPattern-1633287944 Jun 17 13:14:16.117690 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Tenant-Id: 73bf442df39b4f5cbc18f571a0596f10 Jun 17 13:14:16.117690 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Tenant-Name: tempest-TestVolumeBootPattern-1633287944 Jun 17 13:14:16.117690 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-User: tempest-TestVolumeBootPattern-1633287944-project Jun 17 13:14:16.117690 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-User-Domain-Id: default Jun 17 13:14:16.117690 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-User-Domain-Name: Default Jun 17 13:14:16.117690 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-User-Id: 18195083037046bd99166f68690c3dce Jun 17 13:14:16.117690 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-User-Name: tempest-TestVolumeBootPattern-1633287944-project Jun 17 13:14:16.117690 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: method: > Jun 17 13:14:16.117690 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: exception: Instance 72889057-861c-42f3-8629-32fff8f5dab7 could not be found. Jun 17 13:14:16.117690 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: action_args: {'id': '72889057-861c-42f3-8629-32fff8f5dab7'} Jun 17 13:14:16.118815 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 13:14:16.118815 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:14:16.118815 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 13:14:16.118815 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 13:14:16.118815 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 13:14:16.118815 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 13:14:16.118815 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 13:14:16.118815 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 13:14:16.118815 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 13:14:16.118815 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 13:14:16.118815 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 72889057-861c-42f3-8629-32fff8f5dab7 could not be found. Jun 17 13:14:16.118815 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 13:14:16.118815 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:14:16.118815 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 13:14:16.118815 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:14:16.118815 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:14:16.118815 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:14:16.118815 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 13:14:16.118815 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 13:14:16.118815 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 13:14:16.120282 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 13:14:16.120282 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 13:14:16.120282 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 13:14:16.120282 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 13:14:16.120282 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 13:14:16.120282 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 13:14:16.120282 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 13:14:16.120282 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 72889057-861c-42f3-8629-32fff8f5dab7 could not be found. Jun 17 13:14:16.120282 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 13:14:16.120282 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:14:16.120282 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 13:14:16.120282 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:14:16.120282 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:14:16.120282 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:14:16.120282 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 13:14:16.120282 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 13:14:16.120282 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 72889057-861c-42f3-8629-32fff8f5dab7 could not be found. Jun 17 13:14:16.120282 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 13:14:16.121472 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-46610a0f-dbdd-465d-9f09-3f108f8d5ca9 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Returning 404 to user: Instance 72889057-861c-42f3-8629-32fff8f5dab7 could not be found. {{(pid=117660) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 13:14:16.121472 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-46610a0f-dbdd-465d-9f09-3f108f8d5ca9 tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] 10.222.0.48 "GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7" status: 404 len: 111 microversion: 2.1 time: 0.029727 Jun 17 13:14:16.121472 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 380/790] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:14:16 2022] GET /compute/v2.1/servers/72889057-861c-42f3-8629-32fff8f5dab7 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 13:14:16.128347 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-dcedab77-743b-476d-813a-91a920d9e9bc tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:16.129216 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-dcedab77-743b-476d-813a-91a920d9e9bc tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:16.135945 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dcedab77-743b-476d-813a-91a920d9e9bc tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:16.136385 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dcedab77-743b-476d-813a-91a920d9e9bc tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:16.137156 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dcedab77-743b-476d-813a-91a920d9e9bc tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:16.137945 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dcedab77-743b-476d-813a-91a920d9e9bc tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:16.173593 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-dcedab77-743b-476d-813a-91a920d9e9bc tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054235 Jun 17 13:14:16.174333 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 381/791] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:14:16 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:14:16.529902 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO oslo.messaging._drivers.impl_rabbit [req-a76f8c35-f97b-4d52-86e1-bf5781113ea6 req-1291a5c2-6717-4208-a17d-cc06e8a57642 service nova] [54b5a2bb-8f74-4d96-a68a-b3b4ae55fb33] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 33788. Jun 17 13:14:16.533748 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [req-a76f8c35-f97b-4d52-86e1-bf5781113ea6 req-1291a5c2-6717-4208-a17d-cc06e8a57642 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.110497 Jun 17 13:14:16.534429 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 411/792] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 13:14:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:17.015515 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-794a89e8-4a7f-4c73-8665-2df977a9511d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:17.017075 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-794a89e8-4a7f-4c73-8665-2df977a9511d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:17.023888 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-794a89e8-4a7f-4c73-8665-2df977a9511d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:17.024327 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-794a89e8-4a7f-4c73-8665-2df977a9511d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:17.025272 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-794a89e8-4a7f-4c73-8665-2df977a9511d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:17.025684 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-794a89e8-4a7f-4c73-8665-2df977a9511d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:17.055901 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-794a89e8-4a7f-4c73-8665-2df977a9511d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045062 Jun 17 13:14:17.056445 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 382/793] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:17 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:17.099564 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-9fda2dd8-553e-4db5-9fad-2b22ce1e8429 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:17.101128 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-9fda2dd8-553e-4db5-9fad-2b22ce1e8429 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:17.108241 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9fda2dd8-553e-4db5-9fad-2b22ce1e8429 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:17.108682 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9fda2dd8-553e-4db5-9fad-2b22ce1e8429 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:17.109449 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9fda2dd8-553e-4db5-9fad-2b22ce1e8429 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:17.109877 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9fda2dd8-553e-4db5-9fad-2b22ce1e8429 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:17.140779 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-9fda2dd8-553e-4db5-9fad-2b22ce1e8429 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045897 Jun 17 13:14:17.141240 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 412/794] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:17 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:17.185416 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-03be1ed0-e9e5-472b-9e4a-3ef4d6e51c4e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:17.186387 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-03be1ed0-e9e5-472b-9e4a-3ef4d6e51c4e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:17.192639 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-03be1ed0-e9e5-472b-9e4a-3ef4d6e51c4e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:17.193129 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-03be1ed0-e9e5-472b-9e4a-3ef4d6e51c4e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:17.193960 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-03be1ed0-e9e5-472b-9e4a-3ef4d6e51c4e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:17.194433 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-03be1ed0-e9e5-472b-9e4a-3ef4d6e51c4e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:17.224173 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-03be1ed0-e9e5-472b-9e4a-3ef4d6e51c4e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043029 Jun 17 13:14:17.224711 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 383/795] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:14:17 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:14:18.068291 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-73a6871c-5295-415b-b126-70f373a76d37 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:18.069207 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-73a6871c-5295-415b-b126-70f373a76d37 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:18.076230 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-73a6871c-5295-415b-b126-70f373a76d37 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:18.076679 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-73a6871c-5295-415b-b126-70f373a76d37 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:18.078027 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-73a6871c-5295-415b-b126-70f373a76d37 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:18.078027 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-73a6871c-5295-415b-b126-70f373a76d37 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:18.116959 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-73a6871c-5295-415b-b126-70f373a76d37 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052810 Jun 17 13:14:18.117527 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 413/796] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:18 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:18.152999 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-587ba48f-7ec6-4310-9493-bf5d93b78e34 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:18.153923 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-587ba48f-7ec6-4310-9493-bf5d93b78e34 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:18.160719 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-587ba48f-7ec6-4310-9493-bf5d93b78e34 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:18.161165 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-587ba48f-7ec6-4310-9493-bf5d93b78e34 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:18.161932 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-587ba48f-7ec6-4310-9493-bf5d93b78e34 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:18.162398 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-587ba48f-7ec6-4310-9493-bf5d93b78e34 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:18.192471 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-587ba48f-7ec6-4310-9493-bf5d93b78e34 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043743 Jun 17 13:14:18.193045 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 384/797] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:18 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:18.239069 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-bdeff4b4-bbaf-4dfa-946f-003b9314e360 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:18.240407 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-bdeff4b4-bbaf-4dfa-946f-003b9314e360 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:18.248097 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-bdeff4b4-bbaf-4dfa-946f-003b9314e360 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:18.248554 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-bdeff4b4-bbaf-4dfa-946f-003b9314e360 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:18.249286 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-bdeff4b4-bbaf-4dfa-946f-003b9314e360 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:18.249715 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-bdeff4b4-bbaf-4dfa-946f-003b9314e360 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:18.279670 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-bdeff4b4-bbaf-4dfa-946f-003b9314e360 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047033 Jun 17 13:14:18.280192 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 414/798] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:14:18 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:14:18.548519 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [req-46946d66-65c3-47b4-8504-84c1c57e71e5 req-5b2a4c7d-2551-49a5-936a-fbe758fb248a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29d26a8a-a734-4531-b9ee-04506c852fe2", "tag": "4ae50ebd-a268-4596-8c67-1e7de84bfb9e"}]} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:14:18.556947 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-46946d66-65c3-47b4-8504-84c1c57e71e5 req-5b2a4c7d-2551-49a5-936a-fbe758fb248a service nova] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:18.557381 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-46946d66-65c3-47b4-8504-84c1c57e71e5 req-5b2a4c7d-2551-49a5-936a-fbe758fb248a service nova] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:18.569401 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.compute.server_external_events [req-46946d66-65c3-47b4-8504-84c1c57e71e5 req-5b2a4c7d-2551-49a5-936a-fbe758fb248a service nova] Creating event network-changed:4ae50ebd-a268-4596-8c67-1e7de84bfb9e for instance 29d26a8a-a734-4531-b9ee-04506c852fe2 on hv-cinder-83754 Jun 17 13:14:18.574463 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [req-46946d66-65c3-47b4-8504-84c1c57e71e5 req-5b2a4c7d-2551-49a5-936a-fbe758fb248a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029569 Jun 17 13:14:18.575037 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 385/799] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 13:14:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:19.128281 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-c1b2268b-124d-4655-a02c-b1f4743fc10d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:19.131733 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-c1b2268b-124d-4655-a02c-b1f4743fc10d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:19.140149 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c1b2268b-124d-4655-a02c-b1f4743fc10d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:19.140614 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c1b2268b-124d-4655-a02c-b1f4743fc10d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:19.141391 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c1b2268b-124d-4655-a02c-b1f4743fc10d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:19.141792 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c1b2268b-124d-4655-a02c-b1f4743fc10d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:19.173674 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-c1b2268b-124d-4655-a02c-b1f4743fc10d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049390 Jun 17 13:14:19.174508 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 415/800] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:19 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:19.205267 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-911e75ed-7bed-4edb-ba03-b753e2ef0dea tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:19.206314 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-911e75ed-7bed-4edb-ba03-b753e2ef0dea tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:19.213113 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-911e75ed-7bed-4edb-ba03-b753e2ef0dea tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:19.213563 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-911e75ed-7bed-4edb-ba03-b753e2ef0dea tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:19.214557 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-911e75ed-7bed-4edb-ba03-b753e2ef0dea tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:19.215098 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-911e75ed-7bed-4edb-ba03-b753e2ef0dea tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:19.254863 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-911e75ed-7bed-4edb-ba03-b753e2ef0dea tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053974 Jun 17 13:14:19.255689 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 386/801] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:19 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:19.291844 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-c069f175-51cc-42b5-899a-fca11b0b7ab2 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:19.293477 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-c069f175-51cc-42b5-899a-fca11b0b7ab2 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:19.299855 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c069f175-51cc-42b5-899a-fca11b0b7ab2 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:19.300337 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c069f175-51cc-42b5-899a-fca11b0b7ab2 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:19.301142 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c069f175-51cc-42b5-899a-fca11b0b7ab2 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:19.301578 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c069f175-51cc-42b5-899a-fca11b0b7ab2 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:19.334332 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-c069f175-51cc-42b5-899a-fca11b0b7ab2 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046405 Jun 17 13:14:19.335361 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 416/802] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:14:19 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:14:20.185299 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-06b747bf-9aa5-4490-890c-f19b0c8fdcea tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:20.186338 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-06b747bf-9aa5-4490-890c-f19b0c8fdcea tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:20.192813 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-06b747bf-9aa5-4490-890c-f19b0c8fdcea tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:20.193244 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-06b747bf-9aa5-4490-890c-f19b0c8fdcea tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:20.194001 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-06b747bf-9aa5-4490-890c-f19b0c8fdcea tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:20.194466 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-06b747bf-9aa5-4490-890c-f19b0c8fdcea tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:20.224628 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-06b747bf-9aa5-4490-890c-f19b0c8fdcea tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043322 Jun 17 13:14:20.225241 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 387/803] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:20 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:20.268794 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-60338b9f-a689-4e58-93e9-fb358952f531 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:20.269745 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-60338b9f-a689-4e58-93e9-fb358952f531 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:20.277125 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-60338b9f-a689-4e58-93e9-fb358952f531 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:20.277520 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-60338b9f-a689-4e58-93e9-fb358952f531 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:20.278326 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-60338b9f-a689-4e58-93e9-fb358952f531 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:20.278801 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-60338b9f-a689-4e58-93e9-fb358952f531 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:20.310305 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-60338b9f-a689-4e58-93e9-fb358952f531 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045425 Jun 17 13:14:20.310851 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 417/804] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:20 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:20.347620 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-b61311a7-d204-40e4-98fe-ab931c9c1045 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:20.348698 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-b61311a7-d204-40e4-98fe-ab931c9c1045 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:20.356570 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b61311a7-d204-40e4-98fe-ab931c9c1045 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:20.357112 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b61311a7-d204-40e4-98fe-ab931c9c1045 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:20.358023 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b61311a7-d204-40e4-98fe-ab931c9c1045 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:20.358610 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b61311a7-d204-40e4-98fe-ab931c9c1045 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:20.395730 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-b61311a7-d204-40e4-98fe-ab931c9c1045 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052764 Jun 17 13:14:20.396317 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 388/805] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:14:20 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:14:21.237820 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-112ed0a4-9c6c-4dbd-a8f8-7e6023b57b67 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:21.238696 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-112ed0a4-9c6c-4dbd-a8f8-7e6023b57b67 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:21.245147 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-112ed0a4-9c6c-4dbd-a8f8-7e6023b57b67 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:21.245762 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-112ed0a4-9c6c-4dbd-a8f8-7e6023b57b67 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:21.246661 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-112ed0a4-9c6c-4dbd-a8f8-7e6023b57b67 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:21.247098 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-112ed0a4-9c6c-4dbd-a8f8-7e6023b57b67 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:21.278759 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-112ed0a4-9c6c-4dbd-a8f8-7e6023b57b67 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045400 Jun 17 13:14:21.282633 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 418/806] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:21 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:21.322864 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-cac91ea4-133f-433a-842b-b3496d637333 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:21.323815 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-cac91ea4-133f-433a-842b-b3496d637333 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:21.331085 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cac91ea4-133f-433a-842b-b3496d637333 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:21.331506 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cac91ea4-133f-433a-842b-b3496d637333 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:21.332296 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cac91ea4-133f-433a-842b-b3496d637333 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:21.332727 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cac91ea4-133f-433a-842b-b3496d637333 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:21.366647 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-cac91ea4-133f-433a-842b-b3496d637333 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047658 Jun 17 13:14:21.367216 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 389/807] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:21 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:21.409344 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-299e108a-327c-422c-9321-bbb12f0f2715 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:21.410329 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-299e108a-327c-422c-9321-bbb12f0f2715 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:21.416676 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-299e108a-327c-422c-9321-bbb12f0f2715 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:21.417123 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-299e108a-327c-422c-9321-bbb12f0f2715 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:21.417894 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-299e108a-327c-422c-9321-bbb12f0f2715 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:21.418428 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-299e108a-327c-422c-9321-bbb12f0f2715 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:21.451350 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-299e108a-327c-422c-9321-bbb12f0f2715 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046088 Jun 17 13:14:21.451915 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 419/808] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:14:21 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:14:22.292486 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-4da4790b-44eb-4aee-a5b8-4609a7d65ea0 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:22.293400 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-4da4790b-44eb-4aee-a5b8-4609a7d65ea0 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:22.300642 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4da4790b-44eb-4aee-a5b8-4609a7d65ea0 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:22.301043 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4da4790b-44eb-4aee-a5b8-4609a7d65ea0 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:22.301810 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4da4790b-44eb-4aee-a5b8-4609a7d65ea0 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:22.302270 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4da4790b-44eb-4aee-a5b8-4609a7d65ea0 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:22.333939 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-4da4790b-44eb-4aee-a5b8-4609a7d65ea0 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046902 Jun 17 13:14:22.334859 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 390/809] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:22 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:22.380707 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-1e7a8a8e-1a4e-47f8-9fe3-b800bd808b92 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:22.382399 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-1e7a8a8e-1a4e-47f8-9fe3-b800bd808b92 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:22.391872 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-1e7a8a8e-1a4e-47f8-9fe3-b800bd808b92 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:22.392353 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-1e7a8a8e-1a4e-47f8-9fe3-b800bd808b92 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:22.393135 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-1e7a8a8e-1a4e-47f8-9fe3-b800bd808b92 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:22.393590 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-1e7a8a8e-1a4e-47f8-9fe3-b800bd808b92 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:22.426811 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-1e7a8a8e-1a4e-47f8-9fe3-b800bd808b92 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051953 Jun 17 13:14:22.427984 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 420/810] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:22 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:22.464777 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-09dce494-55e9-4fad-9ee6-0c1991106caf tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:22.465694 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-09dce494-55e9-4fad-9ee6-0c1991106caf tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:22.472479 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-09dce494-55e9-4fad-9ee6-0c1991106caf tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:22.472935 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-09dce494-55e9-4fad-9ee6-0c1991106caf tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:22.473678 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-09dce494-55e9-4fad-9ee6-0c1991106caf tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:22.474113 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-09dce494-55e9-4fad-9ee6-0c1991106caf tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:22.477832 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:14:22.510685 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-09dce494-55e9-4fad-9ee6-0c1991106caf tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049613 Jun 17 13:14:22.511495 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 391/811] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:14:22 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:14:23.346457 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-bc7653f2-5489-4315-b6c0-c08084bfbc8f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:23.347385 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-bc7653f2-5489-4315-b6c0-c08084bfbc8f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:23.353948 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-bc7653f2-5489-4315-b6c0-c08084bfbc8f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:23.354431 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-bc7653f2-5489-4315-b6c0-c08084bfbc8f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:23.355200 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-bc7653f2-5489-4315-b6c0-c08084bfbc8f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:23.355645 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-bc7653f2-5489-4315-b6c0-c08084bfbc8f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:23.382483 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_cell1:SELECT=100 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:14:23.388909 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-bc7653f2-5489-4315-b6c0-c08084bfbc8f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045763 Jun 17 13:14:23.388909 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 421/812] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:23 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:23.441348 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-d6126ae2-e998-4f68-96f3-936fcebad2f5 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:23.442377 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-d6126ae2-e998-4f68-96f3-936fcebad2f5 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:23.449883 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d6126ae2-e998-4f68-96f3-936fcebad2f5 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:23.450341 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d6126ae2-e998-4f68-96f3-936fcebad2f5 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:23.451096 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d6126ae2-e998-4f68-96f3-936fcebad2f5 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:23.451523 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d6126ae2-e998-4f68-96f3-936fcebad2f5 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:23.485056 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-d6126ae2-e998-4f68-96f3-936fcebad2f5 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049423 Jun 17 13:14:23.485632 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 392/813] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:23 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:23.525464 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-a581cac7-d06c-4912-838a-c18b712b67ea tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:23.526412 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-a581cac7-d06c-4912-838a-c18b712b67ea tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:23.535011 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a581cac7-d06c-4912-838a-c18b712b67ea tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:23.535539 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a581cac7-d06c-4912-838a-c18b712b67ea tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:23.536311 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a581cac7-d06c-4912-838a-c18b712b67ea tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:23.536741 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a581cac7-d06c-4912-838a-c18b712b67ea tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:23.568713 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-a581cac7-d06c-4912-838a-c18b712b67ea tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047361 Jun 17 13:14:23.569192 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 422/814] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:14:23 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 17 13:14:24.404414 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-897e57d0-db86-4cdc-87d6-dd8f782bf183 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:24.406890 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-897e57d0-db86-4cdc-87d6-dd8f782bf183 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:24.414068 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-897e57d0-db86-4cdc-87d6-dd8f782bf183 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:24.414547 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-897e57d0-db86-4cdc-87d6-dd8f782bf183 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:24.415413 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-897e57d0-db86-4cdc-87d6-dd8f782bf183 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:24.415749 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-897e57d0-db86-4cdc-87d6-dd8f782bf183 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:24.452566 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-897e57d0-db86-4cdc-87d6-dd8f782bf183 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054308 Jun 17 13:14:24.453184 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 393/815] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:24 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:24.499453 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-e0dd1071-fd2b-4fd2-b8c4-73649dc7b7ff tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:24.500423 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-e0dd1071-fd2b-4fd2-b8c4-73649dc7b7ff tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:24.508172 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e0dd1071-fd2b-4fd2-b8c4-73649dc7b7ff tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:24.508626 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e0dd1071-fd2b-4fd2-b8c4-73649dc7b7ff tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:24.509394 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e0dd1071-fd2b-4fd2-b8c4-73649dc7b7ff tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:24.509811 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e0dd1071-fd2b-4fd2-b8c4-73649dc7b7ff tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:24.555275 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-e0dd1071-fd2b-4fd2-b8c4-73649dc7b7ff tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059429 Jun 17 13:14:24.556065 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 423/816] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:24 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:24.580935 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-8f68051b-5b79-4cb2-a0f8-a7d0fadc3deb tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:24.581766 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-8f68051b-5b79-4cb2-a0f8-a7d0fadc3deb tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:24.588080 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8f68051b-5b79-4cb2-a0f8-a7d0fadc3deb tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:24.588517 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8f68051b-5b79-4cb2-a0f8-a7d0fadc3deb tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:24.589275 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8f68051b-5b79-4cb2-a0f8-a7d0fadc3deb tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:24.589699 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8f68051b-5b79-4cb2-a0f8-a7d0fadc3deb tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:24.620595 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-8f68051b-5b79-4cb2-a0f8-a7d0fadc3deb tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043759 Jun 17 13:14:24.621146 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 394/817] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:14:24 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:14:25.467135 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-0c0780d8-215e-4c18-8614-3d976c7d82c8 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:25.468282 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-0c0780d8-215e-4c18-8614-3d976c7d82c8 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:25.475559 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0c0780d8-215e-4c18-8614-3d976c7d82c8 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:25.476014 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0c0780d8-215e-4c18-8614-3d976c7d82c8 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:25.476787 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0c0780d8-215e-4c18-8614-3d976c7d82c8 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:25.477222 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0c0780d8-215e-4c18-8614-3d976c7d82c8 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:25.508187 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-0c0780d8-215e-4c18-8614-3d976c7d82c8 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047214 Jun 17 13:14:25.508902 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 424/818] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:25 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:25.569900 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-8f9d52e0-8b25-4610-a9db-effd886a256f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:25.570769 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-8f9d52e0-8b25-4610-a9db-effd886a256f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:25.572646 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell0:SELECT=2 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:14:25.573296 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell0:SELECT=6 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:14:25.580363 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8f9d52e0-8b25-4610-a9db-effd886a256f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:25.580814 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8f9d52e0-8b25-4610-a9db-effd886a256f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:25.581619 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8f9d52e0-8b25-4610-a9db-effd886a256f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:25.582050 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8f9d52e0-8b25-4610-a9db-effd886a256f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:25.612977 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-8f9d52e0-8b25-4610-a9db-effd886a256f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047194 Jun 17 13:14:25.613540 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 395/819] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:25 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:25.633132 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-4fa63f4a-2650-478d-a251-42abc3c1c5c0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:25.634120 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-4fa63f4a-2650-478d-a251-42abc3c1c5c0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:25.640275 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4fa63f4a-2650-478d-a251-42abc3c1c5c0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:25.640721 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4fa63f4a-2650-478d-a251-42abc3c1c5c0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:25.642150 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4fa63f4a-2650-478d-a251-42abc3c1c5c0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:25.642630 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4fa63f4a-2650-478d-a251-42abc3c1c5c0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:25.673735 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-4fa63f4a-2650-478d-a251-42abc3c1c5c0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044240 Jun 17 13:14:25.674337 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 425/820] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:14:25 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:14:26.522933 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-fe8cc790-509f-4957-8dbf-6509ec153237 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:26.524035 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-fe8cc790-509f-4957-8dbf-6509ec153237 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:26.532592 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fe8cc790-509f-4957-8dbf-6509ec153237 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:26.533361 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fe8cc790-509f-4957-8dbf-6509ec153237 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:26.534599 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fe8cc790-509f-4957-8dbf-6509ec153237 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:26.535291 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fe8cc790-509f-4957-8dbf-6509ec153237 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:26.569177 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-fe8cc790-509f-4957-8dbf-6509ec153237 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052511 Jun 17 13:14:26.569777 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 396/821] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:26 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:26.624975 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-2483277a-4c90-4ed1-bd65-b012cca9b288 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:26.625877 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-2483277a-4c90-4ed1-bd65-b012cca9b288 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:26.632840 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2483277a-4c90-4ed1-bd65-b012cca9b288 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:26.633281 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2483277a-4c90-4ed1-bd65-b012cca9b288 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:26.634035 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2483277a-4c90-4ed1-bd65-b012cca9b288 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:26.634615 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2483277a-4c90-4ed1-bd65-b012cca9b288 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:26.664844 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-2483277a-4c90-4ed1-bd65-b012cca9b288 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043958 Jun 17 13:14:26.665425 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 426/822] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:26 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:26.685278 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-10534108-b405-4b43-be8f-58eda6fe3a97 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:26.686232 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-10534108-b405-4b43-be8f-58eda6fe3a97 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:26.693288 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-10534108-b405-4b43-be8f-58eda6fe3a97 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:26.693734 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-10534108-b405-4b43-be8f-58eda6fe3a97 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:26.694523 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-10534108-b405-4b43-be8f-58eda6fe3a97 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:26.694951 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-10534108-b405-4b43-be8f-58eda6fe3a97 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:26.724236 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-10534108-b405-4b43-be8f-58eda6fe3a97 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043032 Jun 17 13:14:26.724768 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 397/823] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:14:26 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:14:27.581852 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-1d6a5b16-7fac-4de9-810b-89ca8f8e922c tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:27.582806 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-1d6a5b16-7fac-4de9-810b-89ca8f8e922c tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:27.589800 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-1d6a5b16-7fac-4de9-810b-89ca8f8e922c tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:27.590344 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-1d6a5b16-7fac-4de9-810b-89ca8f8e922c tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:27.591348 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-1d6a5b16-7fac-4de9-810b-89ca8f8e922c tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:27.591832 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-1d6a5b16-7fac-4de9-810b-89ca8f8e922c tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:27.623744 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-1d6a5b16-7fac-4de9-810b-89ca8f8e922c tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046504 Jun 17 13:14:27.624320 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 427/824] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:27 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:27.677297 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-fbcc9ec3-5233-45b5-944b-8e2a48a0de71 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:27.678390 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-fbcc9ec3-5233-45b5-944b-8e2a48a0de71 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:27.684592 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fbcc9ec3-5233-45b5-944b-8e2a48a0de71 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:27.685044 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fbcc9ec3-5233-45b5-944b-8e2a48a0de71 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:27.685809 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fbcc9ec3-5233-45b5-944b-8e2a48a0de71 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:27.686409 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fbcc9ec3-5233-45b5-944b-8e2a48a0de71 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:27.718821 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-fbcc9ec3-5233-45b5-944b-8e2a48a0de71 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045958 Jun 17 13:14:27.719387 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 398/825] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:27 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:27.738878 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-2050188d-5639-4a46-9942-e48db571b5e1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:27.739833 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-2050188d-5639-4a46-9942-e48db571b5e1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:27.746475 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2050188d-5639-4a46-9942-e48db571b5e1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:27.746924 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2050188d-5639-4a46-9942-e48db571b5e1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:27.747679 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2050188d-5639-4a46-9942-e48db571b5e1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:27.748108 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2050188d-5639-4a46-9942-e48db571b5e1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:27.778892 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-2050188d-5639-4a46-9942-e48db571b5e1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045882 Jun 17 13:14:27.779451 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 428/826] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:14:27 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:14:28.636367 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-dfaf58fd-0366-4073-8d1d-a7ffe931bab6 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:28.637399 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-dfaf58fd-0366-4073-8d1d-a7ffe931bab6 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:28.643926 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dfaf58fd-0366-4073-8d1d-a7ffe931bab6 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:28.644368 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dfaf58fd-0366-4073-8d1d-a7ffe931bab6 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:28.645124 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dfaf58fd-0366-4073-8d1d-a7ffe931bab6 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:28.645552 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dfaf58fd-0366-4073-8d1d-a7ffe931bab6 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:28.676842 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-dfaf58fd-0366-4073-8d1d-a7ffe931bab6 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044432 Jun 17 13:14:28.677405 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 399/827] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:28 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:28.733204 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-2366ba60-bfed-4804-9e42-7eef8256e78c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:28.734344 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-2366ba60-bfed-4804-9e42-7eef8256e78c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:28.742368 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2366ba60-bfed-4804-9e42-7eef8256e78c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:28.743093 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2366ba60-bfed-4804-9e42-7eef8256e78c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:28.743546 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2366ba60-bfed-4804-9e42-7eef8256e78c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:28.743999 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2366ba60-bfed-4804-9e42-7eef8256e78c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:28.775305 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-2366ba60-bfed-4804-9e42-7eef8256e78c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046520 Jun 17 13:14:28.775905 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 429/828] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:28 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:28.792352 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-009d18ef-70e7-46d7-b729-c8091dce4d83 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:28.793451 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-009d18ef-70e7-46d7-b729-c8091dce4d83 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:28.796954 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_api:SELECT=100 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:14:28.802308 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-009d18ef-70e7-46d7-b729-c8091dce4d83 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:28.802754 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-009d18ef-70e7-46d7-b729-c8091dce4d83 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:28.803568 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-009d18ef-70e7-46d7-b729-c8091dce4d83 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:28.804003 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-009d18ef-70e7-46d7-b729-c8091dce4d83 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:28.835818 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-009d18ef-70e7-46d7-b729-c8091dce4d83 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047737 Jun 17 13:14:28.836387 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 400/829] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:14:28 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:14:29.688848 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-7b712118-bf77-40df-abc4-6292935d2379 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:29.689801 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-7b712118-bf77-40df-abc4-6292935d2379 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:29.696467 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7b712118-bf77-40df-abc4-6292935d2379 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:29.696913 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7b712118-bf77-40df-abc4-6292935d2379 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:29.697665 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7b712118-bf77-40df-abc4-6292935d2379 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:29.698120 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7b712118-bf77-40df-abc4-6292935d2379 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:29.729830 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-7b712118-bf77-40df-abc4-6292935d2379 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044909 Jun 17 13:14:29.730478 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 430/830] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:29 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:29.787450 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-0c6a9a9a-010a-4760-924e-51e26f8dff07 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:29.788400 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-0c6a9a9a-010a-4760-924e-51e26f8dff07 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:29.795279 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0c6a9a9a-010a-4760-924e-51e26f8dff07 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:29.795885 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0c6a9a9a-010a-4760-924e-51e26f8dff07 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:29.796484 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0c6a9a9a-010a-4760-924e-51e26f8dff07 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:29.796915 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0c6a9a9a-010a-4760-924e-51e26f8dff07 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:29.828884 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-0c6a9a9a-010a-4760-924e-51e26f8dff07 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045524 Jun 17 13:14:29.829440 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 401/831] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:29 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:29.849197 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-2867d39b-58db-4cc2-9edc-d463b829c11d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:29.850235 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-2867d39b-58db-4cc2-9edc-d463b829c11d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:29.856828 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2867d39b-58db-4cc2-9edc-d463b829c11d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:29.857267 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2867d39b-58db-4cc2-9edc-d463b829c11d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:29.858022 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2867d39b-58db-4cc2-9edc-d463b829c11d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:29.858472 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2867d39b-58db-4cc2-9edc-d463b829c11d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:29.887796 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-2867d39b-58db-4cc2-9edc-d463b829c11d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043561 Jun 17 13:14:29.888346 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 431/832] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:14:29 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:14:30.745132 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-010e4a94-4ccb-413a-aa22-5a5c02662493 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:30.746404 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-010e4a94-4ccb-413a-aa22-5a5c02662493 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:30.754934 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-010e4a94-4ccb-413a-aa22-5a5c02662493 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:30.755381 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-010e4a94-4ccb-413a-aa22-5a5c02662493 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:30.756146 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-010e4a94-4ccb-413a-aa22-5a5c02662493 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:30.756574 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-010e4a94-4ccb-413a-aa22-5a5c02662493 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:30.788249 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-010e4a94-4ccb-413a-aa22-5a5c02662493 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049210 Jun 17 13:14:30.789042 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 402/833] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:30 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:30.841977 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-bb926d53-e676-460f-86b5-1636c9ee9325 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:30.842939 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-bb926d53-e676-460f-86b5-1636c9ee9325 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:30.849258 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-bb926d53-e676-460f-86b5-1636c9ee9325 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:30.849864 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-bb926d53-e676-460f-86b5-1636c9ee9325 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:30.850489 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-bb926d53-e676-460f-86b5-1636c9ee9325 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:30.850926 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-bb926d53-e676-460f-86b5-1636c9ee9325 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:30.880910 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-bb926d53-e676-460f-86b5-1636c9ee9325 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042985 Jun 17 13:14:30.881474 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 432/834] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:30 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:30.899955 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-c6db9e61-df8e-4ea0-b523-f1a15418afad tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:30.900910 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-c6db9e61-df8e-4ea0-b523-f1a15418afad tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:30.907829 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c6db9e61-df8e-4ea0-b523-f1a15418afad tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:30.908273 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c6db9e61-df8e-4ea0-b523-f1a15418afad tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:30.909363 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c6db9e61-df8e-4ea0-b523-f1a15418afad tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:30.909797 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c6db9e61-df8e-4ea0-b523-f1a15418afad tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:30.940938 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-c6db9e61-df8e-4ea0-b523-f1a15418afad tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044824 Jun 17 13:14:30.941494 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 403/835] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:14:30 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:14:31.802758 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-a8b2d10b-53f3-4cde-a33e-5010d6a8ecc2 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:31.803690 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-a8b2d10b-53f3-4cde-a33e-5010d6a8ecc2 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:31.809988 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a8b2d10b-53f3-4cde-a33e-5010d6a8ecc2 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:31.810475 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a8b2d10b-53f3-4cde-a33e-5010d6a8ecc2 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:31.811240 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a8b2d10b-53f3-4cde-a33e-5010d6a8ecc2 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:31.811680 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a8b2d10b-53f3-4cde-a33e-5010d6a8ecc2 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:31.841926 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-a8b2d10b-53f3-4cde-a33e-5010d6a8ecc2 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044144 Jun 17 13:14:31.842570 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 433/836] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:31 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:31.898075 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-e1f82257-199c-428b-94ac-c68aa2d49df6 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:31.899359 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-e1f82257-199c-428b-94ac-c68aa2d49df6 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:31.909286 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e1f82257-199c-428b-94ac-c68aa2d49df6 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:31.909925 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e1f82257-199c-428b-94ac-c68aa2d49df6 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:31.910512 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e1f82257-199c-428b-94ac-c68aa2d49df6 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:31.910936 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e1f82257-199c-428b-94ac-c68aa2d49df6 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:31.940842 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-e1f82257-199c-428b-94ac-c68aa2d49df6 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049102 Jun 17 13:14:31.941394 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 404/837] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:31 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:31.956244 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-c41777b0-fd01-443b-965f-e98335a3a4d3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:31.957464 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-c41777b0-fd01-443b-965f-e98335a3a4d3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:31.968053 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c41777b0-fd01-443b-965f-e98335a3a4d3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:31.968646 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c41777b0-fd01-443b-965f-e98335a3a4d3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:31.970155 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c41777b0-fd01-443b-965f-e98335a3a4d3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:31.971227 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c41777b0-fd01-443b-965f-e98335a3a4d3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:32.006359 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-c41777b0-fd01-443b-965f-e98335a3a4d3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056893 Jun 17 13:14:32.006918 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 434/838] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:14:31 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:14:32.855326 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-29c92c9c-ff30-4051-9662-4f498e4db864 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:32.856165 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-29c92c9c-ff30-4051-9662-4f498e4db864 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:32.863696 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-29c92c9c-ff30-4051-9662-4f498e4db864 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:32.864140 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-29c92c9c-ff30-4051-9662-4f498e4db864 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:32.864913 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-29c92c9c-ff30-4051-9662-4f498e4db864 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:32.865347 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-29c92c9c-ff30-4051-9662-4f498e4db864 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:32.897055 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-29c92c9c-ff30-4051-9662-4f498e4db864 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045739 Jun 17 13:14:32.897950 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 405/839] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:32 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:32.953288 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-61877ac2-37d6-4a85-b5fd-7cb4042dd478 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:32.954244 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-61877ac2-37d6-4a85-b5fd-7cb4042dd478 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:32.960679 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-61877ac2-37d6-4a85-b5fd-7cb4042dd478 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:32.961303 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-61877ac2-37d6-4a85-b5fd-7cb4042dd478 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:32.961873 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-61877ac2-37d6-4a85-b5fd-7cb4042dd478 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:32.962373 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-61877ac2-37d6-4a85-b5fd-7cb4042dd478 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:32.994506 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-61877ac2-37d6-4a85-b5fd-7cb4042dd478 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045138 Jun 17 13:14:32.995085 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 435/840] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:32 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:33.021559 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-3edcc3f4-9b17-4d35-a818-40b2fdb7ffef tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:33.022962 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-3edcc3f4-9b17-4d35-a818-40b2fdb7ffef tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:33.032391 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3edcc3f4-9b17-4d35-a818-40b2fdb7ffef tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:33.032839 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3edcc3f4-9b17-4d35-a818-40b2fdb7ffef tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:33.033675 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3edcc3f4-9b17-4d35-a818-40b2fdb7ffef tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:33.034438 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3edcc3f4-9b17-4d35-a818-40b2fdb7ffef tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:33.069681 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-3edcc3f4-9b17-4d35-a818-40b2fdb7ffef tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054582 Jun 17 13:14:33.070288 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 406/841] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:14:33 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:14:33.909658 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-4280f857-d97d-432a-a785-d5d939a26e4e tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:33.910629 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-4280f857-d97d-432a-a785-d5d939a26e4e tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:33.917423 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4280f857-d97d-432a-a785-d5d939a26e4e tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:33.917874 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4280f857-d97d-432a-a785-d5d939a26e4e tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:33.918665 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4280f857-d97d-432a-a785-d5d939a26e4e tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:33.919095 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4280f857-d97d-432a-a785-d5d939a26e4e tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:33.950865 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-4280f857-d97d-432a-a785-d5d939a26e4e tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045420 Jun 17 13:14:33.951430 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 436/842] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:33 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:34.010498 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-de90503c-ac16-4eca-8cfd-e25bfa0f5cfd tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:34.011943 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-de90503c-ac16-4eca-8cfd-e25bfa0f5cfd tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:34.020976 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-de90503c-ac16-4eca-8cfd-e25bfa0f5cfd tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:34.021467 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-de90503c-ac16-4eca-8cfd-e25bfa0f5cfd tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:34.022371 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-de90503c-ac16-4eca-8cfd-e25bfa0f5cfd tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:34.022956 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-de90503c-ac16-4eca-8cfd-e25bfa0f5cfd tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:34.050000 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=100 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:14:34.055596 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-de90503c-ac16-4eca-8cfd-e25bfa0f5cfd tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051705 Jun 17 13:14:34.056210 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 407/843] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:34 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:34.083960 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-8e47939e-72b0-42e7-ab2c-c44a23eeb843 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:34.085123 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-8e47939e-72b0-42e7-ab2c-c44a23eeb843 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:34.095160 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8e47939e-72b0-42e7-ab2c-c44a23eeb843 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:34.095662 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8e47939e-72b0-42e7-ab2c-c44a23eeb843 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:34.096771 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8e47939e-72b0-42e7-ab2c-c44a23eeb843 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:34.097362 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8e47939e-72b0-42e7-ab2c-c44a23eeb843 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:34.128538 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-8e47939e-72b0-42e7-ab2c-c44a23eeb843 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050952 Jun 17 13:14:34.129362 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 437/844] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:14:34 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:14:34.963503 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-36676f83-4069-4200-a887-02b20bce9ea9 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:34.964417 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-36676f83-4069-4200-a887-02b20bce9ea9 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:34.970860 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-36676f83-4069-4200-a887-02b20bce9ea9 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:34.971306 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-36676f83-4069-4200-a887-02b20bce9ea9 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:34.972338 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-36676f83-4069-4200-a887-02b20bce9ea9 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:34.972766 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-36676f83-4069-4200-a887-02b20bce9ea9 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:35.003654 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-36676f83-4069-4200-a887-02b20bce9ea9 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043804 Jun 17 13:14:35.004235 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 408/845] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:34 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:35.068284 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-0e29e98e-7817-4706-9226-898962b5fce9 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:35.069288 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-0e29e98e-7817-4706-9226-898962b5fce9 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:35.075850 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0e29e98e-7817-4706-9226-898962b5fce9 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:35.076303 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0e29e98e-7817-4706-9226-898962b5fce9 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:35.077077 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0e29e98e-7817-4706-9226-898962b5fce9 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:35.077561 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0e29e98e-7817-4706-9226-898962b5fce9 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:35.094458 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_cell1:SELECT=100 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:14:35.108459 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-0e29e98e-7817-4706-9226-898962b5fce9 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044611 Jun 17 13:14:35.109031 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 438/846] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:35 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:35.143661 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-45b58a56-6ca8-4927-ab38-fba220397e61 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:35.144702 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-45b58a56-6ca8-4927-ab38-fba220397e61 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:35.153454 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-45b58a56-6ca8-4927-ab38-fba220397e61 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:35.153899 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-45b58a56-6ca8-4927-ab38-fba220397e61 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:35.154716 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-45b58a56-6ca8-4927-ab38-fba220397e61 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:35.155147 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-45b58a56-6ca8-4927-ab38-fba220397e61 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:35.186726 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-45b58a56-6ca8-4927-ab38-fba220397e61 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049524 Jun 17 13:14:35.187389 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 409/847] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:14:35 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:14:36.019109 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-0be2b584-77c8-4e57-8e81-12588b291189 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:36.020062 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-0be2b584-77c8-4e57-8e81-12588b291189 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:36.026683 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0be2b584-77c8-4e57-8e81-12588b291189 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:36.027135 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0be2b584-77c8-4e57-8e81-12588b291189 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:36.027892 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0be2b584-77c8-4e57-8e81-12588b291189 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:36.028334 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0be2b584-77c8-4e57-8e81-12588b291189 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:36.059874 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-0be2b584-77c8-4e57-8e81-12588b291189 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047193 Jun 17 13:14:36.060465 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 439/848] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:36 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:36.121012 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-01e23130-2d89-4c6b-98e1-d630a49edfe5 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:36.122161 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-01e23130-2d89-4c6b-98e1-d630a49edfe5 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:36.128943 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-01e23130-2d89-4c6b-98e1-d630a49edfe5 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:36.129391 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-01e23130-2d89-4c6b-98e1-d630a49edfe5 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:36.130158 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-01e23130-2d89-4c6b-98e1-d630a49edfe5 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:36.130659 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-01e23130-2d89-4c6b-98e1-d630a49edfe5 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:36.164305 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-01e23130-2d89-4c6b-98e1-d630a49edfe5 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047263 Jun 17 13:14:36.165022 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 410/849] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:36 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:36.199076 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-4a20126a-c6bf-48ae-a0ca-ca30ef814918 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:36.200007 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-4a20126a-c6bf-48ae-a0ca-ca30ef814918 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:36.203479 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_api:SELECT=100 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:14:36.208092 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4a20126a-c6bf-48ae-a0ca-ca30ef814918 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:36.208542 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4a20126a-c6bf-48ae-a0ca-ca30ef814918 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:36.209315 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4a20126a-c6bf-48ae-a0ca-ca30ef814918 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:36.209758 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4a20126a-c6bf-48ae-a0ca-ca30ef814918 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:36.242055 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-4a20126a-c6bf-48ae-a0ca-ca30ef814918 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046920 Jun 17 13:14:36.242658 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 440/850] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:14:36 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:14:37.072489 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-6664b698-0405-4283-aa18-9ca7ab4098e5 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:37.073421 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-6664b698-0405-4283-aa18-9ca7ab4098e5 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:37.080056 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6664b698-0405-4283-aa18-9ca7ab4098e5 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:37.080506 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6664b698-0405-4283-aa18-9ca7ab4098e5 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:37.081470 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6664b698-0405-4283-aa18-9ca7ab4098e5 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:37.081998 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6664b698-0405-4283-aa18-9ca7ab4098e5 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:37.114394 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-6664b698-0405-4283-aa18-9ca7ab4098e5 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044551 Jun 17 13:14:37.114967 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 411/851] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:37 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:37.178968 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-06ced4c0-cde0-4978-b257-2cc1e76d5b4a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:37.180382 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-06ced4c0-cde0-4978-b257-2cc1e76d5b4a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:37.187868 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-06ced4c0-cde0-4978-b257-2cc1e76d5b4a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:37.188325 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-06ced4c0-cde0-4978-b257-2cc1e76d5b4a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:37.189082 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-06ced4c0-cde0-4978-b257-2cc1e76d5b4a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:37.189541 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-06ced4c0-cde0-4978-b257-2cc1e76d5b4a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:37.219129 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-06ced4c0-cde0-4978-b257-2cc1e76d5b4a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047156 Jun 17 13:14:37.219790 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 441/852] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:37 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:37.255935 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-6087b493-8173-48ea-a8eb-7f8759e7e65e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:37.256844 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-6087b493-8173-48ea-a8eb-7f8759e7e65e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:37.263784 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6087b493-8173-48ea-a8eb-7f8759e7e65e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:37.264224 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6087b493-8173-48ea-a8eb-7f8759e7e65e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:37.264974 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6087b493-8173-48ea-a8eb-7f8759e7e65e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:37.265397 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6087b493-8173-48ea-a8eb-7f8759e7e65e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:37.295630 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-6087b493-8173-48ea-a8eb-7f8759e7e65e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045107 Jun 17 13:14:37.296170 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 412/853] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:14:37 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:14:38.126556 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-a26a9ef0-9e6e-47b1-85ca-4cd78c44f314 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:38.127473 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-a26a9ef0-9e6e-47b1-85ca-4cd78c44f314 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:38.134223 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a26a9ef0-9e6e-47b1-85ca-4cd78c44f314 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:38.134634 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a26a9ef0-9e6e-47b1-85ca-4cd78c44f314 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:38.135406 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a26a9ef0-9e6e-47b1-85ca-4cd78c44f314 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:38.135845 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a26a9ef0-9e6e-47b1-85ca-4cd78c44f314 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:38.166337 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-a26a9ef0-9e6e-47b1-85ca-4cd78c44f314 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043758 Jun 17 13:14:38.166891 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 442/854] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:38 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:38.232317 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-c24c8251-b03d-4265-a28a-150ffaa7986e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:38.233292 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-c24c8251-b03d-4265-a28a-150ffaa7986e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:38.240654 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c24c8251-b03d-4265-a28a-150ffaa7986e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:38.241087 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c24c8251-b03d-4265-a28a-150ffaa7986e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:38.241880 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c24c8251-b03d-4265-a28a-150ffaa7986e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:38.242340 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c24c8251-b03d-4265-a28a-150ffaa7986e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:38.273099 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-c24c8251-b03d-4265-a28a-150ffaa7986e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045020 Jun 17 13:14:38.273744 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 413/855] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:38 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:38.307720 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-66ceed01-f24e-404a-9450-988c614d5409 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:38.308660 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-66ceed01-f24e-404a-9450-988c614d5409 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:38.315581 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-66ceed01-f24e-404a-9450-988c614d5409 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:38.315958 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-66ceed01-f24e-404a-9450-988c614d5409 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:38.316739 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-66ceed01-f24e-404a-9450-988c614d5409 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:38.317183 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-66ceed01-f24e-404a-9450-988c614d5409 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:38.346631 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-66ceed01-f24e-404a-9450-988c614d5409 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042860 Jun 17 13:14:38.347708 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 443/856] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:14:38 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:14:39.181789 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-8e72773a-909e-495c-a1b9-2c152747c11f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:39.182792 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-8e72773a-909e-495c-a1b9-2c152747c11f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:39.189920 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8e72773a-909e-495c-a1b9-2c152747c11f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:39.190486 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8e72773a-909e-495c-a1b9-2c152747c11f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:39.191783 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8e72773a-909e-495c-a1b9-2c152747c11f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:39.192352 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8e72773a-909e-495c-a1b9-2c152747c11f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:39.231377 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-8e72773a-909e-495c-a1b9-2c152747c11f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054262 Jun 17 13:14:39.231927 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 414/857] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:39 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:39.285362 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-348a14bf-e97d-4530-8809-4f2093e5c189 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:39.286182 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-348a14bf-e97d-4530-8809-4f2093e5c189 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:39.292266 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-348a14bf-e97d-4530-8809-4f2093e5c189 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:39.292721 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-348a14bf-e97d-4530-8809-4f2093e5c189 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:39.293583 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-348a14bf-e97d-4530-8809-4f2093e5c189 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:39.293956 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-348a14bf-e97d-4530-8809-4f2093e5c189 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:39.333551 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-348a14bf-e97d-4530-8809-4f2093e5c189 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052752 Jun 17 13:14:39.334349 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 444/858] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:39 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:39.359106 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-708faa68-00c1-4e43-905b-61cf424dec94 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:39.360018 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-708faa68-00c1-4e43-905b-61cf424dec94 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:39.367257 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-708faa68-00c1-4e43-905b-61cf424dec94 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:39.367691 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-708faa68-00c1-4e43-905b-61cf424dec94 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:39.368454 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-708faa68-00c1-4e43-905b-61cf424dec94 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:39.368887 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-708faa68-00c1-4e43-905b-61cf424dec94 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:39.399752 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-708faa68-00c1-4e43-905b-61cf424dec94 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044574 Jun 17 13:14:39.400311 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 415/859] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:14:39 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:14:40.246653 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-643050a4-f82d-438b-8664-c167383639b1 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:40.247943 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-643050a4-f82d-438b-8664-c167383639b1 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:40.255872 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-643050a4-f82d-438b-8664-c167383639b1 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:40.256335 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-643050a4-f82d-438b-8664-c167383639b1 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:40.257088 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-643050a4-f82d-438b-8664-c167383639b1 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:40.257580 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-643050a4-f82d-438b-8664-c167383639b1 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:40.288539 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-643050a4-f82d-438b-8664-c167383639b1 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048004 Jun 17 13:14:40.289099 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 445/860] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:40 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:40.344954 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-739fa68d-60a8-48e3-b83f-31136d90fafc tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:40.346790 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-739fa68d-60a8-48e3-b83f-31136d90fafc tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:40.353547 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-739fa68d-60a8-48e3-b83f-31136d90fafc tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:40.354014 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-739fa68d-60a8-48e3-b83f-31136d90fafc tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:40.354819 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-739fa68d-60a8-48e3-b83f-31136d90fafc tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:40.355258 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-739fa68d-60a8-48e3-b83f-31136d90fafc tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:40.386631 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-739fa68d-60a8-48e3-b83f-31136d90fafc tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045578 Jun 17 13:14:40.387464 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 416/861] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:40 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:40.412355 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-549db0ea-d911-43e4-9148-6adcd15de20f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:40.413306 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-549db0ea-d911-43e4-9148-6adcd15de20f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:40.419646 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-549db0ea-d911-43e4-9148-6adcd15de20f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:40.420093 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-549db0ea-d911-43e4-9148-6adcd15de20f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:40.420863 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-549db0ea-d911-43e4-9148-6adcd15de20f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:40.421299 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-549db0ea-d911-43e4-9148-6adcd15de20f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:40.451925 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-549db0ea-d911-43e4-9148-6adcd15de20f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044158 Jun 17 13:14:40.452479 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 446/862] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:14:40 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:14:41.301968 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-f8ce2e86-b1d9-4336-b06b-7df7046f8191 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:41.302879 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-f8ce2e86-b1d9-4336-b06b-7df7046f8191 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:41.309572 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f8ce2e86-b1d9-4336-b06b-7df7046f8191 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:41.310012 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f8ce2e86-b1d9-4336-b06b-7df7046f8191 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:41.310811 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f8ce2e86-b1d9-4336-b06b-7df7046f8191 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:41.311238 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f8ce2e86-b1d9-4336-b06b-7df7046f8191 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:41.342376 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-f8ce2e86-b1d9-4336-b06b-7df7046f8191 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044533 Jun 17 13:14:41.342919 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 417/863] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:41 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:41.398621 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-80e2d231-ff65-4ef4-9e4c-d9d2073e8642 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:41.399567 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-80e2d231-ff65-4ef4-9e4c-d9d2073e8642 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:41.406647 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-80e2d231-ff65-4ef4-9e4c-d9d2073e8642 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:41.407096 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-80e2d231-ff65-4ef4-9e4c-d9d2073e8642 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:41.407872 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-80e2d231-ff65-4ef4-9e4c-d9d2073e8642 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:41.408305 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-80e2d231-ff65-4ef4-9e4c-d9d2073e8642 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:41.448771 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-80e2d231-ff65-4ef4-9e4c-d9d2073e8642 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053811 Jun 17 13:14:41.454705 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 447/864] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:41 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:41.466868 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-1c6dc5b3-89da-40c9-b502-df2b690dc271 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:41.468275 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-1c6dc5b3-89da-40c9-b502-df2b690dc271 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:41.478131 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1c6dc5b3-89da-40c9-b502-df2b690dc271 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:41.478788 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1c6dc5b3-89da-40c9-b502-df2b690dc271 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:41.479974 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1c6dc5b3-89da-40c9-b502-df2b690dc271 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:41.480579 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1c6dc5b3-89da-40c9-b502-df2b690dc271 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:41.514717 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-1c6dc5b3-89da-40c9-b502-df2b690dc271 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053762 Jun 17 13:14:41.515269 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 418/865] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:14:41 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:14:42.354537 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-188f7586-4f16-42c1-b329-7ab4d134b978 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:42.355934 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-188f7586-4f16-42c1-b329-7ab4d134b978 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:42.364103 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-188f7586-4f16-42c1-b329-7ab4d134b978 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:42.364551 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-188f7586-4f16-42c1-b329-7ab4d134b978 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:42.365316 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-188f7586-4f16-42c1-b329-7ab4d134b978 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:42.365753 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-188f7586-4f16-42c1-b329-7ab4d134b978 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:42.396994 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-188f7586-4f16-42c1-b329-7ab4d134b978 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046480 Jun 17 13:14:42.397572 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 448/866] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:42 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:42.462996 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-ed4fcbaf-cad7-48ff-bb7e-bcc118b7c8de tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:42.464093 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-ed4fcbaf-cad7-48ff-bb7e-bcc118b7c8de tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:42.471782 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ed4fcbaf-cad7-48ff-bb7e-bcc118b7c8de tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:42.472572 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ed4fcbaf-cad7-48ff-bb7e-bcc118b7c8de tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:42.472971 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ed4fcbaf-cad7-48ff-bb7e-bcc118b7c8de tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:42.473401 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ed4fcbaf-cad7-48ff-bb7e-bcc118b7c8de tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:42.506196 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-ed4fcbaf-cad7-48ff-bb7e-bcc118b7c8de tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047092 Jun 17 13:14:42.506781 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 419/867] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:42 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:42.527030 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-b0942313-7d7d-400d-becd-d46f1b6d3aa3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:42.527980 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-b0942313-7d7d-400d-becd-d46f1b6d3aa3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:42.535114 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b0942313-7d7d-400d-becd-d46f1b6d3aa3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:42.535566 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b0942313-7d7d-400d-becd-d46f1b6d3aa3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:42.536351 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b0942313-7d7d-400d-becd-d46f1b6d3aa3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:42.536786 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b0942313-7d7d-400d-becd-d46f1b6d3aa3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:42.567894 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-b0942313-7d7d-400d-becd-d46f1b6d3aa3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044722 Jun 17 13:14:42.568378 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 449/868] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:14:42 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:14:43.409865 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-2d1e7a3b-37ae-4096-bd17-3f3e156313a6 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:43.410843 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-2d1e7a3b-37ae-4096-bd17-3f3e156313a6 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:43.417342 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2d1e7a3b-37ae-4096-bd17-3f3e156313a6 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:43.417787 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2d1e7a3b-37ae-4096-bd17-3f3e156313a6 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:43.418576 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2d1e7a3b-37ae-4096-bd17-3f3e156313a6 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:43.419005 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2d1e7a3b-37ae-4096-bd17-3f3e156313a6 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:43.449247 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-2d1e7a3b-37ae-4096-bd17-3f3e156313a6 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043643 Jun 17 13:14:43.449781 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 420/869] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:43 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:43.518482 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-62ceb3d0-e4c9-4a14-aa91-499c4f5e867b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:43.519430 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-62ceb3d0-e4c9-4a14-aa91-499c4f5e867b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:43.526147 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-62ceb3d0-e4c9-4a14-aa91-499c4f5e867b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:43.526608 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-62ceb3d0-e4c9-4a14-aa91-499c4f5e867b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:43.527456 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-62ceb3d0-e4c9-4a14-aa91-499c4f5e867b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:43.528037 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-62ceb3d0-e4c9-4a14-aa91-499c4f5e867b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:43.561190 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-62ceb3d0-e4c9-4a14-aa91-499c4f5e867b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046736 Jun 17 13:14:43.562046 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 450/870] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:43 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:43.579912 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-f21548d2-42fd-4f23-866a-0eca34285800 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:43.581153 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-f21548d2-42fd-4f23-866a-0eca34285800 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:43.588078 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f21548d2-42fd-4f23-866a-0eca34285800 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:43.588525 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f21548d2-42fd-4f23-866a-0eca34285800 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:43.589298 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f21548d2-42fd-4f23-866a-0eca34285800 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:43.589761 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f21548d2-42fd-4f23-866a-0eca34285800 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:43.619312 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-f21548d2-42fd-4f23-866a-0eca34285800 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043397 Jun 17 13:14:43.620111 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 421/871] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:14:43 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:14:44.465623 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-568d8d91-90bd-45c3-b8f1-e8555d1aae03 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:44.466695 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-568d8d91-90bd-45c3-b8f1-e8555d1aae03 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:44.475454 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-568d8d91-90bd-45c3-b8f1-e8555d1aae03 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:44.476123 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-568d8d91-90bd-45c3-b8f1-e8555d1aae03 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:44.477265 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-568d8d91-90bd-45c3-b8f1-e8555d1aae03 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:44.478055 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-568d8d91-90bd-45c3-b8f1-e8555d1aae03 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:44.510284 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-568d8d91-90bd-45c3-b8f1-e8555d1aae03 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050349 Jun 17 13:14:44.510842 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 451/872] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:44 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:44.573153 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-e532cf91-fac6-40ce-a7eb-5b79c0ebabd3 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:44.573996 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-e532cf91-fac6-40ce-a7eb-5b79c0ebabd3 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:44.580242 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e532cf91-fac6-40ce-a7eb-5b79c0ebabd3 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:44.580842 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e532cf91-fac6-40ce-a7eb-5b79c0ebabd3 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:44.581660 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e532cf91-fac6-40ce-a7eb-5b79c0ebabd3 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:44.582100 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e532cf91-fac6-40ce-a7eb-5b79c0ebabd3 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:44.612888 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-e532cf91-fac6-40ce-a7eb-5b79c0ebabd3 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043803 Jun 17 13:14:44.613505 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 422/873] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:44 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:44.639181 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-5ec09a8c-ecbb-45d4-b46e-7c79f5e6f455 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:44.640192 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-5ec09a8c-ecbb-45d4-b46e-7c79f5e6f455 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:44.649371 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-5ec09a8c-ecbb-45d4-b46e-7c79f5e6f455 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:44.650054 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-5ec09a8c-ecbb-45d4-b46e-7c79f5e6f455 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:44.651261 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-5ec09a8c-ecbb-45d4-b46e-7c79f5e6f455 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:44.651917 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-5ec09a8c-ecbb-45d4-b46e-7c79f5e6f455 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:44.684259 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-5ec09a8c-ecbb-45d4-b46e-7c79f5e6f455 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049149 Jun 17 13:14:44.684820 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 452/874] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:14:44 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:14:45.524386 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-3e334c41-149a-4381-8907-355f6da49394 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:45.525529 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-3e334c41-149a-4381-8907-355f6da49394 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:45.534227 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3e334c41-149a-4381-8907-355f6da49394 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:45.534672 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3e334c41-149a-4381-8907-355f6da49394 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:45.535430 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3e334c41-149a-4381-8907-355f6da49394 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:45.535854 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3e334c41-149a-4381-8907-355f6da49394 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:45.565525 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-3e334c41-149a-4381-8907-355f6da49394 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046588 Jun 17 13:14:45.566117 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 423/875] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:45 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:45.626743 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-fa320e62-5f81-4d1d-814b-0940241b8e1b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:45.627758 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-fa320e62-5f81-4d1d-814b-0940241b8e1b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:45.634138 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-fa320e62-5f81-4d1d-814b-0940241b8e1b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:45.634573 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-fa320e62-5f81-4d1d-814b-0940241b8e1b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:45.635330 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-fa320e62-5f81-4d1d-814b-0940241b8e1b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:45.635737 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-fa320e62-5f81-4d1d-814b-0940241b8e1b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:45.666601 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-fa320e62-5f81-4d1d-814b-0940241b8e1b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043812 Jun 17 13:14:45.667205 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 453/876] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:45 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:45.696504 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-60e69889-3888-418d-aa55-f3848881c6f7 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:45.697414 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-60e69889-3888-418d-aa55-f3848881c6f7 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:45.704301 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-60e69889-3888-418d-aa55-f3848881c6f7 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:45.704745 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-60e69889-3888-418d-aa55-f3848881c6f7 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:45.705599 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-60e69889-3888-418d-aa55-f3848881c6f7 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:45.706005 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-60e69889-3888-418d-aa55-f3848881c6f7 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:45.725214 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=100 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:14:45.739948 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-60e69889-3888-418d-aa55-f3848881c6f7 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047481 Jun 17 13:14:45.740524 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 424/877] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:14:45 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:14:46.579438 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-c538eaf0-1e49-4517-b658-695930dd60ae tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:46.580314 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-c538eaf0-1e49-4517-b658-695930dd60ae tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:46.589224 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c538eaf0-1e49-4517-b658-695930dd60ae tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:46.589890 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c538eaf0-1e49-4517-b658-695930dd60ae tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:46.590967 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c538eaf0-1e49-4517-b658-695930dd60ae tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:46.591522 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c538eaf0-1e49-4517-b658-695930dd60ae tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:46.623798 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-c538eaf0-1e49-4517-b658-695930dd60ae tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048427 Jun 17 13:14:46.624593 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 454/878] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:46 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:46.679027 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-84bff471-956c-4c7f-8960-673ac27b5552 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:46.679955 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-84bff471-956c-4c7f-8960-673ac27b5552 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:46.686341 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-84bff471-956c-4c7f-8960-673ac27b5552 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:46.686789 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-84bff471-956c-4c7f-8960-673ac27b5552 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:46.687542 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-84bff471-956c-4c7f-8960-673ac27b5552 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:46.687970 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-84bff471-956c-4c7f-8960-673ac27b5552 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:46.717966 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-84bff471-956c-4c7f-8960-673ac27b5552 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043047 Jun 17 13:14:46.718758 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 425/879] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:46 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:46.752316 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-6570485c-6937-4516-91e4-8ab41cea9d96 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:46.753864 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-6570485c-6937-4516-91e4-8ab41cea9d96 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:46.760549 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6570485c-6937-4516-91e4-8ab41cea9d96 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:46.761002 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6570485c-6937-4516-91e4-8ab41cea9d96 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:46.761838 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6570485c-6937-4516-91e4-8ab41cea9d96 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:46.762371 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6570485c-6937-4516-91e4-8ab41cea9d96 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:46.766525 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_cell1:SELECT=100 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:14:46.792813 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-6570485c-6937-4516-91e4-8ab41cea9d96 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044582 Jun 17 13:14:46.793368 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 455/880] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:14:46 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:14:47.635769 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-3186703a-bbee-422c-8512-ef7a09e6b03e tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:47.636666 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-3186703a-bbee-422c-8512-ef7a09e6b03e tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:47.643321 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3186703a-bbee-422c-8512-ef7a09e6b03e tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:47.643764 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3186703a-bbee-422c-8512-ef7a09e6b03e tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:47.644521 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3186703a-bbee-422c-8512-ef7a09e6b03e tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:47.644947 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3186703a-bbee-422c-8512-ef7a09e6b03e tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:47.675202 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-3186703a-bbee-422c-8512-ef7a09e6b03e tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043462 Jun 17 13:14:47.675756 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 426/881] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:47 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:47.734703 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-41a43f8b-bb4c-4fee-a923-b76a053d4385 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:47.736312 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-41a43f8b-bb4c-4fee-a923-b76a053d4385 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:47.745789 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-41a43f8b-bb4c-4fee-a923-b76a053d4385 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:47.746388 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-41a43f8b-bb4c-4fee-a923-b76a053d4385 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:47.747630 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-41a43f8b-bb4c-4fee-a923-b76a053d4385 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:47.748290 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-41a43f8b-bb4c-4fee-a923-b76a053d4385 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:47.780952 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-41a43f8b-bb4c-4fee-a923-b76a053d4385 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052659 Jun 17 13:14:47.781596 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 456/882] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:47 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 13:14:47.806356 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-f6fe8cbe-3fcf-47d8-8f1d-7cde5fa738ee tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:47.807320 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-f6fe8cbe-3fcf-47d8-8f1d-7cde5fa738ee tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:47.813983 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f6fe8cbe-3fcf-47d8-8f1d-7cde5fa738ee tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:47.814465 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f6fe8cbe-3fcf-47d8-8f1d-7cde5fa738ee tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:47.815576 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f6fe8cbe-3fcf-47d8-8f1d-7cde5fa738ee tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:47.816018 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f6fe8cbe-3fcf-47d8-8f1d-7cde5fa738ee tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:47.847435 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-f6fe8cbe-3fcf-47d8-8f1d-7cde5fa738ee tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045090 Jun 17 13:14:47.848010 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 427/883] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:14:47 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:14:48.687659 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-a21d8d50-51f4-4ce4-9233-5b6e9f2910d9 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:48.688598 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-a21d8d50-51f4-4ce4-9233-5b6e9f2910d9 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:48.695493 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a21d8d50-51f4-4ce4-9233-5b6e9f2910d9 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:48.695960 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a21d8d50-51f4-4ce4-9233-5b6e9f2910d9 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:48.696722 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a21d8d50-51f4-4ce4-9233-5b6e9f2910d9 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:48.697150 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a21d8d50-51f4-4ce4-9233-5b6e9f2910d9 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:48.728694 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-a21d8d50-51f4-4ce4-9233-5b6e9f2910d9 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045067 Jun 17 13:14:48.729249 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 457/884] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:48 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:48.793873 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-0121c5d4-9ca6-4561-928f-093fd2d6dee0 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:48.794852 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-0121c5d4-9ca6-4561-928f-093fd2d6dee0 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:48.802937 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0121c5d4-9ca6-4561-928f-093fd2d6dee0 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:48.803370 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0121c5d4-9ca6-4561-928f-093fd2d6dee0 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:48.804162 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0121c5d4-9ca6-4561-928f-093fd2d6dee0 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:48.804589 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0121c5d4-9ca6-4561-928f-093fd2d6dee0 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:48.843736 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-0121c5d4-9ca6-4561-928f-093fd2d6dee0 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053771 Jun 17 13:14:48.845203 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 428/885] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:48 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:48.860201 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-aef138b7-ec82-4e77-ba0e-30a21f025885 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:48.861715 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-aef138b7-ec82-4e77-ba0e-30a21f025885 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:48.869273 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-aef138b7-ec82-4e77-ba0e-30a21f025885 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:48.869798 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-aef138b7-ec82-4e77-ba0e-30a21f025885 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:48.870511 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-aef138b7-ec82-4e77-ba0e-30a21f025885 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:48.870939 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-aef138b7-ec82-4e77-ba0e-30a21f025885 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:48.901429 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-aef138b7-ec82-4e77-ba0e-30a21f025885 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046049 Jun 17 13:14:48.901991 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 458/886] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:14:48 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:14:49.741448 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-c50de44e-528f-422a-b2d7-9ef2a32d02a1 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:49.742407 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-c50de44e-528f-422a-b2d7-9ef2a32d02a1 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:49.748705 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c50de44e-528f-422a-b2d7-9ef2a32d02a1 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:49.749152 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c50de44e-528f-422a-b2d7-9ef2a32d02a1 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:49.749915 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c50de44e-528f-422a-b2d7-9ef2a32d02a1 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:49.750373 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c50de44e-528f-422a-b2d7-9ef2a32d02a1 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:49.780507 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-c50de44e-528f-422a-b2d7-9ef2a32d02a1 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043307 Jun 17 13:14:49.781059 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 429/887] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:49 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:49.855630 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-420a84c7-82c5-4f5d-b1e4-d025b436f956 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:49.856560 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-420a84c7-82c5-4f5d-b1e4-d025b436f956 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:49.863469 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-420a84c7-82c5-4f5d-b1e4-d025b436f956 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:49.864086 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-420a84c7-82c5-4f5d-b1e4-d025b436f956 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:49.864649 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-420a84c7-82c5-4f5d-b1e4-d025b436f956 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:49.865082 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-420a84c7-82c5-4f5d-b1e4-d025b436f956 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:49.895297 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-420a84c7-82c5-4f5d-b1e4-d025b436f956 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043633 Jun 17 13:14:49.895882 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 459/888] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:49 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:49.913479 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-a9a2dce5-ba27-4899-b058-54e14ee7700e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:49.914465 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-a9a2dce5-ba27-4899-b058-54e14ee7700e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:49.920598 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a9a2dce5-ba27-4899-b058-54e14ee7700e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:49.921179 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a9a2dce5-ba27-4899-b058-54e14ee7700e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:49.921780 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a9a2dce5-ba27-4899-b058-54e14ee7700e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:49.922242 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a9a2dce5-ba27-4899-b058-54e14ee7700e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:49.951694 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-a9a2dce5-ba27-4899-b058-54e14ee7700e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042277 Jun 17 13:14:49.952241 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 430/889] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:14:49 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:14:50.793167 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-15ee2beb-104b-4bff-a6d4-90cc2593418a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:50.794117 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-15ee2beb-104b-4bff-a6d4-90cc2593418a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:50.801020 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-15ee2beb-104b-4bff-a6d4-90cc2593418a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:50.801470 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-15ee2beb-104b-4bff-a6d4-90cc2593418a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:50.802251 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-15ee2beb-104b-4bff-a6d4-90cc2593418a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:50.802708 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-15ee2beb-104b-4bff-a6d4-90cc2593418a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:50.833998 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-15ee2beb-104b-4bff-a6d4-90cc2593418a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044839 Jun 17 13:14:50.834593 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 460/890] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:50 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:50.907182 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-856399fd-8196-47fb-915a-0f8163f6ccbc tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:50.908135 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-856399fd-8196-47fb-915a-0f8163f6ccbc tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:50.915354 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-856399fd-8196-47fb-915a-0f8163f6ccbc tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:50.915944 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-856399fd-8196-47fb-915a-0f8163f6ccbc tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:50.916544 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-856399fd-8196-47fb-915a-0f8163f6ccbc tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:50.916973 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-856399fd-8196-47fb-915a-0f8163f6ccbc tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:50.947359 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-856399fd-8196-47fb-915a-0f8163f6ccbc tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044133 Jun 17 13:14:50.947966 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 431/891] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:50 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:50.966185 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-678a284d-6d2c-4583-881a-ac04885251aa tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:50.967090 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-678a284d-6d2c-4583-881a-ac04885251aa tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:50.974038 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-678a284d-6d2c-4583-881a-ac04885251aa tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:50.974516 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-678a284d-6d2c-4583-881a-ac04885251aa tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:50.975287 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-678a284d-6d2c-4583-881a-ac04885251aa tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:50.975720 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-678a284d-6d2c-4583-881a-ac04885251aa tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:51.006064 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-678a284d-6d2c-4583-881a-ac04885251aa tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046159 Jun 17 13:14:51.006667 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 461/892] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:14:50 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:14:51.848231 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-4142dc11-11c0-45b2-bfb7-90a65daf5a33 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:51.849660 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-4142dc11-11c0-45b2-bfb7-90a65daf5a33 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:51.859350 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4142dc11-11c0-45b2-bfb7-90a65daf5a33 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:51.860072 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4142dc11-11c0-45b2-bfb7-90a65daf5a33 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:51.861233 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4142dc11-11c0-45b2-bfb7-90a65daf5a33 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:51.862000 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4142dc11-11c0-45b2-bfb7-90a65daf5a33 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:51.893707 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-4142dc11-11c0-45b2-bfb7-90a65daf5a33 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051106 Jun 17 13:14:51.894294 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 432/893] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:51 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:51.960127 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-5a141b48-22f4-4aa3-920a-dd9b41970355 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:51.961129 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-5a141b48-22f4-4aa3-920a-dd9b41970355 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:51.967410 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-5a141b48-22f4-4aa3-920a-dd9b41970355 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:51.968057 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-5a141b48-22f4-4aa3-920a-dd9b41970355 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:51.968612 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-5a141b48-22f4-4aa3-920a-dd9b41970355 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:51.969044 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-5a141b48-22f4-4aa3-920a-dd9b41970355 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:51.999363 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-5a141b48-22f4-4aa3-920a-dd9b41970355 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043186 Jun 17 13:14:51.999922 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 462/894] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:51 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:52.016885 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-56f31433-5d9a-4826-b8a9-7357c16883e8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:52.017916 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-56f31433-5d9a-4826-b8a9-7357c16883e8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:52.025013 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-56f31433-5d9a-4826-b8a9-7357c16883e8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:52.025461 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-56f31433-5d9a-4826-b8a9-7357c16883e8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:52.026254 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-56f31433-5d9a-4826-b8a9-7357c16883e8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:52.026711 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-56f31433-5d9a-4826-b8a9-7357c16883e8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:52.057343 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-56f31433-5d9a-4826-b8a9-7357c16883e8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044466 Jun 17 13:14:52.057923 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 433/895] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:14:52 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:14:52.909612 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-9255949e-851c-4784-8cc0-fb6e669c387f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:52.910653 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-9255949e-851c-4784-8cc0-fb6e669c387f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:52.917736 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9255949e-851c-4784-8cc0-fb6e669c387f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:52.918227 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9255949e-851c-4784-8cc0-fb6e669c387f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:52.919005 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9255949e-851c-4784-8cc0-fb6e669c387f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:52.919436 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9255949e-851c-4784-8cc0-fb6e669c387f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:52.950377 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-9255949e-851c-4784-8cc0-fb6e669c387f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046459 Jun 17 13:14:52.950925 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 463/896] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:52 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:53.012253 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-c9295dc7-5af9-40d8-9b52-0eea1a83b09a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:53.013462 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-c9295dc7-5af9-40d8-9b52-0eea1a83b09a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:53.023243 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c9295dc7-5af9-40d8-9b52-0eea1a83b09a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:53.023935 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c9295dc7-5af9-40d8-9b52-0eea1a83b09a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:53.024809 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c9295dc7-5af9-40d8-9b52-0eea1a83b09a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:53.025475 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c9295dc7-5af9-40d8-9b52-0eea1a83b09a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:53.068843 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-c9295dc7-5af9-40d8-9b52-0eea1a83b09a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060400 Jun 17 13:14:53.069925 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 434/897] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:53 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:53.071622 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-edaa9e47-66ed-4ed4-bcff-277752aebc18 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:53.073064 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-edaa9e47-66ed-4ed4-bcff-277752aebc18 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:53.085156 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-edaa9e47-66ed-4ed4-bcff-277752aebc18 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:53.086016 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-edaa9e47-66ed-4ed4-bcff-277752aebc18 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:53.087452 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-edaa9e47-66ed-4ed4-bcff-277752aebc18 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:53.088226 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-edaa9e47-66ed-4ed4-bcff-277752aebc18 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:53.138448 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-edaa9e47-66ed-4ed4-bcff-277752aebc18 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.072506 Jun 17 13:14:53.139488 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 464/898] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:14:53 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 17 13:14:53.962961 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-9d007004-4938-4a84-82f5-d74cc1b5f859 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:53.964185 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-9d007004-4938-4a84-82f5-d74cc1b5f859 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:53.971138 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9d007004-4938-4a84-82f5-d74cc1b5f859 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:53.971578 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9d007004-4938-4a84-82f5-d74cc1b5f859 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:53.972912 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9d007004-4938-4a84-82f5-d74cc1b5f859 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:53.973354 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9d007004-4938-4a84-82f5-d74cc1b5f859 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:54.004958 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-9d007004-4938-4a84-82f5-d74cc1b5f859 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046541 Jun 17 13:14:54.005540 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 435/899] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:53 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:54.083762 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-e0951714-2f04-4a76-9f87-e0f4e3d4b851 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:54.084684 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-e0951714-2f04-4a76-9f87-e0f4e3d4b851 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:54.091702 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e0951714-2f04-4a76-9f87-e0f4e3d4b851 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:54.092145 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e0951714-2f04-4a76-9f87-e0f4e3d4b851 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:54.092899 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e0951714-2f04-4a76-9f87-e0f4e3d4b851 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:54.093327 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e0951714-2f04-4a76-9f87-e0f4e3d4b851 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:54.123650 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-e0951714-2f04-4a76-9f87-e0f4e3d4b851 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044683 Jun 17 13:14:54.124173 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 465/900] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:54 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:54.151009 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-df598de0-5334-46ac-a568-e5a228e33ca1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:54.151935 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-df598de0-5334-46ac-a568-e5a228e33ca1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:54.158827 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-df598de0-5334-46ac-a568-e5a228e33ca1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:54.159257 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-df598de0-5334-46ac-a568-e5a228e33ca1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:54.160028 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-df598de0-5334-46ac-a568-e5a228e33ca1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:54.160464 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-df598de0-5334-46ac-a568-e5a228e33ca1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:54.189980 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-df598de0-5334-46ac-a568-e5a228e33ca1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042955 Jun 17 13:14:54.190569 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 436/901] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:14:54 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:14:55.020601 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-d56878c8-9cfc-428d-990f-5edd46d2dd8b tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:55.021974 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-d56878c8-9cfc-428d-990f-5edd46d2dd8b tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:55.031601 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d56878c8-9cfc-428d-990f-5edd46d2dd8b tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:55.032347 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d56878c8-9cfc-428d-990f-5edd46d2dd8b tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:55.033513 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d56878c8-9cfc-428d-990f-5edd46d2dd8b tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:55.034293 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d56878c8-9cfc-428d-990f-5edd46d2dd8b tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:55.066927 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-d56878c8-9cfc-428d-990f-5edd46d2dd8b tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052608 Jun 17 13:14:55.067498 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 466/902] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:55 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:55.136069 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-9932c425-3c36-4b36-9c80-8b43a8bfb527 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:55.137012 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-9932c425-3c36-4b36-9c80-8b43a8bfb527 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:55.143890 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9932c425-3c36-4b36-9c80-8b43a8bfb527 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:55.144582 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9932c425-3c36-4b36-9c80-8b43a8bfb527 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:55.145474 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9932c425-3c36-4b36-9c80-8b43a8bfb527 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:55.145910 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9932c425-3c36-4b36-9c80-8b43a8bfb527 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:55.178935 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-9932c425-3c36-4b36-9c80-8b43a8bfb527 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046968 Jun 17 13:14:55.182964 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 437/903] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:55 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:55.202076 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-43e2d0f3-b2b0-45f0-83d0-9d05cd7a8381 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:55.203047 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-43e2d0f3-b2b0-45f0-83d0-9d05cd7a8381 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:55.209982 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-43e2d0f3-b2b0-45f0-83d0-9d05cd7a8381 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:55.210633 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-43e2d0f3-b2b0-45f0-83d0-9d05cd7a8381 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:55.211430 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-43e2d0f3-b2b0-45f0-83d0-9d05cd7a8381 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:55.211854 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-43e2d0f3-b2b0-45f0-83d0-9d05cd7a8381 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:55.245967 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-43e2d0f3-b2b0-45f0-83d0-9d05cd7a8381 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048539 Jun 17 13:14:55.246845 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 467/904] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:14:55 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:14:56.082877 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-29c7202b-9415-4977-a6b2-26c370bd6849 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:56.084425 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-29c7202b-9415-4977-a6b2-26c370bd6849 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:56.094131 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-29c7202b-9415-4977-a6b2-26c370bd6849 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:56.094888 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-29c7202b-9415-4977-a6b2-26c370bd6849 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:56.096083 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-29c7202b-9415-4977-a6b2-26c370bd6849 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:56.096778 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-29c7202b-9415-4977-a6b2-26c370bd6849 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:56.126709 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-29c7202b-9415-4977-a6b2-26c370bd6849 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051000 Jun 17 13:14:56.127254 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 438/905] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:56 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:56.191062 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-a9b5b882-e0ac-4f6b-9bec-cbce2360117e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:56.191955 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-a9b5b882-e0ac-4f6b-9bec-cbce2360117e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:56.198391 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a9b5b882-e0ac-4f6b-9bec-cbce2360117e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:56.198844 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a9b5b882-e0ac-4f6b-9bec-cbce2360117e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:56.199608 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a9b5b882-e0ac-4f6b-9bec-cbce2360117e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:56.200035 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a9b5b882-e0ac-4f6b-9bec-cbce2360117e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:56.229949 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-a9b5b882-e0ac-4f6b-9bec-cbce2360117e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043011 Jun 17 13:14:56.230649 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 468/906] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:56 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:56.257366 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-2d3b18b4-a123-409b-ba86-ca1f300b6c02 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:56.258328 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-2d3b18b4-a123-409b-ba86-ca1f300b6c02 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:56.265006 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2d3b18b4-a123-409b-ba86-ca1f300b6c02 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:56.265453 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2d3b18b4-a123-409b-ba86-ca1f300b6c02 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:56.266241 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2d3b18b4-a123-409b-ba86-ca1f300b6c02 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:56.266648 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2d3b18b4-a123-409b-ba86-ca1f300b6c02 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:56.300823 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-2d3b18b4-a123-409b-ba86-ca1f300b6c02 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047540 Jun 17 13:14:56.301403 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 439/907] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:14:56 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:14:57.139914 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-b5d035ab-75b2-4a0d-ae8d-8952153c970e tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:57.140839 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-b5d035ab-75b2-4a0d-ae8d-8952153c970e tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:57.147678 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b5d035ab-75b2-4a0d-ae8d-8952153c970e tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:57.148129 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b5d035ab-75b2-4a0d-ae8d-8952153c970e tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:57.148880 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b5d035ab-75b2-4a0d-ae8d-8952153c970e tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:57.149308 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b5d035ab-75b2-4a0d-ae8d-8952153c970e tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:57.179505 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-b5d035ab-75b2-4a0d-ae8d-8952153c970e tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043612 Jun 17 13:14:57.180035 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 469/908] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:57 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:57.243067 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-bcf18046-0c88-49fe-9c0b-d76a9aa40d9f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:57.244218 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-bcf18046-0c88-49fe-9c0b-d76a9aa40d9f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:57.251221 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bcf18046-0c88-49fe-9c0b-d76a9aa40d9f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:57.251718 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bcf18046-0c88-49fe-9c0b-d76a9aa40d9f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:57.252543 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bcf18046-0c88-49fe-9c0b-d76a9aa40d9f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:57.253026 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bcf18046-0c88-49fe-9c0b-d76a9aa40d9f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:57.283057 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-bcf18046-0c88-49fe-9c0b-d76a9aa40d9f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044659 Jun 17 13:14:57.283718 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 440/909] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:57 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:57.314570 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-d8290c18-02d7-4f61-b1c7-6e94f0e233a1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:57.315498 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-d8290c18-02d7-4f61-b1c7-6e94f0e233a1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:57.322673 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d8290c18-02d7-4f61-b1c7-6e94f0e233a1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:57.323090 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d8290c18-02d7-4f61-b1c7-6e94f0e233a1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:57.323866 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d8290c18-02d7-4f61-b1c7-6e94f0e233a1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:57.324293 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d8290c18-02d7-4f61-b1c7-6e94f0e233a1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:57.354499 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-d8290c18-02d7-4f61-b1c7-6e94f0e233a1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044700 Jun 17 13:14:57.355065 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 470/910] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:14:57 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:14:58.191674 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-0cb1ad10-0a2f-4d68-9a01-4ae7e482b5b2 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:58.192761 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-0cb1ad10-0a2f-4d68-9a01-4ae7e482b5b2 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:58.199447 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0cb1ad10-0a2f-4d68-9a01-4ae7e482b5b2 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:58.199885 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0cb1ad10-0a2f-4d68-9a01-4ae7e482b5b2 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:58.200640 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0cb1ad10-0a2f-4d68-9a01-4ae7e482b5b2 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:58.201065 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0cb1ad10-0a2f-4d68-9a01-4ae7e482b5b2 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:58.204696 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=100 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:14:58.231611 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-0cb1ad10-0a2f-4d68-9a01-4ae7e482b5b2 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043909 Jun 17 13:14:58.232168 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 441/911] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:58 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:58.295083 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-16793672-72c7-44d8-9a1e-ba1af76f7bdb tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:58.296026 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-16793672-72c7-44d8-9a1e-ba1af76f7bdb tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:58.303085 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-16793672-72c7-44d8-9a1e-ba1af76f7bdb tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:58.303536 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-16793672-72c7-44d8-9a1e-ba1af76f7bdb tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:58.304304 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-16793672-72c7-44d8-9a1e-ba1af76f7bdb tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:58.304744 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-16793672-72c7-44d8-9a1e-ba1af76f7bdb tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:58.331627 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_cell1:SELECT=100 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:14:58.336802 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-16793672-72c7-44d8-9a1e-ba1af76f7bdb tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045838 Jun 17 13:14:58.337393 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 471/912] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:58 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:58.367116 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-8602401b-e612-40e7-a48e-e0221900053a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:58.368034 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-8602401b-e612-40e7-a48e-e0221900053a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:58.375056 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8602401b-e612-40e7-a48e-e0221900053a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:58.375473 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8602401b-e612-40e7-a48e-e0221900053a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:58.376336 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8602401b-e612-40e7-a48e-e0221900053a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:58.376719 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8602401b-e612-40e7-a48e-e0221900053a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:58.410172 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-8602401b-e612-40e7-a48e-e0221900053a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047159 Jun 17 13:14:58.410860 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 442/913] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:14:58 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:14:59.244159 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-47bc22e0-b647-428b-8563-b0b237b12b18 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:59.245083 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-47bc22e0-b647-428b-8563-b0b237b12b18 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:59.251878 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-47bc22e0-b647-428b-8563-b0b237b12b18 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:59.252332 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-47bc22e0-b647-428b-8563-b0b237b12b18 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:59.253078 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-47bc22e0-b647-428b-8563-b0b237b12b18 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:59.253510 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-47bc22e0-b647-428b-8563-b0b237b12b18 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:59.289137 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-47bc22e0-b647-428b-8563-b0b237b12b18 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049033 Jun 17 13:14:59.289712 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 472/914] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:59 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:59.357584 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-7b8b30b5-58aa-40e5-b14c-5976ab118b79 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:59.359006 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-7b8b30b5-58aa-40e5-b14c-5976ab118b79 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:59.362763 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_api:SELECT=85 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:14:59.367964 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7b8b30b5-58aa-40e5-b14c-5976ab118b79 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:59.368563 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7b8b30b5-58aa-40e5-b14c-5976ab118b79 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:59.369485 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7b8b30b5-58aa-40e5-b14c-5976ab118b79 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:59.370142 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7b8b30b5-58aa-40e5-b14c-5976ab118b79 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:59.405909 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-7b8b30b5-58aa-40e5-b14c-5976ab118b79 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053843 Jun 17 13:14:59.406549 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 443/915] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:14:59 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:14:59.425205 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-db1f911d-f88c-4f02-b8fc-e26d13069772 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:14:59.426663 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-db1f911d-f88c-4f02-b8fc-e26d13069772 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:14:59.436340 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-db1f911d-f88c-4f02-b8fc-e26d13069772 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:59.436897 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-db1f911d-f88c-4f02-b8fc-e26d13069772 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:59.437855 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-db1f911d-f88c-4f02-b8fc-e26d13069772 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:14:59.438426 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-db1f911d-f88c-4f02-b8fc-e26d13069772 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:14:59.470776 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-db1f911d-f88c-4f02-b8fc-e26d13069772 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052302 Jun 17 13:14:59.471362 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 473/916] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:14:59 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:15:00.302374 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-20d465d4-2b4f-45a1-ab45-a1f299dcfe09 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:00.303297 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-20d465d4-2b4f-45a1-ab45-a1f299dcfe09 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:00.311061 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-20d465d4-2b4f-45a1-ab45-a1f299dcfe09 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:00.311505 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-20d465d4-2b4f-45a1-ab45-a1f299dcfe09 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:00.312282 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-20d465d4-2b4f-45a1-ab45-a1f299dcfe09 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:00.312784 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-20d465d4-2b4f-45a1-ab45-a1f299dcfe09 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:00.365343 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-20d465d4-2b4f-45a1-ab45-a1f299dcfe09 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066984 Jun 17 13:15:00.365904 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 444/917] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:00 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:00.421479 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-c6c04bf2-25f3-4a8f-8ea7-b93614354487 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:00.422990 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-c6c04bf2-25f3-4a8f-8ea7-b93614354487 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:00.432565 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c6c04bf2-25f3-4a8f-8ea7-b93614354487 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:00.433317 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c6c04bf2-25f3-4a8f-8ea7-b93614354487 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:00.433806 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c6c04bf2-25f3-4a8f-8ea7-b93614354487 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:00.434302 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c6c04bf2-25f3-4a8f-8ea7-b93614354487 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:00.469141 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-c6c04bf2-25f3-4a8f-8ea7-b93614354487 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054081 Jun 17 13:15:00.469745 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 474/918] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:00 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:00.483125 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-cb63f2a7-2caf-464b-a335-af0d2791a37f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:00.484087 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-cb63f2a7-2caf-464b-a335-af0d2791a37f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:00.492177 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cb63f2a7-2caf-464b-a335-af0d2791a37f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:00.492638 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cb63f2a7-2caf-464b-a335-af0d2791a37f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:00.493536 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cb63f2a7-2caf-464b-a335-af0d2791a37f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:00.493984 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cb63f2a7-2caf-464b-a335-af0d2791a37f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:00.528254 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-cb63f2a7-2caf-464b-a335-af0d2791a37f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049131 Jun 17 13:15:00.529107 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 445/919] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:15:00 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 17 13:15:01.377228 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-5953b798-8807-4e47-8ba9-cca84e2b3c10 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:01.378970 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-5953b798-8807-4e47-8ba9-cca84e2b3c10 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:01.386879 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-5953b798-8807-4e47-8ba9-cca84e2b3c10 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:01.387464 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-5953b798-8807-4e47-8ba9-cca84e2b3c10 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:01.388460 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-5953b798-8807-4e47-8ba9-cca84e2b3c10 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:01.389003 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-5953b798-8807-4e47-8ba9-cca84e2b3c10 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:01.422128 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-5953b798-8807-4e47-8ba9-cca84e2b3c10 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048936 Jun 17 13:15:01.422722 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 475/920] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:01 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:01.481763 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-c798e566-7800-45c9-a873-a29f592361e2 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:01.482784 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-c798e566-7800-45c9-a873-a29f592361e2 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:01.490620 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c798e566-7800-45c9-a873-a29f592361e2 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:01.491237 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c798e566-7800-45c9-a873-a29f592361e2 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:01.491852 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c798e566-7800-45c9-a873-a29f592361e2 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:01.492283 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c798e566-7800-45c9-a873-a29f592361e2 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:01.522399 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-c798e566-7800-45c9-a873-a29f592361e2 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044597 Jun 17 13:15:01.522956 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 446/921] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:01 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:01.540753 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-186de933-af28-4911-ad2d-745bb4df002c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:01.541689 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-186de933-af28-4911-ad2d-745bb4df002c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:01.548653 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-186de933-af28-4911-ad2d-745bb4df002c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:01.549107 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-186de933-af28-4911-ad2d-745bb4df002c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:01.549902 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-186de933-af28-4911-ad2d-745bb4df002c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:01.550378 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-186de933-af28-4911-ad2d-745bb4df002c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:01.580957 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-186de933-af28-4911-ad2d-745bb4df002c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044582 Jun 17 13:15:01.581541 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 476/922] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:15:01 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:15:02.433690 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-eaadf1e5-29cb-4db7-8ed8-50b5305241d3 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:02.434735 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-eaadf1e5-29cb-4db7-8ed8-50b5305241d3 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:02.440803 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-eaadf1e5-29cb-4db7-8ed8-50b5305241d3 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:02.441242 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-eaadf1e5-29cb-4db7-8ed8-50b5305241d3 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:02.441989 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-eaadf1e5-29cb-4db7-8ed8-50b5305241d3 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:02.442615 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-eaadf1e5-29cb-4db7-8ed8-50b5305241d3 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:02.471624 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-eaadf1e5-29cb-4db7-8ed8-50b5305241d3 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041883 Jun 17 13:15:02.472773 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 447/923] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:02 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:02.534185 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-9cf7a6c3-c947-4bb2-899e-ce010616a66f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:02.535091 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-9cf7a6c3-c947-4bb2-899e-ce010616a66f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:02.541627 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9cf7a6c3-c947-4bb2-899e-ce010616a66f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:02.542241 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9cf7a6c3-c947-4bb2-899e-ce010616a66f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:02.542844 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9cf7a6c3-c947-4bb2-899e-ce010616a66f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:02.543273 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9cf7a6c3-c947-4bb2-899e-ce010616a66f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:02.573143 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-9cf7a6c3-c947-4bb2-899e-ce010616a66f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042848 Jun 17 13:15:02.573620 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 477/924] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:02 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:02.593092 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-61fe5ef5-dce0-489c-85e5-e0b8e6345b7a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:02.594031 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-61fe5ef5-dce0-489c-85e5-e0b8e6345b7a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:02.601497 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-61fe5ef5-dce0-489c-85e5-e0b8e6345b7a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:02.601951 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-61fe5ef5-dce0-489c-85e5-e0b8e6345b7a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:02.602751 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-61fe5ef5-dce0-489c-85e5-e0b8e6345b7a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:02.603189 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-61fe5ef5-dce0-489c-85e5-e0b8e6345b7a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:02.633129 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-61fe5ef5-dce0-489c-85e5-e0b8e6345b7a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044065 Jun 17 13:15:02.633905 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 448/925] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:15:02 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:15:03.488035 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-44863685-2f80-4cf1-b1df-a614801c0fd9 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:03.489554 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-44863685-2f80-4cf1-b1df-a614801c0fd9 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:03.496926 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-44863685-2f80-4cf1-b1df-a614801c0fd9 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:03.497396 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-44863685-2f80-4cf1-b1df-a614801c0fd9 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:03.498296 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-44863685-2f80-4cf1-b1df-a614801c0fd9 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:03.498753 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-44863685-2f80-4cf1-b1df-a614801c0fd9 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:03.530401 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-44863685-2f80-4cf1-b1df-a614801c0fd9 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049309 Jun 17 13:15:03.530952 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 478/926] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:03 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:03.585094 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-71f3462c-3d5f-487f-9064-f027dd6e1ded tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:03.585948 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-71f3462c-3d5f-487f-9064-f027dd6e1ded tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:03.592253 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-71f3462c-3d5f-487f-9064-f027dd6e1ded tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:03.592699 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-71f3462c-3d5f-487f-9064-f027dd6e1ded tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:03.593451 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-71f3462c-3d5f-487f-9064-f027dd6e1ded tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:03.594026 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-71f3462c-3d5f-487f-9064-f027dd6e1ded tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:03.623844 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-71f3462c-3d5f-487f-9064-f027dd6e1ded tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042914 Jun 17 13:15:03.624385 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 449/927] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:03 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:03.646247 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-43de46fa-d812-4b10-b997-4798d9a2917d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:03.647173 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-43de46fa-d812-4b10-b997-4798d9a2917d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:03.654406 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-43de46fa-d812-4b10-b997-4798d9a2917d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:03.654858 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-43de46fa-d812-4b10-b997-4798d9a2917d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:03.655617 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-43de46fa-d812-4b10-b997-4798d9a2917d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:03.656050 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-43de46fa-d812-4b10-b997-4798d9a2917d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:03.686381 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-43de46fa-d812-4b10-b997-4798d9a2917d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044287 Jun 17 13:15:03.686955 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 479/928] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:15:03 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:15:04.545841 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-a19be47d-65a3-42b6-b33d-34a84d54b91f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:04.546995 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-a19be47d-65a3-42b6-b33d-34a84d54b91f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:04.556033 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a19be47d-65a3-42b6-b33d-34a84d54b91f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:04.556480 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a19be47d-65a3-42b6-b33d-34a84d54b91f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:04.557262 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a19be47d-65a3-42b6-b33d-34a84d54b91f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:04.557667 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a19be47d-65a3-42b6-b33d-34a84d54b91f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:04.593224 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-a19be47d-65a3-42b6-b33d-34a84d54b91f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054406 Jun 17 13:15:04.593696 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 450/929] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:04 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:04.638172 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-8b5bca61-7aae-4b19-bf21-f53b8511ecbd tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:04.639131 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-8b5bca61-7aae-4b19-bf21-f53b8511ecbd tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:04.652776 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8b5bca61-7aae-4b19-bf21-f53b8511ecbd tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:04.653457 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8b5bca61-7aae-4b19-bf21-f53b8511ecbd tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:04.653970 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8b5bca61-7aae-4b19-bf21-f53b8511ecbd tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:04.654431 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8b5bca61-7aae-4b19-bf21-f53b8511ecbd tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:04.688938 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-8b5bca61-7aae-4b19-bf21-f53b8511ecbd tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056544 Jun 17 13:15:04.689529 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 480/930] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:04 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 13:15:04.699816 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-d9d53b23-509f-4e56-8287-e20a35162777 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:04.700832 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-d9d53b23-509f-4e56-8287-e20a35162777 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:04.707630 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d9d53b23-509f-4e56-8287-e20a35162777 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:04.708122 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d9d53b23-509f-4e56-8287-e20a35162777 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:04.709485 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d9d53b23-509f-4e56-8287-e20a35162777 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:04.710299 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d9d53b23-509f-4e56-8287-e20a35162777 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:04.748135 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-d9d53b23-509f-4e56-8287-e20a35162777 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053542 Jun 17 13:15:04.748897 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 451/931] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:15:04 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:15:05.610013 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-fe3a8491-0c72-4b74-83d8-44458a34a6e6 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:05.611710 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-fe3a8491-0c72-4b74-83d8-44458a34a6e6 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:05.619650 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-fe3a8491-0c72-4b74-83d8-44458a34a6e6 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:05.620108 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-fe3a8491-0c72-4b74-83d8-44458a34a6e6 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:05.620870 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-fe3a8491-0c72-4b74-83d8-44458a34a6e6 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:05.621310 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-fe3a8491-0c72-4b74-83d8-44458a34a6e6 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:05.651032 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-fe3a8491-0c72-4b74-83d8-44458a34a6e6 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047920 Jun 17 13:15:05.651585 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 481/932] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:05 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:05.701104 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-4a28c8e5-e7c6-4bbc-8002-5fbe6d193367 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:05.702071 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-4a28c8e5-e7c6-4bbc-8002-5fbe6d193367 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:05.709205 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4a28c8e5-e7c6-4bbc-8002-5fbe6d193367 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:05.709658 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4a28c8e5-e7c6-4bbc-8002-5fbe6d193367 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:05.710459 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4a28c8e5-e7c6-4bbc-8002-5fbe6d193367 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:05.710897 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4a28c8e5-e7c6-4bbc-8002-5fbe6d193367 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:05.761069 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-55164d80-4f65-430d-b49f-b8b5f0b5dd86 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:05.762148 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-55164d80-4f65-430d-b49f-b8b5f0b5dd86 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:05.769219 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-55164d80-4f65-430d-b49f-b8b5f0b5dd86 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:05.769677 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-55164d80-4f65-430d-b49f-b8b5f0b5dd86 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:05.770672 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-55164d80-4f65-430d-b49f-b8b5f0b5dd86 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:05.771304 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-55164d80-4f65-430d-b49f-b8b5f0b5dd86 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:05.805561 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-55164d80-4f65-430d-b49f-b8b5f0b5dd86 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048515 Jun 17 13:15:05.806413 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 482/933] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:15:05 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:15:05.901780 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-4a28c8e5-e7c6-4bbc-8002-5fbe6d193367 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.204683 Jun 17 13:15:05.902374 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 452/934] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:05 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:06.665277 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-f01e8a7c-804b-458f-a939-00a5504899cb tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:06.666260 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-f01e8a7c-804b-458f-a939-00a5504899cb tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:06.668165 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_api:SELECT=85 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:15:06.673633 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f01e8a7c-804b-458f-a939-00a5504899cb tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:06.674115 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f01e8a7c-804b-458f-a939-00a5504899cb tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:06.674873 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f01e8a7c-804b-458f-a939-00a5504899cb tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:06.675309 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f01e8a7c-804b-458f-a939-00a5504899cb tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:06.705913 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-f01e8a7c-804b-458f-a939-00a5504899cb tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045924 Jun 17 13:15:06.706507 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 483/935] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:06 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:06.822498 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-31580a6f-05b8-498f-9f2f-4ee64c552502 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:06.823422 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-31580a6f-05b8-498f-9f2f-4ee64c552502 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:06.830599 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-31580a6f-05b8-498f-9f2f-4ee64c552502 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:06.831042 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-31580a6f-05b8-498f-9f2f-4ee64c552502 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:06.831806 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-31580a6f-05b8-498f-9f2f-4ee64c552502 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:06.832237 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-31580a6f-05b8-498f-9f2f-4ee64c552502 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:06.863690 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-31580a6f-05b8-498f-9f2f-4ee64c552502 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047635 Jun 17 13:15:06.864347 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 453/936] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:15:06 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:15:06.914944 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-4b78b356-ae59-44b6-bfb7-870be9f7e0ad tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:06.915899 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-4b78b356-ae59-44b6-bfb7-870be9f7e0ad tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:06.922732 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4b78b356-ae59-44b6-bfb7-870be9f7e0ad tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:06.923189 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4b78b356-ae59-44b6-bfb7-870be9f7e0ad tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:06.923960 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4b78b356-ae59-44b6-bfb7-870be9f7e0ad tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:06.924398 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4b78b356-ae59-44b6-bfb7-870be9f7e0ad tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:06.954565 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-4b78b356-ae59-44b6-bfb7-870be9f7e0ad tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044276 Jun 17 13:15:06.955181 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 484/937] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:06 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:07.717257 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-e47b1841-b8c3-40fd-8a8c-56a6aa47460b tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:07.718228 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-e47b1841-b8c3-40fd-8a8c-56a6aa47460b tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:07.725390 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e47b1841-b8c3-40fd-8a8c-56a6aa47460b tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:07.725678 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e47b1841-b8c3-40fd-8a8c-56a6aa47460b tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:07.726467 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e47b1841-b8c3-40fd-8a8c-56a6aa47460b tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:07.726892 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e47b1841-b8c3-40fd-8a8c-56a6aa47460b tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:07.757746 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-e47b1841-b8c3-40fd-8a8c-56a6aa47460b tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044459 Jun 17 13:15:07.758344 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 454/938] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:07 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:07.880318 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-5b170ed2-e469-4db7-84a6-a199095a729a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:07.882237 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-5b170ed2-e469-4db7-84a6-a199095a729a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:07.892351 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-5b170ed2-e469-4db7-84a6-a199095a729a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:07.893086 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-5b170ed2-e469-4db7-84a6-a199095a729a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:07.894386 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-5b170ed2-e469-4db7-84a6-a199095a729a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:07.895131 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-5b170ed2-e469-4db7-84a6-a199095a729a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:07.925962 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-5b170ed2-e469-4db7-84a6-a199095a729a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052507 Jun 17 13:15:07.926905 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 485/939] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:15:07 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:15:07.966111 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-279e8614-3546-41d1-a85c-0f383a9e2d46 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:07.967044 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-279e8614-3546-41d1-a85c-0f383a9e2d46 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:07.973775 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-279e8614-3546-41d1-a85c-0f383a9e2d46 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:07.974243 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-279e8614-3546-41d1-a85c-0f383a9e2d46 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:07.975009 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-279e8614-3546-41d1-a85c-0f383a9e2d46 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:07.975441 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-279e8614-3546-41d1-a85c-0f383a9e2d46 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:08.005235 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-279e8614-3546-41d1-a85c-0f383a9e2d46 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043231 Jun 17 13:15:08.005776 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 455/940] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:07 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:08.774910 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-566fbec5-4f3a-4e57-94e0-3c2b872765ed tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:08.776026 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-566fbec5-4f3a-4e57-94e0-3c2b872765ed tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:08.783673 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-566fbec5-4f3a-4e57-94e0-3c2b872765ed tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:08.784196 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-566fbec5-4f3a-4e57-94e0-3c2b872765ed tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:08.785084 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-566fbec5-4f3a-4e57-94e0-3c2b872765ed tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:08.785590 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-566fbec5-4f3a-4e57-94e0-3c2b872765ed tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:08.818151 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-566fbec5-4f3a-4e57-94e0-3c2b872765ed tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049143 Jun 17 13:15:08.818738 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 486/941] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:08 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:08.941582 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-9c3f327e-ba4b-4a57-97f4-5a2be7d56a23 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:08.943084 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-9c3f327e-ba4b-4a57-97f4-5a2be7d56a23 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:08.949893 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9c3f327e-ba4b-4a57-97f4-5a2be7d56a23 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:08.950383 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9c3f327e-ba4b-4a57-97f4-5a2be7d56a23 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:08.951144 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9c3f327e-ba4b-4a57-97f4-5a2be7d56a23 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:08.951570 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9c3f327e-ba4b-4a57-97f4-5a2be7d56a23 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:08.981260 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-9c3f327e-ba4b-4a57-97f4-5a2be7d56a23 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046425 Jun 17 13:15:08.981892 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 456/942] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:15:08 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:15:09.016881 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-48488137-e409-4cee-ac51-1e4c94c27578 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:09.017790 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-48488137-e409-4cee-ac51-1e4c94c27578 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:09.024367 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-48488137-e409-4cee-ac51-1e4c94c27578 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:09.024809 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-48488137-e409-4cee-ac51-1e4c94c27578 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:09.025614 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-48488137-e409-4cee-ac51-1e4c94c27578 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:09.025991 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-48488137-e409-4cee-ac51-1e4c94c27578 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:09.057101 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-48488137-e409-4cee-ac51-1e4c94c27578 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044124 Jun 17 13:15:09.057654 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 487/943] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:09 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:09.834320 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-e5ac1319-4c3a-4097-a405-d295098bfdc5 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:09.835843 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-e5ac1319-4c3a-4097-a405-d295098bfdc5 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:09.846000 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e5ac1319-4c3a-4097-a405-d295098bfdc5 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:09.846791 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e5ac1319-4c3a-4097-a405-d295098bfdc5 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:09.848032 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e5ac1319-4c3a-4097-a405-d295098bfdc5 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:09.848745 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e5ac1319-4c3a-4097-a405-d295098bfdc5 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:09.878530 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=100 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:15:09.886539 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-e5ac1319-4c3a-4097-a405-d295098bfdc5 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058728 Jun 17 13:15:09.887359 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 457/944] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:09 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:09.993738 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-3c73ebee-aaeb-4c33-b856-bd6ee9b2618c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:09.994708 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-3c73ebee-aaeb-4c33-b856-bd6ee9b2618c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:10.001810 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-3c73ebee-aaeb-4c33-b856-bd6ee9b2618c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:10.002362 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-3c73ebee-aaeb-4c33-b856-bd6ee9b2618c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:10.003195 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-3c73ebee-aaeb-4c33-b856-bd6ee9b2618c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:10.003683 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-3c73ebee-aaeb-4c33-b856-bd6ee9b2618c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:10.021574 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_cell1:SELECT=100 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:15:10.035659 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-3c73ebee-aaeb-4c33-b856-bd6ee9b2618c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046252 Jun 17 13:15:10.036234 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 488/945] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:15:09 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:15:10.068981 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-21eebdd8-8d47-4af4-802b-6a98604ec364 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:10.069912 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-21eebdd8-8d47-4af4-802b-6a98604ec364 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:10.076886 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-21eebdd8-8d47-4af4-802b-6a98604ec364 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:10.077330 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-21eebdd8-8d47-4af4-802b-6a98604ec364 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:10.078121 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-21eebdd8-8d47-4af4-802b-6a98604ec364 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:10.078576 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-21eebdd8-8d47-4af4-802b-6a98604ec364 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:10.109691 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-21eebdd8-8d47-4af4-802b-6a98604ec364 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044556 Jun 17 13:15:10.110236 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 458/946] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:10 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:11.035726 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-5c2738a2-3079-4f65-8c91-b56c172d58d2 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:11.037098 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-5c2738a2-3079-4f65-8c91-b56c172d58d2 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:11.044627 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-5c2738a2-3079-4f65-8c91-b56c172d58d2 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:11.045073 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-5c2738a2-3079-4f65-8c91-b56c172d58d2 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:11.045844 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-5c2738a2-3079-4f65-8c91-b56c172d58d2 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:11.046321 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-5c2738a2-3079-4f65-8c91-b56c172d58d2 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:11.048099 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-66256b0a-bcf5-4c74-9740-d963b131f4e0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:11.049010 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-66256b0a-bcf5-4c74-9740-d963b131f4e0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:11.055573 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-66256b0a-bcf5-4c74-9740-d963b131f4e0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:11.056021 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-66256b0a-bcf5-4c74-9740-d963b131f4e0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:11.056757 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-66256b0a-bcf5-4c74-9740-d963b131f4e0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:11.057180 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-66256b0a-bcf5-4c74-9740-d963b131f4e0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:11.077323 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-5c2738a2-3079-4f65-8c91-b56c172d58d2 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.180813 Jun 17 13:15:11.077894 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 489/947] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:10 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:11.086269 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-66256b0a-bcf5-4c74-9740-d963b131f4e0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042012 Jun 17 13:15:11.086767 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 459/948] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:15:11 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:15:11.125453 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-4c1f2b82-18d1-4353-93f0-6c15badf7fb9 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:11.126999 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-4c1f2b82-18d1-4353-93f0-6c15badf7fb9 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:11.135208 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4c1f2b82-18d1-4353-93f0-6c15badf7fb9 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:11.135661 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4c1f2b82-18d1-4353-93f0-6c15badf7fb9 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:11.136423 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4c1f2b82-18d1-4353-93f0-6c15badf7fb9 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:11.136868 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4c1f2b82-18d1-4353-93f0-6c15badf7fb9 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:11.166924 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-4c1f2b82-18d1-4353-93f0-6c15badf7fb9 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048834 Jun 17 13:15:11.167484 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 490/949] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:11 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:12.093092 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-39b0dd86-d4ca-49d7-b64d-dfb8cfb0aa77 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:12.094703 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-39b0dd86-d4ca-49d7-b64d-dfb8cfb0aa77 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:12.102535 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-f781d1d4-23a9-4891-b7f1-06c06f53052e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:12.103461 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-f781d1d4-23a9-4891-b7f1-06c06f53052e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:12.104046 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-39b0dd86-d4ca-49d7-b64d-dfb8cfb0aa77 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:12.104506 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-39b0dd86-d4ca-49d7-b64d-dfb8cfb0aa77 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:12.105260 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-39b0dd86-d4ca-49d7-b64d-dfb8cfb0aa77 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:12.105683 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-39b0dd86-d4ca-49d7-b64d-dfb8cfb0aa77 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:12.109665 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f781d1d4-23a9-4891-b7f1-06c06f53052e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:12.110131 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f781d1d4-23a9-4891-b7f1-06c06f53052e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:12.111255 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f781d1d4-23a9-4891-b7f1-06c06f53052e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:12.111692 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f781d1d4-23a9-4891-b7f1-06c06f53052e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:12.136200 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-39b0dd86-d4ca-49d7-b64d-dfb8cfb0aa77 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050189 Jun 17 13:15:12.136723 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 460/950] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:12 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:12.141944 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-f781d1d4-23a9-4891-b7f1-06c06f53052e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047626 Jun 17 13:15:12.142620 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 491/951] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:15:12 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:15:12.178332 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-381d1a23-e061-4d04-9c09-193fa32f6f54 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:12.179443 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-381d1a23-e061-4d04-9c09-193fa32f6f54 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:12.185471 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-381d1a23-e061-4d04-9c09-193fa32f6f54 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:12.185933 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-381d1a23-e061-4d04-9c09-193fa32f6f54 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:12.186709 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-381d1a23-e061-4d04-9c09-193fa32f6f54 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:12.187199 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-381d1a23-e061-4d04-9c09-193fa32f6f54 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:12.217523 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-381d1a23-e061-4d04-9c09-193fa32f6f54 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043092 Jun 17 13:15:12.218097 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 461/952] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:12 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:13.151849 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-f11611f9-1ee1-41cd-91b7-8f8a13f57b9b tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:13.152994 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-f11611f9-1ee1-41cd-91b7-8f8a13f57b9b tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:13.156670 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-5e344d0a-74fb-4afa-89e5-3660e7dbdfbb tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:13.157866 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-5e344d0a-74fb-4afa-89e5-3660e7dbdfbb tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:13.161426 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f11611f9-1ee1-41cd-91b7-8f8a13f57b9b tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:13.161977 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f11611f9-1ee1-41cd-91b7-8f8a13f57b9b tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:13.162966 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f11611f9-1ee1-41cd-91b7-8f8a13f57b9b tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:13.163503 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f11611f9-1ee1-41cd-91b7-8f8a13f57b9b tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:13.166597 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5e344d0a-74fb-4afa-89e5-3660e7dbdfbb tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:13.167120 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5e344d0a-74fb-4afa-89e5-3660e7dbdfbb tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:13.168095 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5e344d0a-74fb-4afa-89e5-3660e7dbdfbb tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:13.168631 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5e344d0a-74fb-4afa-89e5-3660e7dbdfbb tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:13.197930 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-f11611f9-1ee1-41cd-91b7-8f8a13f57b9b tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052269 Jun 17 13:15:13.198707 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 492/953] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:13 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:13.202523 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-5e344d0a-74fb-4afa-89e5-3660e7dbdfbb tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050619 Jun 17 13:15:13.203185 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 462/954] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:15:13 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:15:13.228738 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-a189775a-1b33-466c-b36f-3bf7d3672c89 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:13.229690 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-a189775a-1b33-466c-b36f-3bf7d3672c89 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:13.236726 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a189775a-1b33-466c-b36f-3bf7d3672c89 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:13.237171 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a189775a-1b33-466c-b36f-3bf7d3672c89 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:13.237927 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a189775a-1b33-466c-b36f-3bf7d3672c89 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:13.238392 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a189775a-1b33-466c-b36f-3bf7d3672c89 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:13.268627 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-a189775a-1b33-466c-b36f-3bf7d3672c89 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043802 Jun 17 13:15:13.269185 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 493/955] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:13 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:14.210440 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-697bea74-9309-4a65-b250-1b13f9f9910a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:14.211362 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-697bea74-9309-4a65-b250-1b13f9f9910a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:14.214321 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-809598ce-6bd3-4cc3-af04-8817cdec3025 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:14.215274 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-809598ce-6bd3-4cc3-af04-8817cdec3025 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:14.219042 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-697bea74-9309-4a65-b250-1b13f9f9910a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:14.219498 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-697bea74-9309-4a65-b250-1b13f9f9910a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:14.220266 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-697bea74-9309-4a65-b250-1b13f9f9910a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:14.220700 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-697bea74-9309-4a65-b250-1b13f9f9910a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:14.221970 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-809598ce-6bd3-4cc3-af04-8817cdec3025 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:14.222443 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-809598ce-6bd3-4cc3-af04-8817cdec3025 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:14.223212 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-809598ce-6bd3-4cc3-af04-8817cdec3025 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:14.223630 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-809598ce-6bd3-4cc3-af04-8817cdec3025 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:14.250476 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-697bea74-9309-4a65-b250-1b13f9f9910a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044808 Jun 17 13:15:14.251036 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 463/956] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:14 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:14.254066 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-809598ce-6bd3-4cc3-af04-8817cdec3025 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043683 Jun 17 13:15:14.254743 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 494/957] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:15:14 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:15:14.279828 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-02d8b7fa-4ec3-4fd4-ab90-55b96356a419 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:14.280780 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-02d8b7fa-4ec3-4fd4-ab90-55b96356a419 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:14.287186 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-02d8b7fa-4ec3-4fd4-ab90-55b96356a419 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:14.287638 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-02d8b7fa-4ec3-4fd4-ab90-55b96356a419 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:14.288408 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-02d8b7fa-4ec3-4fd4-ab90-55b96356a419 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:14.288847 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-02d8b7fa-4ec3-4fd4-ab90-55b96356a419 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:14.320039 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-02d8b7fa-4ec3-4fd4-ab90-55b96356a419 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044016 Jun 17 13:15:14.320861 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 464/958] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:14 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:15.266671 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-18a4663e-665f-41c2-ad32-6d53fd8e5549 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:15.268174 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-18a4663e-665f-41c2-ad32-6d53fd8e5549 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:15.269461 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-88e43251-0feb-4e46-8a13-1db654a35fbc tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:15.270976 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-88e43251-0feb-4e46-8a13-1db654a35fbc tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:15.277497 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-18a4663e-665f-41c2-ad32-6d53fd8e5549 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:15.277946 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-18a4663e-665f-41c2-ad32-6d53fd8e5549 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:15.279157 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-18a4663e-665f-41c2-ad32-6d53fd8e5549 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:15.279302 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-88e43251-0feb-4e46-8a13-1db654a35fbc tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:15.279681 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-88e43251-0feb-4e46-8a13-1db654a35fbc tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:15.279835 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-18a4663e-665f-41c2-ad32-6d53fd8e5549 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:15.280446 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-88e43251-0feb-4e46-8a13-1db654a35fbc tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:15.280870 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-88e43251-0feb-4e46-8a13-1db654a35fbc tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:15.314106 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-88e43251-0feb-4e46-8a13-1db654a35fbc tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050823 Jun 17 13:15:15.314312 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-18a4663e-665f-41c2-ad32-6d53fd8e5549 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054284 Jun 17 13:15:15.315079 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 495/959] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:15 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:15.317036 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 465/960] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:15:15 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:15:15.332280 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-479ceb3b-1f13-46bf-a9f8-e297f0cba46b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:15.333212 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-479ceb3b-1f13-46bf-a9f8-e297f0cba46b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:15.339338 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-479ceb3b-1f13-46bf-a9f8-e297f0cba46b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:15.339815 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-479ceb3b-1f13-46bf-a9f8-e297f0cba46b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:15.340595 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-479ceb3b-1f13-46bf-a9f8-e297f0cba46b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:15.341020 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-479ceb3b-1f13-46bf-a9f8-e297f0cba46b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:15.370634 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-479ceb3b-1f13-46bf-a9f8-e297f0cba46b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042238 Jun 17 13:15:15.371445 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 496/961] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:15 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:16.328175 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-6ed900f5-59c5-429e-a419-364747d7a2fd tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:16.328646 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-09d0dd8e-2a74-44e8-b0aa-66942cc1c2db tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:16.329082 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-6ed900f5-59c5-429e-a419-364747d7a2fd tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:16.329194 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-09d0dd8e-2a74-44e8-b0aa-66942cc1c2db tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:16.336003 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6ed900f5-59c5-429e-a419-364747d7a2fd tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:16.336169 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-09d0dd8e-2a74-44e8-b0aa-66942cc1c2db tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:16.336462 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6ed900f5-59c5-429e-a419-364747d7a2fd tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:16.336608 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-09d0dd8e-2a74-44e8-b0aa-66942cc1c2db tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:16.337283 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-09d0dd8e-2a74-44e8-b0aa-66942cc1c2db tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:16.337726 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-09d0dd8e-2a74-44e8-b0aa-66942cc1c2db tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:16.337915 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6ed900f5-59c5-429e-a419-364747d7a2fd tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:16.338420 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6ed900f5-59c5-429e-a419-364747d7a2fd tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:16.369438 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-09d0dd8e-2a74-44e8-b0aa-66942cc1c2db tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045126 Jun 17 13:15:16.369998 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-6ed900f5-59c5-429e-a419-364747d7a2fd tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045832 Jun 17 13:15:16.370180 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 497/962] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:15:16 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:15:16.370626 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 466/963] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:16 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:16.382467 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-d84699c1-51a3-4e38-bb5c-2a4cb2fa8980 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:16.383483 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-d84699c1-51a3-4e38-bb5c-2a4cb2fa8980 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:16.390196 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d84699c1-51a3-4e38-bb5c-2a4cb2fa8980 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:16.390668 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d84699c1-51a3-4e38-bb5c-2a4cb2fa8980 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:16.391433 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d84699c1-51a3-4e38-bb5c-2a4cb2fa8980 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:16.391868 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d84699c1-51a3-4e38-bb5c-2a4cb2fa8980 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:16.420944 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-d84699c1-51a3-4e38-bb5c-2a4cb2fa8980 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042212 Jun 17 13:15:16.421501 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 498/964] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:16 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:17.381443 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-c3558a00-c80a-4d1e-a27a-d6e188e479d4 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:17.382074 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-590d9370-cd1e-4f4e-b21f-26209f1485ec tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:17.382488 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-590d9370-cd1e-4f4e-b21f-26209f1485ec tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:17.382600 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-c3558a00-c80a-4d1e-a27a-d6e188e479d4 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:17.389382 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-590d9370-cd1e-4f4e-b21f-26209f1485ec tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:17.389830 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-590d9370-cd1e-4f4e-b21f-26209f1485ec tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:17.390434 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c3558a00-c80a-4d1e-a27a-d6e188e479d4 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:17.390785 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-590d9370-cd1e-4f4e-b21f-26209f1485ec tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:17.390917 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c3558a00-c80a-4d1e-a27a-d6e188e479d4 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:17.391241 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-590d9370-cd1e-4f4e-b21f-26209f1485ec tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:17.391663 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c3558a00-c80a-4d1e-a27a-d6e188e479d4 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:17.392069 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c3558a00-c80a-4d1e-a27a-d6e188e479d4 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:17.421703 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-590d9370-cd1e-4f4e-b21f-26209f1485ec tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044357 Jun 17 13:15:17.422297 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 467/965] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:15:17 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:15:17.422503 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-c3558a00-c80a-4d1e-a27a-d6e188e479d4 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045190 Jun 17 13:15:17.423072 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 499/966] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:17 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:17.432930 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-aef94132-e674-4395-8afd-8c877501ad88 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:17.433861 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-aef94132-e674-4395-8afd-8c877501ad88 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:17.439909 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-aef94132-e674-4395-8afd-8c877501ad88 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:17.440357 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-aef94132-e674-4395-8afd-8c877501ad88 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:17.441112 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-aef94132-e674-4395-8afd-8c877501ad88 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:17.441544 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-aef94132-e674-4395-8afd-8c877501ad88 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:17.474008 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-aef94132-e674-4395-8afd-8c877501ad88 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044776 Jun 17 13:15:17.474959 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 468/967] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:17 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:18.433794 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-466c50c3-cd90-4715-a289-e3ca606fd9d1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:18.434795 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-466c50c3-cd90-4715-a289-e3ca606fd9d1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:18.434963 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-191dc209-d98a-4ecc-8071-a18a0101b555 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:18.439219 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-191dc209-d98a-4ecc-8071-a18a0101b555 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:18.441941 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-466c50c3-cd90-4715-a289-e3ca606fd9d1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:18.442429 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-466c50c3-cd90-4715-a289-e3ca606fd9d1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:18.443232 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-466c50c3-cd90-4715-a289-e3ca606fd9d1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:18.443820 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-466c50c3-cd90-4715-a289-e3ca606fd9d1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:18.447400 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-191dc209-d98a-4ecc-8071-a18a0101b555 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:18.447854 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-191dc209-d98a-4ecc-8071-a18a0101b555 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:18.448627 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-191dc209-d98a-4ecc-8071-a18a0101b555 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:18.449061 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-191dc209-d98a-4ecc-8071-a18a0101b555 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:18.475233 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-466c50c3-cd90-4715-a289-e3ca606fd9d1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045594 Jun 17 13:15:18.476154 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 500/968] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:15:18 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:15:18.480383 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-191dc209-d98a-4ecc-8071-a18a0101b555 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050021 Jun 17 13:15:18.481203 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 469/969] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:18 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:18.487143 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-f62ec249-f42b-41dc-8b9d-c562fda22111 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:18.488066 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-f62ec249-f42b-41dc-8b9d-c562fda22111 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:18.494885 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f62ec249-f42b-41dc-8b9d-c562fda22111 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:18.495455 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f62ec249-f42b-41dc-8b9d-c562fda22111 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:18.496216 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f62ec249-f42b-41dc-8b9d-c562fda22111 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:18.496643 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f62ec249-f42b-41dc-8b9d-c562fda22111 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:18.527423 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-f62ec249-f42b-41dc-8b9d-c562fda22111 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044799 Jun 17 13:15:18.528185 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 501/970] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:18 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:19.493114 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-8a962c97-99e4-4e7a-9ccd-aeab1edf9285 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:19.494878 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-8a962c97-99e4-4e7a-9ccd-aeab1edf9285 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:19.497196 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-31295aad-d26e-4cdd-b91a-7912465ac9a5 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:19.498737 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-31295aad-d26e-4cdd-b91a-7912465ac9a5 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:19.505075 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8a962c97-99e4-4e7a-9ccd-aeab1edf9285 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:19.505782 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8a962c97-99e4-4e7a-9ccd-aeab1edf9285 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:19.507092 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8a962c97-99e4-4e7a-9ccd-aeab1edf9285 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:19.507801 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8a962c97-99e4-4e7a-9ccd-aeab1edf9285 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:19.509483 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-31295aad-d26e-4cdd-b91a-7912465ac9a5 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:19.510796 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-31295aad-d26e-4cdd-b91a-7912465ac9a5 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:19.511457 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-31295aad-d26e-4cdd-b91a-7912465ac9a5 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:19.511901 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-31295aad-d26e-4cdd-b91a-7912465ac9a5 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:19.538782 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-8a962c97-99e4-4e7a-9ccd-aeab1edf9285 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052496 Jun 17 13:15:19.539356 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 470/971] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:15:19 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:15:19.543917 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-25db3aef-9771-478c-84e3-83ed4caf2573 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:19.544841 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-25db3aef-9771-478c-84e3-83ed4caf2573 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:19.549344 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-31295aad-d26e-4cdd-b91a-7912465ac9a5 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059729 Jun 17 13:15:19.549918 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 502/972] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:19 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:19.550649 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-25db3aef-9771-478c-84e3-83ed4caf2573 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:19.551064 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-25db3aef-9771-478c-84e3-83ed4caf2573 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:19.551822 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-25db3aef-9771-478c-84e3-83ed4caf2573 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:19.552236 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-25db3aef-9771-478c-84e3-83ed4caf2573 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:19.581453 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-25db3aef-9771-478c-84e3-83ed4caf2573 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041086 Jun 17 13:15:19.582003 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 471/973] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:19 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:20.555026 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-57117ee5-c57a-4f16-bad3-a982252e579f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:20.556560 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-57117ee5-c57a-4f16-bad3-a982252e579f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:20.561963 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-1992a251-2178-419e-a617-84549fa83923 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:20.563430 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-57117ee5-c57a-4f16-bad3-a982252e579f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:20.563596 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-1992a251-2178-419e-a617-84549fa83923 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:20.563883 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-57117ee5-c57a-4f16-bad3-a982252e579f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:20.564648 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-57117ee5-c57a-4f16-bad3-a982252e579f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:20.565081 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-57117ee5-c57a-4f16-bad3-a982252e579f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:20.570043 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1992a251-2178-419e-a617-84549fa83923 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:20.570450 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1992a251-2178-419e-a617-84549fa83923 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:20.571222 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1992a251-2178-419e-a617-84549fa83923 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:20.571655 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1992a251-2178-419e-a617-84549fa83923 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:20.595997 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-57117ee5-c57a-4f16-bad3-a982252e579f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047757 Jun 17 13:15:20.600393 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 503/974] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:15:20 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:15:20.601702 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-7ef41efc-864f-41ee-a7d7-bb01890cfc64 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:20.602629 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-7ef41efc-864f-41ee-a7d7-bb01890cfc64 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:20.605323 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-1992a251-2178-419e-a617-84549fa83923 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047494 Jun 17 13:15:20.606234 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 472/975] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:20 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:20.609115 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7ef41efc-864f-41ee-a7d7-bb01890cfc64 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:20.609601 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7ef41efc-864f-41ee-a7d7-bb01890cfc64 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:20.610740 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7ef41efc-864f-41ee-a7d7-bb01890cfc64 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:20.611175 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7ef41efc-864f-41ee-a7d7-bb01890cfc64 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:20.640938 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-7ef41efc-864f-41ee-a7d7-bb01890cfc64 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043001 Jun 17 13:15:20.641681 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 504/976] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:20 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:21.612649 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-8060b4a5-24e3-4482-8290-e118f696b80f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:21.613909 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-8060b4a5-24e3-4482-8290-e118f696b80f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:21.621756 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-0d3555ed-6939-4fc2-b20e-9ee7f4629370 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:21.623306 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-0d3555ed-6939-4fc2-b20e-9ee7f4629370 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:21.625743 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8060b4a5-24e3-4482-8290-e118f696b80f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:21.626596 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8060b4a5-24e3-4482-8290-e118f696b80f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:21.627857 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8060b4a5-24e3-4482-8290-e118f696b80f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:21.628579 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8060b4a5-24e3-4482-8290-e118f696b80f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:21.634230 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0d3555ed-6939-4fc2-b20e-9ee7f4629370 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:21.635596 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0d3555ed-6939-4fc2-b20e-9ee7f4629370 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:21.636387 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0d3555ed-6939-4fc2-b20e-9ee7f4629370 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:21.636820 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0d3555ed-6939-4fc2-b20e-9ee7f4629370 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:21.640621 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_cell1:SELECT=100 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:15:21.662265 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-8060b4a5-24e3-4482-8290-e118f696b80f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056920 Jun 17 13:15:21.666410 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 473/977] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:15:21 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:15:21.667423 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-0d3555ed-6939-4fc2-b20e-9ee7f4629370 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052787 Jun 17 13:15:21.667839 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-58fae2b1-f2b5-46dd-adaf-84f92bd9dca9 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:21.668254 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 505/978] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:21 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:21.668755 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-58fae2b1-f2b5-46dd-adaf-84f92bd9dca9 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:21.674786 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-58fae2b1-f2b5-46dd-adaf-84f92bd9dca9 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:21.675240 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-58fae2b1-f2b5-46dd-adaf-84f92bd9dca9 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:21.676001 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-58fae2b1-f2b5-46dd-adaf-84f92bd9dca9 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:21.676440 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-58fae2b1-f2b5-46dd-adaf-84f92bd9dca9 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:21.694134 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=100 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:15:21.708850 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-58fae2b1-f2b5-46dd-adaf-84f92bd9dca9 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044854 Jun 17 13:15:21.709410 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 474/979] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:21 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:22.678677 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-7376d4b3-c2fb-4050-8c1b-8077c9d0cea5 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:22.680687 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-7376d4b3-c2fb-4050-8c1b-8077c9d0cea5 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:22.682547 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-9be7a0c1-5c87-46aa-94c9-e65458cbaf64 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:22.683533 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-9be7a0c1-5c87-46aa-94c9-e65458cbaf64 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:22.688662 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7376d4b3-c2fb-4050-8c1b-8077c9d0cea5 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:22.689118 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7376d4b3-c2fb-4050-8c1b-8077c9d0cea5 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:22.689883 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7376d4b3-c2fb-4050-8c1b-8077c9d0cea5 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:22.690323 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7376d4b3-c2fb-4050-8c1b-8077c9d0cea5 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:22.690572 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9be7a0c1-5c87-46aa-94c9-e65458cbaf64 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:22.691046 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9be7a0c1-5c87-46aa-94c9-e65458cbaf64 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:22.691798 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9be7a0c1-5c87-46aa-94c9-e65458cbaf64 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:22.692546 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9be7a0c1-5c87-46aa-94c9-e65458cbaf64 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:22.720726 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-7376d4b3-c2fb-4050-8c1b-8077c9d0cea5 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048757 Jun 17 13:15:22.721304 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 506/980] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:15:22 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:15:22.724812 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-9be7a0c1-5c87-46aa-94c9-e65458cbaf64 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046032 Jun 17 13:15:22.724812 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 475/981] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:22 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:22.726165 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-a355fa18-1c4f-48dc-92ed-f36f6271aa64 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:22.727089 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-a355fa18-1c4f-48dc-92ed-f36f6271aa64 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:22.733323 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a355fa18-1c4f-48dc-92ed-f36f6271aa64 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:22.733771 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a355fa18-1c4f-48dc-92ed-f36f6271aa64 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:22.734568 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a355fa18-1c4f-48dc-92ed-f36f6271aa64 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:22.735000 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a355fa18-1c4f-48dc-92ed-f36f6271aa64 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:22.767613 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-a355fa18-1c4f-48dc-92ed-f36f6271aa64 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045216 Jun 17 13:15:22.768397 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 507/982] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:22 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:23.736080 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-ee4a3eaf-7f67-446c-ba2a-03170b0f9b1b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:23.736679 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-89dfdd22-415d-4262-9d5c-fd1ab3975af1 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:23.737072 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-ee4a3eaf-7f67-446c-ba2a-03170b0f9b1b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:23.737613 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-89dfdd22-415d-4262-9d5c-fd1ab3975af1 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:23.746056 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ee4a3eaf-7f67-446c-ba2a-03170b0f9b1b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:23.746362 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-89dfdd22-415d-4262-9d5c-fd1ab3975af1 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:23.746740 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ee4a3eaf-7f67-446c-ba2a-03170b0f9b1b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:23.746886 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-89dfdd22-415d-4262-9d5c-fd1ab3975af1 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:23.747561 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-89dfdd22-415d-4262-9d5c-fd1ab3975af1 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:23.747704 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ee4a3eaf-7f67-446c-ba2a-03170b0f9b1b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:23.747996 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-89dfdd22-415d-4262-9d5c-fd1ab3975af1 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:23.748247 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ee4a3eaf-7f67-446c-ba2a-03170b0f9b1b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:23.778308 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-89dfdd22-415d-4262-9d5c-fd1ab3975af1 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047885 Jun 17 13:15:23.778916 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 508/983] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:23 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:23.780289 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-ee4a3eaf-7f67-446c-ba2a-03170b0f9b1b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050920 Jun 17 13:15:23.781021 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 476/984] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:15:23 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:15:23.783527 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-aec85b12-8eae-4f59-9a56-ad34ce499a54 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:23.784585 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-aec85b12-8eae-4f59-9a56-ad34ce499a54 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:23.790745 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-aec85b12-8eae-4f59-9a56-ad34ce499a54 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:23.791265 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-aec85b12-8eae-4f59-9a56-ad34ce499a54 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:23.792097 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-aec85b12-8eae-4f59-9a56-ad34ce499a54 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:23.792535 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-aec85b12-8eae-4f59-9a56-ad34ce499a54 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:23.821685 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-aec85b12-8eae-4f59-9a56-ad34ce499a54 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041737 Jun 17 13:15:23.822547 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 509/985] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:23 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:24.794054 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-3547eca3-495e-4e63-872e-56c008435ea6 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:24.794826 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-1511b1a7-2401-45dd-8e76-7a6442e8b590 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:24.795292 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-3547eca3-495e-4e63-872e-56c008435ea6 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:24.795755 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-1511b1a7-2401-45dd-8e76-7a6442e8b590 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:24.801679 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3547eca3-495e-4e63-872e-56c008435ea6 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:24.802122 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3547eca3-495e-4e63-872e-56c008435ea6 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:24.802468 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-1511b1a7-2401-45dd-8e76-7a6442e8b590 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:24.802903 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3547eca3-495e-4e63-872e-56c008435ea6 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:24.803049 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-1511b1a7-2401-45dd-8e76-7a6442e8b590 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:24.803306 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3547eca3-495e-4e63-872e-56c008435ea6 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:24.803667 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-1511b1a7-2401-45dd-8e76-7a6442e8b590 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:24.804105 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-1511b1a7-2401-45dd-8e76-7a6442e8b590 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:24.837637 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-3547eca3-495e-4e63-872e-56c008435ea6 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049473 Jun 17 13:15:24.838246 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 477/986] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:24 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:24.839122 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-1511b1a7-2401-45dd-8e76-7a6442e8b590 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049778 Jun 17 13:15:24.843288 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 510/987] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:15:24 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:15:24.843447 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-1151e1b1-a106-4410-b297-160c5a7e0a34 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:24.843733 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-1151e1b1-a106-4410-b297-160c5a7e0a34 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:24.849892 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1151e1b1-a106-4410-b297-160c5a7e0a34 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:24.850377 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1151e1b1-a106-4410-b297-160c5a7e0a34 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:24.851140 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1151e1b1-a106-4410-b297-160c5a7e0a34 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:24.851574 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1151e1b1-a106-4410-b297-160c5a7e0a34 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:24.881627 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-1151e1b1-a106-4410-b297-160c5a7e0a34 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042334 Jun 17 13:15:24.882456 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 478/988] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:24 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:25.851878 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-0d7628ec-c863-43a2-8a52-f4deaefec3e4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:25.852674 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-0e3af90a-169d-4e9e-adfb-e8a0f7a6fe1b tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:25.853073 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-0d7628ec-c863-43a2-8a52-f4deaefec3e4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:25.853555 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-0e3af90a-169d-4e9e-adfb-e8a0f7a6fe1b tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:25.861055 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0d7628ec-c863-43a2-8a52-f4deaefec3e4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:25.861272 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0e3af90a-169d-4e9e-adfb-e8a0f7a6fe1b tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:25.861550 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0d7628ec-c863-43a2-8a52-f4deaefec3e4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:25.861734 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0e3af90a-169d-4e9e-adfb-e8a0f7a6fe1b tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:25.862519 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0d7628ec-c863-43a2-8a52-f4deaefec3e4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:25.862699 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0e3af90a-169d-4e9e-adfb-e8a0f7a6fe1b tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:25.863024 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0d7628ec-c863-43a2-8a52-f4deaefec3e4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:25.863227 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0e3af90a-169d-4e9e-adfb-e8a0f7a6fe1b tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:25.894664 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-0d7628ec-c863-43a2-8a52-f4deaefec3e4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047249 Jun 17 13:15:25.895744 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 479/989] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:15:25 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:15:25.899668 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-0e3af90a-169d-4e9e-adfb-e8a0f7a6fe1b tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052333 Jun 17 13:15:25.900891 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-93d87094-39a0-490a-8b2f-c20610864966 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:25.901763 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 511/990] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:25 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:25.901915 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-93d87094-39a0-490a-8b2f-c20610864966 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:25.908079 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-93d87094-39a0-490a-8b2f-c20610864966 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:25.908525 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-93d87094-39a0-490a-8b2f-c20610864966 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:25.909351 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-93d87094-39a0-490a-8b2f-c20610864966 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:25.909714 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-93d87094-39a0-490a-8b2f-c20610864966 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:25.939321 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-93d87094-39a0-490a-8b2f-c20610864966 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042336 Jun 17 13:15:25.940092 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 480/991] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:25 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:26.911775 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-0db723c4-533a-4c9f-9cbc-2d67c424a135 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:26.913271 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-0db723c4-533a-4c9f-9cbc-2d67c424a135 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:26.916709 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-3935bfab-7019-40f4-bfe8-34ddeab8faa1 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:26.917667 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-3935bfab-7019-40f4-bfe8-34ddeab8faa1 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:26.921419 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0db723c4-533a-4c9f-9cbc-2d67c424a135 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:26.921865 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0db723c4-533a-4c9f-9cbc-2d67c424a135 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:26.922712 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0db723c4-533a-4c9f-9cbc-2d67c424a135 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:26.923164 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0db723c4-533a-4c9f-9cbc-2d67c424a135 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:26.924857 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3935bfab-7019-40f4-bfe8-34ddeab8faa1 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:26.925299 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3935bfab-7019-40f4-bfe8-34ddeab8faa1 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:26.926066 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3935bfab-7019-40f4-bfe8-34ddeab8faa1 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:26.926518 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3935bfab-7019-40f4-bfe8-34ddeab8faa1 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:26.953677 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-0db723c4-533a-4c9f-9cbc-2d67c424a135 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048831 Jun 17 13:15:26.957922 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 512/992] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:15:26 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:15:26.958081 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-3935bfab-7019-40f4-bfe8-34ddeab8faa1 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046825 Jun 17 13:15:26.958081 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 481/993] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:26 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:26.958845 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-f64dc8b1-1b33-4059-937d-150dfda7a571 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:26.959754 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-f64dc8b1-1b33-4059-937d-150dfda7a571 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:26.965727 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f64dc8b1-1b33-4059-937d-150dfda7a571 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:26.966210 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f64dc8b1-1b33-4059-937d-150dfda7a571 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:26.966962 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f64dc8b1-1b33-4059-937d-150dfda7a571 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:26.967392 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f64dc8b1-1b33-4059-937d-150dfda7a571 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:26.998312 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-f64dc8b1-1b33-4059-937d-150dfda7a571 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042927 Jun 17 13:15:26.998848 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 513/994] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:26 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:27.970616 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-6c0555d9-9b58-4e39-90aa-b66744aaa841 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:27.972155 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-6c0555d9-9b58-4e39-90aa-b66744aaa841 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:27.972748 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-143d635e-74a9-47e7-949e-94ff224ca230 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:27.974545 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-143d635e-74a9-47e7-949e-94ff224ca230 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:27.983364 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6c0555d9-9b58-4e39-90aa-b66744aaa841 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:27.984107 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6c0555d9-9b58-4e39-90aa-b66744aaa841 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:27.985756 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6c0555d9-9b58-4e39-90aa-b66744aaa841 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:27.986522 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6c0555d9-9b58-4e39-90aa-b66744aaa841 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:27.986884 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-143d635e-74a9-47e7-949e-94ff224ca230 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:27.987635 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-143d635e-74a9-47e7-949e-94ff224ca230 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:27.988895 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-143d635e-74a9-47e7-949e-94ff224ca230 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:27.989624 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-143d635e-74a9-47e7-949e-94ff224ca230 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:28.020246 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-6c0555d9-9b58-4e39-90aa-b66744aaa841 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056791 Jun 17 13:15:28.020781 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 482/995] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:15:27 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:15:28.025573 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-f1ccdfaa-1e9e-4a08-9305-49234990e0b6 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:28.026539 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-f1ccdfaa-1e9e-4a08-9305-49234990e0b6 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:28.028104 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-143d635e-74a9-47e7-949e-94ff224ca230 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061944 Jun 17 13:15:28.029036 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 514/996] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:27 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:28.032478 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f1ccdfaa-1e9e-4a08-9305-49234990e0b6 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:28.032925 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f1ccdfaa-1e9e-4a08-9305-49234990e0b6 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:28.033695 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f1ccdfaa-1e9e-4a08-9305-49234990e0b6 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:28.034108 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f1ccdfaa-1e9e-4a08-9305-49234990e0b6 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:28.069336 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-f1ccdfaa-1e9e-4a08-9305-49234990e0b6 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047517 Jun 17 13:15:28.070056 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 483/997] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:28 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:29.037885 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-629e6ec9-675b-45a9-a835-9d02eac1036b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:29.039425 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-629e6ec9-675b-45a9-a835-9d02eac1036b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:29.043642 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-2bb74089-7750-40d6-bd85-08aa29c47157 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:29.045227 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-2bb74089-7750-40d6-bd85-08aa29c47157 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:29.050691 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-629e6ec9-675b-45a9-a835-9d02eac1036b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:29.051447 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-629e6ec9-675b-45a9-a835-9d02eac1036b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:29.052706 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-629e6ec9-675b-45a9-a835-9d02eac1036b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:29.053408 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-629e6ec9-675b-45a9-a835-9d02eac1036b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:29.056275 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2bb74089-7750-40d6-bd85-08aa29c47157 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:29.057125 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2bb74089-7750-40d6-bd85-08aa29c47157 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:29.057912 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2bb74089-7750-40d6-bd85-08aa29c47157 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:29.058381 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2bb74089-7750-40d6-bd85-08aa29c47157 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:29.085054 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-629e6ec9-675b-45a9-a835-9d02eac1036b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054121 Jun 17 13:15:29.085669 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 515/998] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:15:29 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:15:29.088923 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-2bb74089-7750-40d6-bd85-08aa29c47157 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052018 Jun 17 13:15:29.089453 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 484/999] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:29 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:29.090352 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-9fc20e1c-dcb5-48ce-bfe5-bc7e0a9e33ce tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:29.091277 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-9fc20e1c-dcb5-48ce-bfe5-bc7e0a9e33ce tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:29.097625 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9fc20e1c-dcb5-48ce-bfe5-bc7e0a9e33ce tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:29.098083 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9fc20e1c-dcb5-48ce-bfe5-bc7e0a9e33ce tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:29.098962 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9fc20e1c-dcb5-48ce-bfe5-bc7e0a9e33ce tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:29.099386 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9fc20e1c-dcb5-48ce-bfe5-bc7e0a9e33ce tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:29.128966 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-9fc20e1c-dcb5-48ce-bfe5-bc7e0a9e33ce tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042241 Jun 17 13:15:29.129495 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 516/1000] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:29 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:30.101334 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-1b0adbfc-592d-4f00-b698-d4dcf83ec86b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:30.102917 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-1b0adbfc-592d-4f00-b698-d4dcf83ec86b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:30.105430 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-518a3ecb-de3b-409c-a532-2bfa4d9632d8 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:30.106929 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_api:SELECT=84 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:15:30.107199 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-518a3ecb-de3b-409c-a532-2bfa4d9632d8 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:30.116195 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1b0adbfc-592d-4f00-b698-d4dcf83ec86b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:30.116927 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1b0adbfc-592d-4f00-b698-d4dcf83ec86b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:30.118179 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1b0adbfc-592d-4f00-b698-d4dcf83ec86b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:30.118927 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1b0adbfc-592d-4f00-b698-d4dcf83ec86b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:30.119167 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-518a3ecb-de3b-409c-a532-2bfa4d9632d8 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:30.119919 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-518a3ecb-de3b-409c-a532-2bfa4d9632d8 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:30.120730 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-518a3ecb-de3b-409c-a532-2bfa4d9632d8 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:30.121163 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-518a3ecb-de3b-409c-a532-2bfa4d9632d8 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:30.149706 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-1b0adbfc-592d-4f00-b698-d4dcf83ec86b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055228 Jun 17 13:15:30.154872 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 485/1001] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:15:30 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:15:30.155177 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-518a3ecb-de3b-409c-a532-2bfa4d9632d8 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053920 Jun 17 13:15:30.155177 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 517/1002] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:30 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:30.155355 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-18730015-3483-418d-a90c-a2f5212a2163 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:30.155837 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-18730015-3483-418d-a90c-a2f5212a2163 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:30.162282 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-18730015-3483-418d-a90c-a2f5212a2163 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:30.162692 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-18730015-3483-418d-a90c-a2f5212a2163 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:30.163482 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-18730015-3483-418d-a90c-a2f5212a2163 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:30.163916 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-18730015-3483-418d-a90c-a2f5212a2163 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:30.194033 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-18730015-3483-418d-a90c-a2f5212a2163 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042727 Jun 17 13:15:30.194607 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 486/1003] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:30 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:31.163948 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-470778f8-be15-4108-a151-3b2fa097fc5d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:31.164588 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-975816e1-e178-4840-bbcd-c4b0aa9fdcee tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:31.165039 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-470778f8-be15-4108-a151-3b2fa097fc5d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:31.165230 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-975816e1-e178-4840-bbcd-c4b0aa9fdcee tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:31.172130 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-975816e1-e178-4840-bbcd-c4b0aa9fdcee tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:31.172493 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-470778f8-be15-4108-a151-3b2fa097fc5d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:31.172674 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-975816e1-e178-4840-bbcd-c4b0aa9fdcee tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:31.172952 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-470778f8-be15-4108-a151-3b2fa097fc5d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:31.173326 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-975816e1-e178-4840-bbcd-c4b0aa9fdcee tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:31.173734 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-470778f8-be15-4108-a151-3b2fa097fc5d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:31.173872 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-975816e1-e178-4840-bbcd-c4b0aa9fdcee tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:31.174205 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-470778f8-be15-4108-a151-3b2fa097fc5d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:31.203921 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-975816e1-e178-4840-bbcd-c4b0aa9fdcee tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043600 Jun 17 13:15:31.211204 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 487/1004] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:31 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:31.211518 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-470778f8-be15-4108-a151-3b2fa097fc5d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045643 Jun 17 13:15:31.211518 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 518/1005] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:15:31 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:15:31.211747 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-cc64c2ba-291d-4ac7-979e-6e2b60e2537b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:31.211747 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-cc64c2ba-291d-4ac7-979e-6e2b60e2537b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:31.216447 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cc64c2ba-291d-4ac7-979e-6e2b60e2537b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:31.216887 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cc64c2ba-291d-4ac7-979e-6e2b60e2537b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:31.217618 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cc64c2ba-291d-4ac7-979e-6e2b60e2537b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:31.218066 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cc64c2ba-291d-4ac7-979e-6e2b60e2537b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:31.247742 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-cc64c2ba-291d-4ac7-979e-6e2b60e2537b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042277 Jun 17 13:15:31.248322 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 488/1006] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:31 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:32.219214 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-2c4c478a-1c6d-400e-9418-06992e7f07fd tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:32.219815 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-fe541a13-fdac-45eb-9a32-3c3d5eef6134 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:32.220183 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-2c4c478a-1c6d-400e-9418-06992e7f07fd tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:32.220368 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-fe541a13-fdac-45eb-9a32-3c3d5eef6134 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:32.227064 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2c4c478a-1c6d-400e-9418-06992e7f07fd tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:32.227321 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fe541a13-fdac-45eb-9a32-3c3d5eef6134 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:32.227517 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2c4c478a-1c6d-400e-9418-06992e7f07fd tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:32.227826 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fe541a13-fdac-45eb-9a32-3c3d5eef6134 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:32.228284 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2c4c478a-1c6d-400e-9418-06992e7f07fd tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:32.228570 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fe541a13-fdac-45eb-9a32-3c3d5eef6134 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:32.228816 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2c4c478a-1c6d-400e-9418-06992e7f07fd tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:32.229650 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fe541a13-fdac-45eb-9a32-3c3d5eef6134 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:32.259118 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-2c4c478a-1c6d-400e-9418-06992e7f07fd tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044045 Jun 17 13:15:32.259381 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-fe541a13-fdac-45eb-9a32-3c3d5eef6134 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043795 Jun 17 13:15:32.259703 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 519/1007] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:15:32 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:15:32.263671 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 489/1008] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:32 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:32.264685 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-5576d545-adf5-4d89-9179-cefb65ecb5d7 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:32.265660 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-5576d545-adf5-4d89-9179-cefb65ecb5d7 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:32.271736 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-5576d545-adf5-4d89-9179-cefb65ecb5d7 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:32.272190 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-5576d545-adf5-4d89-9179-cefb65ecb5d7 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:32.272953 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-5576d545-adf5-4d89-9179-cefb65ecb5d7 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:32.273384 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-5576d545-adf5-4d89-9179-cefb65ecb5d7 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:32.302490 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-5576d545-adf5-4d89-9179-cefb65ecb5d7 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041690 Jun 17 13:15:32.303063 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 520/1009] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:32 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:33.275629 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-39b25ac5-4a0e-4894-91e9-25dd626b3a9a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:33.276725 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-35bf920c-8c86-4a2c-860f-213e79424c8a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:33.277469 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-39b25ac5-4a0e-4894-91e9-25dd626b3a9a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:33.277722 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-35bf920c-8c86-4a2c-860f-213e79424c8a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:33.287114 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-39b25ac5-4a0e-4894-91e9-25dd626b3a9a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:33.287855 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-39b25ac5-4a0e-4894-91e9-25dd626b3a9a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:33.288325 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-35bf920c-8c86-4a2c-860f-213e79424c8a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:33.289075 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-35bf920c-8c86-4a2c-860f-213e79424c8a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:33.289370 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-39b25ac5-4a0e-4894-91e9-25dd626b3a9a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:33.289850 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-39b25ac5-4a0e-4894-91e9-25dd626b3a9a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:33.290432 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-35bf920c-8c86-4a2c-860f-213e79424c8a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:33.291124 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-35bf920c-8c86-4a2c-860f-213e79424c8a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:33.322670 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_cell1:SELECT=100 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:15:33.323153 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-39b25ac5-4a0e-4894-91e9-25dd626b3a9a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054183 Jun 17 13:15:33.324269 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 490/1010] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:15:33 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:15:33.329367 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-9316ea58-76bb-4aeb-9ce1-c65bd5db3ddd tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:33.330498 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-9316ea58-76bb-4aeb-9ce1-c65bd5db3ddd tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:33.332400 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-35bf920c-8c86-4a2c-860f-213e79424c8a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063292 Jun 17 13:15:33.333731 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 521/1011] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:33 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:33.337357 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9316ea58-76bb-4aeb-9ce1-c65bd5db3ddd tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:33.337831 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9316ea58-76bb-4aeb-9ce1-c65bd5db3ddd tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:33.338663 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9316ea58-76bb-4aeb-9ce1-c65bd5db3ddd tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:33.339164 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9316ea58-76bb-4aeb-9ce1-c65bd5db3ddd tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:33.343427 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=100 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:15:33.371645 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-9316ea58-76bb-4aeb-9ce1-c65bd5db3ddd tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046394 Jun 17 13:15:33.372267 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 491/1012] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:33 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:34.337140 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-ebd78895-066f-4bf5-81a5-c380f1ad5eca tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:34.338323 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-ebd78895-066f-4bf5-81a5-c380f1ad5eca tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:34.345297 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-384d1776-2ad0-4728-ba4c-54e3900fc6b2 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:34.345796 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ebd78895-066f-4bf5-81a5-c380f1ad5eca tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:34.346074 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ebd78895-066f-4bf5-81a5-c380f1ad5eca tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:34.346285 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-384d1776-2ad0-4728-ba4c-54e3900fc6b2 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:34.346891 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ebd78895-066f-4bf5-81a5-c380f1ad5eca tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:34.347298 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ebd78895-066f-4bf5-81a5-c380f1ad5eca tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:34.352959 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-384d1776-2ad0-4728-ba4c-54e3900fc6b2 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:34.353423 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-384d1776-2ad0-4728-ba4c-54e3900fc6b2 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:34.354204 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-384d1776-2ad0-4728-ba4c-54e3900fc6b2 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:34.354662 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-384d1776-2ad0-4728-ba4c-54e3900fc6b2 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:34.378390 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-ebd78895-066f-4bf5-81a5-c380f1ad5eca tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045697 Jun 17 13:15:34.378653 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 522/1013] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:15:34 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:15:34.389862 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-83bef754-356a-4725-bd00-edf459b562c6 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:34.389862 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-83bef754-356a-4725-bd00-edf459b562c6 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:34.392515 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-384d1776-2ad0-4728-ba4c-54e3900fc6b2 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051763 Jun 17 13:15:34.393320 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-83bef754-356a-4725-bd00-edf459b562c6 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:34.393722 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 492/1014] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:34 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:34.393882 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-83bef754-356a-4725-bd00-edf459b562c6 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:34.394584 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-83bef754-356a-4725-bd00-edf459b562c6 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:34.395025 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-83bef754-356a-4725-bd00-edf459b562c6 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:34.426415 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-83bef754-356a-4725-bd00-edf459b562c6 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045855 Jun 17 13:15:34.427007 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 523/1015] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:34 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:35.391792 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-bea8f54e-a7dd-4f49-9375-69998d364aac tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:35.392970 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-bea8f54e-a7dd-4f49-9375-69998d364aac tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:35.402015 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bea8f54e-a7dd-4f49-9375-69998d364aac tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:35.402511 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bea8f54e-a7dd-4f49-9375-69998d364aac tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:35.403311 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bea8f54e-a7dd-4f49-9375-69998d364aac tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:35.403747 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bea8f54e-a7dd-4f49-9375-69998d364aac tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:35.404784 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-5981abad-3232-4276-9529-68fa55fb28fd tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:35.405714 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-5981abad-3232-4276-9529-68fa55fb28fd tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:35.415380 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-5981abad-3232-4276-9529-68fa55fb28fd tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:35.416060 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-5981abad-3232-4276-9529-68fa55fb28fd tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:35.417270 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-5981abad-3232-4276-9529-68fa55fb28fd tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:35.417900 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-5981abad-3232-4276-9529-68fa55fb28fd tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:35.439336 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-bea8f54e-a7dd-4f49-9375-69998d364aac tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053402 Jun 17 13:15:35.439909 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 493/1016] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:15:35 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:15:35.444625 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-d0cc6bcd-c528-4bd3-9512-bfe6d9fb7feb tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:35.445525 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-d0cc6bcd-c528-4bd3-9512-bfe6d9fb7feb tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:35.452511 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d0cc6bcd-c528-4bd3-9512-bfe6d9fb7feb tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:35.452678 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d0cc6bcd-c528-4bd3-9512-bfe6d9fb7feb tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:35.453665 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d0cc6bcd-c528-4bd3-9512-bfe6d9fb7feb tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:35.454129 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d0cc6bcd-c528-4bd3-9512-bfe6d9fb7feb tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:35.454408 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-5981abad-3232-4276-9529-68fa55fb28fd tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053847 Jun 17 13:15:35.460277 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 524/1017] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:35 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:35.487176 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-d0cc6bcd-c528-4bd3-9512-bfe6d9fb7feb tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046112 Jun 17 13:15:35.487895 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 494/1018] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:35 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:36.452615 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-ce821a9f-2489-43c3-b5d7-fd439a02df2e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:36.453549 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-ce821a9f-2489-43c3-b5d7-fd439a02df2e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:36.460952 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ce821a9f-2489-43c3-b5d7-fd439a02df2e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:36.461405 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ce821a9f-2489-43c3-b5d7-fd439a02df2e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:36.462191 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ce821a9f-2489-43c3-b5d7-fd439a02df2e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:36.462635 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ce821a9f-2489-43c3-b5d7-fd439a02df2e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:36.468257 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-8aa860f5-00c9-42de-9de4-f868b3d5f5cd tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:36.469169 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-8aa860f5-00c9-42de-9de4-f868b3d5f5cd tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:36.476247 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8aa860f5-00c9-42de-9de4-f868b3d5f5cd tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:36.476690 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8aa860f5-00c9-42de-9de4-f868b3d5f5cd tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:36.477453 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8aa860f5-00c9-42de-9de4-f868b3d5f5cd tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:36.477879 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8aa860f5-00c9-42de-9de4-f868b3d5f5cd tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:36.495056 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-ce821a9f-2489-43c3-b5d7-fd439a02df2e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044875 Jun 17 13:15:36.496182 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 525/1019] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:15:36 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:15:36.502858 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-0dc23281-c0c1-4bdc-ac2b-c3929c1ff234 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:36.504077 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-0dc23281-c0c1-4bdc-ac2b-c3929c1ff234 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:36.510577 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0dc23281-c0c1-4bdc-ac2b-c3929c1ff234 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:36.510990 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0dc23281-c0c1-4bdc-ac2b-c3929c1ff234 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:36.511642 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-8aa860f5-00c9-42de-9de4-f868b3d5f5cd tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047419 Jun 17 13:15:36.511768 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0dc23281-c0c1-4bdc-ac2b-c3929c1ff234 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:36.515610 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0dc23281-c0c1-4bdc-ac2b-c3929c1ff234 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:36.515762 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 495/1020] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:36 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:36.543007 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-0dc23281-c0c1-4bdc-ac2b-c3929c1ff234 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046127 Jun 17 13:15:36.543819 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 526/1021] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:36 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:37.507349 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-eca9bdfe-ac75-4319-a743-e91009d07126 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:37.508292 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-eca9bdfe-ac75-4319-a743-e91009d07126 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:37.515469 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-eca9bdfe-ac75-4319-a743-e91009d07126 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:37.515924 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-eca9bdfe-ac75-4319-a743-e91009d07126 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:37.516690 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-eca9bdfe-ac75-4319-a743-e91009d07126 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:37.517185 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-eca9bdfe-ac75-4319-a743-e91009d07126 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:37.523791 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-b6ce3111-0e85-4bc3-961b-b23539809863 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:37.524752 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-b6ce3111-0e85-4bc3-961b-b23539809863 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:37.527178 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_api:SELECT=88 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:15:37.533121 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b6ce3111-0e85-4bc3-961b-b23539809863 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:37.533562 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b6ce3111-0e85-4bc3-961b-b23539809863 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:37.534596 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b6ce3111-0e85-4bc3-961b-b23539809863 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:37.535033 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b6ce3111-0e85-4bc3-961b-b23539809863 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:37.546985 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-eca9bdfe-ac75-4319-a743-e91009d07126 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043650 Jun 17 13:15:37.551153 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 496/1022] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:15:37 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:15:37.554653 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-891c6355-0d4b-4f23-a5e3-c7e3a37f1cbb tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:37.555600 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-891c6355-0d4b-4f23-a5e3-c7e3a37f1cbb tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:37.561641 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-891c6355-0d4b-4f23-a5e3-c7e3a37f1cbb tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:37.562112 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-891c6355-0d4b-4f23-a5e3-c7e3a37f1cbb tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:37.562873 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-891c6355-0d4b-4f23-a5e3-c7e3a37f1cbb tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:37.563296 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-891c6355-0d4b-4f23-a5e3-c7e3a37f1cbb tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:37.565516 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-b6ce3111-0e85-4bc3-961b-b23539809863 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045637 Jun 17 13:15:37.566481 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 527/1023] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:37 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 13:15:37.593425 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-891c6355-0d4b-4f23-a5e3-c7e3a37f1cbb tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042343 Jun 17 13:15:37.593962 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 497/1024] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:37 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 13:15:38.561011 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-285f8d41-d330-4890-8671-4df140b47957 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:38.562260 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-285f8d41-d330-4890-8671-4df140b47957 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:38.570031 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-285f8d41-d330-4890-8671-4df140b47957 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:38.570514 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-285f8d41-d330-4890-8671-4df140b47957 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:38.571282 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-285f8d41-d330-4890-8671-4df140b47957 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:38.571708 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-285f8d41-d330-4890-8671-4df140b47957 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:38.577001 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-30cd4af3-9496-4713-a4f1-566fbbee8bd5 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:38.577946 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-30cd4af3-9496-4713-a4f1-566fbbee8bd5 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:38.585299 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-30cd4af3-9496-4713-a4f1-566fbbee8bd5 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:38.585751 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-30cd4af3-9496-4713-a4f1-566fbbee8bd5 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:38.586663 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-30cd4af3-9496-4713-a4f1-566fbbee8bd5 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:38.587094 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-30cd4af3-9496-4713-a4f1-566fbbee8bd5 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:38.602348 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-285f8d41-d330-4890-8671-4df140b47957 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046415 Jun 17 13:15:38.602930 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 528/1025] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:15:38 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:15:38.607558 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-a70b9014-d60c-46a1-ad77-93a476667d5a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:38.608481 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-a70b9014-d60c-46a1-ad77-93a476667d5a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:38.614787 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a70b9014-d60c-46a1-ad77-93a476667d5a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:38.615316 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a70b9014-d60c-46a1-ad77-93a476667d5a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:38.616085 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a70b9014-d60c-46a1-ad77-93a476667d5a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:38.616523 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a70b9014-d60c-46a1-ad77-93a476667d5a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:38.619778 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-30cd4af3-9496-4713-a4f1-566fbbee8bd5 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046757 Jun 17 13:15:38.621165 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 498/1026] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:38 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 13:15:38.647950 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-a70b9014-d60c-46a1-ad77-93a476667d5a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043938 Jun 17 13:15:38.648739 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 529/1027] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:38 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:39.616901 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-b4a6a057-4d7d-4238-a0f4-57e40ea21d21 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:39.618154 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-b4a6a057-4d7d-4238-a0f4-57e40ea21d21 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:39.626972 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b4a6a057-4d7d-4238-a0f4-57e40ea21d21 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:39.627606 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b4a6a057-4d7d-4238-a0f4-57e40ea21d21 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:39.628661 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b4a6a057-4d7d-4238-a0f4-57e40ea21d21 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:39.629169 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b4a6a057-4d7d-4238-a0f4-57e40ea21d21 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:39.632373 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-c29caaad-2a53-4acd-9637-c7a1114fe9ec tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:39.633344 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-c29caaad-2a53-4acd-9637-c7a1114fe9ec tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:39.640149 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c29caaad-2a53-4acd-9637-c7a1114fe9ec tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:39.640531 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c29caaad-2a53-4acd-9637-c7a1114fe9ec tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:39.641306 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c29caaad-2a53-4acd-9637-c7a1114fe9ec tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:39.641747 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c29caaad-2a53-4acd-9637-c7a1114fe9ec tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:39.659911 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-b4a6a057-4d7d-4238-a0f4-57e40ea21d21 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048660 Jun 17 13:15:39.660470 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 499/1028] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:15:39 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:15:39.665177 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-17d512a6-923c-4ba5-aef8-40dbac5a3d46 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:39.666076 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-17d512a6-923c-4ba5-aef8-40dbac5a3d46 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:39.672379 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-17d512a6-923c-4ba5-aef8-40dbac5a3d46 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:39.672630 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-c29caaad-2a53-4acd-9637-c7a1114fe9ec tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044701 Jun 17 13:15:39.672826 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-17d512a6-923c-4ba5-aef8-40dbac5a3d46 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:39.673227 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 530/1029] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:39 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:39.673563 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-17d512a6-923c-4ba5-aef8-40dbac5a3d46 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:39.674202 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-17d512a6-923c-4ba5-aef8-40dbac5a3d46 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:39.705724 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-17d512a6-923c-4ba5-aef8-40dbac5a3d46 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044237 Jun 17 13:15:39.706295 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 500/1030] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:39 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:40.676212 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-7bf6f105-9fc1-4101-835b-5870e8b33380 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:40.677774 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-7bf6f105-9fc1-4101-835b-5870e8b33380 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:40.685218 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7bf6f105-9fc1-4101-835b-5870e8b33380 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:40.685481 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-0e07e618-7bf2-455d-b83a-4b89250049d4 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:40.685955 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7bf6f105-9fc1-4101-835b-5870e8b33380 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:40.686426 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-0e07e618-7bf2-455d-b83a-4b89250049d4 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:40.686598 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7bf6f105-9fc1-4101-835b-5870e8b33380 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:40.686863 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7bf6f105-9fc1-4101-835b-5870e8b33380 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:40.693227 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0e07e618-7bf2-455d-b83a-4b89250049d4 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:40.693714 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0e07e618-7bf2-455d-b83a-4b89250049d4 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:40.694596 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0e07e618-7bf2-455d-b83a-4b89250049d4 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:40.695287 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0e07e618-7bf2-455d-b83a-4b89250049d4 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:40.717753 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-7bf6f105-9fc1-4101-835b-5870e8b33380 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048288 Jun 17 13:15:40.718359 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 531/1031] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:15:40 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:15:40.722930 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-80cb9e3e-f691-4acd-a28f-275f874d9649 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:40.723867 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-80cb9e3e-f691-4acd-a28f-275f874d9649 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:40.728910 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-0e07e618-7bf2-455d-b83a-4b89250049d4 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047273 Jun 17 13:15:40.730798 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 501/1032] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:40 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:40.730944 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-80cb9e3e-f691-4acd-a28f-275f874d9649 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:40.730944 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-80cb9e3e-f691-4acd-a28f-275f874d9649 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:40.731220 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-80cb9e3e-f691-4acd-a28f-275f874d9649 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:40.731667 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-80cb9e3e-f691-4acd-a28f-275f874d9649 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:40.761945 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-80cb9e3e-f691-4acd-a28f-275f874d9649 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042556 Jun 17 13:15:40.762723 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 532/1033] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:40 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:41.217323 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 13:15:41.217692 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Fri Jun 17 13:15:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 17 13:15:41.732425 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-d2ddbd90-d6e0-4d41-8048-33b1644b2894 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:41.733344 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-d2ddbd90-d6e0-4d41-8048-33b1644b2894 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:41.740694 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d2ddbd90-d6e0-4d41-8048-33b1644b2894 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:41.741159 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d2ddbd90-d6e0-4d41-8048-33b1644b2894 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:41.741482 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-a8e0133e-9c17-4744-92da-b06f7333005c tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:41.741962 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d2ddbd90-d6e0-4d41-8048-33b1644b2894 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:41.742370 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d2ddbd90-d6e0-4d41-8048-33b1644b2894 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:41.742534 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-a8e0133e-9c17-4744-92da-b06f7333005c tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:41.749590 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a8e0133e-9c17-4744-92da-b06f7333005c tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:41.750115 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a8e0133e-9c17-4744-92da-b06f7333005c tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:41.751027 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a8e0133e-9c17-4744-92da-b06f7333005c tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:41.751620 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a8e0133e-9c17-4744-92da-b06f7333005c tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:41.773034 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-d2ddbd90-d6e0-4d41-8048-33b1644b2894 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045646 Jun 17 13:15:41.773602 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 502/1034] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:15:41 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:15:41.778593 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-390f166b-eb31-4324-9bf1-3280ec407c66 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:41.779507 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-390f166b-eb31-4324-9bf1-3280ec407c66 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:41.785184 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-a8e0133e-9c17-4744-92da-b06f7333005c tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047968 Jun 17 13:15:41.785449 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-390f166b-eb31-4324-9bf1-3280ec407c66 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:41.785746 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 533/1035] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:41 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 13:15:41.785898 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-390f166b-eb31-4324-9bf1-3280ec407c66 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:41.786766 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-390f166b-eb31-4324-9bf1-3280ec407c66 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:41.787205 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-390f166b-eb31-4324-9bf1-3280ec407c66 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:41.817639 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-390f166b-eb31-4324-9bf1-3280ec407c66 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042980 Jun 17 13:15:41.818192 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 503/1036] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:41 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:42.789584 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-c8488566-7c1a-46f4-b536-384f6379faac tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:42.791202 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-c8488566-7c1a-46f4-b536-384f6379faac tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:42.801283 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-eb6e445d-da79-49c5-8e49-693ab3e5adb1 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:42.802784 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c8488566-7c1a-46f4-b536-384f6379faac tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:42.803063 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-eb6e445d-da79-49c5-8e49-693ab3e5adb1 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:42.803567 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c8488566-7c1a-46f4-b536-384f6379faac tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:42.804838 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c8488566-7c1a-46f4-b536-384f6379faac tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:42.805574 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c8488566-7c1a-46f4-b536-384f6379faac tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:42.811939 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-eb6e445d-da79-49c5-8e49-693ab3e5adb1 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:42.812454 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-eb6e445d-da79-49c5-8e49-693ab3e5adb1 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:42.813376 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-eb6e445d-da79-49c5-8e49-693ab3e5adb1 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:42.813797 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-eb6e445d-da79-49c5-8e49-693ab3e5adb1 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:42.836203 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-c8488566-7c1a-46f4-b536-384f6379faac tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053400 Jun 17 13:15:42.836799 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 534/1037] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:15:42 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:15:42.843900 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-6de6ee9e-928c-42d9-b19f-d62acdad7e3d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:42.844818 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-6de6ee9e-928c-42d9-b19f-d62acdad7e3d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:42.846558 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-eb6e445d-da79-49c5-8e49-693ab3e5adb1 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052224 Jun 17 13:15:42.847305 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 504/1038] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:42 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:42.850801 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6de6ee9e-928c-42d9-b19f-d62acdad7e3d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:42.851256 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6de6ee9e-928c-42d9-b19f-d62acdad7e3d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:42.852013 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6de6ee9e-928c-42d9-b19f-d62acdad7e3d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:42.852449 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6de6ee9e-928c-42d9-b19f-d62acdad7e3d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:42.882269 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-6de6ee9e-928c-42d9-b19f-d62acdad7e3d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044421 Jun 17 13:15:42.882829 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 535/1039] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:42 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:43.852694 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-b90d5efa-7b84-4250-909f-3e4d371a12d5 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:43.854283 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-b90d5efa-7b84-4250-909f-3e4d371a12d5 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:43.860076 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-d4b8498f-901b-43ba-8718-e6c730ea98eb tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:43.861023 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-d4b8498f-901b-43ba-8718-e6c730ea98eb tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:43.862333 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b90d5efa-7b84-4250-909f-3e4d371a12d5 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:43.862785 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b90d5efa-7b84-4250-909f-3e4d371a12d5 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:43.863556 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b90d5efa-7b84-4250-909f-3e4d371a12d5 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:43.863992 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b90d5efa-7b84-4250-909f-3e4d371a12d5 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:43.867830 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d4b8498f-901b-43ba-8718-e6c730ea98eb tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:43.868286 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d4b8498f-901b-43ba-8718-e6c730ea98eb tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:43.869055 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d4b8498f-901b-43ba-8718-e6c730ea98eb tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:43.869488 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d4b8498f-901b-43ba-8718-e6c730ea98eb tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:43.894678 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-b90d5efa-7b84-4250-909f-3e4d371a12d5 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048746 Jun 17 13:15:43.895218 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 505/1040] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:15:43 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:15:43.899797 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-9720d414-31aa-4c56-8f10-b466dc33ce82 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:43.899976 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-d4b8498f-901b-43ba-8718-e6c730ea98eb tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044210 Jun 17 13:15:43.903659 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 536/1041] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:43 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:43.903798 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-9720d414-31aa-4c56-8f10-b466dc33ce82 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:43.907791 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9720d414-31aa-4c56-8f10-b466dc33ce82 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:43.908237 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9720d414-31aa-4c56-8f10-b466dc33ce82 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:43.909004 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9720d414-31aa-4c56-8f10-b466dc33ce82 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:43.909484 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9720d414-31aa-4c56-8f10-b466dc33ce82 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:43.946615 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-9720d414-31aa-4c56-8f10-b466dc33ce82 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050313 Jun 17 13:15:43.947217 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 506/1042] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:43 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:44.911369 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-b36d2b05-7793-44e6-8e83-b4affb748812 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:44.912850 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-b36d2b05-7793-44e6-8e83-b4affb748812 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:44.915531 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-fd925673-af83-4c0a-9812-406891635986 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:44.917017 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-fd925673-af83-4c0a-9812-406891635986 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:44.924064 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b36d2b05-7793-44e6-8e83-b4affb748812 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:44.924808 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b36d2b05-7793-44e6-8e83-b4affb748812 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:44.926069 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b36d2b05-7793-44e6-8e83-b4affb748812 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:44.926870 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b36d2b05-7793-44e6-8e83-b4affb748812 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:44.927654 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fd925673-af83-4c0a-9812-406891635986 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:44.928407 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fd925673-af83-4c0a-9812-406891635986 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:44.929764 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fd925673-af83-4c0a-9812-406891635986 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:44.930540 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fd925673-af83-4c0a-9812-406891635986 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:44.956940 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=100 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:15:44.960747 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-b36d2b05-7793-44e6-8e83-b4affb748812 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056120 Jun 17 13:15:44.961508 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 537/1043] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:15:44 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:15:44.962202 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-fd925673-af83-4c0a-9812-406891635986 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053397 Jun 17 13:15:44.962904 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 507/1044] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:44 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:44.966000 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-2d1b6fa1-ff4e-4987-914f-fb73798872d8 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:44.966970 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-2d1b6fa1-ff4e-4987-914f-fb73798872d8 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:44.973063 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2d1b6fa1-ff4e-4987-914f-fb73798872d8 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:44.975067 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2d1b6fa1-ff4e-4987-914f-fb73798872d8 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:44.975067 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2d1b6fa1-ff4e-4987-914f-fb73798872d8 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:44.975067 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2d1b6fa1-ff4e-4987-914f-fb73798872d8 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:44.991518 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_cell1:SELECT=100 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:15:45.004792 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-2d1b6fa1-ff4e-4987-914f-fb73798872d8 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042496 Jun 17 13:15:45.005352 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 538/1045] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:44 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:45.975101 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-ea6a69e3-ffcf-41cf-be7f-c962e8798eca tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:45.975873 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-ab255133-381e-4e9b-8d52-502f44f5b40b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:45.976348 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-ea6a69e3-ffcf-41cf-be7f-c962e8798eca tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:45.977097 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-ab255133-381e-4e9b-8d52-502f44f5b40b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:45.985777 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ea6a69e3-ffcf-41cf-be7f-c962e8798eca tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:45.986255 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ea6a69e3-ffcf-41cf-be7f-c962e8798eca tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:45.986398 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ab255133-381e-4e9b-8d52-502f44f5b40b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:45.986824 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ab255133-381e-4e9b-8d52-502f44f5b40b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:45.986989 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ea6a69e3-ffcf-41cf-be7f-c962e8798eca tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:45.987423 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ea6a69e3-ffcf-41cf-be7f-c962e8798eca tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:45.987582 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ab255133-381e-4e9b-8d52-502f44f5b40b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:45.988012 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ab255133-381e-4e9b-8d52-502f44f5b40b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:46.018330 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-ea6a69e3-ffcf-41cf-be7f-c962e8798eca tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048288 Jun 17 13:15:46.018934 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 508/1046] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:45 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:46.021634 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-ab255133-381e-4e9b-8d52-502f44f5b40b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048426 Jun 17 13:15:46.022275 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 539/1047] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:15:45 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:15:46.023377 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-9cbf8ed1-0d69-4f25-a9d2-352d450782c0 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:46.024295 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-9cbf8ed1-0d69-4f25-a9d2-352d450782c0 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:46.030423 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9cbf8ed1-0d69-4f25-a9d2-352d450782c0 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:46.030870 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9cbf8ed1-0d69-4f25-a9d2-352d450782c0 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:46.031867 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9cbf8ed1-0d69-4f25-a9d2-352d450782c0 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:46.032298 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9cbf8ed1-0d69-4f25-a9d2-352d450782c0 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:46.061133 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-9cbf8ed1-0d69-4f25-a9d2-352d450782c0 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041319 Jun 17 13:15:46.061954 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 509/1048] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:46 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:47.031253 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-68f92125-f12c-4c71-aaf5-3e3a57a426ea tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:47.032319 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-68f92125-f12c-4c71-aaf5-3e3a57a426ea tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:47.033953 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-fe4b2623-f4dc-47db-8748-8c17ca0e34ba tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:47.034920 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-fe4b2623-f4dc-47db-8748-8c17ca0e34ba tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:47.039249 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-68f92125-f12c-4c71-aaf5-3e3a57a426ea tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:47.039687 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-68f92125-f12c-4c71-aaf5-3e3a57a426ea tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:47.040432 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-68f92125-f12c-4c71-aaf5-3e3a57a426ea tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:47.040858 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-68f92125-f12c-4c71-aaf5-3e3a57a426ea tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:47.041452 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fe4b2623-f4dc-47db-8748-8c17ca0e34ba tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:47.041902 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fe4b2623-f4dc-47db-8748-8c17ca0e34ba tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:47.042695 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fe4b2623-f4dc-47db-8748-8c17ca0e34ba tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:47.043130 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fe4b2623-f4dc-47db-8748-8c17ca0e34ba tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:47.071708 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-68f92125-f12c-4c71-aaf5-3e3a57a426ea tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044927 Jun 17 13:15:47.072277 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 540/1049] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:47 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:47.074061 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-fe4b2623-f4dc-47db-8748-8c17ca0e34ba tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044756 Jun 17 13:15:47.074810 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 510/1050] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:15:47 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:15:47.077093 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-46449759-12c0-467b-8d48-c709b0963897 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:47.078243 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-46449759-12c0-467b-8d48-c709b0963897 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:47.084283 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-46449759-12c0-467b-8d48-c709b0963897 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:47.084750 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-46449759-12c0-467b-8d48-c709b0963897 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:47.085618 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-46449759-12c0-467b-8d48-c709b0963897 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:47.086118 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-46449759-12c0-467b-8d48-c709b0963897 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:47.116289 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-46449759-12c0-467b-8d48-c709b0963897 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042986 Jun 17 13:15:47.116884 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 541/1051] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:47 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:47.809168 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 13:15:47.809468 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Fri Jun 17 13:15:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 17 13:15:48.085710 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-dc0093eb-dc02-4432-a91f-2101d318dcb8 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:48.087734 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-dc0093eb-dc02-4432-a91f-2101d318dcb8 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:48.093107 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-6714d46c-c615-454e-be70-2f76416191fa tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:48.094262 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-6714d46c-c615-454e-be70-2f76416191fa tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:48.095307 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dc0093eb-dc02-4432-a91f-2101d318dcb8 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:48.095844 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dc0093eb-dc02-4432-a91f-2101d318dcb8 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:48.096694 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dc0093eb-dc02-4432-a91f-2101d318dcb8 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:48.097238 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dc0093eb-dc02-4432-a91f-2101d318dcb8 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:48.103729 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6714d46c-c615-454e-be70-2f76416191fa tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:48.104349 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6714d46c-c615-454e-be70-2f76416191fa tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:48.105338 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6714d46c-c615-454e-be70-2f76416191fa tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:48.106083 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6714d46c-c615-454e-be70-2f76416191fa tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:48.131333 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-dc0093eb-dc02-4432-a91f-2101d318dcb8 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050028 Jun 17 13:15:48.131906 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 511/1052] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:48 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:48.138559 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-6714d46c-c615-454e-be70-2f76416191fa tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056288 Jun 17 13:15:48.139038 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-5271c4ba-79f8-453f-8c41-ee64dee3fae8 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:48.139161 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 542/1053] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:15:48 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:15:48.139958 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-5271c4ba-79f8-453f-8c41-ee64dee3fae8 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:48.146015 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5271c4ba-79f8-453f-8c41-ee64dee3fae8 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:48.146488 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5271c4ba-79f8-453f-8c41-ee64dee3fae8 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:48.147391 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5271c4ba-79f8-453f-8c41-ee64dee3fae8 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:48.147696 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5271c4ba-79f8-453f-8c41-ee64dee3fae8 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:48.176719 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-5271c4ba-79f8-453f-8c41-ee64dee3fae8 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043793 Jun 17 13:15:48.177272 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 512/1054] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:48 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:49.145421 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-9645dd69-77e1-418e-b2d4-c15c27fb3710 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:49.147313 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-9645dd69-77e1-418e-b2d4-c15c27fb3710 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:49.151312 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-6c3366d8-87e5-40da-abb8-53a74aed04b3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:49.152591 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-6c3366d8-87e5-40da-abb8-53a74aed04b3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:49.156793 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9645dd69-77e1-418e-b2d4-c15c27fb3710 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:49.157067 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9645dd69-77e1-418e-b2d4-c15c27fb3710 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:49.158565 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9645dd69-77e1-418e-b2d4-c15c27fb3710 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:49.158732 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9645dd69-77e1-418e-b2d4-c15c27fb3710 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:49.160927 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6c3366d8-87e5-40da-abb8-53a74aed04b3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:49.161376 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6c3366d8-87e5-40da-abb8-53a74aed04b3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:49.162129 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6c3366d8-87e5-40da-abb8-53a74aed04b3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:49.162597 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6c3366d8-87e5-40da-abb8-53a74aed04b3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:49.189225 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-9645dd69-77e1-418e-b2d4-c15c27fb3710 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048789 Jun 17 13:15:49.193203 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 543/1055] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:49 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:49.193662 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-6c3366d8-87e5-40da-abb8-53a74aed04b3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046633 Jun 17 13:15:49.194178 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 513/1056] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:15:49 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:15:49.194702 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-9b676323-35f1-4251-a1e0-dd19200f50fb tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:49.195639 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-9b676323-35f1-4251-a1e0-dd19200f50fb tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:49.202044 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9b676323-35f1-4251-a1e0-dd19200f50fb tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:49.202549 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9b676323-35f1-4251-a1e0-dd19200f50fb tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:49.203360 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9b676323-35f1-4251-a1e0-dd19200f50fb tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:49.203799 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9b676323-35f1-4251-a1e0-dd19200f50fb tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:49.234045 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-9b676323-35f1-4251-a1e0-dd19200f50fb tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043142 Jun 17 13:15:49.234992 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 544/1057] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:49 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:50.203651 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-d0eb3cce-3b8a-4934-b419-5c2f77e72fa7 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:50.205088 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-d0eb3cce-3b8a-4934-b419-5c2f77e72fa7 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:50.207035 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-14040941-bbfa-4588-a984-454e6ddadd9c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:50.207981 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-14040941-bbfa-4588-a984-454e6ddadd9c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:50.212115 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d0eb3cce-3b8a-4934-b419-5c2f77e72fa7 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:50.212563 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d0eb3cce-3b8a-4934-b419-5c2f77e72fa7 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:50.213407 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d0eb3cce-3b8a-4934-b419-5c2f77e72fa7 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:50.213838 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d0eb3cce-3b8a-4934-b419-5c2f77e72fa7 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:50.214877 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-14040941-bbfa-4588-a984-454e6ddadd9c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:50.215332 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-14040941-bbfa-4588-a984-454e6ddadd9c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:50.216094 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-14040941-bbfa-4588-a984-454e6ddadd9c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:50.216559 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-14040941-bbfa-4588-a984-454e6ddadd9c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:50.247702 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-d0eb3cce-3b8a-4934-b419-5c2f77e72fa7 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049291 Jun 17 13:15:50.248252 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 514/1058] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:50 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:50.251295 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-14040941-bbfa-4588-a984-454e6ddadd9c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049866 Jun 17 13:15:50.252021 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 545/1059] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:15:50 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:15:50.253027 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-22cee4ac-6028-493a-98fc-a86b4c4c1396 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:50.253929 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-22cee4ac-6028-493a-98fc-a86b4c4c1396 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:50.259956 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-22cee4ac-6028-493a-98fc-a86b4c4c1396 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:50.260396 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-22cee4ac-6028-493a-98fc-a86b4c4c1396 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:50.261147 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-22cee4ac-6028-493a-98fc-a86b4c4c1396 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:50.261572 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-22cee4ac-6028-493a-98fc-a86b4c4c1396 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:50.291194 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-22cee4ac-6028-493a-98fc-a86b4c4c1396 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041940 Jun 17 13:15:50.291738 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 515/1060] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:50 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:51.264561 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-2761e834-7abb-42f2-9b13-ad2614c460be tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:51.266053 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-2761e834-7abb-42f2-9b13-ad2614c460be tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:51.267154 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-cd34949f-30e3-4e66-b8e7-48223aa012c6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:51.268451 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-cd34949f-30e3-4e66-b8e7-48223aa012c6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:51.273860 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2761e834-7abb-42f2-9b13-ad2614c460be tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:51.274336 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2761e834-7abb-42f2-9b13-ad2614c460be tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:51.275096 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2761e834-7abb-42f2-9b13-ad2614c460be tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:51.275239 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cd34949f-30e3-4e66-b8e7-48223aa012c6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:51.275524 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2761e834-7abb-42f2-9b13-ad2614c460be tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:51.275685 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cd34949f-30e3-4e66-b8e7-48223aa012c6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:51.276435 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cd34949f-30e3-4e66-b8e7-48223aa012c6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:51.276865 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cd34949f-30e3-4e66-b8e7-48223aa012c6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:51.306700 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-cd34949f-30e3-4e66-b8e7-48223aa012c6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046121 Jun 17 13:15:51.310609 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 516/1061] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:15:51 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:15:51.310758 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-2761e834-7abb-42f2-9b13-ad2614c460be tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051196 Jun 17 13:15:51.310758 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 546/1062] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:51 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:51.315194 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-d463630c-146c-4460-9fc5-07afaba6c2b3 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:51.316168 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-d463630c-146c-4460-9fc5-07afaba6c2b3 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:51.322718 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d463630c-146c-4460-9fc5-07afaba6c2b3 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:51.323166 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d463630c-146c-4460-9fc5-07afaba6c2b3 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:51.323940 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d463630c-146c-4460-9fc5-07afaba6c2b3 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:51.324606 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d463630c-146c-4460-9fc5-07afaba6c2b3 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:51.353429 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-d463630c-146c-4460-9fc5-07afaba6c2b3 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045155 Jun 17 13:15:51.354035 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 517/1063] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:51 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:52.320663 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-d0eb5547-23a1-4ef8-985e-9cc5a66253f2 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:52.321586 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-d0eb5547-23a1-4ef8-985e-9cc5a66253f2 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:52.321745 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-dd5ad131-67f8-4c77-b035-eab5f212ce03 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:52.322559 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-dd5ad131-67f8-4c77-b035-eab5f212ce03 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:52.328887 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d0eb5547-23a1-4ef8-985e-9cc5a66253f2 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:52.329401 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d0eb5547-23a1-4ef8-985e-9cc5a66253f2 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:52.329738 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dd5ad131-67f8-4c77-b035-eab5f212ce03 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:52.330245 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d0eb5547-23a1-4ef8-985e-9cc5a66253f2 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:52.330391 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dd5ad131-67f8-4c77-b035-eab5f212ce03 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:52.330708 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d0eb5547-23a1-4ef8-985e-9cc5a66253f2 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:52.331210 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dd5ad131-67f8-4c77-b035-eab5f212ce03 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:52.331664 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dd5ad131-67f8-4c77-b035-eab5f212ce03 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:52.361981 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-d0eb5547-23a1-4ef8-985e-9cc5a66253f2 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045616 Jun 17 13:15:52.362792 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-dd5ad131-67f8-4c77-b035-eab5f212ce03 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044487 Jun 17 13:15:52.362924 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 518/1064] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:52 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:52.363413 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 547/1065] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:15:52 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:15:52.367643 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-c316889c-0347-4443-8edb-746298f983c2 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:52.368662 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-c316889c-0347-4443-8edb-746298f983c2 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:52.374978 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c316889c-0347-4443-8edb-746298f983c2 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:52.375493 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c316889c-0347-4443-8edb-746298f983c2 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:52.376350 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c316889c-0347-4443-8edb-746298f983c2 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:52.376780 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c316889c-0347-4443-8edb-746298f983c2 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:52.409569 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-c316889c-0347-4443-8edb-746298f983c2 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045374 Jun 17 13:15:52.410157 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 519/1066] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:52 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:53.375309 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-743a66d4-6f5d-480a-9c76-547c9fb3e88e tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:53.376237 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-743a66d4-6f5d-480a-9c76-547c9fb3e88e tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:53.376903 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-d0ce9a1e-eec9-4e0b-af5f-00031bd07b1f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:53.377831 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-d0ce9a1e-eec9-4e0b-af5f-00031bd07b1f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:53.383456 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-743a66d4-6f5d-480a-9c76-547c9fb3e88e tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:53.383899 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-743a66d4-6f5d-480a-9c76-547c9fb3e88e tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:53.384694 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-743a66d4-6f5d-480a-9c76-547c9fb3e88e tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:53.385124 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-743a66d4-6f5d-480a-9c76-547c9fb3e88e tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:53.386353 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d0ce9a1e-eec9-4e0b-af5f-00031bd07b1f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:53.386932 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d0ce9a1e-eec9-4e0b-af5f-00031bd07b1f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:53.387823 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d0ce9a1e-eec9-4e0b-af5f-00031bd07b1f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:53.388259 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d0ce9a1e-eec9-4e0b-af5f-00031bd07b1f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:53.416788 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-743a66d4-6f5d-480a-9c76-547c9fb3e88e tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045515 Jun 17 13:15:53.417374 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 548/1067] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:53 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:53.420110 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-d0ce9a1e-eec9-4e0b-af5f-00031bd07b1f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047138 Jun 17 13:15:53.420722 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 520/1068] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:15:53 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:15:53.421971 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-03295215-483a-4633-ad22-e1f7a4f07994 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:53.422911 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-03295215-483a-4633-ad22-e1f7a4f07994 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:53.430040 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-03295215-483a-4633-ad22-e1f7a4f07994 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:53.430528 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-03295215-483a-4633-ad22-e1f7a4f07994 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:53.431322 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-03295215-483a-4633-ad22-e1f7a4f07994 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:53.431760 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-03295215-483a-4633-ad22-e1f7a4f07994 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:53.462643 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-03295215-483a-4633-ad22-e1f7a4f07994 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044213 Jun 17 13:15:53.463205 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 549/1069] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:53 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:54.430218 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-2c0e7a28-e56c-4798-9a32-64820054bc31 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:54.431151 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-2c0e7a28-e56c-4798-9a32-64820054bc31 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:54.432842 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-afa71ac4-15f9-47c0-b739-e79796dc5731 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:54.433796 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-afa71ac4-15f9-47c0-b739-e79796dc5731 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:54.438102 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2c0e7a28-e56c-4798-9a32-64820054bc31 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:54.438559 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2c0e7a28-e56c-4798-9a32-64820054bc31 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:54.439335 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2c0e7a28-e56c-4798-9a32-64820054bc31 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:54.439765 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2c0e7a28-e56c-4798-9a32-64820054bc31 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:54.440361 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-afa71ac4-15f9-47c0-b739-e79796dc5731 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:54.440801 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-afa71ac4-15f9-47c0-b739-e79796dc5731 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:54.441551 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-afa71ac4-15f9-47c0-b739-e79796dc5731 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:54.441979 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-afa71ac4-15f9-47c0-b739-e79796dc5731 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:54.469201 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-2c0e7a28-e56c-4798-9a32-64820054bc31 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044942 Jun 17 13:15:54.469747 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 521/1070] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:54 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:54.474282 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-3c58bc45-f31f-44f2-85d0-4f08f80b9faa tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:54.475528 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-3c58bc45-f31f-44f2-85d0-4f08f80b9faa tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:54.475735 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-afa71ac4-15f9-47c0-b739-e79796dc5731 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046792 Jun 17 13:15:54.476297 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 550/1071] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:15:54 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:15:54.481414 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3c58bc45-f31f-44f2-85d0-4f08f80b9faa tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:54.481854 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3c58bc45-f31f-44f2-85d0-4f08f80b9faa tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:54.482636 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3c58bc45-f31f-44f2-85d0-4f08f80b9faa tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:54.483069 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3c58bc45-f31f-44f2-85d0-4f08f80b9faa tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:54.512874 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-3c58bc45-f31f-44f2-85d0-4f08f80b9faa tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042080 Jun 17 13:15:54.516719 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 522/1072] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:54 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:55.483642 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-e087d1e2-4a14-4800-833a-3d6e123dddff tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:55.484953 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-e087d1e2-4a14-4800-833a-3d6e123dddff tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:55.487957 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-e71eb898-2536-46ab-9e71-5957dfc18d2b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:55.488892 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-e71eb898-2536-46ab-9e71-5957dfc18d2b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:55.492087 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e087d1e2-4a14-4800-833a-3d6e123dddff tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:55.492524 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e087d1e2-4a14-4800-833a-3d6e123dddff tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:55.493312 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e087d1e2-4a14-4800-833a-3d6e123dddff tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:55.493722 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e087d1e2-4a14-4800-833a-3d6e123dddff tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:55.495623 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e71eb898-2536-46ab-9e71-5957dfc18d2b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:55.496068 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e71eb898-2536-46ab-9e71-5957dfc18d2b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:55.496815 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e71eb898-2536-46ab-9e71-5957dfc18d2b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:55.497258 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e71eb898-2536-46ab-9e71-5957dfc18d2b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:55.523523 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-e087d1e2-4a14-4800-833a-3d6e123dddff tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044905 Jun 17 13:15:55.524305 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 551/1073] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:55 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:55.527141 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-e71eb898-2536-46ab-9e71-5957dfc18d2b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043538 Jun 17 13:15:55.527863 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 523/1074] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:15:55 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:15:55.528680 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-2d862892-be00-466a-a143-712e5daadcd9 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:55.529593 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-2d862892-be00-466a-a143-712e5daadcd9 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:55.535567 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2d862892-be00-466a-a143-712e5daadcd9 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:55.536012 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2d862892-be00-466a-a143-712e5daadcd9 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:55.536764 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2d862892-be00-466a-a143-712e5daadcd9 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:55.537200 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2d862892-be00-466a-a143-712e5daadcd9 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:55.567003 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-2d862892-be00-466a-a143-712e5daadcd9 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041868 Jun 17 13:15:55.567596 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 552/1075] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:55 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:56.537251 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-f8290dfb-f566-40c1-91f4-06491a437cc9 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:56.538135 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-f8290dfb-f566-40c1-91f4-06491a437cc9 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:56.540423 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-bf5d8244-9068-4ce2-8130-1b03a5ea4e9a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:56.541437 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-bf5d8244-9068-4ce2-8130-1b03a5ea4e9a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:56.545484 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f8290dfb-f566-40c1-91f4-06491a437cc9 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:56.545936 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f8290dfb-f566-40c1-91f4-06491a437cc9 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:56.546788 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f8290dfb-f566-40c1-91f4-06491a437cc9 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:56.547215 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f8290dfb-f566-40c1-91f4-06491a437cc9 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:56.548358 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-bf5d8244-9068-4ce2-8130-1b03a5ea4e9a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:56.548807 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-bf5d8244-9068-4ce2-8130-1b03a5ea4e9a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:56.549574 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-bf5d8244-9068-4ce2-8130-1b03a5ea4e9a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:56.550010 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-bf5d8244-9068-4ce2-8130-1b03a5ea4e9a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:56.565992 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=100 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:15:56.579930 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-f8290dfb-f566-40c1-91f4-06491a437cc9 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047617 Jun 17 13:15:56.580473 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 524/1076] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:56 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:56.585272 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-bf5d8244-9068-4ce2-8130-1b03a5ea4e9a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049935 Jun 17 13:15:56.585453 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-02c43991-ec72-4fde-bcd5-3b397ee6f82d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:56.586137 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 553/1077] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:15:56 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 17 13:15:56.586289 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-02c43991-ec72-4fde-bcd5-3b397ee6f82d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:56.592268 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-02c43991-ec72-4fde-bcd5-3b397ee6f82d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:56.592756 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-02c43991-ec72-4fde-bcd5-3b397ee6f82d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:56.593532 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-02c43991-ec72-4fde-bcd5-3b397ee6f82d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:56.593967 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-02c43991-ec72-4fde-bcd5-3b397ee6f82d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:56.626223 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-02c43991-ec72-4fde-bcd5-3b397ee6f82d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044690 Jun 17 13:15:56.626791 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 525/1078] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:56 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:57.593394 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-c6049e45-a8b1-4083-99c1-04da47afeabe tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:57.594562 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-c6049e45-a8b1-4083-99c1-04da47afeabe tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:57.599257 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-c3aeef71-1f83-4010-b36d-a02880fbf6dd tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:57.600936 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-c3aeef71-1f83-4010-b36d-a02880fbf6dd tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:57.602981 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c6049e45-a8b1-4083-99c1-04da47afeabe tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:57.603427 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c6049e45-a8b1-4083-99c1-04da47afeabe tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:57.604201 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c6049e45-a8b1-4083-99c1-04da47afeabe tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:57.604618 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c6049e45-a8b1-4083-99c1-04da47afeabe tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:57.607859 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c3aeef71-1f83-4010-b36d-a02880fbf6dd tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:57.608373 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c3aeef71-1f83-4010-b36d-a02880fbf6dd tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:57.609317 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c3aeef71-1f83-4010-b36d-a02880fbf6dd tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:57.610226 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c3aeef71-1f83-4010-b36d-a02880fbf6dd tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:57.634833 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-c6049e45-a8b1-4083-99c1-04da47afeabe tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046878 Jun 17 13:15:57.635491 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 554/1079] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:57 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:57.639948 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-b121d3d5-e929-4235-ba65-d475b6ed3cb3 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:57.640861 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-b121d3d5-e929-4235-ba65-d475b6ed3cb3 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:57.641810 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-c3aeef71-1f83-4010-b36d-a02880fbf6dd tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047873 Jun 17 13:15:57.642479 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 526/1080] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:15:57 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:15:57.649238 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b121d3d5-e929-4235-ba65-d475b6ed3cb3 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:57.649684 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b121d3d5-e929-4235-ba65-d475b6ed3cb3 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:57.650489 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b121d3d5-e929-4235-ba65-d475b6ed3cb3 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:57.650926 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b121d3d5-e929-4235-ba65-d475b6ed3cb3 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:57.655183 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_cell1:SELECT=100 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:15:57.680511 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-b121d3d5-e929-4235-ba65-d475b6ed3cb3 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044072 Jun 17 13:15:57.681267 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 555/1081] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:57 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:58.648935 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-4a93a6d6-69cb-42fb-aaa5-510a17370269 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:58.650189 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-4a93a6d6-69cb-42fb-aaa5-510a17370269 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:58.654721 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-50f59e76-6778-4f2c-b2b3-e0af1101faef tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:58.655713 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-50f59e76-6778-4f2c-b2b3-e0af1101faef tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:58.657361 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4a93a6d6-69cb-42fb-aaa5-510a17370269 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:58.657810 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4a93a6d6-69cb-42fb-aaa5-510a17370269 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:58.658629 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4a93a6d6-69cb-42fb-aaa5-510a17370269 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:58.659060 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4a93a6d6-69cb-42fb-aaa5-510a17370269 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:58.662785 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-50f59e76-6778-4f2c-b2b3-e0af1101faef tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:58.663236 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-50f59e76-6778-4f2c-b2b3-e0af1101faef tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:58.664037 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-50f59e76-6778-4f2c-b2b3-e0af1101faef tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:58.664470 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-50f59e76-6778-4f2c-b2b3-e0af1101faef tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:58.690124 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-4a93a6d6-69cb-42fb-aaa5-510a17370269 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046151 Jun 17 13:15:58.690716 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 527/1082] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:58 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:58.694581 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-50f59e76-6778-4f2c-b2b3-e0af1101faef tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043772 Jun 17 13:15:58.695396 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 556/1083] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:15:58 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:15:58.695545 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-e192b95a-1786-499e-9520-1ab559323d3e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:58.696480 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-e192b95a-1786-499e-9520-1ab559323d3e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:58.702944 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e192b95a-1786-499e-9520-1ab559323d3e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:58.703393 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e192b95a-1786-499e-9520-1ab559323d3e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:58.704164 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e192b95a-1786-499e-9520-1ab559323d3e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:58.704600 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e192b95a-1786-499e-9520-1ab559323d3e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:58.734294 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-e192b95a-1786-499e-9520-1ab559323d3e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042461 Jun 17 13:15:58.735188 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 528/1084] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:58 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:59.701292 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-ab0f808d-3226-4c53-982c-efed8221c76c tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:59.702505 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-ab0f808d-3226-4c53-982c-efed8221c76c tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:59.705538 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-90078b39-194c-4747-80eb-52fbc195e7be tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:59.706548 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-90078b39-194c-4747-80eb-52fbc195e7be tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:59.709587 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ab0f808d-3226-4c53-982c-efed8221c76c tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:59.710026 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ab0f808d-3226-4c53-982c-efed8221c76c tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:59.710812 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ab0f808d-3226-4c53-982c-efed8221c76c tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:59.711245 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ab0f808d-3226-4c53-982c-efed8221c76c tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:59.713445 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-90078b39-194c-4747-80eb-52fbc195e7be tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:59.713883 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-90078b39-194c-4747-80eb-52fbc195e7be tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:59.714662 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-90078b39-194c-4747-80eb-52fbc195e7be tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:59.715084 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-90078b39-194c-4747-80eb-52fbc195e7be tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:59.744443 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-ab0f808d-3226-4c53-982c-efed8221c76c tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046907 Jun 17 13:15:59.745029 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 557/1085] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:59 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:15:59.745612 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-90078b39-194c-4747-80eb-52fbc195e7be tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043907 Jun 17 13:15:59.749572 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 529/1086] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:15:59 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:15:59.749730 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-4d824436-0a99-4bef-8db3-ebd57d047b59 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:15:59.750511 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-4d824436-0a99-4bef-8db3-ebd57d047b59 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:15:59.756801 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4d824436-0a99-4bef-8db3-ebd57d047b59 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:59.757251 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4d824436-0a99-4bef-8db3-ebd57d047b59 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:59.758010 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4d824436-0a99-4bef-8db3-ebd57d047b59 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:15:59.758478 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4d824436-0a99-4bef-8db3-ebd57d047b59 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:15:59.789399 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-4d824436-0a99-4bef-8db3-ebd57d047b59 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043336 Jun 17 13:15:59.790145 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 558/1087] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:15:59 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:00.760991 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-a5c7b256-b00d-4ac9-bcc1-cea7c711dd17 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:00.761878 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-390085be-0d47-43f2-aa2d-f095dee650f6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:00.762573 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-a5c7b256-b00d-4ac9-bcc1-cea7c711dd17 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:00.763345 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-390085be-0d47-43f2-aa2d-f095dee650f6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:00.765496 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_api:SELECT=90 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:16:00.770679 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-390085be-0d47-43f2-aa2d-f095dee650f6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:00.770891 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a5c7b256-b00d-4ac9-bcc1-cea7c711dd17 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:00.771130 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-390085be-0d47-43f2-aa2d-f095dee650f6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:00.771264 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a5c7b256-b00d-4ac9-bcc1-cea7c711dd17 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:00.771921 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-390085be-0d47-43f2-aa2d-f095dee650f6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:00.772041 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a5c7b256-b00d-4ac9-bcc1-cea7c711dd17 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:00.772354 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-390085be-0d47-43f2-aa2d-f095dee650f6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:00.772473 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a5c7b256-b00d-4ac9-bcc1-cea7c711dd17 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:00.803225 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-390085be-0d47-43f2-aa2d-f095dee650f6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048341 Jun 17 13:16:00.803518 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-a5c7b256-b00d-4ac9-bcc1-cea7c711dd17 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049231 Jun 17 13:16:00.803871 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 530/1088] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:00 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:00.807215 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 559/1089] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:16:00 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:16:00.811932 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-7733c9cf-2ae6-4f40-8421-e6a912f7c9f2 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:00.812836 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-7733c9cf-2ae6-4f40-8421-e6a912f7c9f2 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:00.818790 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7733c9cf-2ae6-4f40-8421-e6a912f7c9f2 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:00.819227 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7733c9cf-2ae6-4f40-8421-e6a912f7c9f2 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:00.820037 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7733c9cf-2ae6-4f40-8421-e6a912f7c9f2 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:00.820460 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7733c9cf-2ae6-4f40-8421-e6a912f7c9f2 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:00.850848 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-7733c9cf-2ae6-4f40-8421-e6a912f7c9f2 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042578 Jun 17 13:16:00.851780 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 531/1090] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:00 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:01.817276 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-de90ccda-b300-4411-9751-97af1721d229 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:01.818150 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-3c14e037-3fc6-4488-8625-a4018486f253 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:01.818614 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-de90ccda-b300-4411-9751-97af1721d229 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:01.818740 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-3c14e037-3fc6-4488-8625-a4018486f253 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:01.826968 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-3c14e037-3fc6-4488-8625-a4018486f253 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:01.827195 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-de90ccda-b300-4411-9751-97af1721d229 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:01.827333 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-3c14e037-3fc6-4488-8625-a4018486f253 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:01.827435 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-de90ccda-b300-4411-9751-97af1721d229 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:01.828322 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-3c14e037-3fc6-4488-8625-a4018486f253 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:01.828528 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-de90ccda-b300-4411-9751-97af1721d229 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:01.828868 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-3c14e037-3fc6-4488-8625-a4018486f253 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:01.829063 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-de90ccda-b300-4411-9751-97af1721d229 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:01.862380 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-de90ccda-b300-4411-9751-97af1721d229 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049981 Jun 17 13:16:01.862946 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 532/1091] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:01 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:01.863121 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-3c14e037-3fc6-4488-8625-a4018486f253 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050650 Jun 17 13:16:01.866906 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 560/1092] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:16:01 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:16:01.867638 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-4a8bd63a-abe4-4518-a6ea-82204d611a96 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:01.868666 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-4a8bd63a-abe4-4518-a6ea-82204d611a96 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:01.875857 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4a8bd63a-abe4-4518-a6ea-82204d611a96 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:01.876336 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4a8bd63a-abe4-4518-a6ea-82204d611a96 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:01.877065 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4a8bd63a-abe4-4518-a6ea-82204d611a96 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:01.877517 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4a8bd63a-abe4-4518-a6ea-82204d611a96 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:01.908042 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-4a8bd63a-abe4-4518-a6ea-82204d611a96 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044050 Jun 17 13:16:01.908717 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 533/1093] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:01 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:02.878847 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-abc1c059-d524-421a-b82b-9a9e995681ac tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:02.879942 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-c8526efc-c61f-49ad-8d56-ea92bae888bf tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:02.880544 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-abc1c059-d524-421a-b82b-9a9e995681ac tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:02.880700 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-c8526efc-c61f-49ad-8d56-ea92bae888bf tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:02.890812 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-abc1c059-d524-421a-b82b-9a9e995681ac tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:02.891261 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c8526efc-c61f-49ad-8d56-ea92bae888bf tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:02.891437 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-abc1c059-d524-421a-b82b-9a9e995681ac tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:02.891709 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c8526efc-c61f-49ad-8d56-ea92bae888bf tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:02.891978 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-abc1c059-d524-421a-b82b-9a9e995681ac tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:02.892432 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-abc1c059-d524-421a-b82b-9a9e995681ac tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:02.892595 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c8526efc-c61f-49ad-8d56-ea92bae888bf tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:02.892907 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c8526efc-c61f-49ad-8d56-ea92bae888bf tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:02.924798 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-abc1c059-d524-421a-b82b-9a9e995681ac tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052744 Jun 17 13:16:02.925131 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-c8526efc-c61f-49ad-8d56-ea92bae888bf tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053231 Jun 17 13:16:02.928798 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 534/1094] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:16:02 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:16:02.928971 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 561/1095] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:02 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:02.930766 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-8c349121-7a47-4986-b58d-f90f99da5cc0 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:02.931509 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-8c349121-7a47-4986-b58d-f90f99da5cc0 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:02.938612 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8c349121-7a47-4986-b58d-f90f99da5cc0 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:02.939062 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8c349121-7a47-4986-b58d-f90f99da5cc0 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:02.939799 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8c349121-7a47-4986-b58d-f90f99da5cc0 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:02.940244 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8c349121-7a47-4986-b58d-f90f99da5cc0 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:02.970071 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-8c349121-7a47-4986-b58d-f90f99da5cc0 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043305 Jun 17 13:16:02.970646 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 535/1096] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:02 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:03.937420 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-2be05149-6f71-466a-818d-75af6f2288ae tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:03.938129 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-ddd29d15-eef1-4afe-afa4-c1524c6f2661 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:03.938722 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-ddd29d15-eef1-4afe-afa4-c1524c6f2661 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:03.938905 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-2be05149-6f71-466a-818d-75af6f2288ae tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:03.945988 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ddd29d15-eef1-4afe-afa4-c1524c6f2661 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:03.946633 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ddd29d15-eef1-4afe-afa4-c1524c6f2661 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:03.947408 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ddd29d15-eef1-4afe-afa4-c1524c6f2661 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:03.947834 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ddd29d15-eef1-4afe-afa4-c1524c6f2661 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:03.948501 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2be05149-6f71-466a-818d-75af6f2288ae tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:03.949006 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2be05149-6f71-466a-818d-75af6f2288ae tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:03.949776 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2be05149-6f71-466a-818d-75af6f2288ae tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:03.950253 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2be05149-6f71-466a-818d-75af6f2288ae tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:03.981328 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-ddd29d15-eef1-4afe-afa4-c1524c6f2661 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047843 Jun 17 13:16:03.981900 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 536/1097] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:03 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:03.987218 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-edb32e99-e2eb-4918-9d0f-eaf62bb81091 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:03.988111 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-edb32e99-e2eb-4918-9d0f-eaf62bb81091 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:03.992027 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-2be05149-6f71-466a-818d-75af6f2288ae tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.058809 Jun 17 13:16:03.992819 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 562/1098] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:16:03 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:16:03.998790 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-edb32e99-e2eb-4918-9d0f-eaf62bb81091 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:04.000007 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-edb32e99-e2eb-4918-9d0f-eaf62bb81091 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:04.000783 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-edb32e99-e2eb-4918-9d0f-eaf62bb81091 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:04.001226 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-edb32e99-e2eb-4918-9d0f-eaf62bb81091 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:04.038553 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-edb32e99-e2eb-4918-9d0f-eaf62bb81091 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055539 Jun 17 13:16:04.039109 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 537/1099] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:03 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:04.995694 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-9ba98b1d-782d-434e-9135-777ce7cc644f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:04.996908 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-9ba98b1d-782d-434e-9135-777ce7cc644f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:05.004406 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-94d4ac8f-8038-43e6-9d7f-7527b89f82cd tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:05.004923 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9ba98b1d-782d-434e-9135-777ce7cc644f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:05.004923 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9ba98b1d-782d-434e-9135-777ce7cc644f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:05.005330 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-94d4ac8f-8038-43e6-9d7f-7527b89f82cd tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:05.005604 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9ba98b1d-782d-434e-9135-777ce7cc644f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:05.006043 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9ba98b1d-782d-434e-9135-777ce7cc644f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:05.011735 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-94d4ac8f-8038-43e6-9d7f-7527b89f82cd tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:05.012180 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-94d4ac8f-8038-43e6-9d7f-7527b89f82cd tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:05.012938 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-94d4ac8f-8038-43e6-9d7f-7527b89f82cd tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:05.013454 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-94d4ac8f-8038-43e6-9d7f-7527b89f82cd tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:05.036418 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-9ba98b1d-782d-434e-9135-777ce7cc644f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046651 Jun 17 13:16:05.036996 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 563/1100] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:04 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:05.043944 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-94d4ac8f-8038-43e6-9d7f-7527b89f82cd tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043751 Jun 17 13:16:05.044509 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 538/1101] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:16:04 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:16:05.051264 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-838dee44-75c3-48a4-af3e-ed7d24880ae2 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:05.052271 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-838dee44-75c3-48a4-af3e-ed7d24880ae2 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:05.058569 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-838dee44-75c3-48a4-af3e-ed7d24880ae2 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:05.058959 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-838dee44-75c3-48a4-af3e-ed7d24880ae2 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:05.059721 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-838dee44-75c3-48a4-af3e-ed7d24880ae2 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:05.060162 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-838dee44-75c3-48a4-af3e-ed7d24880ae2 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:05.096876 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-838dee44-75c3-48a4-af3e-ed7d24880ae2 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049454 Jun 17 13:16:05.097564 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 564/1102] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:05 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:06.052517 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-0c58a2cd-c5e5-4823-8e46-2ebf3590ccd2 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:06.053881 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-0c58a2cd-c5e5-4823-8e46-2ebf3590ccd2 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:06.059975 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-9440b910-1bee-49a8-a99d-4e8e02a8815a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:06.061517 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-9440b910-1bee-49a8-a99d-4e8e02a8815a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:06.064611 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0c58a2cd-c5e5-4823-8e46-2ebf3590ccd2 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:06.065131 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0c58a2cd-c5e5-4823-8e46-2ebf3590ccd2 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:06.065906 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0c58a2cd-c5e5-4823-8e46-2ebf3590ccd2 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:06.066365 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0c58a2cd-c5e5-4823-8e46-2ebf3590ccd2 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:06.069299 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9440b910-1bee-49a8-a99d-4e8e02a8815a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:06.069726 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9440b910-1bee-49a8-a99d-4e8e02a8815a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:06.070542 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9440b910-1bee-49a8-a99d-4e8e02a8815a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:06.070980 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9440b910-1bee-49a8-a99d-4e8e02a8815a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:06.096371 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-0c58a2cd-c5e5-4823-8e46-2ebf3590ccd2 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050874 Jun 17 13:16:06.097167 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 539/1103] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:06 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:06.100970 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-9440b910-1bee-49a8-a99d-4e8e02a8815a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047631 Jun 17 13:16:06.101522 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 565/1104] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:16:06 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:16:06.108419 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-0003a264-f5c1-4174-b24a-4ca4c11c9c44 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:06.109779 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-0003a264-f5c1-4174-b24a-4ca4c11c9c44 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:06.117076 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0003a264-f5c1-4174-b24a-4ca4c11c9c44 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:06.117552 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0003a264-f5c1-4174-b24a-4ca4c11c9c44 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:06.118349 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0003a264-f5c1-4174-b24a-4ca4c11c9c44 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:06.118860 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0003a264-f5c1-4174-b24a-4ca4c11c9c44 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:06.148747 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-0003a264-f5c1-4174-b24a-4ca4c11c9c44 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044183 Jun 17 13:16:06.149509 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 540/1105] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:06 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:07.112505 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-952bb856-6670-4de1-b824-1b4e8ead3f1e tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:07.113349 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-952bb856-6670-4de1-b824-1b4e8ead3f1e tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:07.115325 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-fa3d6eb7-8d88-44a9-a05c-f2647f84bf64 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:07.116250 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-fa3d6eb7-8d88-44a9-a05c-f2647f84bf64 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:07.120398 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-952bb856-6670-4de1-b824-1b4e8ead3f1e tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:07.120879 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-952bb856-6670-4de1-b824-1b4e8ead3f1e tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:07.121614 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-952bb856-6670-4de1-b824-1b4e8ead3f1e tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:07.122059 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-952bb856-6670-4de1-b824-1b4e8ead3f1e tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:07.122967 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fa3d6eb7-8d88-44a9-a05c-f2647f84bf64 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:07.123450 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fa3d6eb7-8d88-44a9-a05c-f2647f84bf64 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:07.124225 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fa3d6eb7-8d88-44a9-a05c-f2647f84bf64 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:07.124661 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fa3d6eb7-8d88-44a9-a05c-f2647f84bf64 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:07.128402 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=100 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:16:07.152475 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-952bb856-6670-4de1-b824-1b4e8ead3f1e tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046560 Jun 17 13:16:07.153045 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 566/1106] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:07 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:07.155138 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-fa3d6eb7-8d88-44a9-a05c-f2647f84bf64 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044714 Jun 17 13:16:07.155672 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 541/1107] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:16:07 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:16:07.160736 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-4c871dbd-1a3b-4a3f-9361-be30a3f7cf2e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:07.161661 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-4c871dbd-1a3b-4a3f-9361-be30a3f7cf2e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:07.167754 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4c871dbd-1a3b-4a3f-9361-be30a3f7cf2e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:07.168210 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4c871dbd-1a3b-4a3f-9361-be30a3f7cf2e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:07.168965 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4c871dbd-1a3b-4a3f-9361-be30a3f7cf2e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:07.169424 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4c871dbd-1a3b-4a3f-9361-be30a3f7cf2e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:07.199303 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-4c871dbd-1a3b-4a3f-9361-be30a3f7cf2e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042609 Jun 17 13:16:07.199895 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 567/1108] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:07 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:08.165006 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-18892cd6-9b50-4c4a-acd8-797b6b3ca4c7 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:08.165929 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-18892cd6-9b50-4c4a-acd8-797b6b3ca4c7 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:08.167846 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-037e496d-69b6-4838-8a22-a4ab176dd47d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:08.168770 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-037e496d-69b6-4838-8a22-a4ab176dd47d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:08.171181 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_api:SELECT=82 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:16:08.172383 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-18892cd6-9b50-4c4a-acd8-797b6b3ca4c7 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:08.172878 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-18892cd6-9b50-4c4a-acd8-797b6b3ca4c7 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:08.173716 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-18892cd6-9b50-4c4a-acd8-797b6b3ca4c7 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:08.174254 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-18892cd6-9b50-4c4a-acd8-797b6b3ca4c7 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:08.177218 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-037e496d-69b6-4838-8a22-a4ab176dd47d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:08.177667 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-037e496d-69b6-4838-8a22-a4ab176dd47d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:08.178468 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-037e496d-69b6-4838-8a22-a4ab176dd47d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:08.178905 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-037e496d-69b6-4838-8a22-a4ab176dd47d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:08.204399 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-18892cd6-9b50-4c4a-acd8-797b6b3ca4c7 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044039 Jun 17 13:16:08.205155 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 542/1109] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:08 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:08.210166 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-037e496d-69b6-4838-8a22-a4ab176dd47d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046209 Jun 17 13:16:08.210768 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 568/1110] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:16:08 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:16:08.211802 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-7ed01290-870f-48cc-961a-6d4be585ff1f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:08.212727 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-7ed01290-870f-48cc-961a-6d4be585ff1f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:08.218744 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7ed01290-870f-48cc-961a-6d4be585ff1f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:08.219196 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7ed01290-870f-48cc-961a-6d4be585ff1f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:08.219933 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7ed01290-870f-48cc-961a-6d4be585ff1f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:08.220395 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7ed01290-870f-48cc-961a-6d4be585ff1f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:08.249971 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-7ed01290-870f-48cc-961a-6d4be585ff1f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042658 Jun 17 13:16:08.254543 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 543/1111] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:08 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:09.221102 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-b5bd962d-8158-436c-b767-aad4274ed43a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:09.222625 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-b5bd962d-8158-436c-b767-aad4274ed43a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:09.225558 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-efeb12da-8de6-42b8-9fde-47c409e44d7c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:09.227832 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-efeb12da-8de6-42b8-9fde-47c409e44d7c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:09.235146 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b5bd962d-8158-436c-b767-aad4274ed43a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:09.236207 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b5bd962d-8158-436c-b767-aad4274ed43a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:09.238152 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b5bd962d-8158-436c-b767-aad4274ed43a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:09.239297 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b5bd962d-8158-436c-b767-aad4274ed43a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:09.239581 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-efeb12da-8de6-42b8-9fde-47c409e44d7c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:09.240180 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-efeb12da-8de6-42b8-9fde-47c409e44d7c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:09.242020 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-efeb12da-8de6-42b8-9fde-47c409e44d7c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:09.242520 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-efeb12da-8de6-42b8-9fde-47c409e44d7c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:09.276180 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-efeb12da-8de6-42b8-9fde-47c409e44d7c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.057635 Jun 17 13:16:09.280243 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 544/1112] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:16:09 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:16:09.280526 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-b5bd962d-8158-436c-b767-aad4274ed43a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063910 Jun 17 13:16:09.281385 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 569/1113] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:09 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:09.281702 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-4198758e-8378-4755-b41d-61cf1cf8801b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:09.283059 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-4198758e-8378-4755-b41d-61cf1cf8801b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:09.289656 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4198758e-8378-4755-b41d-61cf1cf8801b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:09.290131 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4198758e-8378-4755-b41d-61cf1cf8801b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:09.290918 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4198758e-8378-4755-b41d-61cf1cf8801b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:09.291337 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4198758e-8378-4755-b41d-61cf1cf8801b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:09.321300 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-4198758e-8378-4755-b41d-61cf1cf8801b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043144 Jun 17 13:16:09.321842 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 545/1114] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:09 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:10.292684 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-88e1cc8d-7ce9-403e-a867-c0f1f6c72ce7 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:10.294064 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-88e1cc8d-7ce9-403e-a867-c0f1f6c72ce7 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:10.294373 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-726c1ad9-756f-4570-bd82-ebb2ded6f03e tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:10.295853 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-726c1ad9-756f-4570-bd82-ebb2ded6f03e tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:10.305597 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-88e1cc8d-7ce9-403e-a867-c0f1f6c72ce7 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:10.305912 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-726c1ad9-756f-4570-bd82-ebb2ded6f03e tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:10.306351 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-88e1cc8d-7ce9-403e-a867-c0f1f6c72ce7 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:10.306483 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-726c1ad9-756f-4570-bd82-ebb2ded6f03e tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:10.307135 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-726c1ad9-756f-4570-bd82-ebb2ded6f03e tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:10.307263 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-88e1cc8d-7ce9-403e-a867-c0f1f6c72ce7 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:10.307565 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-726c1ad9-756f-4570-bd82-ebb2ded6f03e tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:10.307673 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-88e1cc8d-7ce9-403e-a867-c0f1f6c72ce7 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:10.337316 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-726c1ad9-756f-4570-bd82-ebb2ded6f03e tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049986 Jun 17 13:16:10.337702 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-88e1cc8d-7ce9-403e-a867-c0f1f6c72ce7 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051896 Jun 17 13:16:10.341352 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 546/1115] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:10 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:10.341503 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 570/1116] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:16:10 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:16:10.342846 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-64cda2db-3ad6-4cc2-abef-893120570ad3 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:10.343776 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-64cda2db-3ad6-4cc2-abef-893120570ad3 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:10.349835 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-64cda2db-3ad6-4cc2-abef-893120570ad3 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:10.350304 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-64cda2db-3ad6-4cc2-abef-893120570ad3 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:10.351050 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-64cda2db-3ad6-4cc2-abef-893120570ad3 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:10.351655 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-64cda2db-3ad6-4cc2-abef-893120570ad3 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:10.381477 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-64cda2db-3ad6-4cc2-abef-893120570ad3 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042249 Jun 17 13:16:10.382313 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 547/1117] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:10 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:11.349818 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-7f2fe5a5-9c7e-448d-9912-c2fded214785 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:11.350500 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-af376d2f-143c-4e5e-a955-7329bf01ea19 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:11.350921 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-7f2fe5a5-9c7e-448d-9912-c2fded214785 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:11.351039 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-af376d2f-143c-4e5e-a955-7329bf01ea19 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:11.358290 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7f2fe5a5-9c7e-448d-9912-c2fded214785 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:11.358508 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-af376d2f-143c-4e5e-a955-7329bf01ea19 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:11.358762 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7f2fe5a5-9c7e-448d-9912-c2fded214785 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:11.358928 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-af376d2f-143c-4e5e-a955-7329bf01ea19 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:11.359906 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7f2fe5a5-9c7e-448d-9912-c2fded214785 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:11.360073 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-af376d2f-143c-4e5e-a955-7329bf01ea19 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:11.360359 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7f2fe5a5-9c7e-448d-9912-c2fded214785 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:11.360516 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-af376d2f-143c-4e5e-a955-7329bf01ea19 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:11.388813 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_cell1:SELECT=100 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:16:11.393558 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-af376d2f-143c-4e5e-a955-7329bf01ea19 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048008 Jun 17 13:16:11.393747 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-7f2fe5a5-9c7e-448d-9912-c2fded214785 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048120 Jun 17 13:16:11.397535 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 571/1118] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:16:11 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:16:11.397869 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 548/1119] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:11 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:11.399738 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-b12ac76c-e385-422f-a9b3-1b6b9d48d834 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:11.400624 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-b12ac76c-e385-422f-a9b3-1b6b9d48d834 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:11.408299 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b12ac76c-e385-422f-a9b3-1b6b9d48d834 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:11.408783 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b12ac76c-e385-422f-a9b3-1b6b9d48d834 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:11.409493 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b12ac76c-e385-422f-a9b3-1b6b9d48d834 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:11.409922 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b12ac76c-e385-422f-a9b3-1b6b9d48d834 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:11.444150 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-b12ac76c-e385-422f-a9b3-1b6b9d48d834 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048919 Jun 17 13:16:11.444738 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 572/1120] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:11 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:12.409742 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-9ec5376a-af0b-4bf3-b001-2810ddfc609d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:12.411301 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-9ec5376a-af0b-4bf3-b001-2810ddfc609d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:12.412928 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-9eb45d84-2801-4460-a1c5-3e400e190668 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:12.414457 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-9eb45d84-2801-4460-a1c5-3e400e190668 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:12.420248 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9ec5376a-af0b-4bf3-b001-2810ddfc609d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:12.420720 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9ec5376a-af0b-4bf3-b001-2810ddfc609d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:12.421494 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9ec5376a-af0b-4bf3-b001-2810ddfc609d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:12.421638 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9eb45d84-2801-4460-a1c5-3e400e190668 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:12.421922 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9ec5376a-af0b-4bf3-b001-2810ddfc609d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:12.422115 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9eb45d84-2801-4460-a1c5-3e400e190668 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:12.422842 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9eb45d84-2801-4460-a1c5-3e400e190668 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:12.423275 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9eb45d84-2801-4460-a1c5-3e400e190668 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:12.455405 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-9ec5376a-af0b-4bf3-b001-2810ddfc609d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052098 Jun 17 13:16:12.459799 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 549/1121] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:16:12 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:16:12.460740 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-9eb45d84-2801-4460-a1c5-3e400e190668 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054478 Jun 17 13:16:12.460963 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-c6e8b7fc-f388-451c-aa14-b7643e7a953c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:12.461603 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 573/1122] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:12 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 13:16:12.465491 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-c6e8b7fc-f388-451c-aa14-b7643e7a953c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:12.471795 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c6e8b7fc-f388-451c-aa14-b7643e7a953c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:12.472244 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c6e8b7fc-f388-451c-aa14-b7643e7a953c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:12.473019 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c6e8b7fc-f388-451c-aa14-b7643e7a953c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:12.473456 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c6e8b7fc-f388-451c-aa14-b7643e7a953c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:12.502413 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-c6e8b7fc-f388-451c-aa14-b7643e7a953c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045057 Jun 17 13:16:12.502958 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 550/1123] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:12 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:13.468254 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-b8388556-5267-41d6-a200-12225a24d6e8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:13.469283 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-b8388556-5267-41d6-a200-12225a24d6e8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:13.472306 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-20f8febe-61c2-4945-a16b-16e85f1f4c6f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:13.473238 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-20f8febe-61c2-4945-a16b-16e85f1f4c6f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:13.476228 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b8388556-5267-41d6-a200-12225a24d6e8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:13.476672 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b8388556-5267-41d6-a200-12225a24d6e8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:13.477433 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b8388556-5267-41d6-a200-12225a24d6e8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:13.477856 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b8388556-5267-41d6-a200-12225a24d6e8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:13.480277 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-20f8febe-61c2-4945-a16b-16e85f1f4c6f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:13.480728 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-20f8febe-61c2-4945-a16b-16e85f1f4c6f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:13.481507 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-20f8febe-61c2-4945-a16b-16e85f1f4c6f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:13.481942 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-20f8febe-61c2-4945-a16b-16e85f1f4c6f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:13.508137 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-b8388556-5267-41d6-a200-12225a24d6e8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043963 Jun 17 13:16:13.508672 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 574/1124] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:16:13 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:16:13.513488 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-20f8febe-61c2-4945-a16b-16e85f1f4c6f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044930 Jun 17 13:16:13.514310 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 551/1125] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:13 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:13.516273 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-26691228-defd-4e91-89e5-5bb48539fb68 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:13.517211 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-26691228-defd-4e91-89e5-5bb48539fb68 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:13.523737 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-26691228-defd-4e91-89e5-5bb48539fb68 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:13.524213 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-26691228-defd-4e91-89e5-5bb48539fb68 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:13.525202 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-26691228-defd-4e91-89e5-5bb48539fb68 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:13.525795 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-26691228-defd-4e91-89e5-5bb48539fb68 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:13.556046 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-26691228-defd-4e91-89e5-5bb48539fb68 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046019 Jun 17 13:16:13.556609 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 575/1126] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:13 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:14.525043 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-ca448fba-b7f0-44ab-8759-188430f74fb3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:14.526454 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-ca448fba-b7f0-44ab-8759-188430f74fb3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:14.529111 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-ae38762c-dc4d-4c36-bb57-334b8cbd2b51 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:14.531024 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-ae38762c-dc4d-4c36-bb57-334b8cbd2b51 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:14.537296 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ca448fba-b7f0-44ab-8759-188430f74fb3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:14.538055 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ca448fba-b7f0-44ab-8759-188430f74fb3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:14.539388 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ca448fba-b7f0-44ab-8759-188430f74fb3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:14.540118 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ca448fba-b7f0-44ab-8759-188430f74fb3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:14.542069 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ae38762c-dc4d-4c36-bb57-334b8cbd2b51 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:14.542861 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ae38762c-dc4d-4c36-bb57-334b8cbd2b51 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:14.544127 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ae38762c-dc4d-4c36-bb57-334b8cbd2b51 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:14.544857 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ae38762c-dc4d-4c36-bb57-334b8cbd2b51 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:14.575161 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-ca448fba-b7f0-44ab-8759-188430f74fb3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.057081 Jun 17 13:16:14.579527 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 552/1127] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:16:14 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:16:14.579697 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-ae38762c-dc4d-4c36-bb57-334b8cbd2b51 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054583 Jun 17 13:16:14.579697 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 576/1128] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:14 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:14.580929 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-3612a43c-0ea1-403d-9779-1d2174e52f2a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:14.581992 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-3612a43c-0ea1-403d-9779-1d2174e52f2a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:14.588077 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3612a43c-0ea1-403d-9779-1d2174e52f2a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:14.588518 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3612a43c-0ea1-403d-9779-1d2174e52f2a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:14.589270 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3612a43c-0ea1-403d-9779-1d2174e52f2a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:14.589698 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3612a43c-0ea1-403d-9779-1d2174e52f2a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:14.629014 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-3612a43c-0ea1-403d-9779-1d2174e52f2a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042990 Jun 17 13:16:14.629014 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 553/1129] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:14 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:15.591849 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-d8fa51a4-bc9d-4ee3-8c4c-4c77f5b16f82 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:15.592862 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-1500d19a-ac43-42e0-969f-6b3b93d4be2a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:15.593517 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-d8fa51a4-bc9d-4ee3-8c4c-4c77f5b16f82 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:15.595055 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-1500d19a-ac43-42e0-969f-6b3b93d4be2a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:15.600710 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d8fa51a4-bc9d-4ee3-8c4c-4c77f5b16f82 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:15.601165 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d8fa51a4-bc9d-4ee3-8c4c-4c77f5b16f82 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:15.601705 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1500d19a-ac43-42e0-969f-6b3b93d4be2a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:15.601941 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d8fa51a4-bc9d-4ee3-8c4c-4c77f5b16f82 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:15.602144 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1500d19a-ac43-42e0-969f-6b3b93d4be2a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:15.602409 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d8fa51a4-bc9d-4ee3-8c4c-4c77f5b16f82 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:15.603167 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1500d19a-ac43-42e0-969f-6b3b93d4be2a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:15.603600 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1500d19a-ac43-42e0-969f-6b3b93d4be2a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:15.633346 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-d8fa51a4-bc9d-4ee3-8c4c-4c77f5b16f82 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048358 Jun 17 13:16:15.637751 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 577/1130] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:16:15 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:16:15.638237 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-1500d19a-ac43-42e0-969f-6b3b93d4be2a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049214 Jun 17 13:16:15.638237 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 554/1131] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:15 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:15.643209 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-d7b6ec0f-41c6-45f6-9e94-7a2b83401f18 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:15.644138 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-d7b6ec0f-41c6-45f6-9e94-7a2b83401f18 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:15.650269 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d7b6ec0f-41c6-45f6-9e94-7a2b83401f18 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:15.650724 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d7b6ec0f-41c6-45f6-9e94-7a2b83401f18 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:15.651482 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d7b6ec0f-41c6-45f6-9e94-7a2b83401f18 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:15.651915 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d7b6ec0f-41c6-45f6-9e94-7a2b83401f18 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:15.680295 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-d7b6ec0f-41c6-45f6-9e94-7a2b83401f18 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045339 Jun 17 13:16:15.680846 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 578/1132] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:15 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:16.646467 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-a94920ce-9160-44a2-8656-48be6ec554d6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:16.647395 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-a94920ce-9160-44a2-8656-48be6ec554d6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:16.647563 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-d1626236-aead-4c2e-8bb5-184b851b30ea tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:16.648512 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-d1626236-aead-4c2e-8bb5-184b851b30ea tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:16.655215 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a94920ce-9160-44a2-8656-48be6ec554d6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:16.655438 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d1626236-aead-4c2e-8bb5-184b851b30ea tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:16.655704 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a94920ce-9160-44a2-8656-48be6ec554d6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:16.655824 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d1626236-aead-4c2e-8bb5-184b851b30ea tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:16.656555 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d1626236-aead-4c2e-8bb5-184b851b30ea tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:16.656696 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a94920ce-9160-44a2-8656-48be6ec554d6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:16.656987 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d1626236-aead-4c2e-8bb5-184b851b30ea tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:16.657187 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a94920ce-9160-44a2-8656-48be6ec554d6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:16.687070 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-a94920ce-9160-44a2-8656-48be6ec554d6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044920 Jun 17 13:16:16.687545 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-d1626236-aead-4c2e-8bb5-184b851b30ea tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044076 Jun 17 13:16:16.687973 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 555/1133] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:16:16 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:16:16.691762 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 579/1134] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:16 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:16.692537 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-08d5b842-5ac3-4b5e-a877-c84f2f652ba9 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:16.693449 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-08d5b842-5ac3-4b5e-a877-c84f2f652ba9 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:16.700012 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-08d5b842-5ac3-4b5e-a877-c84f2f652ba9 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:16.700494 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-08d5b842-5ac3-4b5e-a877-c84f2f652ba9 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:16.701261 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-08d5b842-5ac3-4b5e-a877-c84f2f652ba9 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:16.701684 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-08d5b842-5ac3-4b5e-a877-c84f2f652ba9 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:16.730912 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-08d5b842-5ac3-4b5e-a877-c84f2f652ba9 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041920 Jun 17 13:16:16.731450 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 556/1135] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:16 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:17.701241 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-4f63524a-14ea-4a9b-a2bf-7f9dfc663cf1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:17.702311 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-4f63524a-14ea-4a9b-a2bf-7f9dfc663cf1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:17.704107 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-6299554a-31a4-4fff-9757-883cf7901474 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:17.706232 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-6299554a-31a4-4fff-9757-883cf7901474 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:17.710114 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4f63524a-14ea-4a9b-a2bf-7f9dfc663cf1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:17.710675 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4f63524a-14ea-4a9b-a2bf-7f9dfc663cf1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:17.711647 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4f63524a-14ea-4a9b-a2bf-7f9dfc663cf1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:17.712182 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4f63524a-14ea-4a9b-a2bf-7f9dfc663cf1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:17.714683 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6299554a-31a4-4fff-9757-883cf7901474 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:17.715242 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6299554a-31a4-4fff-9757-883cf7901474 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:17.716361 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6299554a-31a4-4fff-9757-883cf7901474 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:17.716924 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6299554a-31a4-4fff-9757-883cf7901474 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:17.744732 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-4f63524a-14ea-4a9b-a2bf-7f9dfc663cf1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048892 Jun 17 13:16:17.744966 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=100 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:16:17.745726 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 580/1136] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:16:17 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:16:17.751510 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-e9ec5ed2-c0e1-4b4c-ae40-26e70c4326ec tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:17.752102 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-6299554a-31a4-4fff-9757-883cf7901474 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052895 Jun 17 13:16:17.752492 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-e9ec5ed2-c0e1-4b4c-ae40-26e70c4326ec tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:17.753568 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 557/1137] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:17 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:17.758874 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e9ec5ed2-c0e1-4b4c-ae40-26e70c4326ec tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:17.759371 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e9ec5ed2-c0e1-4b4c-ae40-26e70c4326ec tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:17.760174 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e9ec5ed2-c0e1-4b4c-ae40-26e70c4326ec tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:17.760629 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e9ec5ed2-c0e1-4b4c-ae40-26e70c4326ec tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:17.790918 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-e9ec5ed2-c0e1-4b4c-ae40-26e70c4326ec tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043787 Jun 17 13:16:17.791493 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 581/1138] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:17 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:18.761488 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-303f016e-27b5-4e78-bfed-a1a6fb391a29 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:18.762919 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-303f016e-27b5-4e78-bfed-a1a6fb391a29 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:18.767795 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-90de7cff-e3ca-4776-a7a1-b41eea792c02 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:18.768842 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-90de7cff-e3ca-4776-a7a1-b41eea792c02 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:18.772812 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-303f016e-27b5-4e78-bfed-a1a6fb391a29 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:18.773938 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-303f016e-27b5-4e78-bfed-a1a6fb391a29 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:18.774739 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-303f016e-27b5-4e78-bfed-a1a6fb391a29 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:18.775033 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-90de7cff-e3ca-4776-a7a1-b41eea792c02 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:18.775171 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-303f016e-27b5-4e78-bfed-a1a6fb391a29 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:18.775484 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-90de7cff-e3ca-4776-a7a1-b41eea792c02 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:18.776243 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-90de7cff-e3ca-4776-a7a1-b41eea792c02 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:18.776671 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-90de7cff-e3ca-4776-a7a1-b41eea792c02 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:18.806410 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-90de7cff-e3ca-4776-a7a1-b41eea792c02 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044647 Jun 17 13:16:18.806730 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-303f016e-27b5-4e78-bfed-a1a6fb391a29 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051499 Jun 17 13:16:18.810514 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 582/1139] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:18 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:18.810672 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 558/1140] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:16:18 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:16:18.811980 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-cf09d3da-18c3-4413-a41e-6336221e3807 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:18.812883 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-cf09d3da-18c3-4413-a41e-6336221e3807 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:18.819343 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-cf09d3da-18c3-4413-a41e-6336221e3807 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:18.819792 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-cf09d3da-18c3-4413-a41e-6336221e3807 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:18.820533 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-cf09d3da-18c3-4413-a41e-6336221e3807 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:18.820978 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-cf09d3da-18c3-4413-a41e-6336221e3807 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:18.850353 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-cf09d3da-18c3-4413-a41e-6336221e3807 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042007 Jun 17 13:16:18.850908 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 583/1141] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:18 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:19.818986 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-11a1119f-a461-4acf-a778-e306e6415618 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:19.819639 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-53ec71e0-2481-45d2-89ce-61c7246e376f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:19.820059 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-11a1119f-a461-4acf-a778-e306e6415618 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:19.820455 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-53ec71e0-2481-45d2-89ce-61c7246e376f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:19.826833 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-53ec71e0-2481-45d2-89ce-61c7246e376f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:19.827002 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-11a1119f-a461-4acf-a778-e306e6415618 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:19.827281 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-53ec71e0-2481-45d2-89ce-61c7246e376f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:19.827450 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-11a1119f-a461-4acf-a778-e306e6415618 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:19.828145 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-11a1119f-a461-4acf-a778-e306e6415618 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:19.828577 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-11a1119f-a461-4acf-a778-e306e6415618 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:19.828753 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-53ec71e0-2481-45d2-89ce-61c7246e376f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:19.829203 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-53ec71e0-2481-45d2-89ce-61c7246e376f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:19.861075 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-11a1119f-a461-4acf-a778-e306e6415618 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046398 Jun 17 13:16:19.861805 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-53ec71e0-2481-45d2-89ce-61c7246e376f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047177 Jun 17 13:16:19.862122 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 584/1142] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:16:19 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:16:19.862604 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 559/1143] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:19 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:19.867165 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-c48f6f04-a3a6-465f-8f21-6bacc54efbad tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:19.867897 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-c48f6f04-a3a6-465f-8f21-6bacc54efbad tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:19.873865 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c48f6f04-a3a6-465f-8f21-6bacc54efbad tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:19.874337 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c48f6f04-a3a6-465f-8f21-6bacc54efbad tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:19.875333 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c48f6f04-a3a6-465f-8f21-6bacc54efbad tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:19.875766 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c48f6f04-a3a6-465f-8f21-6bacc54efbad tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:19.909735 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-c48f6f04-a3a6-465f-8f21-6bacc54efbad tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046627 Jun 17 13:16:19.910704 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 585/1144] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:19 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:20.877478 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-11973da7-6727-4365-8656-dad2ce6b10c1 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:20.878268 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-5124c291-bf5f-400a-b47c-7f09da05cec4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:20.878618 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-5124c291-bf5f-400a-b47c-7f09da05cec4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:20.878718 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-11973da7-6727-4365-8656-dad2ce6b10c1 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:20.885427 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5124c291-bf5f-400a-b47c-7f09da05cec4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:20.885609 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-11973da7-6727-4365-8656-dad2ce6b10c1 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:20.885888 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5124c291-bf5f-400a-b47c-7f09da05cec4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:20.886050 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-11973da7-6727-4365-8656-dad2ce6b10c1 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:20.886751 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5124c291-bf5f-400a-b47c-7f09da05cec4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:20.886898 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-11973da7-6727-4365-8656-dad2ce6b10c1 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:20.887188 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-11973da7-6727-4365-8656-dad2ce6b10c1 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:20.887344 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5124c291-bf5f-400a-b47c-7f09da05cec4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:20.917355 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-11973da7-6727-4365-8656-dad2ce6b10c1 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046698 Jun 17 13:16:20.917626 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-5124c291-bf5f-400a-b47c-7f09da05cec4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046934 Jun 17 13:16:20.917919 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 586/1146] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:20 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:20.918035 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 560/1146] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:16:20 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:16:20.922557 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-4f4cb534-9d8a-4697-a45c-0b4fe9a206f7 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:20.923477 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-4f4cb534-9d8a-4697-a45c-0b4fe9a206f7 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:20.930517 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4f4cb534-9d8a-4697-a45c-0b4fe9a206f7 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:20.930972 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4f4cb534-9d8a-4697-a45c-0b4fe9a206f7 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:20.931734 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4f4cb534-9d8a-4697-a45c-0b4fe9a206f7 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:20.932168 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4f4cb534-9d8a-4697-a45c-0b4fe9a206f7 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:20.962366 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-4f4cb534-9d8a-4697-a45c-0b4fe9a206f7 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043041 Jun 17 13:16:20.962848 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 587/1147] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:20 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:21.929145 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-2c1cd99d-f63f-4ef3-961e-f4c84bcf530e tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:21.930127 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-2c1cd99d-f63f-4ef3-961e-f4c84bcf530e tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:21.932749 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-e7f544fa-e597-4d09-8189-4039778596bb tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:21.933800 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-e7f544fa-e597-4d09-8189-4039778596bb tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:21.936937 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2c1cd99d-f63f-4ef3-961e-f4c84bcf530e tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:21.937385 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2c1cd99d-f63f-4ef3-961e-f4c84bcf530e tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:21.938177 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2c1cd99d-f63f-4ef3-961e-f4c84bcf530e tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:21.938615 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2c1cd99d-f63f-4ef3-961e-f4c84bcf530e tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:21.940894 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e7f544fa-e597-4d09-8189-4039778596bb tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:21.941361 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e7f544fa-e597-4d09-8189-4039778596bb tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:21.942114 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e7f544fa-e597-4d09-8189-4039778596bb tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:21.942563 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e7f544fa-e597-4d09-8189-4039778596bb tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:21.959242 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_cell1:SELECT=100 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:16:21.968364 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-2c1cd99d-f63f-4ef3-961e-f4c84bcf530e tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043154 Jun 17 13:16:21.969147 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 561/1148] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:21 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:21.975102 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-e7f544fa-e597-4d09-8189-4039778596bb tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046653 Jun 17 13:16:21.975672 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 588/1149] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:16:21 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:16:21.976462 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-0a275b82-2fa3-4509-9efd-5a0b857e4f99 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:21.977402 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-0a275b82-2fa3-4509-9efd-5a0b857e4f99 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:21.983453 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0a275b82-2fa3-4509-9efd-5a0b857e4f99 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:21.983907 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0a275b82-2fa3-4509-9efd-5a0b857e4f99 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:21.985011 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0a275b82-2fa3-4509-9efd-5a0b857e4f99 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:21.985445 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0a275b82-2fa3-4509-9efd-5a0b857e4f99 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:22.016400 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-0a275b82-2fa3-4509-9efd-5a0b857e4f99 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046449 Jun 17 13:16:22.016947 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 562/1150] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:21 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:22.985209 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-b197d755-0352-4ac3-91d6-1cb4ecc237cf tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:22.986702 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-b197d755-0352-4ac3-91d6-1cb4ecc237cf tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:22.990654 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-a1baf6af-7e57-44aa-9410-9867eedaa7bf tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:22.992152 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-a1baf6af-7e57-44aa-9410-9867eedaa7bf tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:22.998682 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b197d755-0352-4ac3-91d6-1cb4ecc237cf tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:22.999419 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b197d755-0352-4ac3-91d6-1cb4ecc237cf tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:23.000850 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b197d755-0352-4ac3-91d6-1cb4ecc237cf tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:23.002656 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b197d755-0352-4ac3-91d6-1cb4ecc237cf tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:23.003554 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a1baf6af-7e57-44aa-9410-9867eedaa7bf tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:23.004032 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a1baf6af-7e57-44aa-9410-9867eedaa7bf tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:23.004807 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a1baf6af-7e57-44aa-9410-9867eedaa7bf tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:23.005243 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a1baf6af-7e57-44aa-9410-9867eedaa7bf tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:23.034918 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-b197d755-0352-4ac3-91d6-1cb4ecc237cf tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056824 Jun 17 13:16:23.035498 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 589/1151] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:22 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:23.035636 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-a1baf6af-7e57-44aa-9410-9867eedaa7bf tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052188 Jun 17 13:16:23.036368 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 563/1152] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:16:22 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:16:23.042858 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-33c7dfcd-b77b-4c96-ac03-e2bc19574750 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:23.043771 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-33c7dfcd-b77b-4c96-ac03-e2bc19574750 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:23.050385 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-33c7dfcd-b77b-4c96-ac03-e2bc19574750 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:23.050837 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-33c7dfcd-b77b-4c96-ac03-e2bc19574750 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:23.051602 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-33c7dfcd-b77b-4c96-ac03-e2bc19574750 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:23.052071 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-33c7dfcd-b77b-4c96-ac03-e2bc19574750 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:23.082513 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-33c7dfcd-b77b-4c96-ac03-e2bc19574750 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045891 Jun 17 13:16:23.083075 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 590/1153] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:23 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:24.051321 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-2c689f9b-f3b8-4ce4-a71f-7eefa79f18c4 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:24.052093 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-cfe657f0-d323-4482-95d2-5209ab0a140b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:24.052549 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-2c689f9b-f3b8-4ce4-a71f-7eefa79f18c4 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:24.053006 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-cfe657f0-d323-4482-95d2-5209ab0a140b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:24.059820 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2c689f9b-f3b8-4ce4-a71f-7eefa79f18c4 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:24.060008 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-cfe657f0-d323-4482-95d2-5209ab0a140b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:24.060267 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2c689f9b-f3b8-4ce4-a71f-7eefa79f18c4 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:24.060429 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-cfe657f0-d323-4482-95d2-5209ab0a140b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:24.061035 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2c689f9b-f3b8-4ce4-a71f-7eefa79f18c4 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:24.061191 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-cfe657f0-d323-4482-95d2-5209ab0a140b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:24.061463 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2c689f9b-f3b8-4ce4-a71f-7eefa79f18c4 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:24.061622 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-cfe657f0-d323-4482-95d2-5209ab0a140b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:24.092455 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-2c689f9b-f3b8-4ce4-a71f-7eefa79f18c4 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047704 Jun 17 13:16:24.093022 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 564/1154] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:24 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:24.097107 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-cfe657f0-d323-4482-95d2-5209ab0a140b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051581 Jun 17 13:16:24.097922 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 591/1155] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:16:24 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:16:24.098060 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-06c9030f-b423-4acb-99a8-164eb329acec tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:24.099019 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-06c9030f-b423-4acb-99a8-164eb329acec tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:24.105290 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-06c9030f-b423-4acb-99a8-164eb329acec tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:24.105740 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-06c9030f-b423-4acb-99a8-164eb329acec tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:24.106566 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-06c9030f-b423-4acb-99a8-164eb329acec tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:24.107029 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-06c9030f-b423-4acb-99a8-164eb329acec tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:24.136368 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-06c9030f-b423-4acb-99a8-164eb329acec tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042355 Jun 17 13:16:24.137127 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 565/1156] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:24 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:25.108848 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-affb46e3-02ef-43b4-8462-a3315626a579 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:25.110624 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-affb46e3-02ef-43b4-8462-a3315626a579 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:25.113429 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-2de4fccd-dc0c-458a-963d-ecf53bb330da tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:25.114968 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-2de4fccd-dc0c-458a-963d-ecf53bb330da tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:25.121902 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-affb46e3-02ef-43b4-8462-a3315626a579 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:25.122665 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-affb46e3-02ef-43b4-8462-a3315626a579 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:25.123971 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-affb46e3-02ef-43b4-8462-a3315626a579 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:25.124684 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-affb46e3-02ef-43b4-8462-a3315626a579 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:25.125803 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2de4fccd-dc0c-458a-963d-ecf53bb330da tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:25.126618 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2de4fccd-dc0c-458a-963d-ecf53bb330da tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:25.127877 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2de4fccd-dc0c-458a-963d-ecf53bb330da tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:25.128614 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2de4fccd-dc0c-458a-963d-ecf53bb330da tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:25.156534 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-affb46e3-02ef-43b4-8462-a3315626a579 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054517 Jun 17 13:16:25.157124 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 592/1157] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:25 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:25.158702 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-2de4fccd-dc0c-458a-963d-ecf53bb330da tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052458 Jun 17 13:16:25.159232 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 566/1158] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:16:25 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:16:25.164509 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-e9e9c7dc-43a5-495e-bf3a-81dcde856ff3 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:25.165341 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-e9e9c7dc-43a5-495e-bf3a-81dcde856ff3 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:25.171884 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e9e9c7dc-43a5-495e-bf3a-81dcde856ff3 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:25.172385 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e9e9c7dc-43a5-495e-bf3a-81dcde856ff3 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:25.173158 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e9e9c7dc-43a5-495e-bf3a-81dcde856ff3 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:25.173597 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e9e9c7dc-43a5-495e-bf3a-81dcde856ff3 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:25.204209 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-e9e9c7dc-43a5-495e-bf3a-81dcde856ff3 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046029 Jun 17 13:16:25.204790 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 593/1159] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:25 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:26.171532 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-063281f4-9919-4a70-92e3-10a31f04525d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:26.172116 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-e65e4ca5-03c8-48e2-ac81-dcc68ac550f7 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:26.172490 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-063281f4-9919-4a70-92e3-10a31f04525d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:26.173299 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-e65e4ca5-03c8-48e2-ac81-dcc68ac550f7 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:26.180197 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-063281f4-9919-4a70-92e3-10a31f04525d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:26.180635 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-063281f4-9919-4a70-92e3-10a31f04525d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:26.180807 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e65e4ca5-03c8-48e2-ac81-dcc68ac550f7 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:26.181240 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e65e4ca5-03c8-48e2-ac81-dcc68ac550f7 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:26.181468 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-063281f4-9919-4a70-92e3-10a31f04525d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:26.182005 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e65e4ca5-03c8-48e2-ac81-dcc68ac550f7 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:26.182173 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-063281f4-9919-4a70-92e3-10a31f04525d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:26.182484 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e65e4ca5-03c8-48e2-ac81-dcc68ac550f7 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:26.212341 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-063281f4-9919-4a70-92e3-10a31f04525d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047465 Jun 17 13:16:26.212917 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 567/1160] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:26 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:26.214548 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-e65e4ca5-03c8-48e2-ac81-dcc68ac550f7 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048253 Jun 17 13:16:26.215327 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 594/1161] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:16:26 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:16:26.217458 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-d035fbb2-d41b-4446-a100-52a85bfb0cbe tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:26.218407 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-d035fbb2-d41b-4446-a100-52a85bfb0cbe tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:26.224736 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d035fbb2-d41b-4446-a100-52a85bfb0cbe tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:26.225188 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d035fbb2-d41b-4446-a100-52a85bfb0cbe tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:26.225990 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d035fbb2-d41b-4446-a100-52a85bfb0cbe tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:26.226394 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d035fbb2-d41b-4446-a100-52a85bfb0cbe tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:26.256848 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-d035fbb2-d41b-4446-a100-52a85bfb0cbe tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042912 Jun 17 13:16:26.257393 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 568/1162] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:26 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:27.227098 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-6b4815fe-89bc-4dfa-8989-ebdd1282aef2 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:27.227918 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-6b4815fe-89bc-4dfa-8989-ebdd1282aef2 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:27.228061 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-1ca41356-e488-47f6-ad5b-d89abd6c86ee tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:27.228915 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-1ca41356-e488-47f6-ad5b-d89abd6c86ee tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:27.235502 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6b4815fe-89bc-4dfa-8989-ebdd1282aef2 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:27.235954 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6b4815fe-89bc-4dfa-8989-ebdd1282aef2 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:27.236385 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1ca41356-e488-47f6-ad5b-d89abd6c86ee tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:27.236714 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6b4815fe-89bc-4dfa-8989-ebdd1282aef2 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:27.236913 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1ca41356-e488-47f6-ad5b-d89abd6c86ee tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:27.237127 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6b4815fe-89bc-4dfa-8989-ebdd1282aef2 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:27.237697 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1ca41356-e488-47f6-ad5b-d89abd6c86ee tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:27.238163 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1ca41356-e488-47f6-ad5b-d89abd6c86ee tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:27.268032 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-6b4815fe-89bc-4dfa-8989-ebdd1282aef2 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046336 Jun 17 13:16:27.268583 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 595/1163] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:27 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:27.269689 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-1ca41356-e488-47f6-ad5b-d89abd6c86ee tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046065 Jun 17 13:16:27.270383 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 569/1164] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:16:27 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:16:27.273522 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-21e331e9-3020-4270-b1c7-de1b8a6a12a2 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:27.274448 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-21e331e9-3020-4270-b1c7-de1b8a6a12a2 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:27.284070 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-21e331e9-3020-4270-b1c7-de1b8a6a12a2 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:27.284519 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-21e331e9-3020-4270-b1c7-de1b8a6a12a2 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:27.285278 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-21e331e9-3020-4270-b1c7-de1b8a6a12a2 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:27.285683 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-21e331e9-3020-4270-b1c7-de1b8a6a12a2 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:27.321825 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-21e331e9-3020-4270-b1c7-de1b8a6a12a2 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051643 Jun 17 13:16:27.322342 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 596/1165] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:27 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:28.284370 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-ce719966-1174-4bdf-8d11-e4ede0b28c3d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:28.285803 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-ce719966-1174-4bdf-8d11-e4ede0b28c3d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:28.286060 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-2248e5ab-2b3e-4cc7-814d-44f95ab9bf72 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:28.287632 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-2248e5ab-2b3e-4cc7-814d-44f95ab9bf72 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:28.297737 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ce719966-1174-4bdf-8d11-e4ede0b28c3d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:28.298605 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ce719966-1174-4bdf-8d11-e4ede0b28c3d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:28.298974 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2248e5ab-2b3e-4cc7-814d-44f95ab9bf72 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:28.299717 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2248e5ab-2b3e-4cc7-814d-44f95ab9bf72 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:28.299965 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ce719966-1174-4bdf-8d11-e4ede0b28c3d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:28.300737 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ce719966-1174-4bdf-8d11-e4ede0b28c3d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:28.301001 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2248e5ab-2b3e-4cc7-814d-44f95ab9bf72 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:28.301685 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2248e5ab-2b3e-4cc7-814d-44f95ab9bf72 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:28.334258 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-2248e5ab-2b3e-4cc7-814d-44f95ab9bf72 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054705 Jun 17 13:16:28.334796 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 597/1166] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:16:28 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:16:28.335556 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-ce719966-1174-4bdf-8d11-e4ede0b28c3d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058111 Jun 17 13:16:28.336395 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 570/1167] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:28 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:28.340183 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-e1fcd6e6-05fd-48f1-89cc-3f5bce7bf018 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:28.341102 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-e1fcd6e6-05fd-48f1-89cc-3f5bce7bf018 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:28.347515 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e1fcd6e6-05fd-48f1-89cc-3f5bce7bf018 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:28.347962 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e1fcd6e6-05fd-48f1-89cc-3f5bce7bf018 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:28.348716 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e1fcd6e6-05fd-48f1-89cc-3f5bce7bf018 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:28.349144 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e1fcd6e6-05fd-48f1-89cc-3f5bce7bf018 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:28.379812 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-e1fcd6e6-05fd-48f1-89cc-3f5bce7bf018 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043971 Jun 17 13:16:28.380397 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 598/1168] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:28 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:29.346619 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-7d1a5196-0687-4649-904f-ec05a2117915 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:29.347578 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-7d1a5196-0687-4649-904f-ec05a2117915 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:29.348921 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-303fb826-aff8-4533-8328-f1e9f401598f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:29.349883 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-303fb826-aff8-4533-8328-f1e9f401598f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:29.354624 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7d1a5196-0687-4649-904f-ec05a2117915 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:29.355076 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7d1a5196-0687-4649-904f-ec05a2117915 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:29.355910 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7d1a5196-0687-4649-904f-ec05a2117915 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:29.356345 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7d1a5196-0687-4649-904f-ec05a2117915 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:29.357587 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-303fb826-aff8-4533-8328-f1e9f401598f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:29.358056 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-303fb826-aff8-4533-8328-f1e9f401598f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:29.358841 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-303fb826-aff8-4533-8328-f1e9f401598f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:29.359625 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-303fb826-aff8-4533-8328-f1e9f401598f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:29.386226 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-7d1a5196-0687-4649-904f-ec05a2117915 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043607 Jun 17 13:16:29.387113 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 571/1169] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:16:29 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:16:29.392880 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-303fb826-aff8-4533-8328-f1e9f401598f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047883 Jun 17 13:16:29.393432 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 599/1170] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:29 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:29.393969 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-a11fbb85-75e4-4b46-a22a-3866b6767aa8 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:29.394994 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-a11fbb85-75e4-4b46-a22a-3866b6767aa8 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:29.401145 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a11fbb85-75e4-4b46-a22a-3866b6767aa8 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:29.401586 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a11fbb85-75e4-4b46-a22a-3866b6767aa8 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:29.402378 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a11fbb85-75e4-4b46-a22a-3866b6767aa8 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:29.402808 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a11fbb85-75e4-4b46-a22a-3866b6767aa8 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:29.431810 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-a11fbb85-75e4-4b46-a22a-3866b6767aa8 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043645 Jun 17 13:16:29.432365 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 572/1171] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:29 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:30.402079 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-f383e3cc-fc1e-44de-89c3-c787c38908d0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:30.403839 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-f383e3cc-fc1e-44de-89c3-c787c38908d0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:30.408054 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-90a2d335-4dcd-42af-93e4-186b163aa295 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:30.409555 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-90a2d335-4dcd-42af-93e4-186b163aa295 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:30.415609 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f383e3cc-fc1e-44de-89c3-c787c38908d0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:30.415881 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f383e3cc-fc1e-44de-89c3-c787c38908d0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:30.417174 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f383e3cc-fc1e-44de-89c3-c787c38908d0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:30.417467 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f383e3cc-fc1e-44de-89c3-c787c38908d0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:30.419716 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-90a2d335-4dcd-42af-93e4-186b163aa295 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:30.420168 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-90a2d335-4dcd-42af-93e4-186b163aa295 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:30.420944 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-90a2d335-4dcd-42af-93e4-186b163aa295 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:30.421425 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-90a2d335-4dcd-42af-93e4-186b163aa295 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:30.447665 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-f383e3cc-fc1e-44de-89c3-c787c38908d0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052330 Jun 17 13:16:30.451624 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 600/1172] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:16:30 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:16:30.452195 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-90a2d335-4dcd-42af-93e4-186b163aa295 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051127 Jun 17 13:16:30.452751 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 573/1173] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:30 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:30.453209 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-27d6d4a3-0831-4c51-9a11-1fb060126fd2 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:30.454225 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-27d6d4a3-0831-4c51-9a11-1fb060126fd2 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:30.460435 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-27d6d4a3-0831-4c51-9a11-1fb060126fd2 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:30.460883 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-27d6d4a3-0831-4c51-9a11-1fb060126fd2 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:30.461638 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-27d6d4a3-0831-4c51-9a11-1fb060126fd2 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:30.462052 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-27d6d4a3-0831-4c51-9a11-1fb060126fd2 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:30.491912 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-27d6d4a3-0831-4c51-9a11-1fb060126fd2 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042345 Jun 17 13:16:30.492477 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 601/1174] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:30 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:31.459260 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-136a4280-0df2-4961-9ad0-51c84fea1277 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:31.460115 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-136a4280-0df2-4961-9ad0-51c84fea1277 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:31.462484 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_api:SELECT=88 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:16:31.463833 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-42e26b6b-01ef-41d0-9639-3c1fadbd9c44 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:31.465038 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-42e26b6b-01ef-41d0-9639-3c1fadbd9c44 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:31.468985 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-136a4280-0df2-4961-9ad0-51c84fea1277 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:31.469430 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-136a4280-0df2-4961-9ad0-51c84fea1277 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:31.470236 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-136a4280-0df2-4961-9ad0-51c84fea1277 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:31.470665 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-136a4280-0df2-4961-9ad0-51c84fea1277 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:31.471373 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-42e26b6b-01ef-41d0-9639-3c1fadbd9c44 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:31.471828 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-42e26b6b-01ef-41d0-9639-3c1fadbd9c44 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:31.472596 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-42e26b6b-01ef-41d0-9639-3c1fadbd9c44 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:31.473033 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-42e26b6b-01ef-41d0-9639-3c1fadbd9c44 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:31.488126 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=100 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:16:31.504125 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-136a4280-0df2-4961-9ad0-51c84fea1277 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049018 Jun 17 13:16:31.504757 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 574/1175] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:16:31 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:16:31.507006 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-42e26b6b-01ef-41d0-9639-3c1fadbd9c44 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047120 Jun 17 13:16:31.510859 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 602/1176] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:31 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:31.511015 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-871d562e-9f51-41ba-8a1e-27ced586886a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:31.511015 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-871d562e-9f51-41ba-8a1e-27ced586886a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:31.517220 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-871d562e-9f51-41ba-8a1e-27ced586886a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:31.517672 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-871d562e-9f51-41ba-8a1e-27ced586886a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:31.518616 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-871d562e-9f51-41ba-8a1e-27ced586886a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:31.519048 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-871d562e-9f51-41ba-8a1e-27ced586886a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:31.548621 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-871d562e-9f51-41ba-8a1e-27ced586886a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042884 Jun 17 13:16:31.549162 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 575/1177] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:31 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:32.516529 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-4c1ef6d1-0055-48c3-9ea1-a193aa68d950 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:32.517346 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-4c1ef6d1-0055-48c3-9ea1-a193aa68d950 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:32.518481 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-1bfdd666-c926-4dae-9dee-ee41abae94b2 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:32.519419 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-1bfdd666-c926-4dae-9dee-ee41abae94b2 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:32.524905 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4c1ef6d1-0055-48c3-9ea1-a193aa68d950 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:32.525425 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4c1ef6d1-0055-48c3-9ea1-a193aa68d950 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:32.526512 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4c1ef6d1-0055-48c3-9ea1-a193aa68d950 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:32.526924 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4c1ef6d1-0055-48c3-9ea1-a193aa68d950 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:32.527063 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1bfdd666-c926-4dae-9dee-ee41abae94b2 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:32.527419 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1bfdd666-c926-4dae-9dee-ee41abae94b2 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:32.528229 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1bfdd666-c926-4dae-9dee-ee41abae94b2 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:32.528667 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1bfdd666-c926-4dae-9dee-ee41abae94b2 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:32.561387 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-1bfdd666-c926-4dae-9dee-ee41abae94b2 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046814 Jun 17 13:16:32.562208 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 576/1178] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:32 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:32.567123 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-beb47aac-9749-4343-83ce-69cbc20164e6 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:32.568150 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-beb47aac-9749-4343-83ce-69cbc20164e6 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:32.569051 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-4c1ef6d1-0055-48c3-9ea1-a193aa68d950 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056619 Jun 17 13:16:32.569822 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 603/1179] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:16:32 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:16:32.577025 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-beb47aac-9749-4343-83ce-69cbc20164e6 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:32.577481 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-beb47aac-9749-4343-83ce-69cbc20164e6 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:32.578368 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-beb47aac-9749-4343-83ce-69cbc20164e6 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:32.578802 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-beb47aac-9749-4343-83ce-69cbc20164e6 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:32.608764 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-beb47aac-9749-4343-83ce-69cbc20164e6 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045542 Jun 17 13:16:32.609713 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 577/1180] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:32 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:33.578373 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-2f5045e3-6e2b-4b37-baa9-ba9a6bab1f19 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:33.579991 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-2f5045e3-6e2b-4b37-baa9-ba9a6bab1f19 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:33.585295 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-220053f5-0be0-4bd3-8346-fb0a93f536a6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:33.586825 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-220053f5-0be0-4bd3-8346-fb0a93f536a6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:33.591175 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2f5045e3-6e2b-4b37-baa9-ba9a6bab1f19 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:33.591919 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2f5045e3-6e2b-4b37-baa9-ba9a6bab1f19 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:33.593084 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2f5045e3-6e2b-4b37-baa9-ba9a6bab1f19 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:33.593504 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2f5045e3-6e2b-4b37-baa9-ba9a6bab1f19 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:33.596284 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-220053f5-0be0-4bd3-8346-fb0a93f536a6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:33.596740 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-220053f5-0be0-4bd3-8346-fb0a93f536a6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:33.597502 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-220053f5-0be0-4bd3-8346-fb0a93f536a6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:33.597933 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-220053f5-0be0-4bd3-8346-fb0a93f536a6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:33.626118 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-2f5045e3-6e2b-4b37-baa9-ba9a6bab1f19 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055291 Jun 17 13:16:33.630858 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 604/1181] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:33 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:33.631744 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-220053f5-0be0-4bd3-8346-fb0a93f536a6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053194 Jun 17 13:16:33.632468 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 578/1182] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:16:33 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:16:33.632627 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-f21cefcc-07b4-49ff-aec7-f33a0016af00 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:33.633598 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-f21cefcc-07b4-49ff-aec7-f33a0016af00 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:33.641426 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f21cefcc-07b4-49ff-aec7-f33a0016af00 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:33.641878 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f21cefcc-07b4-49ff-aec7-f33a0016af00 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:33.642692 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f21cefcc-07b4-49ff-aec7-f33a0016af00 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:33.643131 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f21cefcc-07b4-49ff-aec7-f33a0016af00 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:33.647157 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_cell1:SELECT=100 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:16:33.675247 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-f21cefcc-07b4-49ff-aec7-f33a0016af00 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046710 Jun 17 13:16:33.675802 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 605/1183] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:33 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:34.638917 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-42b7cd3f-4acf-42fe-9785-5f4dd113d5dd tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:34.640454 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-42b7cd3f-4acf-42fe-9785-5f4dd113d5dd tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:34.644105 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-b3087e56-1e22-41f1-8e48-1ddc0d5184ba tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:34.645030 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-b3087e56-1e22-41f1-8e48-1ddc0d5184ba tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:34.647593 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-42b7cd3f-4acf-42fe-9785-5f4dd113d5dd tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:34.648039 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-42b7cd3f-4acf-42fe-9785-5f4dd113d5dd tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:34.648807 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-42b7cd3f-4acf-42fe-9785-5f4dd113d5dd tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:34.649236 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-42b7cd3f-4acf-42fe-9785-5f4dd113d5dd tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:34.651708 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b3087e56-1e22-41f1-8e48-1ddc0d5184ba tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:34.652168 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b3087e56-1e22-41f1-8e48-1ddc0d5184ba tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:34.652933 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b3087e56-1e22-41f1-8e48-1ddc0d5184ba tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:34.653364 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b3087e56-1e22-41f1-8e48-1ddc0d5184ba tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:34.679678 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-42b7cd3f-4acf-42fe-9785-5f4dd113d5dd tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044730 Jun 17 13:16:34.683162 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 579/1184] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:34 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:34.685949 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-b3087e56-1e22-41f1-8e48-1ddc0d5184ba tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045894 Jun 17 13:16:34.687027 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 606/1185] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:16:34 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:16:34.689464 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-7c526554-b4bc-446d-8f0b-33105b62133d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:34.690569 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-7c526554-b4bc-446d-8f0b-33105b62133d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:34.697677 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7c526554-b4bc-446d-8f0b-33105b62133d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:34.698149 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7c526554-b4bc-446d-8f0b-33105b62133d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:34.699079 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7c526554-b4bc-446d-8f0b-33105b62133d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:34.699535 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7c526554-b4bc-446d-8f0b-33105b62133d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:34.728493 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-7c526554-b4bc-446d-8f0b-33105b62133d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043539 Jun 17 13:16:34.729056 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 580/1186] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:34 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 13:16:35.691888 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-0be8a771-e5b8-43e6-839a-33262fcc292d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:35.692819 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-0be8a771-e5b8-43e6-839a-33262fcc292d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:35.698808 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-fb9f4884-9819-4ded-b8a7-53c44823ef1f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:35.699745 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-fb9f4884-9819-4ded-b8a7-53c44823ef1f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:35.699859 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0be8a771-e5b8-43e6-839a-33262fcc292d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:35.700255 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0be8a771-e5b8-43e6-839a-33262fcc292d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:35.701016 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0be8a771-e5b8-43e6-839a-33262fcc292d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:35.701449 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0be8a771-e5b8-43e6-839a-33262fcc292d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:35.706634 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fb9f4884-9819-4ded-b8a7-53c44823ef1f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:35.707108 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fb9f4884-9819-4ded-b8a7-53c44823ef1f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:35.707897 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fb9f4884-9819-4ded-b8a7-53c44823ef1f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:35.708335 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fb9f4884-9819-4ded-b8a7-53c44823ef1f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:35.731439 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-0be8a771-e5b8-43e6-839a-33262fcc292d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043643 Jun 17 13:16:35.731995 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 607/1187] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:35 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:35.740262 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-fb9f4884-9819-4ded-b8a7-53c44823ef1f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045253 Jun 17 13:16:35.740654 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-7328ca2a-94af-4c78-aca4-9a279744e823 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:35.741607 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-7328ca2a-94af-4c78-aca4-9a279744e823 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:35.742519 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 581/1188] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:16:35 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:16:35.748095 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7328ca2a-94af-4c78-aca4-9a279744e823 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:35.748548 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7328ca2a-94af-4c78-aca4-9a279744e823 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:35.749308 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7328ca2a-94af-4c78-aca4-9a279744e823 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:35.749738 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7328ca2a-94af-4c78-aca4-9a279744e823 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:35.780716 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-7328ca2a-94af-4c78-aca4-9a279744e823 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043789 Jun 17 13:16:35.781489 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 608/1189] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:35 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:36.743761 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-6a420180-cfa1-4228-9838-aa344e349b8c tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:36.744685 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-6a420180-cfa1-4228-9838-aa344e349b8c tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:36.751772 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6a420180-cfa1-4228-9838-aa344e349b8c tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:36.752233 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6a420180-cfa1-4228-9838-aa344e349b8c tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:36.752490 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-8597ae22-54b9-475f-ab80-5247d37dca39 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:36.753100 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6a420180-cfa1-4228-9838-aa344e349b8c tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:36.753360 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-8597ae22-54b9-475f-ab80-5247d37dca39 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:36.753536 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6a420180-cfa1-4228-9838-aa344e349b8c tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:36.760110 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8597ae22-54b9-475f-ab80-5247d37dca39 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:36.760559 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8597ae22-54b9-475f-ab80-5247d37dca39 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:36.761320 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8597ae22-54b9-475f-ab80-5247d37dca39 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:36.761776 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8597ae22-54b9-475f-ab80-5247d37dca39 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:36.785030 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-6a420180-cfa1-4228-9838-aa344e349b8c tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045288 Jun 17 13:16:36.785962 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 582/1190] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:36 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:36.792188 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-8597ae22-54b9-475f-ab80-5247d37dca39 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043800 Jun 17 13:16:36.792754 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 609/1191] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:16:36 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:16:36.792997 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-b018b80c-bfaa-4c6c-8012-ff4e583e6cf8 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:36.793846 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-b018b80c-bfaa-4c6c-8012-ff4e583e6cf8 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:36.800140 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b018b80c-bfaa-4c6c-8012-ff4e583e6cf8 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:36.800612 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b018b80c-bfaa-4c6c-8012-ff4e583e6cf8 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:36.801370 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b018b80c-bfaa-4c6c-8012-ff4e583e6cf8 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:36.802041 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b018b80c-bfaa-4c6c-8012-ff4e583e6cf8 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:36.831019 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-b018b80c-bfaa-4c6c-8012-ff4e583e6cf8 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041836 Jun 17 13:16:36.831580 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 583/1192] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:36 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:37.798080 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-a0a9c623-59b7-4c9b-9e46-c216a38a08a8 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:37.799041 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-a0a9c623-59b7-4c9b-9e46-c216a38a08a8 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:37.804866 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-93214bf6-3dda-4d90-979c-2e9048c91c74 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:37.805881 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-93214bf6-3dda-4d90-979c-2e9048c91c74 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:37.806519 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a0a9c623-59b7-4c9b-9e46-c216a38a08a8 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:37.806939 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a0a9c623-59b7-4c9b-9e46-c216a38a08a8 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:37.807789 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a0a9c623-59b7-4c9b-9e46-c216a38a08a8 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:37.808131 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a0a9c623-59b7-4c9b-9e46-c216a38a08a8 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:37.813366 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-93214bf6-3dda-4d90-979c-2e9048c91c74 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:37.813876 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-93214bf6-3dda-4d90-979c-2e9048c91c74 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:37.814687 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-93214bf6-3dda-4d90-979c-2e9048c91c74 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:37.815120 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-93214bf6-3dda-4d90-979c-2e9048c91c74 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:37.837710 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-a0a9c623-59b7-4c9b-9e46-c216a38a08a8 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044169 Jun 17 13:16:37.838458 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 610/1193] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:37 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:37.842940 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-7dbc2b35-a317-475d-914e-b08d896801ca tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:37.843851 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-7dbc2b35-a317-475d-914e-b08d896801ca tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:37.845862 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-93214bf6-3dda-4d90-979c-2e9048c91c74 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045747 Jun 17 13:16:37.846458 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 584/1194] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:16:37 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:16:37.849758 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7dbc2b35-a317-475d-914e-b08d896801ca tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:37.850322 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7dbc2b35-a317-475d-914e-b08d896801ca tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:37.851086 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7dbc2b35-a317-475d-914e-b08d896801ca tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:37.851514 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7dbc2b35-a317-475d-914e-b08d896801ca tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:37.880996 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-7dbc2b35-a317-475d-914e-b08d896801ca tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041607 Jun 17 13:16:37.881649 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 611/1195] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:37 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:38.852687 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-6ed4704e-dc0c-431c-a851-3780777816f1 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:38.854067 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-6ed4704e-dc0c-431c-a851-3780777816f1 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:38.859477 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-ccdacb96-d39d-4b7d-8eea-b54fefaf69b5 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:38.860689 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-ccdacb96-d39d-4b7d-8eea-b54fefaf69b5 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:38.863345 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_api:SELECT=88 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:16:38.863567 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6ed4704e-dc0c-431c-a851-3780777816f1 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:38.864162 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6ed4704e-dc0c-431c-a851-3780777816f1 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:38.865171 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6ed4704e-dc0c-431c-a851-3780777816f1 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:38.865939 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6ed4704e-dc0c-431c-a851-3780777816f1 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:38.870305 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ccdacb96-d39d-4b7d-8eea-b54fefaf69b5 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:38.870749 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ccdacb96-d39d-4b7d-8eea-b54fefaf69b5 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:38.871507 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ccdacb96-d39d-4b7d-8eea-b54fefaf69b5 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:38.871992 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ccdacb96-d39d-4b7d-8eea-b54fefaf69b5 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:38.896734 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-6ed4704e-dc0c-431c-a851-3780777816f1 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050716 Jun 17 13:16:38.897260 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 585/1196] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:38 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:38.902242 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-ccdacb96-d39d-4b7d-8eea-b54fefaf69b5 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048532 Jun 17 13:16:38.902441 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-666ae9ba-d97f-45bb-8536-621c098f8aad tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:38.902813 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 612/1197] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:16:38 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:16:38.903193 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-666ae9ba-d97f-45bb-8536-621c098f8aad tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:38.909151 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-666ae9ba-d97f-45bb-8536-621c098f8aad tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:38.909615 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-666ae9ba-d97f-45bb-8536-621c098f8aad tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:38.910468 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-666ae9ba-d97f-45bb-8536-621c098f8aad tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:38.910886 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-666ae9ba-d97f-45bb-8536-621c098f8aad tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:38.941423 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-666ae9ba-d97f-45bb-8536-621c098f8aad tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042965 Jun 17 13:16:38.942286 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 586/1198] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:38 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:39.909835 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-743b0bd5-448d-4edf-9904-7f15fafe6c45 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:39.911007 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-743b0bd5-448d-4edf-9904-7f15fafe6c45 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:39.913972 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-a0c137c6-ee51-4dd8-ba1f-8c060ad7cab0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:39.915736 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-a0c137c6-ee51-4dd8-ba1f-8c060ad7cab0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:39.918508 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-743b0bd5-448d-4edf-9904-7f15fafe6c45 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:39.918962 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-743b0bd5-448d-4edf-9904-7f15fafe6c45 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:39.919726 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-743b0bd5-448d-4edf-9904-7f15fafe6c45 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:39.920160 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-743b0bd5-448d-4edf-9904-7f15fafe6c45 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:39.922464 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a0c137c6-ee51-4dd8-ba1f-8c060ad7cab0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:39.922915 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a0c137c6-ee51-4dd8-ba1f-8c060ad7cab0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:39.923679 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a0c137c6-ee51-4dd8-ba1f-8c060ad7cab0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:39.924114 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a0c137c6-ee51-4dd8-ba1f-8c060ad7cab0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:39.953168 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-743b0bd5-448d-4edf-9904-7f15fafe6c45 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047895 Jun 17 13:16:39.956964 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 613/1199] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:39 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:39.957113 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-a0c137c6-ee51-4dd8-ba1f-8c060ad7cab0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045300 Jun 17 13:16:39.957113 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 587/1200] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:16:39 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:16:39.958359 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-2bb437ea-76de-4026-94f1-f46ac70a42b1 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:39.959296 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-2bb437ea-76de-4026-94f1-f46ac70a42b1 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:39.965464 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2bb437ea-76de-4026-94f1-f46ac70a42b1 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:39.965938 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2bb437ea-76de-4026-94f1-f46ac70a42b1 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:39.966707 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2bb437ea-76de-4026-94f1-f46ac70a42b1 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:39.967152 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2bb437ea-76de-4026-94f1-f46ac70a42b1 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:39.997080 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-2bb437ea-76de-4026-94f1-f46ac70a42b1 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042372 Jun 17 13:16:39.997837 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 614/1201] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:39 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:40.965709 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-43118848-42c0-403d-9633-97930a3e13e7 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:40.966688 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-43118848-42c0-403d-9633-97930a3e13e7 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:40.966857 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-cc409d83-e6bf-42d9-850d-18b7cd23d196 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:40.967711 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-cc409d83-e6bf-42d9-850d-18b7cd23d196 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:40.973525 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-43118848-42c0-403d-9633-97930a3e13e7 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:40.973999 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-43118848-42c0-403d-9633-97930a3e13e7 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:40.974501 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-cc409d83-e6bf-42d9-850d-18b7cd23d196 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:40.974813 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-43118848-42c0-403d-9633-97930a3e13e7 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:40.974958 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-cc409d83-e6bf-42d9-850d-18b7cd23d196 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:40.975228 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-43118848-42c0-403d-9633-97930a3e13e7 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:40.975678 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-cc409d83-e6bf-42d9-850d-18b7cd23d196 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:40.976114 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-cc409d83-e6bf-42d9-850d-18b7cd23d196 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:41.007990 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-cc409d83-e6bf-42d9-850d-18b7cd23d196 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045362 Jun 17 13:16:41.008223 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-43118848-42c0-403d-9633-97930a3e13e7 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047145 Jun 17 13:16:41.008486 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 615/1202] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:16:40 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:16:41.009106 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 588/1203] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:40 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:41.014051 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-4caec067-2295-42a7-b621-db63452bb307 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:41.015017 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-4caec067-2295-42a7-b621-db63452bb307 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:41.022716 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4caec067-2295-42a7-b621-db63452bb307 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:41.023299 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4caec067-2295-42a7-b621-db63452bb307 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:41.024434 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4caec067-2295-42a7-b621-db63452bb307 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:41.025153 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4caec067-2295-42a7-b621-db63452bb307 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:41.054629 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-4caec067-2295-42a7-b621-db63452bb307 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045077 Jun 17 13:16:41.055199 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 616/1204] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:41 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:42.023722 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-397f9307-2d65-43e1-b47f-b06e76f904f4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:42.025199 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-7c60e6fa-0a1f-4f94-a8b0-d1f91ff455fb tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:42.026296 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-397f9307-2d65-43e1-b47f-b06e76f904f4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:42.026421 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-7c60e6fa-0a1f-4f94-a8b0-d1f91ff455fb tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:42.032741 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-397f9307-2d65-43e1-b47f-b06e76f904f4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:42.032935 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7c60e6fa-0a1f-4f94-a8b0-d1f91ff455fb tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:42.033170 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-397f9307-2d65-43e1-b47f-b06e76f904f4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:42.033336 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7c60e6fa-0a1f-4f94-a8b0-d1f91ff455fb tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:42.033944 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-397f9307-2d65-43e1-b47f-b06e76f904f4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:42.034126 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7c60e6fa-0a1f-4f94-a8b0-d1f91ff455fb tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:42.034367 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-397f9307-2d65-43e1-b47f-b06e76f904f4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:42.034585 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7c60e6fa-0a1f-4f94-a8b0-d1f91ff455fb tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:42.065158 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-7c60e6fa-0a1f-4f94-a8b0-d1f91ff455fb tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046773 Jun 17 13:16:42.065620 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 617/1205] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:42 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:42.065927 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-397f9307-2d65-43e1-b47f-b06e76f904f4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048961 Jun 17 13:16:42.069945 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 589/1206] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:16:42 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:16:42.070312 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-50b2f29e-928b-400c-8705-3357e0b3d565 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:42.071260 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-50b2f29e-928b-400c-8705-3357e0b3d565 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:42.077862 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-50b2f29e-928b-400c-8705-3357e0b3d565 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:42.078460 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-50b2f29e-928b-400c-8705-3357e0b3d565 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:42.079361 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-50b2f29e-928b-400c-8705-3357e0b3d565 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:42.079796 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-50b2f29e-928b-400c-8705-3357e0b3d565 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:42.110668 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-50b2f29e-928b-400c-8705-3357e0b3d565 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043941 Jun 17 13:16:42.111233 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 618/1207] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:42 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:43.078502 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-62e29636-c8e4-4e97-b6de-5ff434b1f924 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:43.079118 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-e7cb468a-aabf-4a00-89a3-63654ebc7e21 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:43.079500 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-62e29636-c8e4-4e97-b6de-5ff434b1f924 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:43.079965 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-e7cb468a-aabf-4a00-89a3-63654ebc7e21 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:43.086854 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-62e29636-c8e4-4e97-b6de-5ff434b1f924 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:43.087127 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e7cb468a-aabf-4a00-89a3-63654ebc7e21 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:43.087332 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-62e29636-c8e4-4e97-b6de-5ff434b1f924 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:43.087479 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e7cb468a-aabf-4a00-89a3-63654ebc7e21 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:43.088105 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-62e29636-c8e4-4e97-b6de-5ff434b1f924 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:43.088254 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e7cb468a-aabf-4a00-89a3-63654ebc7e21 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:43.088537 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-62e29636-c8e4-4e97-b6de-5ff434b1f924 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:43.088695 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e7cb468a-aabf-4a00-89a3-63654ebc7e21 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:43.119769 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-62e29636-c8e4-4e97-b6de-5ff434b1f924 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045740 Jun 17 13:16:43.120325 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 590/1208] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:43 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:43.121163 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-e7cb468a-aabf-4a00-89a3-63654ebc7e21 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046491 Jun 17 13:16:43.121914 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 619/1209] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:16:43 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:16:43.125244 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-5e3a41dc-e257-4e93-ba11-223703c23c11 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:43.126110 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-5e3a41dc-e257-4e93-ba11-223703c23c11 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:43.132296 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5e3a41dc-e257-4e93-ba11-223703c23c11 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:43.132740 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5e3a41dc-e257-4e93-ba11-223703c23c11 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:43.133494 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5e3a41dc-e257-4e93-ba11-223703c23c11 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:43.133924 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5e3a41dc-e257-4e93-ba11-223703c23c11 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:43.137491 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=100 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:16:43.164588 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-5e3a41dc-e257-4e93-ba11-223703c23c11 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043263 Jun 17 13:16:43.165139 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 591/1210] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:43 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:44.134449 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-92ec6004-9a19-43bd-b75e-5798acc44393 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:44.135411 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-20d73aa8-b8a2-4af3-b95c-a35d988f7be2 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:44.135968 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-92ec6004-9a19-43bd-b75e-5798acc44393 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:44.136692 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-20d73aa8-b8a2-4af3-b95c-a35d988f7be2 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:44.145710 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-92ec6004-9a19-43bd-b75e-5798acc44393 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:44.146527 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-92ec6004-9a19-43bd-b75e-5798acc44393 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:44.146720 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-20d73aa8-b8a2-4af3-b95c-a35d988f7be2 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:44.147134 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-20d73aa8-b8a2-4af3-b95c-a35d988f7be2 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:44.147579 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-92ec6004-9a19-43bd-b75e-5798acc44393 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:44.148139 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-20d73aa8-b8a2-4af3-b95c-a35d988f7be2 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:44.148324 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-92ec6004-9a19-43bd-b75e-5798acc44393 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:44.148731 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-20d73aa8-b8a2-4af3-b95c-a35d988f7be2 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:44.180711 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-20d73aa8-b8a2-4af3-b95c-a35d988f7be2 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050503 Jun 17 13:16:44.181059 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-92ec6004-9a19-43bd-b75e-5798acc44393 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052358 Jun 17 13:16:44.181261 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 592/1211] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:16:44 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:16:44.181871 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 620/1212] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:44 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:44.188988 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-728a9e9b-54d2-4e7a-8d05-1e9f04953def tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:44.189926 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-728a9e9b-54d2-4e7a-8d05-1e9f04953def tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:44.196432 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-728a9e9b-54d2-4e7a-8d05-1e9f04953def tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:44.196935 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-728a9e9b-54d2-4e7a-8d05-1e9f04953def tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:44.197769 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-728a9e9b-54d2-4e7a-8d05-1e9f04953def tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:44.198274 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-728a9e9b-54d2-4e7a-8d05-1e9f04953def tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:44.228065 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-728a9e9b-54d2-4e7a-8d05-1e9f04953def tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045717 Jun 17 13:16:44.228907 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 593/1213] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:44 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:45.195749 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-cb89f0f6-a8da-4d35-945b-d0ece2127121 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:45.196550 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-aeb22dbd-c496-466e-846e-f95953195d26 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:45.197123 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-cb89f0f6-a8da-4d35-945b-d0ece2127121 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:45.197710 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-aeb22dbd-c496-466e-846e-f95953195d26 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:45.207720 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-cb89f0f6-a8da-4d35-945b-d0ece2127121 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:45.208422 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-cb89f0f6-a8da-4d35-945b-d0ece2127121 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:45.208701 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-aeb22dbd-c496-466e-846e-f95953195d26 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:45.209420 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-aeb22dbd-c496-466e-846e-f95953195d26 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:45.209665 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-cb89f0f6-a8da-4d35-945b-d0ece2127121 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:45.210518 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-cb89f0f6-a8da-4d35-945b-d0ece2127121 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:45.211060 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-aeb22dbd-c496-466e-846e-f95953195d26 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:45.211888 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-aeb22dbd-c496-466e-846e-f95953195d26 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:45.241049 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_cell1:SELECT=100 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:16:45.245926 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-cb89f0f6-a8da-4d35-945b-d0ece2127121 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056202 Jun 17 13:16:45.246544 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 621/1214] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:16:45 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:16:45.246703 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-aeb22dbd-c496-466e-846e-f95953195d26 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055968 Jun 17 13:16:45.247479 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 594/1215] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:45 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:45.251893 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-aa25b5bd-b25d-42e3-b46f-e5faae245763 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:45.252765 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-aa25b5bd-b25d-42e3-b46f-e5faae245763 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:45.259313 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-aa25b5bd-b25d-42e3-b46f-e5faae245763 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:45.259686 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-aa25b5bd-b25d-42e3-b46f-e5faae245763 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:45.260418 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-aa25b5bd-b25d-42e3-b46f-e5faae245763 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:45.260876 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-aa25b5bd-b25d-42e3-b46f-e5faae245763 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:45.290910 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-aa25b5bd-b25d-42e3-b46f-e5faae245763 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043352 Jun 17 13:16:45.291480 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 622/1216] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:45 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:46.261730 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-2dcb43c5-9f6f-4459-acb5-9741a5661a93 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:46.262592 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-b8484097-06bc-4995-97f5-e57d32a98307 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:46.263368 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-2dcb43c5-9f6f-4459-acb5-9741a5661a93 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:46.263722 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-b8484097-06bc-4995-97f5-e57d32a98307 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:46.270978 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b8484097-06bc-4995-97f5-e57d32a98307 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:46.271257 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2dcb43c5-9f6f-4459-acb5-9741a5661a93 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:46.271442 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b8484097-06bc-4995-97f5-e57d32a98307 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:46.271738 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2dcb43c5-9f6f-4459-acb5-9741a5661a93 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:46.272180 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b8484097-06bc-4995-97f5-e57d32a98307 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:46.272503 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2dcb43c5-9f6f-4459-acb5-9741a5661a93 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:46.272672 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b8484097-06bc-4995-97f5-e57d32a98307 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:46.272937 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2dcb43c5-9f6f-4459-acb5-9741a5661a93 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:46.303091 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-b8484097-06bc-4995-97f5-e57d32a98307 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046981 Jun 17 13:16:46.303369 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-2dcb43c5-9f6f-4459-acb5-9741a5661a93 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047775 Jun 17 13:16:46.303660 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 623/1217] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:46 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:46.303802 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 595/1218] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:16:46 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:16:46.308588 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-b6c5026b-0ecb-498f-a357-68ba07162a67 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:46.309510 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-b6c5026b-0ecb-498f-a357-68ba07162a67 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:46.316048 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b6c5026b-0ecb-498f-a357-68ba07162a67 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:46.316499 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b6c5026b-0ecb-498f-a357-68ba07162a67 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:46.317263 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b6c5026b-0ecb-498f-a357-68ba07162a67 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:46.317699 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b6c5026b-0ecb-498f-a357-68ba07162a67 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:46.346925 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-b6c5026b-0ecb-498f-a357-68ba07162a67 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041991 Jun 17 13:16:46.347487 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 624/1219] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:46 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:47.316943 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-72b60c7e-af8e-42de-8f8e-d1d1edc9f0df tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:47.317510 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-19ae4e72-bf4a-4d52-aeb7-f4acfcfa6256 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:47.317948 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-72b60c7e-af8e-42de-8f8e-d1d1edc9f0df tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:47.318256 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-19ae4e72-bf4a-4d52-aeb7-f4acfcfa6256 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:47.324587 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-72b60c7e-af8e-42de-8f8e-d1d1edc9f0df tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:47.324794 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-19ae4e72-bf4a-4d52-aeb7-f4acfcfa6256 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:47.325022 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-72b60c7e-af8e-42de-8f8e-d1d1edc9f0df tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:47.325196 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-19ae4e72-bf4a-4d52-aeb7-f4acfcfa6256 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:47.325874 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-72b60c7e-af8e-42de-8f8e-d1d1edc9f0df tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:47.325994 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-19ae4e72-bf4a-4d52-aeb7-f4acfcfa6256 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:47.326432 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-72b60c7e-af8e-42de-8f8e-d1d1edc9f0df tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:47.326571 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-19ae4e72-bf4a-4d52-aeb7-f4acfcfa6256 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:47.356439 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-19ae4e72-bf4a-4d52-aeb7-f4acfcfa6256 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044098 Jun 17 13:16:47.356705 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-72b60c7e-af8e-42de-8f8e-d1d1edc9f0df tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044287 Jun 17 13:16:47.361220 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 596/1220] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:47 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:47.361371 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 625/1221] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:16:47 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:16:47.362459 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-7ed29e06-e310-4ec8-9f0e-3cc98e9996b2 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:47.363382 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-7ed29e06-e310-4ec8-9f0e-3cc98e9996b2 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:47.372069 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7ed29e06-e310-4ec8-9f0e-3cc98e9996b2 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:47.372414 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7ed29e06-e310-4ec8-9f0e-3cc98e9996b2 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:47.373192 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7ed29e06-e310-4ec8-9f0e-3cc98e9996b2 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:47.373630 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7ed29e06-e310-4ec8-9f0e-3cc98e9996b2 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:47.403857 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-7ed29e06-e310-4ec8-9f0e-3cc98e9996b2 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045482 Jun 17 13:16:47.404382 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 597/1222] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:47 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:48.369630 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-8a83e049-6cf8-4c3f-8b6b-75f70fcf704e tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:48.370142 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-711be299-343a-4bf1-a2ff-06711674f2f1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:48.370536 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-8a83e049-6cf8-4c3f-8b6b-75f70fcf704e tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:48.370651 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-711be299-343a-4bf1-a2ff-06711674f2f1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:48.377478 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8a83e049-6cf8-4c3f-8b6b-75f70fcf704e tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:48.377894 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8a83e049-6cf8-4c3f-8b6b-75f70fcf704e tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:48.378038 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-711be299-343a-4bf1-a2ff-06711674f2f1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:48.378536 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-711be299-343a-4bf1-a2ff-06711674f2f1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:48.378714 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8a83e049-6cf8-4c3f-8b6b-75f70fcf704e tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:48.379161 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8a83e049-6cf8-4c3f-8b6b-75f70fcf704e tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:48.379412 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-711be299-343a-4bf1-a2ff-06711674f2f1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:48.379885 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-711be299-343a-4bf1-a2ff-06711674f2f1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:48.410346 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-8a83e049-6cf8-4c3f-8b6b-75f70fcf704e tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044623 Jun 17 13:16:48.411913 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-711be299-343a-4bf1-a2ff-06711674f2f1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046023 Jun 17 13:16:48.412049 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 626/1223] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:48 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:48.415522 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 598/1224] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:16:48 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:16:48.416885 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-e49a2218-3778-45a9-8ae0-6856b4befc90 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:48.417951 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-e49a2218-3778-45a9-8ae0-6856b4befc90 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:48.424552 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e49a2218-3778-45a9-8ae0-6856b4befc90 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:48.424992 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e49a2218-3778-45a9-8ae0-6856b4befc90 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:48.425966 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e49a2218-3778-45a9-8ae0-6856b4befc90 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:48.426436 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e49a2218-3778-45a9-8ae0-6856b4befc90 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:48.456306 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-e49a2218-3778-45a9-8ae0-6856b4befc90 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043289 Jun 17 13:16:48.457058 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 627/1225] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:48 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 13:16:49.421303 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-9385a6b0-f5e5-4d80-930c-1bf3fc595980 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:49.422318 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-9385a6b0-f5e5-4d80-930c-1bf3fc595980 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:49.422710 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-55b886f5-3558-4c8d-a053-a2b6aea90078 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:49.423634 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-55b886f5-3558-4c8d-a053-a2b6aea90078 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:49.428569 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9385a6b0-f5e5-4d80-930c-1bf3fc595980 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:49.429193 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9385a6b0-f5e5-4d80-930c-1bf3fc595980 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:49.430183 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9385a6b0-f5e5-4d80-930c-1bf3fc595980 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:49.430616 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9385a6b0-f5e5-4d80-930c-1bf3fc595980 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:49.431279 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-55b886f5-3558-4c8d-a053-a2b6aea90078 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:49.431703 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-55b886f5-3558-4c8d-a053-a2b6aea90078 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:49.432484 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-55b886f5-3558-4c8d-a053-a2b6aea90078 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:49.432925 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-55b886f5-3558-4c8d-a053-a2b6aea90078 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:49.460366 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-9385a6b0-f5e5-4d80-930c-1bf3fc595980 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043031 Jun 17 13:16:49.460905 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 599/1226] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:49 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:49.462579 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-55b886f5-3558-4c8d-a053-a2b6aea90078 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043790 Jun 17 13:16:49.463420 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 628/1227] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:16:49 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:16:49.468002 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-faa65c09-9b5a-47c7-8a43-f7c21719580c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:49.468915 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-faa65c09-9b5a-47c7-8a43-f7c21719580c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:49.475162 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-faa65c09-9b5a-47c7-8a43-f7c21719580c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:49.475602 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-faa65c09-9b5a-47c7-8a43-f7c21719580c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:49.476355 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-faa65c09-9b5a-47c7-8a43-f7c21719580c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:49.476786 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-faa65c09-9b5a-47c7-8a43-f7c21719580c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:49.505967 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-faa65c09-9b5a-47c7-8a43-f7c21719580c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041684 Jun 17 13:16:49.506559 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 600/1228] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:49 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:50.476308 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-9f73acbc-8423-4fdd-956a-466d4d2385bc tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:50.477265 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-9f73acbc-8423-4fdd-956a-466d4d2385bc tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:50.477627 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-ad87c7b6-ffe1-4a9f-b8e2-69654f0c3eac tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:50.478564 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-ad87c7b6-ffe1-4a9f-b8e2-69654f0c3eac tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:50.484202 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9f73acbc-8423-4fdd-956a-466d4d2385bc tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:50.484650 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9f73acbc-8423-4fdd-956a-466d4d2385bc tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:50.485415 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9f73acbc-8423-4fdd-956a-466d4d2385bc tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:50.485574 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ad87c7b6-ffe1-4a9f-b8e2-69654f0c3eac tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:50.485852 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9f73acbc-8423-4fdd-956a-466d4d2385bc tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:50.486025 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ad87c7b6-ffe1-4a9f-b8e2-69654f0c3eac tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:50.486820 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ad87c7b6-ffe1-4a9f-b8e2-69654f0c3eac tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:50.487251 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ad87c7b6-ffe1-4a9f-b8e2-69654f0c3eac tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:50.516088 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-9f73acbc-8423-4fdd-956a-466d4d2385bc tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046349 Jun 17 13:16:50.516659 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 629/1229] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:50 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:50.517359 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-ad87c7b6-ffe1-4a9f-b8e2-69654f0c3eac tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045452 Jun 17 13:16:50.518153 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 601/1230] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:16:50 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:16:50.521227 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-4efdb760-ddc0-48e2-9318-2178c2859218 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:50.522149 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-4efdb760-ddc0-48e2-9318-2178c2859218 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:50.528195 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4efdb760-ddc0-48e2-9318-2178c2859218 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:50.528645 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4efdb760-ddc0-48e2-9318-2178c2859218 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:50.529403 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4efdb760-ddc0-48e2-9318-2178c2859218 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:50.529849 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4efdb760-ddc0-48e2-9318-2178c2859218 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:50.558061 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-4efdb760-ddc0-48e2-9318-2178c2859218 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040414 Jun 17 13:16:50.558672 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 630/1231] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:50 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:51.530067 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-cf35cee0-5752-424b-af4a-18b359b88884 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:51.531377 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-174788f8-d48a-4c5b-a928-c0f61f6f8090 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:51.531972 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-cf35cee0-5752-424b-af4a-18b359b88884 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:51.532660 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-174788f8-d48a-4c5b-a928-c0f61f6f8090 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:51.540288 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cf35cee0-5752-424b-af4a-18b359b88884 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:51.540811 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cf35cee0-5752-424b-af4a-18b359b88884 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:51.541043 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-174788f8-d48a-4c5b-a928-c0f61f6f8090 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:51.541500 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-174788f8-d48a-4c5b-a928-c0f61f6f8090 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:51.541623 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cf35cee0-5752-424b-af4a-18b359b88884 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:51.542005 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cf35cee0-5752-424b-af4a-18b359b88884 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:51.542306 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-174788f8-d48a-4c5b-a928-c0f61f6f8090 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:51.542744 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-174788f8-d48a-4c5b-a928-c0f61f6f8090 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:51.573731 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-cf35cee0-5752-424b-af4a-18b359b88884 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048923 Jun 17 13:16:51.573971 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-174788f8-d48a-4c5b-a928-c0f61f6f8090 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047963 Jun 17 13:16:51.577425 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 602/1232] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:51 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:51.577565 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 631/1233] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:16:51 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:16:51.580059 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-40b2c65d-4ea7-46f6-ad97-064b2258c747 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:51.581123 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-40b2c65d-4ea7-46f6-ad97-064b2258c747 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:51.588570 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-40b2c65d-4ea7-46f6-ad97-064b2258c747 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:51.589007 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-40b2c65d-4ea7-46f6-ad97-064b2258c747 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:51.589757 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-40b2c65d-4ea7-46f6-ad97-064b2258c747 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:51.590212 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-40b2c65d-4ea7-46f6-ad97-064b2258c747 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:51.620228 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-40b2c65d-4ea7-46f6-ad97-064b2258c747 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044674 Jun 17 13:16:51.620821 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 603/1234] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:51 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:52.585117 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-5bf4303a-7737-4803-b2b3-06249da260b7 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:52.585685 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-e0f84359-d3fb-43b8-91a7-aefda4fa6da7 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:52.586267 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-5bf4303a-7737-4803-b2b3-06249da260b7 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:52.586397 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-e0f84359-d3fb-43b8-91a7-aefda4fa6da7 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:52.593086 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-5bf4303a-7737-4803-b2b3-06249da260b7 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:52.593252 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e0f84359-d3fb-43b8-91a7-aefda4fa6da7 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:52.593532 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-5bf4303a-7737-4803-b2b3-06249da260b7 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:52.593799 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e0f84359-d3fb-43b8-91a7-aefda4fa6da7 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:52.594360 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-5bf4303a-7737-4803-b2b3-06249da260b7 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:52.594591 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e0f84359-d3fb-43b8-91a7-aefda4fa6da7 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:52.594831 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-5bf4303a-7737-4803-b2b3-06249da260b7 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:52.595083 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e0f84359-d3fb-43b8-91a7-aefda4fa6da7 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:52.626002 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-e0f84359-d3fb-43b8-91a7-aefda4fa6da7 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044779 Jun 17 13:16:52.626295 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-5bf4303a-7737-4803-b2b3-06249da260b7 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045036 Jun 17 13:16:52.626863 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 632/1235] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:52 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:52.630451 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 604/1236] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:16:52 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 17 13:16:52.631624 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-88c9db82-b494-4676-bd28-182dcf650b6b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:52.632546 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-88c9db82-b494-4676-bd28-182dcf650b6b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:52.638977 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-88c9db82-b494-4676-bd28-182dcf650b6b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:52.639427 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-88c9db82-b494-4676-bd28-182dcf650b6b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:52.640182 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-88c9db82-b494-4676-bd28-182dcf650b6b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:52.640625 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-88c9db82-b494-4676-bd28-182dcf650b6b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:52.671761 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-88c9db82-b494-4676-bd28-182dcf650b6b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043857 Jun 17 13:16:52.672321 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 633/1237] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:52 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:53.637963 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-c19a1f3a-ca2b-400f-8336-abce55d331f1 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:53.638534 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-fdb0db0e-6ff9-4a67-82a1-75ff3947aa97 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:53.638941 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-c19a1f3a-ca2b-400f-8336-abce55d331f1 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:53.639333 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-fdb0db0e-6ff9-4a67-82a1-75ff3947aa97 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:53.646021 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c19a1f3a-ca2b-400f-8336-abce55d331f1 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:53.646200 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-fdb0db0e-6ff9-4a67-82a1-75ff3947aa97 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:53.646564 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c19a1f3a-ca2b-400f-8336-abce55d331f1 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:53.646724 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-fdb0db0e-6ff9-4a67-82a1-75ff3947aa97 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:53.647327 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-fdb0db0e-6ff9-4a67-82a1-75ff3947aa97 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:53.647471 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c19a1f3a-ca2b-400f-8336-abce55d331f1 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:53.647759 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-fdb0db0e-6ff9-4a67-82a1-75ff3947aa97 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:53.647918 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c19a1f3a-ca2b-400f-8336-abce55d331f1 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:53.677666 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-c19a1f3a-ca2b-400f-8336-abce55d331f1 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043687 Jun 17 13:16:53.678349 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 605/1238] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:53 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:53.679035 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-fdb0db0e-6ff9-4a67-82a1-75ff3947aa97 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044950 Jun 17 13:16:53.679656 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 634/1239] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:16:53 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:16:53.683750 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-7915f644-2131-4bb3-88cd-c1c0a299669a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:53.684957 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-7915f644-2131-4bb3-88cd-c1c0a299669a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:53.691304 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7915f644-2131-4bb3-88cd-c1c0a299669a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:53.691751 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7915f644-2131-4bb3-88cd-c1c0a299669a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:53.692511 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7915f644-2131-4bb3-88cd-c1c0a299669a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:53.692945 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7915f644-2131-4bb3-88cd-c1c0a299669a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:53.723606 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-7915f644-2131-4bb3-88cd-c1c0a299669a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043866 Jun 17 13:16:53.724227 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 606/1240] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:53 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:54.690112 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-3cf52b6f-8a79-4d3c-83f0-03c137b6af17 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:54.691060 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-3cf52b6f-8a79-4d3c-83f0-03c137b6af17 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:54.691466 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-65d6c8ff-c36e-499f-990d-d62dabef11d7 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:54.692397 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-65d6c8ff-c36e-499f-990d-d62dabef11d7 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:54.697756 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-3cf52b6f-8a79-4d3c-83f0-03c137b6af17 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:54.698279 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-3cf52b6f-8a79-4d3c-83f0-03c137b6af17 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:54.698994 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-65d6c8ff-c36e-499f-990d-d62dabef11d7 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:54.699129 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-3cf52b6f-8a79-4d3c-83f0-03c137b6af17 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:54.699434 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-65d6c8ff-c36e-499f-990d-d62dabef11d7 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:54.699557 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-3cf52b6f-8a79-4d3c-83f0-03c137b6af17 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:54.700195 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-65d6c8ff-c36e-499f-990d-d62dabef11d7 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:54.700792 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-65d6c8ff-c36e-499f-990d-d62dabef11d7 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:54.726057 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=100 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:16:54.729716 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-3cf52b6f-8a79-4d3c-83f0-03c137b6af17 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043745 Jun 17 13:16:54.730539 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 635/1241] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:54 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:54.730779 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-65d6c8ff-c36e-499f-990d-d62dabef11d7 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043324 Jun 17 13:16:54.736267 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 607/1242] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:16:54 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 17 13:16:54.739069 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-8255fc8e-506d-48f9-89c9-4590e03e90bb tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:54.739991 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-8255fc8e-506d-48f9-89c9-4590e03e90bb tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:54.745863 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8255fc8e-506d-48f9-89c9-4590e03e90bb tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:54.746341 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8255fc8e-506d-48f9-89c9-4590e03e90bb tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:54.747137 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8255fc8e-506d-48f9-89c9-4590e03e90bb tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:54.747795 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8255fc8e-506d-48f9-89c9-4590e03e90bb tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:54.776515 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-8255fc8e-506d-48f9-89c9-4590e03e90bb tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041170 Jun 17 13:16:54.777060 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 636/1243] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:54 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:55.743080 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-96a07336-35fd-4aa9-9517-6126aad2d36a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:55.743945 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-ab6a754b-482f-470d-82a7-bf2bfc063abf tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:55.744321 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-96a07336-35fd-4aa9-9517-6126aad2d36a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:55.744995 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-ab6a754b-482f-470d-82a7-bf2bfc063abf tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:55.750812 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-96a07336-35fd-4aa9-9517-6126aad2d36a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:55.751261 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-96a07336-35fd-4aa9-9517-6126aad2d36a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:55.752029 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-96a07336-35fd-4aa9-9517-6126aad2d36a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:55.752242 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ab6a754b-482f-470d-82a7-bf2bfc063abf tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:55.752461 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-96a07336-35fd-4aa9-9517-6126aad2d36a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:55.752702 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ab6a754b-482f-470d-82a7-bf2bfc063abf tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:55.753463 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ab6a754b-482f-470d-82a7-bf2bfc063abf tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:55.753905 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ab6a754b-482f-470d-82a7-bf2bfc063abf tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:55.784706 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-96a07336-35fd-4aa9-9517-6126aad2d36a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045820 Jun 17 13:16:55.785440 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 608/1244] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:55 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:55.789418 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-ab6a754b-482f-470d-82a7-bf2bfc063abf tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049445 Jun 17 13:16:55.789983 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 637/1245] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:16:55 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:16:55.790331 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-fc715e54-590c-4bf0-b74c-f9980f65904a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:55.791318 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-fc715e54-590c-4bf0-b74c-f9980f65904a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:55.797553 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fc715e54-590c-4bf0-b74c-f9980f65904a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:55.798017 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fc715e54-590c-4bf0-b74c-f9980f65904a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:55.798866 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fc715e54-590c-4bf0-b74c-f9980f65904a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:55.799299 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fc715e54-590c-4bf0-b74c-f9980f65904a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:55.828079 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-fc715e54-590c-4bf0-b74c-f9980f65904a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041771 Jun 17 13:16:55.828614 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 609/1246] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:55 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:56.797116 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-c2187c42-8e93-468f-89ad-7456efe2eca0 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:56.798257 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-c2187c42-8e93-468f-89ad-7456efe2eca0 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:56.801134 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-ca849ed8-ca70-4ebf-a90d-d5c8b8e5b538 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:56.802114 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-ca849ed8-ca70-4ebf-a90d-d5c8b8e5b538 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:56.805209 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c2187c42-8e93-468f-89ad-7456efe2eca0 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:56.805657 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c2187c42-8e93-468f-89ad-7456efe2eca0 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:56.806497 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c2187c42-8e93-468f-89ad-7456efe2eca0 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:56.806931 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c2187c42-8e93-468f-89ad-7456efe2eca0 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:56.809179 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ca849ed8-ca70-4ebf-a90d-d5c8b8e5b538 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:56.809706 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ca849ed8-ca70-4ebf-a90d-d5c8b8e5b538 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:56.810577 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ca849ed8-ca70-4ebf-a90d-d5c8b8e5b538 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:56.811081 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ca849ed8-ca70-4ebf-a90d-d5c8b8e5b538 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:56.824198 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_cell1:SELECT=100 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:16:56.838113 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-c2187c42-8e93-468f-89ad-7456efe2eca0 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045543 Jun 17 13:16:56.838697 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 638/1247] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:56 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:56.841369 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-ca849ed8-ca70-4ebf-a90d-d5c8b8e5b538 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044211 Jun 17 13:16:56.841922 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 610/1248] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:16:56 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:16:56.843994 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-7184f039-abdb-4447-b279-09438a40bf2c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:56.844926 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-7184f039-abdb-4447-b279-09438a40bf2c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:56.851013 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7184f039-abdb-4447-b279-09438a40bf2c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:56.851462 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7184f039-abdb-4447-b279-09438a40bf2c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:56.852229 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7184f039-abdb-4447-b279-09438a40bf2c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:56.852667 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7184f039-abdb-4447-b279-09438a40bf2c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:56.881989 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-7184f039-abdb-4447-b279-09438a40bf2c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042038 Jun 17 13:16:56.882851 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 639/1249] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:56 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:57.851271 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-6ae43019-2af6-43eb-b8fa-83856e25ad94 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:57.852204 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-6ae43019-2af6-43eb-b8fa-83856e25ad94 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:57.853900 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-42bc6cab-2df6-4f66-b521-1dd8cbdbe425 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:57.855442 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-42bc6cab-2df6-4f66-b521-1dd8cbdbe425 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:57.862589 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-42bc6cab-2df6-4f66-b521-1dd8cbdbe425 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:57.863123 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-42bc6cab-2df6-4f66-b521-1dd8cbdbe425 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:57.863966 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-42bc6cab-2df6-4f66-b521-1dd8cbdbe425 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:57.864499 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-42bc6cab-2df6-4f66-b521-1dd8cbdbe425 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:57.865075 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6ae43019-2af6-43eb-b8fa-83856e25ad94 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:57.865519 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6ae43019-2af6-43eb-b8fa-83856e25ad94 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:57.866318 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6ae43019-2af6-43eb-b8fa-83856e25ad94 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:57.866745 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6ae43019-2af6-43eb-b8fa-83856e25ad94 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:57.895359 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-42bc6cab-2df6-4f66-b521-1dd8cbdbe425 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045449 Jun 17 13:16:57.895906 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 640/1250] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:16:57 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:16:57.896056 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-6ae43019-2af6-43eb-b8fa-83856e25ad94 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050662 Jun 17 13:16:57.896600 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 611/1251] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:57 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:57.901266 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-6b31fa8d-a0b5-4393-ba2f-50387f859428 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:57.902238 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-6b31fa8d-a0b5-4393-ba2f-50387f859428 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:57.908446 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6b31fa8d-a0b5-4393-ba2f-50387f859428 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:57.908900 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6b31fa8d-a0b5-4393-ba2f-50387f859428 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:57.909692 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6b31fa8d-a0b5-4393-ba2f-50387f859428 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:57.910132 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6b31fa8d-a0b5-4393-ba2f-50387f859428 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:57.939373 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-6b31fa8d-a0b5-4393-ba2f-50387f859428 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041899 Jun 17 13:16:57.939925 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 641/1252] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:57 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:58.906566 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-84baa589-9678-4a41-a7a9-527ac0dca62c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:58.907444 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-84baa589-9678-4a41-a7a9-527ac0dca62c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:58.907902 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-64a32c6a-047b-4ff3-aa8f-3fb3d3a9690e tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:58.909242 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-64a32c6a-047b-4ff3-aa8f-3fb3d3a9690e tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:58.914302 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-84baa589-9678-4a41-a7a9-527ac0dca62c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:58.914742 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-84baa589-9678-4a41-a7a9-527ac0dca62c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:58.915502 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-84baa589-9678-4a41-a7a9-527ac0dca62c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:58.915923 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-84baa589-9678-4a41-a7a9-527ac0dca62c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:58.916996 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-64a32c6a-047b-4ff3-aa8f-3fb3d3a9690e tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:58.917448 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-64a32c6a-047b-4ff3-aa8f-3fb3d3a9690e tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:58.918252 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-64a32c6a-047b-4ff3-aa8f-3fb3d3a9690e tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:58.918700 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-64a32c6a-047b-4ff3-aa8f-3fb3d3a9690e tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:58.945058 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-84baa589-9678-4a41-a7a9-527ac0dca62c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042309 Jun 17 13:16:58.946223 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 612/1253] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:16:58 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:16:58.948636 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-64a32c6a-047b-4ff3-aa8f-3fb3d3a9690e tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044847 Jun 17 13:16:58.952365 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 642/1254] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:58 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:58.952524 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-bc7f455d-cf8d-446e-a200-cd92514c115a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:58.952524 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-bc7f455d-cf8d-446e-a200-cd92514c115a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:58.957964 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bc7f455d-cf8d-446e-a200-cd92514c115a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:58.958436 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bc7f455d-cf8d-446e-a200-cd92514c115a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:58.959186 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bc7f455d-cf8d-446e-a200-cd92514c115a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:58.959612 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bc7f455d-cf8d-446e-a200-cd92514c115a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:58.989279 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-bc7f455d-cf8d-446e-a200-cd92514c115a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042144 Jun 17 13:16:58.989817 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 613/1255] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:58 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:16:59.957249 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-fef4a75f-fa7b-42be-b82f-2405c67a6179 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:59.959074 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-fef4a75f-fa7b-42be-b82f-2405c67a6179 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:59.960195 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-4ea949c6-961c-48d9-91a6-f4915b022cfa tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:16:59.961109 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-4ea949c6-961c-48d9-91a6-f4915b022cfa tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:16:59.965782 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-fef4a75f-fa7b-42be-b82f-2405c67a6179 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:59.966267 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-fef4a75f-fa7b-42be-b82f-2405c67a6179 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:59.967021 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-fef4a75f-fa7b-42be-b82f-2405c67a6179 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:59.967476 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-fef4a75f-fa7b-42be-b82f-2405c67a6179 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:59.967648 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4ea949c6-961c-48d9-91a6-f4915b022cfa tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:59.968290 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4ea949c6-961c-48d9-91a6-f4915b022cfa tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:59.969044 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4ea949c6-961c-48d9-91a6-f4915b022cfa tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:16:59.969466 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4ea949c6-961c-48d9-91a6-f4915b022cfa tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:16:59.999033 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-fef4a75f-fa7b-42be-b82f-2405c67a6179 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045866 Jun 17 13:16:59.999606 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 643/1256] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:16:59 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:17:00.001331 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-4ea949c6-961c-48d9-91a6-f4915b022cfa tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045165 Jun 17 13:17:00.001883 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 614/1257] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:59 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 13:17:00.009665 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-10b00aa1-5722-4cb5-8d45-0d6b019273fe tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:00.010619 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-10b00aa1-5722-4cb5-8d45-0d6b019273fe tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:00.016572 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-10b00aa1-5722-4cb5-8d45-0d6b019273fe tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:00.017024 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-10b00aa1-5722-4cb5-8d45-0d6b019273fe tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:00.017785 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-10b00aa1-5722-4cb5-8d45-0d6b019273fe tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:00.018252 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-10b00aa1-5722-4cb5-8d45-0d6b019273fe tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:00.049173 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-10b00aa1-5722-4cb5-8d45-0d6b019273fe tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048553 Jun 17 13:17:00.049716 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 644/1258] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:16:59 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:01.013190 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-2b3f215d-7498-4a6c-b436-5c19cae95028 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:01.013775 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-8e0bbc3c-cf11-4e0e-9159-806d8c409057 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:01.014164 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-2b3f215d-7498-4a6c-b436-5c19cae95028 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:01.014271 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-8e0bbc3c-cf11-4e0e-9159-806d8c409057 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:01.020965 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2b3f215d-7498-4a6c-b436-5c19cae95028 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:01.021170 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8e0bbc3c-cf11-4e0e-9159-806d8c409057 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:01.021368 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2b3f215d-7498-4a6c-b436-5c19cae95028 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:01.021534 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8e0bbc3c-cf11-4e0e-9159-806d8c409057 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:01.022210 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8e0bbc3c-cf11-4e0e-9159-806d8c409057 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:01.022646 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8e0bbc3c-cf11-4e0e-9159-806d8c409057 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:01.022802 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2b3f215d-7498-4a6c-b436-5c19cae95028 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:01.023200 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2b3f215d-7498-4a6c-b436-5c19cae95028 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:01.054347 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-2b3f215d-7498-4a6c-b436-5c19cae95028 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045282 Jun 17 13:17:01.054548 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-8e0bbc3c-cf11-4e0e-9159-806d8c409057 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045040 Jun 17 13:17:01.054913 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 615/1259] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:01 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:01.055169 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 645/1260] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:17:01 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:17:01.063978 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-8c76278d-100d-4ddb-b10d-1a7d40050786 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:01.065117 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-8c76278d-100d-4ddb-b10d-1a7d40050786 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:01.071109 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8c76278d-100d-4ddb-b10d-1a7d40050786 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:01.071545 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8c76278d-100d-4ddb-b10d-1a7d40050786 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:01.072260 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8c76278d-100d-4ddb-b10d-1a7d40050786 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:01.072688 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8c76278d-100d-4ddb-b10d-1a7d40050786 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:01.100741 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-8c76278d-100d-4ddb-b10d-1a7d40050786 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040712 Jun 17 13:17:01.101279 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 616/1261] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:01 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 13:17:02.065507 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-503077b3-9b00-4590-82c5-614f641d73bb tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:02.066306 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-f6331a16-c539-4a04-9630-04d3d333b902 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:02.066774 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-503077b3-9b00-4590-82c5-614f641d73bb tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:02.067260 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-f6331a16-c539-4a04-9630-04d3d333b902 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:02.069838 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_api:SELECT=86 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:17:02.075791 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-503077b3-9b00-4590-82c5-614f641d73bb tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:02.076230 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-503077b3-9b00-4590-82c5-614f641d73bb tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:02.076994 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-503077b3-9b00-4590-82c5-614f641d73bb tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:02.077226 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f6331a16-c539-4a04-9630-04d3d333b902 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:02.077388 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-503077b3-9b00-4590-82c5-614f641d73bb tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:02.077760 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f6331a16-c539-4a04-9630-04d3d333b902 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:02.078575 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f6331a16-c539-4a04-9630-04d3d333b902 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:02.079151 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f6331a16-c539-4a04-9630-04d3d333b902 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:02.109178 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-503077b3-9b00-4590-82c5-614f641d73bb tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047313 Jun 17 13:17:02.112940 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 646/1262] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:02 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:02.114716 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-1a8aaf96-e160-4fd2-a13d-8c9c2bdca370 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:02.115556 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-1a8aaf96-e160-4fd2-a13d-8c9c2bdca370 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:02.115813 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-f6331a16-c539-4a04-9630-04d3d333b902 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053520 Jun 17 13:17:02.116555 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 617/1263] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:17:02 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 17 13:17:02.123568 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-1a8aaf96-e160-4fd2-a13d-8c9c2bdca370 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:02.123568 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-1a8aaf96-e160-4fd2-a13d-8c9c2bdca370 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:02.123568 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-1a8aaf96-e160-4fd2-a13d-8c9c2bdca370 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:02.123568 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-1a8aaf96-e160-4fd2-a13d-8c9c2bdca370 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:02.151929 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-1a8aaf96-e160-4fd2-a13d-8c9c2bdca370 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041180 Jun 17 13:17:02.152470 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 647/1264] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:02 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:03.122450 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-13045e0c-0570-4696-a4fa-a12a3d9d2cb4 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:03.122450 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-13045e0c-0570-4696-a4fa-a12a3d9d2cb4 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:03.129629 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-c7ccb124-66bf-4713-a7e4-a0f38c734554 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:03.129629 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-c7ccb124-66bf-4713-a7e4-a0f38c734554 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:03.134424 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-13045e0c-0570-4696-a4fa-a12a3d9d2cb4 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:03.135290 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-13045e0c-0570-4696-a4fa-a12a3d9d2cb4 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:03.136115 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-13045e0c-0570-4696-a4fa-a12a3d9d2cb4 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:03.136420 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c7ccb124-66bf-4713-a7e4-a0f38c734554 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:03.136543 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-13045e0c-0570-4696-a4fa-a12a3d9d2cb4 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:03.136861 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c7ccb124-66bf-4713-a7e4-a0f38c734554 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:03.137592 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c7ccb124-66bf-4713-a7e4-a0f38c734554 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:03.138239 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c7ccb124-66bf-4713-a7e4-a0f38c734554 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:03.168772 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-c7ccb124-66bf-4713-a7e4-a0f38c734554 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044415 Jun 17 13:17:03.169615 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 648/1265] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:17:03 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:17:03.173236 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-13045e0c-0570-4696-a4fa-a12a3d9d2cb4 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055969 Jun 17 13:17:03.174114 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 618/1266] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:03 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:03.174424 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-e072e584-b678-42c2-be2e-4084fb88fc10 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:03.175337 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-e072e584-b678-42c2-be2e-4084fb88fc10 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:03.181494 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e072e584-b678-42c2-be2e-4084fb88fc10 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:03.181936 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e072e584-b678-42c2-be2e-4084fb88fc10 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:03.182729 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e072e584-b678-42c2-be2e-4084fb88fc10 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:03.183162 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e072e584-b678-42c2-be2e-4084fb88fc10 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:03.212932 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-e072e584-b678-42c2-be2e-4084fb88fc10 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042102 Jun 17 13:17:03.213503 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 649/1267] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:03 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:04.180358 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-9d274b1d-8549-4531-abc5-6c578296788b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:04.181305 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-9d274b1d-8549-4531-abc5-6c578296788b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:04.185370 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-26600df0-7f27-4e68-a78a-0bc8eaf48153 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:04.186332 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-26600df0-7f27-4e68-a78a-0bc8eaf48153 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:04.188218 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9d274b1d-8549-4531-abc5-6c578296788b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:04.188617 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9d274b1d-8549-4531-abc5-6c578296788b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:04.189373 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9d274b1d-8549-4531-abc5-6c578296788b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:04.189805 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9d274b1d-8549-4531-abc5-6c578296788b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:04.193370 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-26600df0-7f27-4e68-a78a-0bc8eaf48153 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:04.195169 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-26600df0-7f27-4e68-a78a-0bc8eaf48153 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:04.195969 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-26600df0-7f27-4e68-a78a-0bc8eaf48153 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:04.196413 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-26600df0-7f27-4e68-a78a-0bc8eaf48153 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:04.225523 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-9d274b1d-8549-4531-abc5-6c578296788b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049149 Jun 17 13:17:04.226631 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 619/1268] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:17:04 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:17:04.229502 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-26600df0-7f27-4e68-a78a-0bc8eaf48153 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047919 Jun 17 13:17:04.233847 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 650/1269] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:04 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:04.234928 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-87f2c153-4fa4-4fa5-a52e-f30793cc9ae7 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:04.235836 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-87f2c153-4fa4-4fa5-a52e-f30793cc9ae7 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:04.242109 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-87f2c153-4fa4-4fa5-a52e-f30793cc9ae7 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:04.242552 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-87f2c153-4fa4-4fa5-a52e-f30793cc9ae7 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:04.243302 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-87f2c153-4fa4-4fa5-a52e-f30793cc9ae7 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:04.243832 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-87f2c153-4fa4-4fa5-a52e-f30793cc9ae7 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:04.272158 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-87f2c153-4fa4-4fa5-a52e-f30793cc9ae7 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041367 Jun 17 13:17:04.272691 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 620/1270] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:04 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:05.237506 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-67a274c3-23dc-46e5-a005-367d9eaa4b35 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:05.238611 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-67a274c3-23dc-46e5-a005-367d9eaa4b35 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:05.241722 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-df0db2ff-8dc4-45d5-8531-3fd760c7a4eb tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:05.242826 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-df0db2ff-8dc4-45d5-8531-3fd760c7a4eb tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:05.246663 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-67a274c3-23dc-46e5-a005-367d9eaa4b35 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:05.247206 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-67a274c3-23dc-46e5-a005-367d9eaa4b35 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:05.248100 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-67a274c3-23dc-46e5-a005-367d9eaa4b35 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:05.248554 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-67a274c3-23dc-46e5-a005-367d9eaa4b35 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:05.250644 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-df0db2ff-8dc4-45d5-8531-3fd760c7a4eb tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:05.251093 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-df0db2ff-8dc4-45d5-8531-3fd760c7a4eb tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:05.251852 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-df0db2ff-8dc4-45d5-8531-3fd760c7a4eb tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:05.253560 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-df0db2ff-8dc4-45d5-8531-3fd760c7a4eb tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:05.281120 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-67a274c3-23dc-46e5-a005-367d9eaa4b35 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047991 Jun 17 13:17:05.281860 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 651/1271] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:17:05 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:17:05.286413 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-2660d10e-d77a-46e8-afd9-17ee7a2f2d7b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:05.287336 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-2660d10e-d77a-46e8-afd9-17ee7a2f2d7b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:05.294079 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-df0db2ff-8dc4-45d5-8531-3fd760c7a4eb tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056939 Jun 17 13:17:05.294463 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2660d10e-d77a-46e8-afd9-17ee7a2f2d7b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:05.294680 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 621/1272] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:05 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:05.295060 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2660d10e-d77a-46e8-afd9-17ee7a2f2d7b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:05.295895 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2660d10e-d77a-46e8-afd9-17ee7a2f2d7b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:05.296398 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2660d10e-d77a-46e8-afd9-17ee7a2f2d7b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:05.327930 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-2660d10e-d77a-46e8-afd9-17ee7a2f2d7b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045158 Jun 17 13:17:05.328493 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 652/1273] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:05 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:06.295073 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-58dd6d35-9a9c-4093-b30e-99dd24f27087 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:06.295990 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-58dd6d35-9a9c-4093-b30e-99dd24f27087 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:06.302467 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-58dd6d35-9a9c-4093-b30e-99dd24f27087 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:06.302916 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-58dd6d35-9a9c-4093-b30e-99dd24f27087 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:06.304406 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-58dd6d35-9a9c-4093-b30e-99dd24f27087 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:06.304406 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-58dd6d35-9a9c-4093-b30e-99dd24f27087 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:06.305968 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-4d074497-2f02-4112-91a5-21888b130069 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:06.307607 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-4d074497-2f02-4112-91a5-21888b130069 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:06.315180 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4d074497-2f02-4112-91a5-21888b130069 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:06.315638 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4d074497-2f02-4112-91a5-21888b130069 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:06.316788 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4d074497-2f02-4112-91a5-21888b130069 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:06.316906 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4d074497-2f02-4112-91a5-21888b130069 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:06.341152 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-58dd6d35-9a9c-4093-b30e-99dd24f27087 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050688 Jun 17 13:17:06.342367 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 622/1274] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:17:06 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:17:06.347117 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-1ce1ab02-abcb-47f1-8ece-d183a3561123 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:06.349870 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-1ce1ab02-abcb-47f1-8ece-d183a3561123 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:06.358917 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1ce1ab02-abcb-47f1-8ece-d183a3561123 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:06.359370 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1ce1ab02-abcb-47f1-8ece-d183a3561123 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:06.360144 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1ce1ab02-abcb-47f1-8ece-d183a3561123 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:06.361916 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1ce1ab02-abcb-47f1-8ece-d183a3561123 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:06.364300 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-4d074497-2f02-4112-91a5-21888b130069 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062993 Jun 17 13:17:06.365312 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 653/1275] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:06 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:06.404186 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-1ce1ab02-abcb-47f1-8ece-d183a3561123 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060304 Jun 17 13:17:06.405118 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 623/1276] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:06 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:07.355931 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-cda93de4-d33a-4b7f-bca5-47e0625380fe tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:07.357180 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-cda93de4-d33a-4b7f-bca5-47e0625380fe tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:07.366758 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-cda93de4-d33a-4b7f-bca5-47e0625380fe tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:07.367235 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-cda93de4-d33a-4b7f-bca5-47e0625380fe tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:07.368012 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-cda93de4-d33a-4b7f-bca5-47e0625380fe tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:07.368452 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-cda93de4-d33a-4b7f-bca5-47e0625380fe tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:07.377061 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-4462bfd6-cb45-471a-909c-7ad071c8c1c8 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:07.378726 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-4462bfd6-cb45-471a-909c-7ad071c8c1c8 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:07.387997 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4462bfd6-cb45-471a-909c-7ad071c8c1c8 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:07.388422 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4462bfd6-cb45-471a-909c-7ad071c8c1c8 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:07.389198 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4462bfd6-cb45-471a-909c-7ad071c8c1c8 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:07.389662 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4462bfd6-cb45-471a-909c-7ad071c8c1c8 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:07.401742 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-cda93de4-d33a-4b7f-bca5-47e0625380fe tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051386 Jun 17 13:17:07.402556 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 654/1277] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:17:07 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:17:07.408098 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=100 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:17:07.420179 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-1948a7ce-5b59-40a2-a11a-39fc7af6545d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:07.421110 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-1948a7ce-5b59-40a2-a11a-39fc7af6545d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:07.424167 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-4462bfd6-cb45-471a-909c-7ad071c8c1c8 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051054 Jun 17 13:17:07.424837 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 624/1278] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:07 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:07.428118 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-1948a7ce-5b59-40a2-a11a-39fc7af6545d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:07.428118 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-1948a7ce-5b59-40a2-a11a-39fc7af6545d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:07.428561 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-1948a7ce-5b59-40a2-a11a-39fc7af6545d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:07.429003 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-1948a7ce-5b59-40a2-a11a-39fc7af6545d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:07.432803 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_cell1:SELECT=100 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:17:07.458686 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-1948a7ce-5b59-40a2-a11a-39fc7af6545d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042407 Jun 17 13:17:07.459244 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 655/1279] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:07 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:08.415337 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-9253512e-7c66-49f7-babe-408ede140049 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:08.416270 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-9253512e-7c66-49f7-babe-408ede140049 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:08.423301 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9253512e-7c66-49f7-babe-408ede140049 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:08.423747 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9253512e-7c66-49f7-babe-408ede140049 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:08.424513 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9253512e-7c66-49f7-babe-408ede140049 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:08.424949 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9253512e-7c66-49f7-babe-408ede140049 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:08.436500 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-470af6fb-7ff9-4703-95d8-53706b5448b1 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:08.437445 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-470af6fb-7ff9-4703-95d8-53706b5448b1 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:08.444036 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-470af6fb-7ff9-4703-95d8-53706b5448b1 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:08.444727 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-470af6fb-7ff9-4703-95d8-53706b5448b1 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:08.446447 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-470af6fb-7ff9-4703-95d8-53706b5448b1 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:08.446948 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-470af6fb-7ff9-4703-95d8-53706b5448b1 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:08.456683 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-9253512e-7c66-49f7-babe-408ede140049 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045955 Jun 17 13:17:08.461502 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 625/1280] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:17:08 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:17:08.473771 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-d62b931c-72d7-4013-a089-76a17a958db3 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:08.474876 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-d62b931c-72d7-4013-a089-76a17a958db3 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:08.483084 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d62b931c-72d7-4013-a089-76a17a958db3 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:08.483084 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d62b931c-72d7-4013-a089-76a17a958db3 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:08.483719 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d62b931c-72d7-4013-a089-76a17a958db3 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:08.483954 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d62b931c-72d7-4013-a089-76a17a958db3 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:08.485414 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-470af6fb-7ff9-4703-95d8-53706b5448b1 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052832 Jun 17 13:17:08.486235 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 656/1281] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:08 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:08.515793 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-d62b931c-72d7-4013-a089-76a17a958db3 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045934 Jun 17 13:17:08.516605 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 626/1282] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:08 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 13:17:09.469230 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-a2eeff45-874d-4fcd-93b2-8f49e448ffef tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:09.470145 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-a2eeff45-874d-4fcd-93b2-8f49e448ffef tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:09.472038 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_api:SELECT=90 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:17:09.477844 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a2eeff45-874d-4fcd-93b2-8f49e448ffef tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:09.478326 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a2eeff45-874d-4fcd-93b2-8f49e448ffef tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:09.479137 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a2eeff45-874d-4fcd-93b2-8f49e448ffef tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:09.480440 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a2eeff45-874d-4fcd-93b2-8f49e448ffef tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:09.497442 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-b65a7467-ecb7-43c6-ab4a-2bbc9e77b28f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:09.498487 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-b65a7467-ecb7-43c6-ab4a-2bbc9e77b28f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:09.505332 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b65a7467-ecb7-43c6-ab4a-2bbc9e77b28f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:09.506210 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b65a7467-ecb7-43c6-ab4a-2bbc9e77b28f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:09.506777 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b65a7467-ecb7-43c6-ab4a-2bbc9e77b28f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:09.507299 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b65a7467-ecb7-43c6-ab4a-2bbc9e77b28f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:09.514475 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-a2eeff45-874d-4fcd-93b2-8f49e448ffef tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049521 Jun 17 13:17:09.515068 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 657/1283] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:17:09 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:17:09.527724 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-fa2d90a6-6d77-4685-bd30-9287250a8106 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:09.528659 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-fa2d90a6-6d77-4685-bd30-9287250a8106 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:09.537584 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-fa2d90a6-6d77-4685-bd30-9287250a8106 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:09.538058 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-fa2d90a6-6d77-4685-bd30-9287250a8106 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:09.538867 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-fa2d90a6-6d77-4685-bd30-9287250a8106 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:09.539307 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-fa2d90a6-6d77-4685-bd30-9287250a8106 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:09.547204 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-b65a7467-ecb7-43c6-ab4a-2bbc9e77b28f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053962 Jun 17 13:17:09.548059 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 627/1284] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:09 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:09.570710 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-fa2d90a6-6d77-4685-bd30-9287250a8106 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047656 Jun 17 13:17:09.571268 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 658/1285] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:09 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 13:17:10.528560 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-5a54b5e1-48dd-4ca0-a454-97a61e147dfc tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:10.529715 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-5a54b5e1-48dd-4ca0-a454-97a61e147dfc tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:10.538625 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5a54b5e1-48dd-4ca0-a454-97a61e147dfc tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:10.539270 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5a54b5e1-48dd-4ca0-a454-97a61e147dfc tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:10.540104 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5a54b5e1-48dd-4ca0-a454-97a61e147dfc tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:10.540641 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5a54b5e1-48dd-4ca0-a454-97a61e147dfc tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:10.560757 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-149f8a36-aa5e-4e7b-bddf-ad60aa162604 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:10.561810 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-149f8a36-aa5e-4e7b-bddf-ad60aa162604 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:10.568729 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-149f8a36-aa5e-4e7b-bddf-ad60aa162604 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:10.569219 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-149f8a36-aa5e-4e7b-bddf-ad60aa162604 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:10.570249 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-149f8a36-aa5e-4e7b-bddf-ad60aa162604 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:10.570749 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-149f8a36-aa5e-4e7b-bddf-ad60aa162604 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:10.575936 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-5a54b5e1-48dd-4ca0-a454-97a61e147dfc tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052542 Jun 17 13:17:10.577818 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 628/1286] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:17:10 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:17:10.585415 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-89234878-5c8c-4d73-8a0e-15c68a19536e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:10.586402 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-89234878-5c8c-4d73-8a0e-15c68a19536e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:10.593560 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-89234878-5c8c-4d73-8a0e-15c68a19536e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:10.594014 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-89234878-5c8c-4d73-8a0e-15c68a19536e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:10.594827 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-89234878-5c8c-4d73-8a0e-15c68a19536e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:10.595257 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-89234878-5c8c-4d73-8a0e-15c68a19536e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:10.604920 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-149f8a36-aa5e-4e7b-bddf-ad60aa162604 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048771 Jun 17 13:17:10.605507 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 659/1287] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:10 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:10.626066 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-89234878-5c8c-4d73-8a0e-15c68a19536e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045008 Jun 17 13:17:10.626648 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 629/1288] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:10 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:11.593434 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-14c9345b-6484-4d0f-8547-ba9890ac4c29 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:11.594849 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-14c9345b-6484-4d0f-8547-ba9890ac4c29 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:11.605936 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-14c9345b-6484-4d0f-8547-ba9890ac4c29 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:11.606418 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-14c9345b-6484-4d0f-8547-ba9890ac4c29 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:11.607160 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-14c9345b-6484-4d0f-8547-ba9890ac4c29 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:11.607607 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-14c9345b-6484-4d0f-8547-ba9890ac4c29 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:11.617273 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-2dbb8e45-a754-47ec-8226-c3c5ab17e7c1 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:11.618336 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-2dbb8e45-a754-47ec-8226-c3c5ab17e7c1 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:11.625513 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2dbb8e45-a754-47ec-8226-c3c5ab17e7c1 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:11.626071 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2dbb8e45-a754-47ec-8226-c3c5ab17e7c1 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:11.626916 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2dbb8e45-a754-47ec-8226-c3c5ab17e7c1 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:11.627420 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2dbb8e45-a754-47ec-8226-c3c5ab17e7c1 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:11.640098 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-14c9345b-6484-4d0f-8547-ba9890ac4c29 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054476 Jun 17 13:17:11.644296 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 660/1289] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:17:11 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:17:11.649238 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-f18a7207-7836-4609-8193-8bcbdb80442a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:11.650207 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-f18a7207-7836-4609-8193-8bcbdb80442a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:11.657221 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f18a7207-7836-4609-8193-8bcbdb80442a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:11.657677 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f18a7207-7836-4609-8193-8bcbdb80442a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:11.659476 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f18a7207-7836-4609-8193-8bcbdb80442a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:11.659921 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f18a7207-7836-4609-8193-8bcbdb80442a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:11.661754 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-2dbb8e45-a754-47ec-8226-c3c5ab17e7c1 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048378 Jun 17 13:17:11.662506 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 630/1290] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:11 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:11.690973 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-f18a7207-7836-4609-8193-8bcbdb80442a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045549 Jun 17 13:17:11.691750 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 661/1291] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:11 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:12.652586 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-c8f9bedb-a763-4e0d-b468-263e2e1ff896 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:12.653522 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-c8f9bedb-a763-4e0d-b468-263e2e1ff896 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:12.660638 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c8f9bedb-a763-4e0d-b468-263e2e1ff896 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:12.661083 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c8f9bedb-a763-4e0d-b468-263e2e1ff896 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:12.661848 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c8f9bedb-a763-4e0d-b468-263e2e1ff896 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:12.663898 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c8f9bedb-a763-4e0d-b468-263e2e1ff896 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:12.674456 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-64600ebe-b0bb-4012-b046-c363e21d6584 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:12.675439 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-64600ebe-b0bb-4012-b046-c363e21d6584 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:12.681916 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-64600ebe-b0bb-4012-b046-c363e21d6584 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:12.682613 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-64600ebe-b0bb-4012-b046-c363e21d6584 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:12.683390 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-64600ebe-b0bb-4012-b046-c363e21d6584 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:12.683876 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-64600ebe-b0bb-4012-b046-c363e21d6584 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:12.697743 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-c8f9bedb-a763-4e0d-b468-263e2e1ff896 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048395 Jun 17 13:17:12.697743 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 631/1292] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:17:12 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:17:12.707029 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-9080389b-1d8d-4ec1-9664-f6eaf53ecb8e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:12.707612 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-9080389b-1d8d-4ec1-9664-f6eaf53ecb8e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:12.722036 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9080389b-1d8d-4ec1-9664-f6eaf53ecb8e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:12.722397 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-64600ebe-b0bb-4012-b046-c363e21d6584 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045288 Jun 17 13:17:12.722521 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9080389b-1d8d-4ec1-9664-f6eaf53ecb8e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:12.722624 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 662/1293] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:12 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:12.722710 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9080389b-1d8d-4ec1-9664-f6eaf53ecb8e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:12.722710 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9080389b-1d8d-4ec1-9664-f6eaf53ecb8e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:12.751436 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-9080389b-1d8d-4ec1-9664-f6eaf53ecb8e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048485 Jun 17 13:17:12.752329 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 632/1294] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:12 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:13.713445 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-8a3ca1ed-b080-4b10-ab11-03e4da7904ee tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:13.714964 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-8a3ca1ed-b080-4b10-ab11-03e4da7904ee tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:13.725908 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8a3ca1ed-b080-4b10-ab11-03e4da7904ee tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:13.726656 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8a3ca1ed-b080-4b10-ab11-03e4da7904ee tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:13.728018 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8a3ca1ed-b080-4b10-ab11-03e4da7904ee tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:13.728631 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8a3ca1ed-b080-4b10-ab11-03e4da7904ee tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:13.730524 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-3d2bb05f-f489-4445-9ec6-633c7002518d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:13.731476 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-3d2bb05f-f489-4445-9ec6-633c7002518d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:13.738509 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3d2bb05f-f489-4445-9ec6-633c7002518d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:13.738946 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3d2bb05f-f489-4445-9ec6-633c7002518d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:13.739713 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3d2bb05f-f489-4445-9ec6-633c7002518d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:13.740131 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3d2bb05f-f489-4445-9ec6-633c7002518d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:13.761358 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-8a3ca1ed-b080-4b10-ab11-03e4da7904ee tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054084 Jun 17 13:17:13.761481 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 663/1295] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:17:13 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:17:13.769630 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-14810c39-23c8-4194-97a2-ff13952f7c7d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:13.770654 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-14810c39-23c8-4194-97a2-ff13952f7c7d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:13.783316 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-3d2bb05f-f489-4445-9ec6-633c7002518d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048771 Jun 17 13:17:13.783316 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 633/1296] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:13 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:13.783749 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-14810c39-23c8-4194-97a2-ff13952f7c7d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:13.783749 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-14810c39-23c8-4194-97a2-ff13952f7c7d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:13.783749 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-14810c39-23c8-4194-97a2-ff13952f7c7d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:13.783749 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-14810c39-23c8-4194-97a2-ff13952f7c7d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:13.811747 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-14810c39-23c8-4194-97a2-ff13952f7c7d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045821 Jun 17 13:17:13.812293 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 664/1297] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:13 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:14.777742 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-c22f218d-79d5-4f04-a051-11c07ebfd544 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:14.778742 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-c22f218d-79d5-4f04-a051-11c07ebfd544 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:14.784021 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-a27317b8-056a-4825-a28b-eb2cf9f28d1d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:14.784991 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-a27317b8-056a-4825-a28b-eb2cf9f28d1d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:14.785857 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c22f218d-79d5-4f04-a051-11c07ebfd544 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:14.786676 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c22f218d-79d5-4f04-a051-11c07ebfd544 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:14.787174 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c22f218d-79d5-4f04-a051-11c07ebfd544 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:14.787908 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c22f218d-79d5-4f04-a051-11c07ebfd544 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:14.791835 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a27317b8-056a-4825-a28b-eb2cf9f28d1d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:14.792255 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a27317b8-056a-4825-a28b-eb2cf9f28d1d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:14.793315 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a27317b8-056a-4825-a28b-eb2cf9f28d1d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:14.793877 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a27317b8-056a-4825-a28b-eb2cf9f28d1d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:14.820989 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-c22f218d-79d5-4f04-a051-11c07ebfd544 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050303 Jun 17 13:17:14.821866 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 634/1298] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:17:14 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:17:14.826433 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-226d8e5f-b2f6-401f-95ae-5a326ae68748 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:14.827353 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-226d8e5f-b2f6-401f-95ae-5a326ae68748 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:14.830112 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-a27317b8-056a-4825-a28b-eb2cf9f28d1d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050205 Jun 17 13:17:14.830725 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 665/1299] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:14 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:14.833681 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-226d8e5f-b2f6-401f-95ae-5a326ae68748 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:14.834154 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-226d8e5f-b2f6-401f-95ae-5a326ae68748 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:14.834926 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-226d8e5f-b2f6-401f-95ae-5a326ae68748 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:14.835428 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-226d8e5f-b2f6-401f-95ae-5a326ae68748 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:14.866261 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-226d8e5f-b2f6-401f-95ae-5a326ae68748 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043580 Jun 17 13:17:14.866799 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 635/1300] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:14 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:15.833533 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-a3c709ff-58a1-4dba-b353-ff53db63ac55 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:15.834601 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-a3c709ff-58a1-4dba-b353-ff53db63ac55 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:15.841400 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-e58abe9c-d8fa-4f35-90ec-1ab088665d8a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:15.841909 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a3c709ff-58a1-4dba-b353-ff53db63ac55 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:15.842230 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a3c709ff-58a1-4dba-b353-ff53db63ac55 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:15.842359 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-e58abe9c-d8fa-4f35-90ec-1ab088665d8a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:15.842986 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a3c709ff-58a1-4dba-b353-ff53db63ac55 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:15.843414 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a3c709ff-58a1-4dba-b353-ff53db63ac55 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:15.849632 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e58abe9c-d8fa-4f35-90ec-1ab088665d8a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:15.849632 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e58abe9c-d8fa-4f35-90ec-1ab088665d8a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:15.850270 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e58abe9c-d8fa-4f35-90ec-1ab088665d8a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:15.850701 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e58abe9c-d8fa-4f35-90ec-1ab088665d8a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:15.873763 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-a3c709ff-58a1-4dba-b353-ff53db63ac55 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044423 Jun 17 13:17:15.877770 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 666/1301] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:17:15 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:17:15.879654 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-ecaf091f-b0f5-4387-bc37-fbd3c6de9faa tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:15.880057 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-ecaf091f-b0f5-4387-bc37-fbd3c6de9faa tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:15.884262 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-e58abe9c-d8fa-4f35-90ec-1ab088665d8a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047116 Jun 17 13:17:15.884960 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 636/1302] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:15 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 13:17:15.886340 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ecaf091f-b0f5-4387-bc37-fbd3c6de9faa tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:15.886957 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ecaf091f-b0f5-4387-bc37-fbd3c6de9faa tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:15.887723 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ecaf091f-b0f5-4387-bc37-fbd3c6de9faa tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:15.888166 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ecaf091f-b0f5-4387-bc37-fbd3c6de9faa tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:15.917480 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-ecaf091f-b0f5-4387-bc37-fbd3c6de9faa tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041967 Jun 17 13:17:15.918247 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 667/1303] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:15 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:16.890918 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-72e37366-80c5-4026-ba85-c016833a0321 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:16.892474 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-72e37366-80c5-4026-ba85-c016833a0321 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:16.900415 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-d5e0d5a3-e113-4d16-9359-50d40917640a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:16.902012 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-d5e0d5a3-e113-4d16-9359-50d40917640a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:16.903720 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-72e37366-80c5-4026-ba85-c016833a0321 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:16.904184 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-72e37366-80c5-4026-ba85-c016833a0321 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:16.905009 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-72e37366-80c5-4026-ba85-c016833a0321 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:16.905445 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-72e37366-80c5-4026-ba85-c016833a0321 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:16.908832 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d5e0d5a3-e113-4d16-9359-50d40917640a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:16.909294 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d5e0d5a3-e113-4d16-9359-50d40917640a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:16.910059 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d5e0d5a3-e113-4d16-9359-50d40917640a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:16.910536 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d5e0d5a3-e113-4d16-9359-50d40917640a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:16.941743 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-72e37366-80c5-4026-ba85-c016833a0321 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.058494 Jun 17 13:17:16.945914 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 637/1304] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:17:16 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:17:16.946060 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-d5e0d5a3-e113-4d16-9359-50d40917640a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049122 Jun 17 13:17:16.946060 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 668/1305] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:16 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:16.951187 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-4ddb06a2-4586-4f32-906f-7a2c204eab05 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:16.952148 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-4ddb06a2-4586-4f32-906f-7a2c204eab05 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:16.958301 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4ddb06a2-4586-4f32-906f-7a2c204eab05 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:16.958761 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4ddb06a2-4586-4f32-906f-7a2c204eab05 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:16.959498 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4ddb06a2-4586-4f32-906f-7a2c204eab05 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:16.959948 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4ddb06a2-4586-4f32-906f-7a2c204eab05 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:16.990402 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-4ddb06a2-4586-4f32-906f-7a2c204eab05 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046836 Jun 17 13:17:16.990936 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 638/1306] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:16 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:17.955539 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-7e3f628c-57e5-4d4a-9268-29f3b2515d59 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:17.956217 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-63f6602c-f9a5-418a-8f0e-f7aff0076c25 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:17.956678 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-7e3f628c-57e5-4d4a-9268-29f3b2515d59 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:17.956798 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-63f6602c-f9a5-418a-8f0e-f7aff0076c25 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:17.964021 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7e3f628c-57e5-4d4a-9268-29f3b2515d59 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:17.964207 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-63f6602c-f9a5-418a-8f0e-f7aff0076c25 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:17.964539 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7e3f628c-57e5-4d4a-9268-29f3b2515d59 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:17.964713 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-63f6602c-f9a5-418a-8f0e-f7aff0076c25 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:17.965430 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-63f6602c-f9a5-418a-8f0e-f7aff0076c25 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:17.965895 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-63f6602c-f9a5-418a-8f0e-f7aff0076c25 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:17.966041 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7e3f628c-57e5-4d4a-9268-29f3b2515d59 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:17.966496 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7e3f628c-57e5-4d4a-9268-29f3b2515d59 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:18.000383 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-63f6602c-f9a5-418a-8f0e-f7aff0076c25 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048971 Jun 17 13:17:18.001335 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 639/1307] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:17 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:18.003259 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-7e3f628c-57e5-4d4a-9268-29f3b2515d59 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052200 Jun 17 13:17:18.004063 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 669/1308] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:17:17 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:17:18.005557 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-16b13dd3-7dee-415a-a96e-e4e1dacc3caf tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:18.006527 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-16b13dd3-7dee-415a-a96e-e4e1dacc3caf tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:18.013322 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-16b13dd3-7dee-415a-a96e-e4e1dacc3caf tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:18.013767 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-16b13dd3-7dee-415a-a96e-e4e1dacc3caf tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:18.014568 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-16b13dd3-7dee-415a-a96e-e4e1dacc3caf tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:18.015004 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-16b13dd3-7dee-415a-a96e-e4e1dacc3caf tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:18.045642 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-16b13dd3-7dee-415a-a96e-e4e1dacc3caf tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043542 Jun 17 13:17:18.046577 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 640/1309] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:18 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:18.835570 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 13:17:18.835936 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Fri Jun 17 13:17:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 17 13:17:19.017475 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-ac799074-9463-442e-b67a-485826fb0350 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:19.019064 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-ac799074-9463-442e-b67a-485826fb0350 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:19.020673 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-ca3e4f37-053c-4131-a2ca-32dd2f3c4fcf tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:19.022175 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-ca3e4f37-053c-4131-a2ca-32dd2f3c4fcf tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:19.029466 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ac799074-9463-442e-b67a-485826fb0350 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:19.029913 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ac799074-9463-442e-b67a-485826fb0350 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:19.030711 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ac799074-9463-442e-b67a-485826fb0350 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:19.031137 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ac799074-9463-442e-b67a-485826fb0350 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:19.031300 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ca3e4f37-053c-4131-a2ca-32dd2f3c4fcf tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:19.031704 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ca3e4f37-053c-4131-a2ca-32dd2f3c4fcf tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:19.032474 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ca3e4f37-053c-4131-a2ca-32dd2f3c4fcf tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:19.032903 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ca3e4f37-053c-4131-a2ca-32dd2f3c4fcf tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:19.038535 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=100 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:17:19.063991 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-ac799074-9463-442e-b67a-485826fb0350 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053943 Jun 17 13:17:19.064528 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 670/1310] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:19 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:19.065943 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-ca3e4f37-053c-4131-a2ca-32dd2f3c4fcf tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052606 Jun 17 13:17:19.066824 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 641/1311] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:17:19 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:17:19.073456 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-7d49b678-139f-496d-8975-fe599d15c1c0 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:19.074461 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-7d49b678-139f-496d-8975-fe599d15c1c0 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:19.080549 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7d49b678-139f-496d-8975-fe599d15c1c0 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:19.081005 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7d49b678-139f-496d-8975-fe599d15c1c0 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:19.081766 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7d49b678-139f-496d-8975-fe599d15c1c0 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:19.082187 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7d49b678-139f-496d-8975-fe599d15c1c0 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:19.109067 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_cell1:SELECT=100 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:17:19.114406 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-7d49b678-139f-496d-8975-fe599d15c1c0 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048387 Jun 17 13:17:19.115178 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 671/1312] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:19 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:20.076386 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-ca096cd2-f8e5-4e9a-9fa7-3bf5f5b68245 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:20.077418 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-ca096cd2-f8e5-4e9a-9fa7-3bf5f5b68245 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:20.077688 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-53594cda-8458-433d-a1a7-070bf18ad8fd tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:20.078639 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-53594cda-8458-433d-a1a7-070bf18ad8fd tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:20.084183 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ca096cd2-f8e5-4e9a-9fa7-3bf5f5b68245 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:20.084675 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ca096cd2-f8e5-4e9a-9fa7-3bf5f5b68245 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:20.085458 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-53594cda-8458-433d-a1a7-070bf18ad8fd tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:20.085608 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ca096cd2-f8e5-4e9a-9fa7-3bf5f5b68245 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:20.085991 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ca096cd2-f8e5-4e9a-9fa7-3bf5f5b68245 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:20.086253 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-53594cda-8458-433d-a1a7-070bf18ad8fd tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:20.087003 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-53594cda-8458-433d-a1a7-070bf18ad8fd tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:20.087440 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-53594cda-8458-433d-a1a7-070bf18ad8fd tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:20.116872 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-ca096cd2-f8e5-4e9a-9fa7-3bf5f5b68245 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044540 Jun 17 13:17:20.117640 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 642/1313] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:20 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:20.118236 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-53594cda-8458-433d-a1a7-070bf18ad8fd tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044748 Jun 17 13:17:20.118949 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 672/1314] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:17:20 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:17:20.126140 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-a009ac16-646c-43fb-a6f2-5cfdff17b374 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:20.127073 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-a009ac16-646c-43fb-a6f2-5cfdff17b374 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:20.133221 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a009ac16-646c-43fb-a6f2-5cfdff17b374 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:20.133704 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a009ac16-646c-43fb-a6f2-5cfdff17b374 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:20.134440 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a009ac16-646c-43fb-a6f2-5cfdff17b374 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:20.134876 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a009ac16-646c-43fb-a6f2-5cfdff17b374 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:20.164336 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-a009ac16-646c-43fb-a6f2-5cfdff17b374 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042006 Jun 17 13:17:20.165176 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 643/1315] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:20 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:21.133276 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-24e1fdc9-8ee7-4f34-aade-a7f46c59a7b8 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:21.134771 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-09e44ad3-3418-411a-baae-dcb2a9ba53b8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:21.135465 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-24e1fdc9-8ee7-4f34-aade-a7f46c59a7b8 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:21.136230 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-09e44ad3-3418-411a-baae-dcb2a9ba53b8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:21.145924 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-24e1fdc9-8ee7-4f34-aade-a7f46c59a7b8 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:21.146807 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-24e1fdc9-8ee7-4f34-aade-a7f46c59a7b8 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:21.147506 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-09e44ad3-3418-411a-baae-dcb2a9ba53b8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:21.148249 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-09e44ad3-3418-411a-baae-dcb2a9ba53b8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:21.148553 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-24e1fdc9-8ee7-4f34-aade-a7f46c59a7b8 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:21.149021 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-24e1fdc9-8ee7-4f34-aade-a7f46c59a7b8 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:21.149566 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-09e44ad3-3418-411a-baae-dcb2a9ba53b8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:21.150317 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-09e44ad3-3418-411a-baae-dcb2a9ba53b8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:21.185122 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-24e1fdc9-8ee7-4f34-aade-a7f46c59a7b8 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059029 Jun 17 13:17:21.185766 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-09e44ad3-3418-411a-baae-dcb2a9ba53b8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.058262 Jun 17 13:17:21.189719 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 644/1316] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:17:21 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:17:21.189889 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 673/1317] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:21 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:21.191964 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-0e62929e-dc94-4790-8488-69acbb5b2a36 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:21.192926 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-0e62929e-dc94-4790-8488-69acbb5b2a36 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:21.199000 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0e62929e-dc94-4790-8488-69acbb5b2a36 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:21.199450 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0e62929e-dc94-4790-8488-69acbb5b2a36 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:21.200232 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0e62929e-dc94-4790-8488-69acbb5b2a36 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:21.200661 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0e62929e-dc94-4790-8488-69acbb5b2a36 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:21.230404 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-0e62929e-dc94-4790-8488-69acbb5b2a36 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042352 Jun 17 13:17:21.231172 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 645/1318] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:21 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:22.200026 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-558d38fc-7a32-4373-9303-8a39e5e7a333 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:22.200757 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-a12de8f7-295d-455c-8f6a-2524433d0bcd tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:22.201419 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-558d38fc-7a32-4373-9303-8a39e5e7a333 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:22.202156 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-a12de8f7-295d-455c-8f6a-2524433d0bcd tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:22.211707 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-558d38fc-7a32-4373-9303-8a39e5e7a333 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:22.211971 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a12de8f7-295d-455c-8f6a-2524433d0bcd tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:22.212382 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-558d38fc-7a32-4373-9303-8a39e5e7a333 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:22.212641 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a12de8f7-295d-455c-8f6a-2524433d0bcd tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:22.213493 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-558d38fc-7a32-4373-9303-8a39e5e7a333 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:22.213710 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a12de8f7-295d-455c-8f6a-2524433d0bcd tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:22.214155 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-558d38fc-7a32-4373-9303-8a39e5e7a333 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:22.214397 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a12de8f7-295d-455c-8f6a-2524433d0bcd tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:22.244977 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-558d38fc-7a32-4373-9303-8a39e5e7a333 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050837 Jun 17 13:17:22.248844 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 674/1319] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:22 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:22.249438 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-a12de8f7-295d-455c-8f6a-2524433d0bcd tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055234 Jun 17 13:17:22.249991 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 646/1320] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:17:22 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:17:22.253690 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-dbae0ec7-b84f-4c4d-997a-dbe00ccda40a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:22.254494 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-dbae0ec7-b84f-4c4d-997a-dbe00ccda40a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:22.260687 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-dbae0ec7-b84f-4c4d-997a-dbe00ccda40a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:22.261139 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-dbae0ec7-b84f-4c4d-997a-dbe00ccda40a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:22.262232 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-dbae0ec7-b84f-4c4d-997a-dbe00ccda40a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:22.262739 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-dbae0ec7-b84f-4c4d-997a-dbe00ccda40a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:22.298626 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-dbae0ec7-b84f-4c4d-997a-dbe00ccda40a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048659 Jun 17 13:17:22.299214 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 675/1321] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:22 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:23.261062 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-fd0cc401-f89e-492a-ab37-214b55784039 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:23.262586 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-fd0cc401-f89e-492a-ab37-214b55784039 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:23.264254 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-eda37fe9-98a8-4fcd-8f91-65527b5a38ee tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:23.265166 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-eda37fe9-98a8-4fcd-8f91-65527b5a38ee tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:23.269531 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fd0cc401-f89e-492a-ab37-214b55784039 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:23.269981 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fd0cc401-f89e-492a-ab37-214b55784039 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:23.270801 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fd0cc401-f89e-492a-ab37-214b55784039 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:23.271234 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fd0cc401-f89e-492a-ab37-214b55784039 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:23.271821 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-eda37fe9-98a8-4fcd-8f91-65527b5a38ee tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:23.272266 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-eda37fe9-98a8-4fcd-8f91-65527b5a38ee tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:23.273016 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-eda37fe9-98a8-4fcd-8f91-65527b5a38ee tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:23.273458 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-eda37fe9-98a8-4fcd-8f91-65527b5a38ee tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:23.304097 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-fd0cc401-f89e-492a-ab37-214b55784039 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049860 Jun 17 13:17:23.304360 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-eda37fe9-98a8-4fcd-8f91-65527b5a38ee tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045837 Jun 17 13:17:23.305126 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 647/1322] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:23 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:23.308675 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 676/1323] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:17:23 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:17:23.311064 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-8eddb580-2ed1-4d1f-a34d-d89e6a041587 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:23.312056 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-8eddb580-2ed1-4d1f-a34d-d89e6a041587 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:23.318520 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8eddb580-2ed1-4d1f-a34d-d89e6a041587 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:23.318967 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8eddb580-2ed1-4d1f-a34d-d89e6a041587 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:23.319736 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8eddb580-2ed1-4d1f-a34d-d89e6a041587 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:23.320167 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8eddb580-2ed1-4d1f-a34d-d89e6a041587 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:23.349713 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-8eddb580-2ed1-4d1f-a34d-d89e6a041587 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042391 Jun 17 13:17:23.350296 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 648/1324] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:23 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:24.317650 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-8de54665-554b-4d04-ab22-5723c1976dea tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:24.318351 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-dc33ee12-2391-4253-a05a-17e1158da7f9 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:24.318771 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-dc33ee12-2391-4253-a05a-17e1158da7f9 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:24.318914 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-8de54665-554b-4d04-ab22-5723c1976dea tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:24.326856 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-dc33ee12-2391-4253-a05a-17e1158da7f9 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:24.327051 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8de54665-554b-4d04-ab22-5723c1976dea tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:24.327380 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-dc33ee12-2391-4253-a05a-17e1158da7f9 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:24.327586 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8de54665-554b-4d04-ab22-5723c1976dea tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:24.328274 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-dc33ee12-2391-4253-a05a-17e1158da7f9 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:24.328448 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8de54665-554b-4d04-ab22-5723c1976dea tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:24.328791 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-dc33ee12-2391-4253-a05a-17e1158da7f9 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:24.328964 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8de54665-554b-4d04-ab22-5723c1976dea tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:24.362971 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-8de54665-554b-4d04-ab22-5723c1976dea tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049965 Jun 17 13:17:24.363543 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 649/1325] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:17:24 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:17:24.364762 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-dc33ee12-2391-4253-a05a-17e1158da7f9 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051867 Jun 17 13:17:24.365334 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 677/1326] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:24 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:24.370234 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-79e8611e-caec-4dd3-b8af-1e8500a5bb45 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:24.371145 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-79e8611e-caec-4dd3-b8af-1e8500a5bb45 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:24.377075 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-79e8611e-caec-4dd3-b8af-1e8500a5bb45 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:24.377520 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-79e8611e-caec-4dd3-b8af-1e8500a5bb45 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:24.378322 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-79e8611e-caec-4dd3-b8af-1e8500a5bb45 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:24.378748 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-79e8611e-caec-4dd3-b8af-1e8500a5bb45 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:24.410158 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-79e8611e-caec-4dd3-b8af-1e8500a5bb45 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043765 Jun 17 13:17:24.410965 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 650/1327] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:24 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:25.379317 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-c0bc6eab-ffeb-4bf5-80c5-890bf608fdb3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:25.380595 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-ab0cdde9-7629-4d57-be4a-fe2d14229b22 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:25.381241 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-c0bc6eab-ffeb-4bf5-80c5-890bf608fdb3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:25.382155 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-ab0cdde9-7629-4d57-be4a-fe2d14229b22 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:25.391603 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ab0cdde9-7629-4d57-be4a-fe2d14229b22 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:25.391810 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c0bc6eab-ffeb-4bf5-80c5-890bf608fdb3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:25.392001 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ab0cdde9-7629-4d57-be4a-fe2d14229b22 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:25.392170 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c0bc6eab-ffeb-4bf5-80c5-890bf608fdb3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:25.392976 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c0bc6eab-ffeb-4bf5-80c5-890bf608fdb3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:25.393131 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ab0cdde9-7629-4d57-be4a-fe2d14229b22 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:25.393463 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c0bc6eab-ffeb-4bf5-80c5-890bf608fdb3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:25.393607 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ab0cdde9-7629-4d57-be4a-fe2d14229b22 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:25.425356 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-c0bc6eab-ffeb-4bf5-80c5-890bf608fdb3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053558 Jun 17 13:17:25.426142 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 678/1328] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:17:25 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:17:25.427368 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-ab0cdde9-7629-4d57-be4a-fe2d14229b22 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053682 Jun 17 13:17:25.428213 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 651/1329] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:25 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:25.434991 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-2db1ab3f-7781-42fc-9917-bb174c3ebaef tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:25.435992 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-2db1ab3f-7781-42fc-9917-bb174c3ebaef tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:25.443674 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2db1ab3f-7781-42fc-9917-bb174c3ebaef tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:25.443674 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2db1ab3f-7781-42fc-9917-bb174c3ebaef tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:25.443674 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2db1ab3f-7781-42fc-9917-bb174c3ebaef tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:25.444013 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2db1ab3f-7781-42fc-9917-bb174c3ebaef tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:25.474045 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-2db1ab3f-7781-42fc-9917-bb174c3ebaef tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043712 Jun 17 13:17:25.474632 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 679/1330] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:25 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:26.437837 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-ebc6ebb0-6e89-4ccf-936d-b01f0d47561f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:26.438782 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-ebc6ebb0-6e89-4ccf-936d-b01f0d47561f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:26.439383 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-082aca94-38b7-4593-a47f-1965858dedac tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:26.440389 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-082aca94-38b7-4593-a47f-1965858dedac tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:26.445923 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ebc6ebb0-6e89-4ccf-936d-b01f0d47561f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:26.446399 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ebc6ebb0-6e89-4ccf-936d-b01f0d47561f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:26.447167 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ebc6ebb0-6e89-4ccf-936d-b01f0d47561f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:26.447377 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-082aca94-38b7-4593-a47f-1965858dedac tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:26.447606 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ebc6ebb0-6e89-4ccf-936d-b01f0d47561f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:26.447872 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-082aca94-38b7-4593-a47f-1965858dedac tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:26.448699 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-082aca94-38b7-4593-a47f-1965858dedac tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:26.449132 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-082aca94-38b7-4593-a47f-1965858dedac tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:26.480967 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-082aca94-38b7-4593-a47f-1965858dedac tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045792 Jun 17 13:17:26.481204 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-ebc6ebb0-6e89-4ccf-936d-b01f0d47561f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047348 Jun 17 13:17:26.485652 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 680/1331] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:26 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:26.485807 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 652/1332] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:17:26 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:17:26.487839 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-d7caf668-ff23-45f7-a855-2fd35b14917b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:26.488766 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-d7caf668-ff23-45f7-a855-2fd35b14917b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:26.494892 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d7caf668-ff23-45f7-a855-2fd35b14917b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:26.495312 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d7caf668-ff23-45f7-a855-2fd35b14917b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:26.496092 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d7caf668-ff23-45f7-a855-2fd35b14917b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:26.496535 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d7caf668-ff23-45f7-a855-2fd35b14917b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:26.528143 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-d7caf668-ff23-45f7-a855-2fd35b14917b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045450 Jun 17 13:17:26.528704 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 681/1333] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:26 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:27.493288 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-154d5f1d-f2cd-475b-9e48-74be3804f514 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:27.493906 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-118b190f-cee0-4fa8-998b-b0b093c7f7a0 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:27.494319 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-154d5f1d-f2cd-475b-9e48-74be3804f514 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:27.494417 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-118b190f-cee0-4fa8-998b-b0b093c7f7a0 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:27.501262 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-118b190f-cee0-4fa8-998b-b0b093c7f7a0 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:27.501710 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-118b190f-cee0-4fa8-998b-b0b093c7f7a0 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:27.502053 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-154d5f1d-f2cd-475b-9e48-74be3804f514 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:27.502517 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-118b190f-cee0-4fa8-998b-b0b093c7f7a0 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:27.502662 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-154d5f1d-f2cd-475b-9e48-74be3804f514 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:27.502953 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-118b190f-cee0-4fa8-998b-b0b093c7f7a0 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:27.503293 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-154d5f1d-f2cd-475b-9e48-74be3804f514 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:27.503729 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-154d5f1d-f2cd-475b-9e48-74be3804f514 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:27.533732 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-118b190f-cee0-4fa8-998b-b0b093c7f7a0 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044495 Jun 17 13:17:27.535773 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-154d5f1d-f2cd-475b-9e48-74be3804f514 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046431 Jun 17 13:17:27.536633 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 653/1334] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:27 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 13:17:27.536777 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 682/1335] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:17:27 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 17 13:17:27.541258 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-8f7f565f-f82d-4954-a7e1-1e6025705f40 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:27.542211 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-8f7f565f-f82d-4954-a7e1-1e6025705f40 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:27.548888 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8f7f565f-f82d-4954-a7e1-1e6025705f40 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:27.549333 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8f7f565f-f82d-4954-a7e1-1e6025705f40 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:27.550127 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8f7f565f-f82d-4954-a7e1-1e6025705f40 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:27.550556 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8f7f565f-f82d-4954-a7e1-1e6025705f40 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:27.582532 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-8f7f565f-f82d-4954-a7e1-1e6025705f40 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044936 Jun 17 13:17:27.583093 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 654/1336] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:27 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:28.547339 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-85cb0fe1-90e5-422d-9186-c09b408900cd tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:28.547927 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-37c1babf-3150-479b-8687-1c62b0e4eb0d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:28.548482 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-85cb0fe1-90e5-422d-9186-c09b408900cd tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:28.548629 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-37c1babf-3150-479b-8687-1c62b0e4eb0d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:28.555379 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-37c1babf-3150-479b-8687-1c62b0e4eb0d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:28.555821 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-37c1babf-3150-479b-8687-1c62b0e4eb0d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:28.555965 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-85cb0fe1-90e5-422d-9186-c09b408900cd tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:28.556313 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-85cb0fe1-90e5-422d-9186-c09b408900cd tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:28.556597 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-37c1babf-3150-479b-8687-1c62b0e4eb0d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:28.557029 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-37c1babf-3150-479b-8687-1c62b0e4eb0d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:28.557193 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-85cb0fe1-90e5-422d-9186-c09b408900cd tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:28.557584 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-85cb0fe1-90e5-422d-9186-c09b408900cd tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:28.591283 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-37c1babf-3150-479b-8687-1c62b0e4eb0d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047729 Jun 17 13:17:28.591949 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 655/1337] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:17:28 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:17:28.594147 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-85cb0fe1-90e5-422d-9186-c09b408900cd tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050849 Jun 17 13:17:28.597673 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 683/1338] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:28 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:28.600390 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-7bed6eaa-0d0f-4cc0-82d2-4fecfae6a629 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:28.601483 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-7bed6eaa-0d0f-4cc0-82d2-4fecfae6a629 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:28.607609 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7bed6eaa-0d0f-4cc0-82d2-4fecfae6a629 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:28.608520 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7bed6eaa-0d0f-4cc0-82d2-4fecfae6a629 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:28.609172 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7bed6eaa-0d0f-4cc0-82d2-4fecfae6a629 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:28.609631 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7bed6eaa-0d0f-4cc0-82d2-4fecfae6a629 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:28.639685 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-7bed6eaa-0d0f-4cc0-82d2-4fecfae6a629 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043772 Jun 17 13:17:28.642045 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 656/1339] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:28 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:29.586825 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 13:17:29.587666 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Fri Jun 17 13:17:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 17 13:17:29.607400 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-51932fb8-b491-4dc8-9d7e-ee34db6bb174 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:29.609301 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-51932fb8-b491-4dc8-9d7e-ee34db6bb174 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:29.610588 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-c0bcc62b-30d7-4a84-b588-ca76cce7580d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:29.611907 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-c0bcc62b-30d7-4a84-b588-ca76cce7580d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:29.616555 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-51932fb8-b491-4dc8-9d7e-ee34db6bb174 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:29.616978 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-51932fb8-b491-4dc8-9d7e-ee34db6bb174 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:29.617741 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-51932fb8-b491-4dc8-9d7e-ee34db6bb174 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:29.618194 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-51932fb8-b491-4dc8-9d7e-ee34db6bb174 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:29.618769 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c0bcc62b-30d7-4a84-b588-ca76cce7580d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:29.619208 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c0bcc62b-30d7-4a84-b588-ca76cce7580d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:29.619976 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c0bcc62b-30d7-4a84-b588-ca76cce7580d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:29.620414 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c0bcc62b-30d7-4a84-b588-ca76cce7580d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:29.645682 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=100 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:17:29.649517 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-51932fb8-b491-4dc8-9d7e-ee34db6bb174 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049175 Jun 17 13:17:29.650075 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 684/1340] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:17:29 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:17:29.654458 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-c0bcc62b-30d7-4a84-b588-ca76cce7580d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050847 Jun 17 13:17:29.654588 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-83d4e1de-bbba-4eb2-b26a-0c475ea80ba3 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:29.658353 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 657/1341] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:29 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 13:17:29.658541 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-83d4e1de-bbba-4eb2-b26a-0c475ea80ba3 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:29.662053 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-83d4e1de-bbba-4eb2-b26a-0c475ea80ba3 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:29.662513 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-83d4e1de-bbba-4eb2-b26a-0c475ea80ba3 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:29.663462 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-83d4e1de-bbba-4eb2-b26a-0c475ea80ba3 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:29.664158 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-83d4e1de-bbba-4eb2-b26a-0c475ea80ba3 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:29.695878 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-83d4e1de-bbba-4eb2-b26a-0c475ea80ba3 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044832 Jun 17 13:17:29.696533 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 685/1342] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:29 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:30.662023 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-ab544567-5c8c-4e46-9d85-49b14f2aba93 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:30.663233 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-ab544567-5c8c-4e46-9d85-49b14f2aba93 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:30.666222 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-975844f3-a956-4e20-9f6d-4527e7bd9d9f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:30.667161 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-975844f3-a956-4e20-9f6d-4527e7bd9d9f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:30.670667 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ab544567-5c8c-4e46-9d85-49b14f2aba93 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:30.671167 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ab544567-5c8c-4e46-9d85-49b14f2aba93 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:30.672039 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ab544567-5c8c-4e46-9d85-49b14f2aba93 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:30.672470 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ab544567-5c8c-4e46-9d85-49b14f2aba93 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:30.674131 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-975844f3-a956-4e20-9f6d-4527e7bd9d9f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:30.674590 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-975844f3-a956-4e20-9f6d-4527e7bd9d9f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:30.675354 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-975844f3-a956-4e20-9f6d-4527e7bd9d9f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:30.675812 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-975844f3-a956-4e20-9f6d-4527e7bd9d9f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:30.703743 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-ab544567-5c8c-4e46-9d85-49b14f2aba93 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046320 Jun 17 13:17:30.704357 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 658/1343] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:17:30 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:17:30.708927 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-975844f3-a956-4e20-9f6d-4527e7bd9d9f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046592 Jun 17 13:17:30.712762 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-45f3c5ad-881e-4dbf-855d-14b1982d4bb6 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:30.713482 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 686/1344] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:30 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:30.713612 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-45f3c5ad-881e-4dbf-855d-14b1982d4bb6 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:30.717417 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-45f3c5ad-881e-4dbf-855d-14b1982d4bb6 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:30.717871 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-45f3c5ad-881e-4dbf-855d-14b1982d4bb6 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:30.718689 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-45f3c5ad-881e-4dbf-855d-14b1982d4bb6 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:30.719127 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-45f3c5ad-881e-4dbf-855d-14b1982d4bb6 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:30.750049 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-45f3c5ad-881e-4dbf-855d-14b1982d4bb6 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044659 Jun 17 13:17:30.750632 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 659/1345] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:30 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:31.717027 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-0a4012fa-dd60-4eda-9f28-78e4801acaf5 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:31.718121 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-0a4012fa-dd60-4eda-9f28-78e4801acaf5 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:31.721290 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-29865b07-a519-442d-b79d-70feaad376c7 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:31.722408 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-29865b07-a519-442d-b79d-70feaad376c7 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:31.726240 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0a4012fa-dd60-4eda-9f28-78e4801acaf5 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:31.726770 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0a4012fa-dd60-4eda-9f28-78e4801acaf5 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:31.727666 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0a4012fa-dd60-4eda-9f28-78e4801acaf5 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:31.728173 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0a4012fa-dd60-4eda-9f28-78e4801acaf5 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:31.730066 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-29865b07-a519-442d-b79d-70feaad376c7 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:31.730608 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-29865b07-a519-442d-b79d-70feaad376c7 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:31.731487 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-29865b07-a519-442d-b79d-70feaad376c7 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:31.731985 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-29865b07-a519-442d-b79d-70feaad376c7 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:31.760252 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-0a4012fa-dd60-4eda-9f28-78e4801acaf5 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048010 Jun 17 13:17:31.760803 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 687/1346] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:17:31 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:17:31.762138 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-29865b07-a519-442d-b79d-70feaad376c7 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045300 Jun 17 13:17:31.765805 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 660/1347] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:31 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:31.765964 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-5a45df2a-2c09-48c7-a1e7-23aa2a0bc468 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:31.766664 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-5a45df2a-2c09-48c7-a1e7-23aa2a0bc468 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:31.773066 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-5a45df2a-2c09-48c7-a1e7-23aa2a0bc468 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:31.773515 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-5a45df2a-2c09-48c7-a1e7-23aa2a0bc468 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:31.774309 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-5a45df2a-2c09-48c7-a1e7-23aa2a0bc468 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:31.774741 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-5a45df2a-2c09-48c7-a1e7-23aa2a0bc468 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:31.791879 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_cell1:SELECT=100 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:17:31.805672 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-5a45df2a-2c09-48c7-a1e7-23aa2a0bc468 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043830 Jun 17 13:17:31.806264 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 688/1348] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:31 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:32.774687 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-7901d8cd-fc97-42dd-8057-df481b800b43 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:32.775645 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-86909335-ceca-49a9-b6ba-f6ebebeb9bae tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:32.776219 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-7901d8cd-fc97-42dd-8057-df481b800b43 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:32.776853 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-86909335-ceca-49a9-b6ba-f6ebebeb9bae tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:32.778855 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_api:SELECT=88 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:17:32.787447 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-86909335-ceca-49a9-b6ba-f6ebebeb9bae tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:32.787899 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-86909335-ceca-49a9-b6ba-f6ebebeb9bae tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:32.788374 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7901d8cd-fc97-42dd-8057-df481b800b43 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:32.788675 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-86909335-ceca-49a9-b6ba-f6ebebeb9bae tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:32.788864 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7901d8cd-fc97-42dd-8057-df481b800b43 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:32.789117 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-86909335-ceca-49a9-b6ba-f6ebebeb9bae tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:32.789632 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7901d8cd-fc97-42dd-8057-df481b800b43 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:32.790064 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7901d8cd-fc97-42dd-8057-df481b800b43 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:32.819802 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-86909335-ceca-49a9-b6ba-f6ebebeb9bae tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049549 Jun 17 13:17:32.820388 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 689/1349] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:32 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:32.820703 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-7901d8cd-fc97-42dd-8057-df481b800b43 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051632 Jun 17 13:17:32.823146 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 661/1350] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:17:32 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:17:32.825570 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-d2aa58fb-8af4-4675-ac4d-6c7ea85484f8 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:32.826547 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-d2aa58fb-8af4-4675-ac4d-6c7ea85484f8 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:32.833412 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d2aa58fb-8af4-4675-ac4d-6c7ea85484f8 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:32.833997 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d2aa58fb-8af4-4675-ac4d-6c7ea85484f8 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:32.834895 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d2aa58fb-8af4-4675-ac4d-6c7ea85484f8 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:32.835368 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d2aa58fb-8af4-4675-ac4d-6c7ea85484f8 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:32.866540 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-d2aa58fb-8af4-4675-ac4d-6c7ea85484f8 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045091 Jun 17 13:17:32.867144 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 690/1351] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:32 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:33.834743 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-ad916dfb-8258-4925-acf9-856c4d74b127 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:33.835399 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-dfd69ba1-ef74-4ee8-849e-94d0e0a5ed73 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:33.835771 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-ad916dfb-8258-4925-acf9-856c4d74b127 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:33.836099 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-dfd69ba1-ef74-4ee8-849e-94d0e0a5ed73 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:33.842558 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ad916dfb-8258-4925-acf9-856c4d74b127 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:33.843002 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ad916dfb-8258-4925-acf9-856c4d74b127 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:33.843238 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dfd69ba1-ef74-4ee8-849e-94d0e0a5ed73 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:33.843763 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ad916dfb-8258-4925-acf9-856c4d74b127 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:33.843912 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dfd69ba1-ef74-4ee8-849e-94d0e0a5ed73 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:33.844199 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ad916dfb-8258-4925-acf9-856c4d74b127 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:33.844576 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dfd69ba1-ef74-4ee8-849e-94d0e0a5ed73 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:33.844985 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dfd69ba1-ef74-4ee8-849e-94d0e0a5ed73 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:33.874625 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-ad916dfb-8258-4925-acf9-856c4d74b127 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043981 Jun 17 13:17:33.875195 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 691/1352] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:17:33 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:17:33.875930 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-dfd69ba1-ef74-4ee8-849e-94d0e0a5ed73 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045435 Jun 17 13:17:33.876692 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 662/1353] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:33 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:33.879795 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-7d328438-2c77-459e-8983-0a05765a7c56 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:33.881268 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-7d328438-2c77-459e-8983-0a05765a7c56 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:33.887051 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7d328438-2c77-459e-8983-0a05765a7c56 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:33.887505 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7d328438-2c77-459e-8983-0a05765a7c56 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:33.888271 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7d328438-2c77-459e-8983-0a05765a7c56 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:33.888705 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7d328438-2c77-459e-8983-0a05765a7c56 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:33.917479 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-7d328438-2c77-459e-8983-0a05765a7c56 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041287 Jun 17 13:17:33.918046 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 692/1354] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:33 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:34.888207 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-13007c12-b8e1-49a6-b9e6-11726fd084fe tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:34.888780 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-6ed35538-2494-4d2a-a8e9-1953492ee916 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:34.889167 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-13007c12-b8e1-49a6-b9e6-11726fd084fe tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:34.889715 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-6ed35538-2494-4d2a-a8e9-1953492ee916 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:34.896127 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-13007c12-b8e1-49a6-b9e6-11726fd084fe tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:34.896533 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6ed35538-2494-4d2a-a8e9-1953492ee916 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:34.896692 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-13007c12-b8e1-49a6-b9e6-11726fd084fe tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:34.896984 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6ed35538-2494-4d2a-a8e9-1953492ee916 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:34.897339 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-13007c12-b8e1-49a6-b9e6-11726fd084fe tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:34.897742 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6ed35538-2494-4d2a-a8e9-1953492ee916 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:34.897905 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-13007c12-b8e1-49a6-b9e6-11726fd084fe tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:34.898189 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6ed35538-2494-4d2a-a8e9-1953492ee916 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:34.928432 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-6ed35538-2494-4d2a-a8e9-1953492ee916 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043483 Jun 17 13:17:34.929010 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 693/1355] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:34 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:34.930433 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-13007c12-b8e1-49a6-b9e6-11726fd084fe tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047309 Jun 17 13:17:34.931219 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 663/1356] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:17:34 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:17:34.933945 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-22a2bec2-6f92-4e76-9e75-05f504ed8645 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:34.934899 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-22a2bec2-6f92-4e76-9e75-05f504ed8645 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:34.941229 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-22a2bec2-6f92-4e76-9e75-05f504ed8645 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:34.941653 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-22a2bec2-6f92-4e76-9e75-05f504ed8645 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:34.942476 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-22a2bec2-6f92-4e76-9e75-05f504ed8645 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:34.942888 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-22a2bec2-6f92-4e76-9e75-05f504ed8645 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:34.974213 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-22a2bec2-6f92-4e76-9e75-05f504ed8645 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044173 Jun 17 13:17:34.974995 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 694/1357] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:34 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:35.944499 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-d092f6be-9e5e-4b86-b71a-af69d4f9906d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:35.946286 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-d092f6be-9e5e-4b86-b71a-af69d4f9906d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:35.947163 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-af706d1f-e70d-4f7e-9813-8db7a5cf896a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:35.949193 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-af706d1f-e70d-4f7e-9813-8db7a5cf896a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:35.958744 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d092f6be-9e5e-4b86-b71a-af69d4f9906d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:35.959538 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d092f6be-9e5e-4b86-b71a-af69d4f9906d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:35.960803 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d092f6be-9e5e-4b86-b71a-af69d4f9906d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:35.961573 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d092f6be-9e5e-4b86-b71a-af69d4f9906d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:35.962222 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-af706d1f-e70d-4f7e-9813-8db7a5cf896a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:35.963129 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-af706d1f-e70d-4f7e-9813-8db7a5cf896a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:35.965074 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-af706d1f-e70d-4f7e-9813-8db7a5cf896a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:35.965768 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-af706d1f-e70d-4f7e-9813-8db7a5cf896a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:35.993967 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-d092f6be-9e5e-4b86-b71a-af69d4f9906d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056137 Jun 17 13:17:35.994575 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 664/1358] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:35 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:35.997733 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-af706d1f-e70d-4f7e-9813-8db7a5cf896a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.057833 Jun 17 13:17:35.998376 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 695/1359] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:17:35 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:17:35.999921 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-d1a910ae-2384-4f7f-bae0-95d57a0d2d4c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:36.000841 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-d1a910ae-2384-4f7f-bae0-95d57a0d2d4c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:36.007088 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d1a910ae-2384-4f7f-bae0-95d57a0d2d4c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:36.007538 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d1a910ae-2384-4f7f-bae0-95d57a0d2d4c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:36.008301 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d1a910ae-2384-4f7f-bae0-95d57a0d2d4c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:36.008735 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d1a910ae-2384-4f7f-bae0-95d57a0d2d4c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:36.040777 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-d1a910ae-2384-4f7f-bae0-95d57a0d2d4c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045146 Jun 17 13:17:36.041337 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 665/1360] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:35 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:37.007187 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-9e05aa31-d7fe-44c1-b2e1-43a08ce5531e tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:37.008137 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-9e05aa31-d7fe-44c1-b2e1-43a08ce5531e tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:37.009182 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-ac9abf02-b774-4c5c-a66e-af23de7648f0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:37.010130 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-ac9abf02-b774-4c5c-a66e-af23de7648f0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:37.015115 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9e05aa31-d7fe-44c1-b2e1-43a08ce5531e tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:37.015555 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9e05aa31-d7fe-44c1-b2e1-43a08ce5531e tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:37.016424 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9e05aa31-d7fe-44c1-b2e1-43a08ce5531e tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:37.016893 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9e05aa31-d7fe-44c1-b2e1-43a08ce5531e tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:37.017039 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ac9abf02-b774-4c5c-a66e-af23de7648f0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:37.017339 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ac9abf02-b774-4c5c-a66e-af23de7648f0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:37.018079 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ac9abf02-b774-4c5c-a66e-af23de7648f0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:37.018571 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ac9abf02-b774-4c5c-a66e-af23de7648f0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:37.049072 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-ac9abf02-b774-4c5c-a66e-af23de7648f0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043787 Jun 17 13:17:37.049635 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 666/1361] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:17:37 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:17:37.050414 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-9e05aa31-d7fe-44c1-b2e1-43a08ce5531e tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047226 Jun 17 13:17:37.051156 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 696/1362] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:37 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:37.054440 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-7a65f63a-c4a1-433f-a6b7-c9e1c63b9a00 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:37.055398 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-7a65f63a-c4a1-433f-a6b7-c9e1c63b9a00 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:37.062122 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7a65f63a-c4a1-433f-a6b7-c9e1c63b9a00 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:37.062619 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7a65f63a-c4a1-433f-a6b7-c9e1c63b9a00 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:37.063395 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7a65f63a-c4a1-433f-a6b7-c9e1c63b9a00 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:37.063832 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7a65f63a-c4a1-433f-a6b7-c9e1c63b9a00 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:37.096279 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-7a65f63a-c4a1-433f-a6b7-c9e1c63b9a00 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045573 Jun 17 13:17:37.096816 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 667/1363] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:37 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:38.063248 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-2bf0e386-291d-4a8f-bd3e-465c869d84a6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:38.063877 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-a0ed1030-7d41-4422-ba68-3f6abc702a37 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:38.064253 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-2bf0e386-291d-4a8f-bd3e-465c869d84a6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:38.064353 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-a0ed1030-7d41-4422-ba68-3f6abc702a37 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:38.071181 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a0ed1030-7d41-4422-ba68-3f6abc702a37 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:38.071339 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2bf0e386-291d-4a8f-bd3e-465c869d84a6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:38.071633 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a0ed1030-7d41-4422-ba68-3f6abc702a37 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:38.071801 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2bf0e386-291d-4a8f-bd3e-465c869d84a6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:38.072398 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2bf0e386-291d-4a8f-bd3e-465c869d84a6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:38.072541 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a0ed1030-7d41-4422-ba68-3f6abc702a37 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:38.072860 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a0ed1030-7d41-4422-ba68-3f6abc702a37 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:38.073017 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2bf0e386-291d-4a8f-bd3e-465c869d84a6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:38.103633 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-2bf0e386-291d-4a8f-bd3e-465c869d84a6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045375 Jun 17 13:17:38.104413 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 697/1364] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:17:38 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:17:38.104689 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-a0ed1030-7d41-4422-ba68-3f6abc702a37 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046132 Jun 17 13:17:38.105370 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 668/1365] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:38 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:38.109342 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-1b9d5a85-e7c6-49be-9728-f86b7631684f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:38.110232 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-1b9d5a85-e7c6-49be-9728-f86b7631684f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:38.116539 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-1b9d5a85-e7c6-49be-9728-f86b7631684f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:38.116874 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-1b9d5a85-e7c6-49be-9728-f86b7631684f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:38.117743 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-1b9d5a85-e7c6-49be-9728-f86b7631684f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:38.118061 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-1b9d5a85-e7c6-49be-9728-f86b7631684f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:38.147840 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-1b9d5a85-e7c6-49be-9728-f86b7631684f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042573 Jun 17 13:17:38.148651 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 698/1366] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:38 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:39.117383 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-6cbe460e-327e-4d88-b222-1cb0db6c7d2d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:39.118062 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-e767d15a-0c06-409d-9920-098e87ebf69f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:39.118463 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-6cbe460e-327e-4d88-b222-1cb0db6c7d2d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:39.118983 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-e767d15a-0c06-409d-9920-098e87ebf69f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:39.125224 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6cbe460e-327e-4d88-b222-1cb0db6c7d2d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:39.125648 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6cbe460e-327e-4d88-b222-1cb0db6c7d2d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:39.126625 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6cbe460e-327e-4d88-b222-1cb0db6c7d2d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:39.126764 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e767d15a-0c06-409d-9920-098e87ebf69f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:39.127065 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6cbe460e-327e-4d88-b222-1cb0db6c7d2d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:39.127179 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e767d15a-0c06-409d-9920-098e87ebf69f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:39.127869 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e767d15a-0c06-409d-9920-098e87ebf69f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:39.128306 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e767d15a-0c06-409d-9920-098e87ebf69f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:39.158390 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-6cbe460e-327e-4d88-b222-1cb0db6c7d2d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044911 Jun 17 13:17:39.158623 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-e767d15a-0c06-409d-9920-098e87ebf69f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045045 Jun 17 13:17:39.158958 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 699/1367] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:39 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:39.159135 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 669/1368] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:17:39 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:17:39.164857 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-374f6ae8-89d7-490b-892e-4257d99badd4 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:39.165894 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-374f6ae8-89d7-490b-892e-4257d99badd4 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:39.174054 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-374f6ae8-89d7-490b-892e-4257d99badd4 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:39.174532 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-374f6ae8-89d7-490b-892e-4257d99badd4 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:39.175287 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-374f6ae8-89d7-490b-892e-4257d99badd4 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:39.175713 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-374f6ae8-89d7-490b-892e-4257d99badd4 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:39.205752 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-374f6ae8-89d7-490b-892e-4257d99badd4 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045805 Jun 17 13:17:39.206611 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 700/1369] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:39 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:40.174684 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-df4d7d19-c269-4eee-9767-498ccc31f073 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:40.175839 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-c3392c96-8c10-4a24-b62f-91ed28ad63b0 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:40.176497 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-df4d7d19-c269-4eee-9767-498ccc31f073 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:40.176926 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-c3392c96-8c10-4a24-b62f-91ed28ad63b0 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:40.180293 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_api:SELECT=88 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:17:40.187898 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c3392c96-8c10-4a24-b62f-91ed28ad63b0 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:40.188725 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c3392c96-8c10-4a24-b62f-91ed28ad63b0 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:40.189497 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c3392c96-8c10-4a24-b62f-91ed28ad63b0 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:40.189609 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-df4d7d19-c269-4eee-9767-498ccc31f073 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:40.189926 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c3392c96-8c10-4a24-b62f-91ed28ad63b0 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:40.190036 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-df4d7d19-c269-4eee-9767-498ccc31f073 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:40.190739 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-df4d7d19-c269-4eee-9767-498ccc31f073 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:40.191182 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-df4d7d19-c269-4eee-9767-498ccc31f073 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:40.219889 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-c3392c96-8c10-4a24-b62f-91ed28ad63b0 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051990 Jun 17 13:17:40.220549 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 670/1370] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:40 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:40.221417 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-df4d7d19-c269-4eee-9767-498ccc31f073 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053530 Jun 17 13:17:40.221968 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 701/1371] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:17:40 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 17 13:17:40.225197 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-0e27a72c-cadf-4159-b321-00df72a9904c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:40.226113 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-0e27a72c-cadf-4159-b321-00df72a9904c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:40.232493 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0e27a72c-cadf-4159-b321-00df72a9904c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:40.233281 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0e27a72c-cadf-4159-b321-00df72a9904c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:40.234048 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0e27a72c-cadf-4159-b321-00df72a9904c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:40.234566 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0e27a72c-cadf-4159-b321-00df72a9904c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:40.264733 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-0e27a72c-cadf-4159-b321-00df72a9904c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043150 Jun 17 13:17:40.265259 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 671/1372] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:40 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:41.233246 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-0def5b10-bf8f-4c34-bcab-a3bfff125147 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:41.234333 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-0def5b10-bf8f-4c34-bcab-a3bfff125147 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:41.234683 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-381dfb1a-52e5-4911-ac95-ce93f19e97d5 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:41.235708 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-381dfb1a-52e5-4911-ac95-ce93f19e97d5 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:41.241829 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0def5b10-bf8f-4c34-bcab-a3bfff125147 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:41.242318 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0def5b10-bf8f-4c34-bcab-a3bfff125147 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:41.242773 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-381dfb1a-52e5-4911-ac95-ce93f19e97d5 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:41.243082 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0def5b10-bf8f-4c34-bcab-a3bfff125147 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:41.243231 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-381dfb1a-52e5-4911-ac95-ce93f19e97d5 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:41.243520 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0def5b10-bf8f-4c34-bcab-a3bfff125147 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:41.243955 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-381dfb1a-52e5-4911-ac95-ce93f19e97d5 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:41.244376 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-381dfb1a-52e5-4911-ac95-ce93f19e97d5 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:41.274677 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-0def5b10-bf8f-4c34-bcab-a3bfff125147 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046388 Jun 17 13:17:41.275264 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 702/1373] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:41 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:41.276509 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-381dfb1a-52e5-4911-ac95-ce93f19e97d5 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046636 Jun 17 13:17:41.280922 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 672/1374] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:17:41 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:17:41.281099 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-7bab1f82-d185-4f62-8840-5f7abfa2949e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:41.281099 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-7bab1f82-d185-4f62-8840-5f7abfa2949e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:41.287608 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7bab1f82-d185-4f62-8840-5f7abfa2949e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:41.288061 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7bab1f82-d185-4f62-8840-5f7abfa2949e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:41.288851 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7bab1f82-d185-4f62-8840-5f7abfa2949e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:41.289305 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7bab1f82-d185-4f62-8840-5f7abfa2949e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:41.319705 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-7bab1f82-d185-4f62-8840-5f7abfa2949e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043437 Jun 17 13:17:41.320275 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 703/1375] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:41 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:42.287546 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-4b5ee818-5980-4ea9-ad2f-7401d09bb464 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:42.288908 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-4b5ee818-5980-4ea9-ad2f-7401d09bb464 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:42.289618 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-cae77f97-66bb-4935-9dbb-39e36f3373d3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:42.290588 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-cae77f97-66bb-4935-9dbb-39e36f3373d3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:42.296074 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4b5ee818-5980-4ea9-ad2f-7401d09bb464 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:42.296535 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4b5ee818-5980-4ea9-ad2f-7401d09bb464 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:42.297320 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4b5ee818-5980-4ea9-ad2f-7401d09bb464 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:42.297747 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4b5ee818-5980-4ea9-ad2f-7401d09bb464 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:42.298192 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-cae77f97-66bb-4935-9dbb-39e36f3373d3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:42.298735 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-cae77f97-66bb-4935-9dbb-39e36f3373d3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:42.299590 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-cae77f97-66bb-4935-9dbb-39e36f3373d3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:42.300158 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-cae77f97-66bb-4935-9dbb-39e36f3373d3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:42.332069 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-4b5ee818-5980-4ea9-ad2f-7401d09bb464 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048868 Jun 17 13:17:42.332335 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-cae77f97-66bb-4935-9dbb-39e36f3373d3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046788 Jun 17 13:17:42.332815 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 673/1376] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:42 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:42.332958 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 704/1377] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:17:42 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:17:42.338314 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-20e54c0f-0f7f-47fa-88d2-8d449a2cb05c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:42.339269 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-20e54c0f-0f7f-47fa-88d2-8d449a2cb05c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:42.345459 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-20e54c0f-0f7f-47fa-88d2-8d449a2cb05c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:42.345912 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-20e54c0f-0f7f-47fa-88d2-8d449a2cb05c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:42.346707 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-20e54c0f-0f7f-47fa-88d2-8d449a2cb05c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:42.347135 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-20e54c0f-0f7f-47fa-88d2-8d449a2cb05c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:42.364211 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=100 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:17:42.378267 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-20e54c0f-0f7f-47fa-88d2-8d449a2cb05c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044526 Jun 17 13:17:42.378828 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 674/1378] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:42 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:43.345424 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-46399568-9f21-4545-833d-3ef8dcccb50a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:43.345929 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-d277b1d2-d0f8-478e-bb37-d85ab43d9f8d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:43.346404 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-46399568-9f21-4545-833d-3ef8dcccb50a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:43.346683 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-d277b1d2-d0f8-478e-bb37-d85ab43d9f8d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:43.354060 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-46399568-9f21-4545-833d-3ef8dcccb50a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:43.354287 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d277b1d2-d0f8-478e-bb37-d85ab43d9f8d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:43.354547 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-46399568-9f21-4545-833d-3ef8dcccb50a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:43.354771 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d277b1d2-d0f8-478e-bb37-d85ab43d9f8d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:43.355348 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-46399568-9f21-4545-833d-3ef8dcccb50a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:43.355590 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d277b1d2-d0f8-478e-bb37-d85ab43d9f8d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:43.355796 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-46399568-9f21-4545-833d-3ef8dcccb50a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:43.356007 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d277b1d2-d0f8-478e-bb37-d85ab43d9f8d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:43.360824 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_cell1:SELECT=100 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:17:43.386623 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-d277b1d2-d0f8-478e-bb37-d85ab43d9f8d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044740 Jun 17 13:17:43.390903 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 675/1379] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:17:43 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:17:43.391064 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-46399568-9f21-4545-833d-3ef8dcccb50a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046900 Jun 17 13:17:43.391064 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 705/1380] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:43 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:43.393373 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-7e2f91e1-a7bc-4fef-8f51-38a642a21688 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:43.394321 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-7e2f91e1-a7bc-4fef-8f51-38a642a21688 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:43.401152 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7e2f91e1-a7bc-4fef-8f51-38a642a21688 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:43.401596 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7e2f91e1-a7bc-4fef-8f51-38a642a21688 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:43.402676 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7e2f91e1-a7bc-4fef-8f51-38a642a21688 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:43.402823 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7e2f91e1-a7bc-4fef-8f51-38a642a21688 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:43.433006 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-7e2f91e1-a7bc-4fef-8f51-38a642a21688 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044806 Jun 17 13:17:43.433558 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 676/1381] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:43 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:44.400613 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-549d8246-b98e-4a2a-aa25-c23918e44d3b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:44.401431 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-78ee4dbb-71d8-481e-bd16-c0088c2ef971 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:44.401865 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-549d8246-b98e-4a2a-aa25-c23918e44d3b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:44.402389 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-78ee4dbb-71d8-481e-bd16-c0088c2ef971 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:44.409090 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-549d8246-b98e-4a2a-aa25-c23918e44d3b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:44.409353 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-78ee4dbb-71d8-481e-bd16-c0088c2ef971 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:44.409525 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-549d8246-b98e-4a2a-aa25-c23918e44d3b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:44.409804 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-78ee4dbb-71d8-481e-bd16-c0088c2ef971 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:44.410319 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-549d8246-b98e-4a2a-aa25-c23918e44d3b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:44.410610 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-78ee4dbb-71d8-481e-bd16-c0088c2ef971 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:44.410726 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-549d8246-b98e-4a2a-aa25-c23918e44d3b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:44.411040 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-78ee4dbb-71d8-481e-bd16-c0088c2ef971 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:44.440861 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-78ee4dbb-71d8-481e-bd16-c0088c2ef971 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044441 Jun 17 13:17:44.441423 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 677/1382] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:44 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:44.445944 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-b06af32e-e7dc-4971-be4c-41e8be73392c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:44.447295 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-b06af32e-e7dc-4971-be4c-41e8be73392c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:44.447662 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-549d8246-b98e-4a2a-aa25-c23918e44d3b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052536 Jun 17 13:17:44.448255 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 706/1383] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:17:44 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:17:44.453149 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b06af32e-e7dc-4971-be4c-41e8be73392c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:44.453587 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b06af32e-e7dc-4971-be4c-41e8be73392c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:44.454421 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b06af32e-e7dc-4971-be4c-41e8be73392c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:44.454854 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b06af32e-e7dc-4971-be4c-41e8be73392c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:44.485183 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-b06af32e-e7dc-4971-be4c-41e8be73392c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042767 Jun 17 13:17:44.485758 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 678/1384] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:44 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:45.457180 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-b9c73e2f-f1ad-4075-87e8-dd91d0b618c5 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:45.458771 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-b9c73e2f-f1ad-4075-87e8-dd91d0b618c5 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:45.464065 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-4c964e92-91ac-40d1-b61e-bdb1808b0712 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:45.465203 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-4c964e92-91ac-40d1-b61e-bdb1808b0712 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:45.469776 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b9c73e2f-f1ad-4075-87e8-dd91d0b618c5 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:45.470286 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b9c73e2f-f1ad-4075-87e8-dd91d0b618c5 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:45.471614 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b9c73e2f-f1ad-4075-87e8-dd91d0b618c5 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:45.472270 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b9c73e2f-f1ad-4075-87e8-dd91d0b618c5 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:45.475435 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4c964e92-91ac-40d1-b61e-bdb1808b0712 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:45.476146 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4c964e92-91ac-40d1-b61e-bdb1808b0712 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:45.477444 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4c964e92-91ac-40d1-b61e-bdb1808b0712 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:45.478269 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4c964e92-91ac-40d1-b61e-bdb1808b0712 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:45.505618 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-b9c73e2f-f1ad-4075-87e8-dd91d0b618c5 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055011 Jun 17 13:17:45.506415 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 707/1385] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:45 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:45.510764 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-56ef183d-d890-40a2-a639-183e2fba1bc4 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:45.511670 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-56ef183d-d890-40a2-a639-183e2fba1bc4 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:45.513697 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-4c964e92-91ac-40d1-b61e-bdb1808b0712 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056786 Jun 17 13:17:45.514547 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 679/1386] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:17:45 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:17:45.518574 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-56ef183d-d890-40a2-a639-183e2fba1bc4 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:45.519030 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-56ef183d-d890-40a2-a639-183e2fba1bc4 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:45.519796 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-56ef183d-d890-40a2-a639-183e2fba1bc4 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:45.520269 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-56ef183d-d890-40a2-a639-183e2fba1bc4 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:45.549703 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-56ef183d-d890-40a2-a639-183e2fba1bc4 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042479 Jun 17 13:17:45.550277 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 708/1387] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:45 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:46.522179 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-a2fe92bd-048b-4b89-9d1f-417601fe4179 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:46.523694 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-a2fe92bd-048b-4b89-9d1f-417601fe4179 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:46.528069 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-a2331149-af91-4189-bf65-76d459c838ed tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:46.528966 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-a2331149-af91-4189-bf65-76d459c838ed tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:46.531396 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a2fe92bd-048b-4b89-9d1f-417601fe4179 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:46.531848 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a2fe92bd-048b-4b89-9d1f-417601fe4179 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:46.532619 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a2fe92bd-048b-4b89-9d1f-417601fe4179 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:46.533054 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a2fe92bd-048b-4b89-9d1f-417601fe4179 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:46.535648 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a2331149-af91-4189-bf65-76d459c838ed tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:46.536102 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a2331149-af91-4189-bf65-76d459c838ed tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:46.536865 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a2331149-af91-4189-bf65-76d459c838ed tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:46.537308 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a2331149-af91-4189-bf65-76d459c838ed tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:46.563422 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-a2fe92bd-048b-4b89-9d1f-417601fe4179 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047936 Jun 17 13:17:46.567232 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 680/1388] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:46 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:46.568259 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-a2331149-af91-4189-bf65-76d459c838ed tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046431 Jun 17 13:17:46.569155 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 709/1389] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:17:46 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:17:46.571066 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-be6f5dd8-c742-446f-acac-a1b6d620c248 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:46.572893 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-be6f5dd8-c742-446f-acac-a1b6d620c248 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:46.579825 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-be6f5dd8-c742-446f-acac-a1b6d620c248 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:46.580283 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-be6f5dd8-c742-446f-acac-a1b6d620c248 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:46.581059 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-be6f5dd8-c742-446f-acac-a1b6d620c248 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:46.581544 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-be6f5dd8-c742-446f-acac-a1b6d620c248 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:46.611535 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-be6f5dd8-c742-446f-acac-a1b6d620c248 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046334 Jun 17 13:17:46.612149 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 681/1390] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:46 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:47.576840 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-754adc45-3436-44df-a204-ac366ab30550 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:47.577684 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-754adc45-3436-44df-a204-ac366ab30550 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:47.580358 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-97db27cf-6248-4b86-a074-47f7f22a3cc5 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:47.581309 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-97db27cf-6248-4b86-a074-47f7f22a3cc5 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:47.584707 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-754adc45-3436-44df-a204-ac366ab30550 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:47.585155 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-754adc45-3436-44df-a204-ac366ab30550 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:47.585919 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-754adc45-3436-44df-a204-ac366ab30550 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:47.586383 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-754adc45-3436-44df-a204-ac366ab30550 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:47.588172 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-97db27cf-6248-4b86-a074-47f7f22a3cc5 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:47.588619 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-97db27cf-6248-4b86-a074-47f7f22a3cc5 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:47.589410 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-97db27cf-6248-4b86-a074-47f7f22a3cc5 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:47.589966 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-97db27cf-6248-4b86-a074-47f7f22a3cc5 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:47.617953 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-754adc45-3436-44df-a204-ac366ab30550 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045421 Jun 17 13:17:47.619167 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 710/1391] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:47 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:47.622297 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-97db27cf-6248-4b86-a074-47f7f22a3cc5 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045691 Jun 17 13:17:47.623157 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 682/1392] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:17:47 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:17:47.624008 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-54ca0721-5563-4146-94e3-e6e1b78a3a58 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:47.624924 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-54ca0721-5563-4146-94e3-e6e1b78a3a58 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:47.631113 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-54ca0721-5563-4146-94e3-e6e1b78a3a58 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:47.631558 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-54ca0721-5563-4146-94e3-e6e1b78a3a58 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:47.632432 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-54ca0721-5563-4146-94e3-e6e1b78a3a58 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:47.632936 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-54ca0721-5563-4146-94e3-e6e1b78a3a58 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:47.662135 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-54ca0721-5563-4146-94e3-e6e1b78a3a58 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041676 Jun 17 13:17:47.662721 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 711/1393] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:47 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:48.631932 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-8b95a2ca-ed1a-4ed4-bd83-35daf0556813 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:48.633173 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-8b95a2ca-ed1a-4ed4-bd83-35daf0556813 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:48.637149 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-5097404c-f37a-496d-82e3-f94f7d875e1a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:48.638673 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-5097404c-f37a-496d-82e3-f94f7d875e1a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:48.643934 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8b95a2ca-ed1a-4ed4-bd83-35daf0556813 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:48.644669 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8b95a2ca-ed1a-4ed4-bd83-35daf0556813 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:48.645932 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8b95a2ca-ed1a-4ed4-bd83-35daf0556813 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:48.646694 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8b95a2ca-ed1a-4ed4-bd83-35daf0556813 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:48.649342 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-5097404c-f37a-496d-82e3-f94f7d875e1a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:48.650061 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-5097404c-f37a-496d-82e3-f94f7d875e1a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:48.650867 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-5097404c-f37a-496d-82e3-f94f7d875e1a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:48.651297 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-5097404c-f37a-496d-82e3-f94f7d875e1a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:48.679243 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-8b95a2ca-ed1a-4ed4-bd83-35daf0556813 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053403 Jun 17 13:17:48.679817 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 683/1394] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:48 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:48.681759 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-5097404c-f37a-496d-82e3-f94f7d875e1a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050498 Jun 17 13:17:48.682552 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 712/1395] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:17:48 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:17:48.684666 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-3deb846a-d8a3-4352-a033-827e3a347c3e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:48.685520 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-3deb846a-d8a3-4352-a033-827e3a347c3e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:48.691720 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3deb846a-d8a3-4352-a033-827e3a347c3e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:48.692158 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3deb846a-d8a3-4352-a033-827e3a347c3e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:48.692931 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3deb846a-d8a3-4352-a033-827e3a347c3e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:48.693363 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3deb846a-d8a3-4352-a033-827e3a347c3e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:48.723468 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-3deb846a-d8a3-4352-a033-827e3a347c3e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042536 Jun 17 13:17:48.724020 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 684/1396] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:48 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:49.695094 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-b309ac39-71a3-4356-8fc4-c66baac6075c tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:49.696580 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-b309ac39-71a3-4356-8fc4-c66baac6075c tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:49.697152 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-9edee3cd-02a0-4850-94b8-af5fa618129b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:49.698121 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-9edee3cd-02a0-4850-94b8-af5fa618129b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:49.703771 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b309ac39-71a3-4356-8fc4-c66baac6075c tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:49.704219 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b309ac39-71a3-4356-8fc4-c66baac6075c tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:49.704575 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9edee3cd-02a0-4850-94b8-af5fa618129b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:49.704974 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b309ac39-71a3-4356-8fc4-c66baac6075c tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:49.705122 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9edee3cd-02a0-4850-94b8-af5fa618129b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:49.705398 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b309ac39-71a3-4356-8fc4-c66baac6075c tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:49.705914 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9edee3cd-02a0-4850-94b8-af5fa618129b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:49.706377 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9edee3cd-02a0-4850-94b8-af5fa618129b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:49.735738 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-b309ac39-71a3-4356-8fc4-c66baac6075c tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047285 Jun 17 13:17:49.736299 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 713/1397] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:49 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:49.737721 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-9edee3cd-02a0-4850-94b8-af5fa618129b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047530 Jun 17 13:17:49.738485 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 685/1398] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:17:49 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:17:49.740809 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-03d2a9db-cfec-48df-b50a-7e6fd93da36f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:49.741802 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-03d2a9db-cfec-48df-b50a-7e6fd93da36f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:49.748239 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-03d2a9db-cfec-48df-b50a-7e6fd93da36f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:49.748568 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-03d2a9db-cfec-48df-b50a-7e6fd93da36f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:49.749314 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-03d2a9db-cfec-48df-b50a-7e6fd93da36f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:49.749734 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-03d2a9db-cfec-48df-b50a-7e6fd93da36f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:49.778304 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-03d2a9db-cfec-48df-b50a-7e6fd93da36f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040981 Jun 17 13:17:49.778864 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 714/1399] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:49 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:50.753513 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-1e78b554-0254-4e74-a6a4-e17b43b15979 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:50.754603 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-0e1fb112-5f12-465a-adc5-f1216b59f9af tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:50.755207 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-1e78b554-0254-4e74-a6a4-e17b43b15979 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:50.755513 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-0e1fb112-5f12-465a-adc5-f1216b59f9af tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:50.763527 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0e1fb112-5f12-465a-adc5-f1216b59f9af tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:50.763723 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-1e78b554-0254-4e74-a6a4-e17b43b15979 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:50.763973 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0e1fb112-5f12-465a-adc5-f1216b59f9af tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:50.764118 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-1e78b554-0254-4e74-a6a4-e17b43b15979 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:50.764737 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0e1fb112-5f12-465a-adc5-f1216b59f9af tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:50.764899 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-1e78b554-0254-4e74-a6a4-e17b43b15979 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:50.765167 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0e1fb112-5f12-465a-adc5-f1216b59f9af tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:50.765326 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-1e78b554-0254-4e74-a6a4-e17b43b15979 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:50.795215 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-0e1fb112-5f12-465a-adc5-f1216b59f9af tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048576 Jun 17 13:17:50.795673 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-1e78b554-0254-4e74-a6a4-e17b43b15979 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048731 Jun 17 13:17:50.795820 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 686/1400] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:50 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:50.796540 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 715/1401] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:17:50 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:17:50.800277 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-b5925e40-ce49-49e5-9b8d-1e30ac03d562 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:50.801200 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-b5925e40-ce49-49e5-9b8d-1e30ac03d562 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:50.807685 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b5925e40-ce49-49e5-9b8d-1e30ac03d562 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:50.808144 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b5925e40-ce49-49e5-9b8d-1e30ac03d562 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:50.808887 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b5925e40-ce49-49e5-9b8d-1e30ac03d562 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:50.809311 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b5925e40-ce49-49e5-9b8d-1e30ac03d562 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:50.838060 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-b5925e40-ce49-49e5-9b8d-1e30ac03d562 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041286 Jun 17 13:17:50.838912 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 687/1402] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:50 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:51.809996 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-8d5fd84c-d542-4c3a-a0d0-ca953b1b1785 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:51.811046 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-8d5fd84c-d542-4c3a-a0d0-ca953b1b1785 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:51.811922 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-b0ca6d89-71ab-40fb-9860-ebfaf9a88c52 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:51.812937 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-b0ca6d89-71ab-40fb-9860-ebfaf9a88c52 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:51.818703 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8d5fd84c-d542-4c3a-a0d0-ca953b1b1785 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:51.819204 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8d5fd84c-d542-4c3a-a0d0-ca953b1b1785 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:51.820126 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8d5fd84c-d542-4c3a-a0d0-ca953b1b1785 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:51.820287 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b0ca6d89-71ab-40fb-9860-ebfaf9a88c52 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:51.820610 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8d5fd84c-d542-4c3a-a0d0-ca953b1b1785 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:51.820790 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b0ca6d89-71ab-40fb-9860-ebfaf9a88c52 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:51.821621 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b0ca6d89-71ab-40fb-9860-ebfaf9a88c52 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:51.822152 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b0ca6d89-71ab-40fb-9860-ebfaf9a88c52 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:51.853094 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-8d5fd84c-d542-4c3a-a0d0-ca953b1b1785 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048112 Jun 17 13:17:51.853326 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-b0ca6d89-71ab-40fb-9860-ebfaf9a88c52 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045575 Jun 17 13:17:51.853879 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 688/1403] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:17:51 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:17:51.854030 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 716/1404] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:51 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:51.858657 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-1c55739e-1221-4a80-a292-f93fc8748781 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:51.859545 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-1c55739e-1221-4a80-a292-f93fc8748781 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:51.865509 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1c55739e-1221-4a80-a292-f93fc8748781 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:51.865959 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1c55739e-1221-4a80-a292-f93fc8748781 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:51.866759 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1c55739e-1221-4a80-a292-f93fc8748781 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:51.867194 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1c55739e-1221-4a80-a292-f93fc8748781 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:51.898735 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-1c55739e-1221-4a80-a292-f93fc8748781 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043937 Jun 17 13:17:51.899553 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 689/1405] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:51 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:52.872019 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-956964b1-5d4b-429c-86e1-19b39dd17515 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:52.873573 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-956964b1-5d4b-429c-86e1-19b39dd17515 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:52.880210 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-d4c05808-e80b-4318-8030-4b9e267feb30 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:52.881725 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-d4c05808-e80b-4318-8030-4b9e267feb30 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:52.884953 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-956964b1-5d4b-429c-86e1-19b39dd17515 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:52.885404 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-956964b1-5d4b-429c-86e1-19b39dd17515 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:52.886206 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-956964b1-5d4b-429c-86e1-19b39dd17515 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:52.886643 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-956964b1-5d4b-429c-86e1-19b39dd17515 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:52.889622 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d4c05808-e80b-4318-8030-4b9e267feb30 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:52.891325 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d4c05808-e80b-4318-8030-4b9e267feb30 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:52.891325 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d4c05808-e80b-4318-8030-4b9e267feb30 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:52.891325 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d4c05808-e80b-4318-8030-4b9e267feb30 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:52.918590 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-956964b1-5d4b-429c-86e1-19b39dd17515 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053357 Jun 17 13:17:52.919735 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 717/1406] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:52 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:52.922723 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-d4c05808-e80b-4318-8030-4b9e267feb30 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049505 Jun 17 13:17:52.923286 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 690/1407] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:17:52 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 17 13:17:52.927327 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-4168cd95-bef1-4832-abd1-14505a9b3eec tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:52.928248 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-4168cd95-bef1-4832-abd1-14505a9b3eec tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:52.934361 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4168cd95-bef1-4832-abd1-14505a9b3eec tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:52.934817 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4168cd95-bef1-4832-abd1-14505a9b3eec tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:52.935584 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4168cd95-bef1-4832-abd1-14505a9b3eec tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:52.936020 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4168cd95-bef1-4832-abd1-14505a9b3eec tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:52.978952 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-4168cd95-bef1-4832-abd1-14505a9b3eec tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055111 Jun 17 13:17:52.979708 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 718/1408] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:52 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:53.934387 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-71fec5d1-bb88-4ca5-840f-9ba3a392bb48 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:53.935586 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-71fec5d1-bb88-4ca5-840f-9ba3a392bb48 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:53.936310 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-4f4c24f3-3b22-4fae-9663-7ab275d02966 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:53.937288 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-4f4c24f3-3b22-4fae-9663-7ab275d02966 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:53.943255 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-71fec5d1-bb88-4ca5-840f-9ba3a392bb48 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:53.943755 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-71fec5d1-bb88-4ca5-840f-9ba3a392bb48 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:53.944604 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-71fec5d1-bb88-4ca5-840f-9ba3a392bb48 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:53.944854 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4f4c24f3-3b22-4fae-9663-7ab275d02966 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:53.945046 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-71fec5d1-bb88-4ca5-840f-9ba3a392bb48 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:53.945373 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4f4c24f3-3b22-4fae-9663-7ab275d02966 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:53.946255 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4f4c24f3-3b22-4fae-9663-7ab275d02966 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:53.946734 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4f4c24f3-3b22-4fae-9663-7ab275d02966 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:53.950038 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=100 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:17:53.979255 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-4f4c24f3-3b22-4fae-9663-7ab275d02966 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047208 Jun 17 13:17:53.979413 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-71fec5d1-bb88-4ca5-840f-9ba3a392bb48 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051447 Jun 17 13:17:53.980048 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 719/1409] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:17:53 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:17:53.980199 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 691/1410] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:53 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:53.990936 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-e643049d-e839-420e-9c39-427bda449a76 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:53.991842 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-e643049d-e839-420e-9c39-427bda449a76 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:53.998351 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e643049d-e839-420e-9c39-427bda449a76 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:53.998803 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e643049d-e839-420e-9c39-427bda449a76 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:53.999564 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e643049d-e839-420e-9c39-427bda449a76 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:54.000000 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e643049d-e839-420e-9c39-427bda449a76 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:54.037669 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-e643049d-e839-420e-9c39-427bda449a76 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050652 Jun 17 13:17:54.038295 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 720/1411] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:53 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:54.995667 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-acaae197-c3b1-490b-89db-96f5f13ed270 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:54.997079 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-acaae197-c3b1-490b-89db-96f5f13ed270 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:54.998299 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-06f52a5e-13d3-483c-93d4-5cda662e98af tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:54.999793 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-06f52a5e-13d3-483c-93d4-5cda662e98af tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:55.007653 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-acaae197-c3b1-490b-89db-96f5f13ed270 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:55.008393 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-acaae197-c3b1-490b-89db-96f5f13ed270 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:55.009572 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-06f52a5e-13d3-483c-93d4-5cda662e98af tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:55.009736 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-acaae197-c3b1-490b-89db-96f5f13ed270 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:55.010118 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-06f52a5e-13d3-483c-93d4-5cda662e98af tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:55.010425 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-acaae197-c3b1-490b-89db-96f5f13ed270 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:55.010801 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-06f52a5e-13d3-483c-93d4-5cda662e98af tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:55.011230 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-06f52a5e-13d3-483c-93d4-5cda662e98af tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:55.038416 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_cell1:SELECT=100 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:17:55.042040 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-acaae197-c3b1-490b-89db-96f5f13ed270 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053284 Jun 17 13:17:55.045893 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 692/1412] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:54 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:55.047015 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-06f52a5e-13d3-483c-93d4-5cda662e98af tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055924 Jun 17 13:17:55.047823 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 721/1413] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:17:54 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:17:55.050774 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-922d3aec-711d-4ef9-b583-5a181e773e57 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:55.051719 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-922d3aec-711d-4ef9-b583-5a181e773e57 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:55.058281 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-922d3aec-711d-4ef9-b583-5a181e773e57 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:55.058874 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-922d3aec-711d-4ef9-b583-5a181e773e57 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:55.059520 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-922d3aec-711d-4ef9-b583-5a181e773e57 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:55.059955 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-922d3aec-711d-4ef9-b583-5a181e773e57 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:55.089352 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-922d3aec-711d-4ef9-b583-5a181e773e57 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042361 Jun 17 13:17:55.089913 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 693/1414] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:55 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:56.057242 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-9eca7f0f-520e-41d7-b4b7-e93de51ac151 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:56.058192 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-9eca7f0f-520e-41d7-b4b7-e93de51ac151 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:56.060444 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-7b0735af-ebb1-45c0-a4d9-129a1de660bb tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:56.061345 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-7b0735af-ebb1-45c0-a4d9-129a1de660bb tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:56.065108 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9eca7f0f-520e-41d7-b4b7-e93de51ac151 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:56.065531 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9eca7f0f-520e-41d7-b4b7-e93de51ac151 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:56.066363 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9eca7f0f-520e-41d7-b4b7-e93de51ac151 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:56.066766 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9eca7f0f-520e-41d7-b4b7-e93de51ac151 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:56.068162 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7b0735af-ebb1-45c0-a4d9-129a1de660bb tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:56.068610 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7b0735af-ebb1-45c0-a4d9-129a1de660bb tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:56.069377 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7b0735af-ebb1-45c0-a4d9-129a1de660bb tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:56.069809 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7b0735af-ebb1-45c0-a4d9-129a1de660bb tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:56.099479 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-9eca7f0f-520e-41d7-b4b7-e93de51ac151 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048974 Jun 17 13:17:56.103180 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 722/1415] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:56 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:56.103349 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-7b0735af-ebb1-45c0-a4d9-129a1de660bb tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044629 Jun 17 13:17:56.103349 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 694/1416] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:17:56 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:17:56.109362 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-2f44e854-0214-4e60-803f-4f1f01778d1f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:56.110322 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-2f44e854-0214-4e60-803f-4f1f01778d1f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:56.116316 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2f44e854-0214-4e60-803f-4f1f01778d1f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:56.116761 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2f44e854-0214-4e60-803f-4f1f01778d1f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:56.117510 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2f44e854-0214-4e60-803f-4f1f01778d1f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:56.117937 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2f44e854-0214-4e60-803f-4f1f01778d1f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:56.147679 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-2f44e854-0214-4e60-803f-4f1f01778d1f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046137 Jun 17 13:17:56.148264 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 723/1417] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:56 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:57.115791 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-a1b16f1c-0431-406a-8e40-f8888bb6a13e tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:57.117482 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-a1b16f1c-0431-406a-8e40-f8888bb6a13e tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:57.117728 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-578e9b1d-6208-457b-9b6f-44959c5fd886 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:57.118938 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-578e9b1d-6208-457b-9b6f-44959c5fd886 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:57.125625 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a1b16f1c-0431-406a-8e40-f8888bb6a13e tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:57.125842 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-578e9b1d-6208-457b-9b6f-44959c5fd886 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:57.126072 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a1b16f1c-0431-406a-8e40-f8888bb6a13e tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:57.126355 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-578e9b1d-6208-457b-9b6f-44959c5fd886 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:57.126884 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a1b16f1c-0431-406a-8e40-f8888bb6a13e tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:57.127111 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-578e9b1d-6208-457b-9b6f-44959c5fd886 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:57.127459 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a1b16f1c-0431-406a-8e40-f8888bb6a13e tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:57.127620 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-578e9b1d-6208-457b-9b6f-44959c5fd886 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:57.158045 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-578e9b1d-6208-457b-9b6f-44959c5fd886 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046957 Jun 17 13:17:57.158877 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 724/1418] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:17:57 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:17:57.159621 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-a1b16f1c-0431-406a-8e40-f8888bb6a13e tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050575 Jun 17 13:17:57.160176 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 695/1419] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:57 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:57.165839 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-d3678c6a-6ccc-4821-975a-5efbceea9c7c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:57.166866 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-d3678c6a-6ccc-4821-975a-5efbceea9c7c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:57.173097 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d3678c6a-6ccc-4821-975a-5efbceea9c7c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:57.173591 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d3678c6a-6ccc-4821-975a-5efbceea9c7c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:57.174430 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d3678c6a-6ccc-4821-975a-5efbceea9c7c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:57.174862 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d3678c6a-6ccc-4821-975a-5efbceea9c7c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:57.204349 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-d3678c6a-6ccc-4821-975a-5efbceea9c7c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044667 Jun 17 13:17:57.204996 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 725/1420] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:57 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:58.170626 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-e2a54a2f-eecc-4861-9291-a11f46185cd6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:58.171225 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-e72e4e4d-1bbf-405a-a78b-e71f14dce555 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:58.171681 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-e72e4e4d-1bbf-405a-a78b-e71f14dce555 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:58.171837 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-e2a54a2f-eecc-4861-9291-a11f46185cd6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:58.178383 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e72e4e4d-1bbf-405a-a78b-e71f14dce555 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:58.178536 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e2a54a2f-eecc-4861-9291-a11f46185cd6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:58.178836 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e72e4e4d-1bbf-405a-a78b-e71f14dce555 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:58.178996 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e2a54a2f-eecc-4861-9291-a11f46185cd6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:58.179598 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e72e4e4d-1bbf-405a-a78b-e71f14dce555 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:58.179760 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e2a54a2f-eecc-4861-9291-a11f46185cd6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:58.180030 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e2a54a2f-eecc-4861-9291-a11f46185cd6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:58.180191 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e72e4e4d-1bbf-405a-a78b-e71f14dce555 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:58.211397 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-e72e4e4d-1bbf-405a-a78b-e71f14dce555 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044331 Jun 17 13:17:58.215523 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 726/1421] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:58 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:58.217016 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-9384c4e9-f336-4a9b-8029-1ea6c0395e38 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:58.217924 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-9384c4e9-f336-4a9b-8029-1ea6c0395e38 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:58.218595 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-e2a54a2f-eecc-4861-9291-a11f46185cd6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052144 Jun 17 13:17:58.219344 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 696/1422] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:17:58 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:17:58.223981 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9384c4e9-f336-4a9b-8029-1ea6c0395e38 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:58.224407 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9384c4e9-f336-4a9b-8029-1ea6c0395e38 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:58.225165 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9384c4e9-f336-4a9b-8029-1ea6c0395e38 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:58.225594 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9384c4e9-f336-4a9b-8029-1ea6c0395e38 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:58.254633 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-9384c4e9-f336-4a9b-8029-1ea6c0395e38 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041402 Jun 17 13:17:58.255187 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 727/1423] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:58 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:59.227077 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-278639f7-484f-4618-a9d7-695c5deea1d0 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:59.228696 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-278639f7-484f-4618-a9d7-695c5deea1d0 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:59.235624 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-fc603522-b94e-4f79-bd69-330ba120e423 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:59.237142 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-fc603522-b94e-4f79-bd69-330ba120e423 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:59.240155 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-278639f7-484f-4618-a9d7-695c5deea1d0 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:59.240927 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-278639f7-484f-4618-a9d7-695c5deea1d0 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:59.245565 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-278639f7-484f-4618-a9d7-695c5deea1d0 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:59.245565 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-278639f7-484f-4618-a9d7-695c5deea1d0 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:59.247759 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-fc603522-b94e-4f79-bd69-330ba120e423 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:59.248213 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-fc603522-b94e-4f79-bd69-330ba120e423 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:59.248976 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-fc603522-b94e-4f79-bd69-330ba120e423 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:59.249406 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-fc603522-b94e-4f79-bd69-330ba120e423 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:59.274123 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-278639f7-484f-4618-a9d7-695c5deea1d0 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053855 Jun 17 13:17:59.275505 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 697/1424] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:59 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:17:59.280396 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-1cdc3452-586f-45cc-87a0-f947135df459 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:17:59.281186 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-1cdc3452-586f-45cc-87a0-f947135df459 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:17:59.281640 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-fc603522-b94e-4f79-bd69-330ba120e423 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053932 Jun 17 13:17:59.285508 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 728/1425] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:17:59 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:17:59.287310 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1cdc3452-586f-45cc-87a0-f947135df459 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:59.287760 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1cdc3452-586f-45cc-87a0-f947135df459 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:59.288532 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1cdc3452-586f-45cc-87a0-f947135df459 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:17:59.288964 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1cdc3452-586f-45cc-87a0-f947135df459 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:17:59.325220 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-1cdc3452-586f-45cc-87a0-f947135df459 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044078 Jun 17 13:17:59.325220 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 698/1426] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:17:59 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:18:00.290340 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-6f9929cb-2cf6-4ba4-9d40-90134895b7ec tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:00.291110 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-6f9929cb-2cf6-4ba4-9d40-90134895b7ec tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:00.294775 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-7cfe1b08-5683-40d6-bdc1-001768fafc89 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:00.295695 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-7cfe1b08-5683-40d6-bdc1-001768fafc89 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:00.298192 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6f9929cb-2cf6-4ba4-9d40-90134895b7ec tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:00.298610 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6f9929cb-2cf6-4ba4-9d40-90134895b7ec tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:00.299384 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6f9929cb-2cf6-4ba4-9d40-90134895b7ec tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:00.299821 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6f9929cb-2cf6-4ba4-9d40-90134895b7ec tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:00.302301 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7cfe1b08-5683-40d6-bdc1-001768fafc89 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:00.302746 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7cfe1b08-5683-40d6-bdc1-001768fafc89 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:00.303522 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7cfe1b08-5683-40d6-bdc1-001768fafc89 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:00.303960 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7cfe1b08-5683-40d6-bdc1-001768fafc89 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:00.330787 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-6f9929cb-2cf6-4ba4-9d40-90134895b7ec tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047308 Jun 17 13:18:00.334198 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 729/1427] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:18:00 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:18:00.335880 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-f40fcb57-6bb1-416c-8a9c-8978c7271172 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:00.336880 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-f40fcb57-6bb1-416c-8a9c-8978c7271172 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:00.337671 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-7cfe1b08-5683-40d6-bdc1-001768fafc89 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047170 Jun 17 13:18:00.338400 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 699/1428] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:18:00 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:18:00.342968 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f40fcb57-6bb1-416c-8a9c-8978c7271172 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:00.343424 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f40fcb57-6bb1-416c-8a9c-8978c7271172 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:00.344197 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f40fcb57-6bb1-416c-8a9c-8978c7271172 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:00.344636 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f40fcb57-6bb1-416c-8a9c-8978c7271172 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:00.374674 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-f40fcb57-6bb1-416c-8a9c-8978c7271172 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042329 Jun 17 13:18:00.375399 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 730/1429] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:18:00 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:18:01.343077 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-f4fcb59f-7dd8-4369-9e22-c020b7d86e06 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:01.344121 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-f4fcb59f-7dd8-4369-9e22-c020b7d86e06 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:01.349325 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-81f42b33-0685-4f25-b526-1d559c11a2fa tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:01.350320 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-81f42b33-0685-4f25-b526-1d559c11a2fa tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:01.351272 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f4fcb59f-7dd8-4369-9e22-c020b7d86e06 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:01.351739 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f4fcb59f-7dd8-4369-9e22-c020b7d86e06 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:01.352562 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f4fcb59f-7dd8-4369-9e22-c020b7d86e06 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:01.353084 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f4fcb59f-7dd8-4369-9e22-c020b7d86e06 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:01.357355 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-81f42b33-0685-4f25-b526-1d559c11a2fa tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:01.358187 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-81f42b33-0685-4f25-b526-1d559c11a2fa tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:01.358990 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-81f42b33-0685-4f25-b526-1d559c11a2fa tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:01.359439 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-81f42b33-0685-4f25-b526-1d559c11a2fa tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:01.385684 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-f4fcb59f-7dd8-4369-9e22-c020b7d86e06 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045593 Jun 17 13:18:01.386737 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 700/1430] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:18:01 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:18:01.393827 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-a7cf6c24-ec53-436a-8514-b07328bf245a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:01.394647 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-81f42b33-0685-4f25-b526-1d559c11a2fa tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049394 Jun 17 13:18:01.394807 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-a7cf6c24-ec53-436a-8514-b07328bf245a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:01.395837 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 731/1431] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:18:01 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:18:01.401460 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a7cf6c24-ec53-436a-8514-b07328bf245a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:01.401909 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a7cf6c24-ec53-436a-8514-b07328bf245a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:01.402714 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a7cf6c24-ec53-436a-8514-b07328bf245a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:01.403180 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a7cf6c24-ec53-436a-8514-b07328bf245a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:01.432414 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-a7cf6c24-ec53-436a-8514-b07328bf245a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044363 Jun 17 13:18:01.433148 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 701/1432] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:18:01 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:18:02.401178 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-1758bb5d-fddc-491b-96a0-20ae680aa182 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:02.402142 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-1758bb5d-fddc-491b-96a0-20ae680aa182 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:02.405906 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-0b5ff630-d9cc-40a7-9231-49d058d07290 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:02.406849 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-0b5ff630-d9cc-40a7-9231-49d058d07290 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:02.409107 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-1758bb5d-fddc-491b-96a0-20ae680aa182 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:02.409562 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-1758bb5d-fddc-491b-96a0-20ae680aa182 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:02.410359 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-1758bb5d-fddc-491b-96a0-20ae680aa182 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:02.410800 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-1758bb5d-fddc-491b-96a0-20ae680aa182 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:02.413468 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0b5ff630-d9cc-40a7-9231-49d058d07290 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:02.413914 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0b5ff630-d9cc-40a7-9231-49d058d07290 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:02.414698 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0b5ff630-d9cc-40a7-9231-49d058d07290 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:02.415219 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0b5ff630-d9cc-40a7-9231-49d058d07290 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:02.441449 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-1758bb5d-fddc-491b-96a0-20ae680aa182 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047005 Jun 17 13:18:02.445235 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 732/1433] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:18:02 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:18:02.447149 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-e50ed53e-c208-4176-80f1-f32e5243f3c6 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:02.448277 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-e50ed53e-c208-4176-80f1-f32e5243f3c6 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:02.448597 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-0b5ff630-d9cc-40a7-9231-49d058d07290 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046642 Jun 17 13:18:02.449151 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 702/1434] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:18:02 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:18:02.455972 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e50ed53e-c208-4176-80f1-f32e5243f3c6 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:02.456418 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e50ed53e-c208-4176-80f1-f32e5243f3c6 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:02.457177 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e50ed53e-c208-4176-80f1-f32e5243f3c6 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:02.457608 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e50ed53e-c208-4176-80f1-f32e5243f3c6 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:02.489134 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-e50ed53e-c208-4176-80f1-f32e5243f3c6 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045640 Jun 17 13:18:02.489713 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 733/1435] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:18:02 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:18:03.458268 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-f72128ae-6059-4eb1-a5ba-e5b972ab5b18 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:03.459798 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-f72128ae-6059-4eb1-a5ba-e5b972ab5b18 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:03.464129 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_api:SELECT=84 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:18:03.464422 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-54b45dfd-d2e9-462d-8d8d-60a80240a8e2 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:03.465945 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-54b45dfd-d2e9-462d-8d8d-60a80240a8e2 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:03.473203 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f72128ae-6059-4eb1-a5ba-e5b972ab5b18 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:03.474019 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f72128ae-6059-4eb1-a5ba-e5b972ab5b18 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:03.475642 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f72128ae-6059-4eb1-a5ba-e5b972ab5b18 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:03.475991 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f72128ae-6059-4eb1-a5ba-e5b972ab5b18 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:03.477224 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-54b45dfd-d2e9-462d-8d8d-60a80240a8e2 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:03.478053 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-54b45dfd-d2e9-462d-8d8d-60a80240a8e2 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:03.478889 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-54b45dfd-d2e9-462d-8d8d-60a80240a8e2 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:03.479361 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-54b45dfd-d2e9-462d-8d8d-60a80240a8e2 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:03.510137 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-f72128ae-6059-4eb1-a5ba-e5b972ab5b18 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058558 Jun 17 13:18:03.510771 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 703/1436] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:18:03 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:18:03.513085 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-54b45dfd-d2e9-462d-8d8d-60a80240a8e2 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055279 Jun 17 13:18:03.513794 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 734/1437] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:18:03 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:18:03.515241 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-f26939e7-3edf-49ef-8d40-b28acfd3963b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:03.516148 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-f26939e7-3edf-49ef-8d40-b28acfd3963b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:03.522420 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f26939e7-3edf-49ef-8d40-b28acfd3963b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:03.522865 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f26939e7-3edf-49ef-8d40-b28acfd3963b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:03.523618 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f26939e7-3edf-49ef-8d40-b28acfd3963b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:03.524045 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f26939e7-3edf-49ef-8d40-b28acfd3963b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:03.553476 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-f26939e7-3edf-49ef-8d40-b28acfd3963b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041754 Jun 17 13:18:03.554185 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 704/1438] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:18:03 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:18:04.522995 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-5af1d8db-5d25-4b67-9193-4ac45f6a1ec8 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:04.523920 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-5af1d8db-5d25-4b67-9193-4ac45f6a1ec8 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:04.525312 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-8b69f3fe-5784-4034-9e11-7d0015da236e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:04.526257 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-8b69f3fe-5784-4034-9e11-7d0015da236e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:04.531418 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-5af1d8db-5d25-4b67-9193-4ac45f6a1ec8 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:04.531856 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-5af1d8db-5d25-4b67-9193-4ac45f6a1ec8 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:04.532619 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-5af1d8db-5d25-4b67-9193-4ac45f6a1ec8 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:04.532952 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8b69f3fe-5784-4034-9e11-7d0015da236e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:04.533113 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-5af1d8db-5d25-4b67-9193-4ac45f6a1ec8 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:04.533408 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8b69f3fe-5784-4034-9e11-7d0015da236e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:04.534215 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8b69f3fe-5784-4034-9e11-7d0015da236e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:04.534632 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8b69f3fe-5784-4034-9e11-7d0015da236e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:04.563287 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-5af1d8db-5d25-4b67-9193-4ac45f6a1ec8 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044209 Jun 17 13:18:04.564024 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 735/1439] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:18:04 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:18:04.568182 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-8b69f3fe-5784-4034-9e11-7d0015da236e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046849 Jun 17 13:18:04.568503 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-db88808f-5a42-4e90-8ad9-34ecddddccfc tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:04.569009 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 705/1440] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:18:04 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:18:04.569462 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-db88808f-5a42-4e90-8ad9-34ecddddccfc tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:04.575773 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-db88808f-5a42-4e90-8ad9-34ecddddccfc tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:04.576241 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-db88808f-5a42-4e90-8ad9-34ecddddccfc tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:04.576987 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-db88808f-5a42-4e90-8ad9-34ecddddccfc tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:04.577419 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-db88808f-5a42-4e90-8ad9-34ecddddccfc tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:04.608348 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-db88808f-5a42-4e90-8ad9-34ecddddccfc tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043467 Jun 17 13:18:04.608909 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 736/1441] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:18:04 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:18:05.579302 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-0ee6bea7-0f60-4a61-a603-71232f4718ea tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:05.580791 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-0ee6bea7-0f60-4a61-a603-71232f4718ea tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:05.583732 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-10689622-5fef-44e3-bc73-43325e7a0f33 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:05.585269 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-10689622-5fef-44e3-bc73-43325e7a0f33 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:05.592336 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0ee6bea7-0f60-4a61-a603-71232f4718ea tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:05.593128 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0ee6bea7-0f60-4a61-a603-71232f4718ea tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:05.594421 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0ee6bea7-0f60-4a61-a603-71232f4718ea tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:05.595169 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0ee6bea7-0f60-4a61-a603-71232f4718ea tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:05.596136 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-10689622-5fef-44e3-bc73-43325e7a0f33 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:05.596884 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-10689622-5fef-44e3-bc73-43325e7a0f33 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:05.598160 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-10689622-5fef-44e3-bc73-43325e7a0f33 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:05.598889 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-10689622-5fef-44e3-bc73-43325e7a0f33 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:05.629438 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-0ee6bea7-0f60-4a61-a603-71232f4718ea tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056864 Jun 17 13:18:05.630475 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-10689622-5fef-44e3-bc73-43325e7a0f33 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053324 Jun 17 13:18:05.631193 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 737/1442] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:18:05 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:18:05.633522 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 706/1443] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:18:05 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:18:05.636099 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-46c2a7ad-9269-4c5d-af5e-89d1c9f7c4ba tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:05.637023 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-46c2a7ad-9269-4c5d-af5e-89d1c9f7c4ba tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:05.642986 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-46c2a7ad-9269-4c5d-af5e-89d1c9f7c4ba tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:05.643436 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-46c2a7ad-9269-4c5d-af5e-89d1c9f7c4ba tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:05.644301 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-46c2a7ad-9269-4c5d-af5e-89d1c9f7c4ba tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:05.644741 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-46c2a7ad-9269-4c5d-af5e-89d1c9f7c4ba tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:05.662587 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_cell1:SELECT=100 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:18:05.687016 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-46c2a7ad-9269-4c5d-af5e-89d1c9f7c4ba tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054787 Jun 17 13:18:05.687759 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 738/1444] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:18:05 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:18:06.641712 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-afadd38e-12fc-4a10-b7bb-ed10af88307c tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:06.642705 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-afadd38e-12fc-4a10-b7bb-ed10af88307c tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:06.644648 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-2e4dc26f-e79a-44df-b552-f9dd279dd8d8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:06.645689 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-2e4dc26f-e79a-44df-b552-f9dd279dd8d8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:06.650537 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-afadd38e-12fc-4a10-b7bb-ed10af88307c tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:06.651810 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-afadd38e-12fc-4a10-b7bb-ed10af88307c tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:06.652690 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-afadd38e-12fc-4a10-b7bb-ed10af88307c tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:06.653118 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-afadd38e-12fc-4a10-b7bb-ed10af88307c tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:06.657299 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2e4dc26f-e79a-44df-b552-f9dd279dd8d8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:06.657746 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2e4dc26f-e79a-44df-b552-f9dd279dd8d8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:06.658547 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2e4dc26f-e79a-44df-b552-f9dd279dd8d8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:06.658985 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2e4dc26f-e79a-44df-b552-f9dd279dd8d8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:06.684707 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=100 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:18:06.690596 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-afadd38e-12fc-4a10-b7bb-ed10af88307c tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052706 Jun 17 13:18:06.694912 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 707/1445] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:18:06 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:18:06.698464 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-eb9d9b4a-6a96-4297-a8a3-8d60e0412a91 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:06.699571 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-eb9d9b4a-6a96-4297-a8a3-8d60e0412a91 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:06.702593 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-2e4dc26f-e79a-44df-b552-f9dd279dd8d8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.062935 Jun 17 13:18:06.703589 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 739/1446] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:18:06 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:18:06.709770 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-eb9d9b4a-6a96-4297-a8a3-8d60e0412a91 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:06.710291 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-eb9d9b4a-6a96-4297-a8a3-8d60e0412a91 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:06.711041 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-eb9d9b4a-6a96-4297-a8a3-8d60e0412a91 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:06.711467 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-eb9d9b4a-6a96-4297-a8a3-8d60e0412a91 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:06.742784 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-eb9d9b4a-6a96-4297-a8a3-8d60e0412a91 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048282 Jun 17 13:18:06.743372 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 708/1447] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:18:06 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:18:07.707250 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-8abcf103-60a1-4110-9826-951df1f96f23 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:07.708553 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-8abcf103-60a1-4110-9826-951df1f96f23 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:07.716590 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-303ecc68-d6ce-44a2-ab55-dad4474155c4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:07.717830 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-303ecc68-d6ce-44a2-ab55-dad4474155c4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:07.718494 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8abcf103-60a1-4110-9826-951df1f96f23 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:07.719116 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8abcf103-60a1-4110-9826-951df1f96f23 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:07.720185 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8abcf103-60a1-4110-9826-951df1f96f23 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:07.720804 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8abcf103-60a1-4110-9826-951df1f96f23 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:07.728233 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-303ecc68-d6ce-44a2-ab55-dad4474155c4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:07.728233 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-303ecc68-d6ce-44a2-ab55-dad4474155c4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:07.729044 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-303ecc68-d6ce-44a2-ab55-dad4474155c4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:07.729476 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-303ecc68-d6ce-44a2-ab55-dad4474155c4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:07.753776 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-8abcf103-60a1-4110-9826-951df1f96f23 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053197 Jun 17 13:18:07.754623 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 740/1448] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:18:07 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:18:07.759118 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-6813d0f1-012e-43fe-80d3-7d32ad3ddea1 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:07.760523 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-6813d0f1-012e-43fe-80d3-7d32ad3ddea1 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:07.761075 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-303ecc68-d6ce-44a2-ab55-dad4474155c4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050135 Jun 17 13:18:07.761832 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 709/1449] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:18:07 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:18:07.766004 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6813d0f1-012e-43fe-80d3-7d32ad3ddea1 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:07.766503 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6813d0f1-012e-43fe-80d3-7d32ad3ddea1 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:07.767259 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6813d0f1-012e-43fe-80d3-7d32ad3ddea1 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:07.767689 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6813d0f1-012e-43fe-80d3-7d32ad3ddea1 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:07.796804 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-6813d0f1-012e-43fe-80d3-7d32ad3ddea1 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041287 Jun 17 13:18:07.797353 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 741/1450] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:18:07 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:18:08.769927 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-989be781-48d7-4c71-bf53-24b6400cd96f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:08.771433 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-989be781-48d7-4c71-bf53-24b6400cd96f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:08.776959 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-21527ff2-cb58-4c34-adad-be55c70f8241 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:08.778493 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-21527ff2-cb58-4c34-adad-be55c70f8241 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:08.782421 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-989be781-48d7-4c71-bf53-24b6400cd96f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:08.783185 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-989be781-48d7-4c71-bf53-24b6400cd96f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:08.784440 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-989be781-48d7-4c71-bf53-24b6400cd96f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:08.785156 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-989be781-48d7-4c71-bf53-24b6400cd96f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:08.788633 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-21527ff2-cb58-4c34-adad-be55c70f8241 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:08.789367 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-21527ff2-cb58-4c34-adad-be55c70f8241 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:08.790485 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-21527ff2-cb58-4c34-adad-be55c70f8241 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:08.790915 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-21527ff2-cb58-4c34-adad-be55c70f8241 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:08.816839 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-989be781-48d7-4c71-bf53-24b6400cd96f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053494 Jun 17 13:18:08.817658 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 710/1451] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:18:08 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:18:08.820423 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-21527ff2-cb58-4c34-adad-be55c70f8241 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050762 Jun 17 13:18:08.821166 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 742/1452] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:18:08 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:18:08.822369 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-b8b3e2c3-1885-49d3-bb38-51be413fe18d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:08.823282 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-b8b3e2c3-1885-49d3-bb38-51be413fe18d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:08.829224 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b8b3e2c3-1885-49d3-bb38-51be413fe18d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:08.829671 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b8b3e2c3-1885-49d3-bb38-51be413fe18d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:08.830470 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b8b3e2c3-1885-49d3-bb38-51be413fe18d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:08.830900 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b8b3e2c3-1885-49d3-bb38-51be413fe18d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:08.860702 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-b8b3e2c3-1885-49d3-bb38-51be413fe18d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041958 Jun 17 13:18:08.861245 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 711/1453] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:18:08 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:18:09.832608 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-9f7eb645-10ca-47e6-9d46-907fd64791c5 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:09.834150 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-9f7eb645-10ca-47e6-9d46-907fd64791c5 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:09.835858 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-92b8fb4e-d993-440a-8f69-536bd3e6e781 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:09.837762 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-92b8fb4e-d993-440a-8f69-536bd3e6e781 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:09.841823 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9f7eb645-10ca-47e6-9d46-907fd64791c5 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:09.842314 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9f7eb645-10ca-47e6-9d46-907fd64791c5 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:09.843084 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9f7eb645-10ca-47e6-9d46-907fd64791c5 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:09.843526 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9f7eb645-10ca-47e6-9d46-907fd64791c5 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:09.844665 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-92b8fb4e-d993-440a-8f69-536bd3e6e781 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:09.845111 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-92b8fb4e-d993-440a-8f69-536bd3e6e781 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:09.845880 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-92b8fb4e-d993-440a-8f69-536bd3e6e781 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:09.846359 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-92b8fb4e-d993-440a-8f69-536bd3e6e781 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:09.874699 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-9f7eb645-10ca-47e6-9d46-907fd64791c5 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048577 Jun 17 13:18:09.875276 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 743/1454] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:18:09 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:18:09.877938 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-92b8fb4e-d993-440a-8f69-536bd3e6e781 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048530 Jun 17 13:18:09.878708 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 712/1455] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:18:09 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:18:09.879833 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-193519b0-640b-439b-b21b-53493b2913c4 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:09.880723 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-193519b0-640b-439b-b21b-53493b2913c4 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:09.887157 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-193519b0-640b-439b-b21b-53493b2913c4 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:09.887756 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-193519b0-640b-439b-b21b-53493b2913c4 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:09.888638 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-193519b0-640b-439b-b21b-53493b2913c4 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:09.889093 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-193519b0-640b-439b-b21b-53493b2913c4 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:09.918814 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-193519b0-640b-439b-b21b-53493b2913c4 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042533 Jun 17 13:18:09.919381 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 744/1456] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:18:09 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:18:10.891184 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-8b56c14a-5bd2-456a-92c8-99948cbcb92f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:10.892661 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-8b56c14a-5bd2-456a-92c8-99948cbcb92f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:10.893921 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-3082133b-394c-4c7d-bb39-ae62145c33e9 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:10.895442 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-3082133b-394c-4c7d-bb39-ae62145c33e9 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:10.899084 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_api:SELECT=88 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:18:10.903863 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8b56c14a-5bd2-456a-92c8-99948cbcb92f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:10.904557 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8b56c14a-5bd2-456a-92c8-99948cbcb92f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:10.905908 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8b56c14a-5bd2-456a-92c8-99948cbcb92f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:10.906625 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8b56c14a-5bd2-456a-92c8-99948cbcb92f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:10.908070 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-3082133b-394c-4c7d-bb39-ae62145c33e9 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:10.908844 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-3082133b-394c-4c7d-bb39-ae62145c33e9 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:10.910155 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-3082133b-394c-4c7d-bb39-ae62145c33e9 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:10.910870 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-3082133b-394c-4c7d-bb39-ae62145c33e9 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:10.940336 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-8b56c14a-5bd2-456a-92c8-99948cbcb92f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055985 Jun 17 13:18:10.944333 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 713/1457] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:18:10 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:18:10.944520 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-3082133b-394c-4c7d-bb39-ae62145c33e9 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.057109 Jun 17 13:18:10.945252 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 745/1458] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:18:10 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:18:10.949269 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-ebda1bf3-d08e-4ab9-bc73-fe345b4975d0 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:10.950211 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-ebda1bf3-d08e-4ab9-bc73-fe345b4975d0 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:10.956153 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ebda1bf3-d08e-4ab9-bc73-fe345b4975d0 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:10.956591 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ebda1bf3-d08e-4ab9-bc73-fe345b4975d0 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:10.957344 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ebda1bf3-d08e-4ab9-bc73-fe345b4975d0 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:10.957774 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ebda1bf3-d08e-4ab9-bc73-fe345b4975d0 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:10.988415 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-ebda1bf3-d08e-4ab9-bc73-fe345b4975d0 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043030 Jun 17 13:18:10.992258 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 714/1459] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:18:10 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:18:11.953929 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-d18424a4-d10a-457e-bb7c-d1e51f78c634 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:18:11.955137 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-d18424a4-d10a-457e-bb7c-d1e51f78c634 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:11.957657 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-5218e807-e8d4-43f1-8b8c-303541245144 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:11.958737 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-5218e807-e8d4-43f1-8b8c-303541245144 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:11.963577 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d18424a4-d10a-457e-bb7c-d1e51f78c634 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:11.964024 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d18424a4-d10a-457e-bb7c-d1e51f78c634 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:11.964821 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d18424a4-d10a-457e-bb7c-d1e51f78c634 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:11.965250 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d18424a4-d10a-457e-bb7c-d1e51f78c634 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:11.966282 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5218e807-e8d4-43f1-8b8c-303541245144 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:11.966732 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5218e807-e8d4-43f1-8b8c-303541245144 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:11.967503 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5218e807-e8d4-43f1-8b8c-303541245144 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:11.967947 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5218e807-e8d4-43f1-8b8c-303541245144 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:11.999336 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-5218e807-e8d4-43f1-8b8c-303541245144 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046776 Jun 17 13:18:12.000068 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 715/1460] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:18:11 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:18:12.004464 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-4f8978df-9d75-4ec5-8929-9a0b742fab73 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:12.005614 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-4f8978df-9d75-4ec5-8929-9a0b742fab73 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:12.013496 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4f8978df-9d75-4ec5-8929-9a0b742fab73 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:12.014223 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4f8978df-9d75-4ec5-8929-9a0b742fab73 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:12.014803 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4f8978df-9d75-4ec5-8929-9a0b742fab73 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:12.015074 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4f8978df-9d75-4ec5-8929-9a0b742fab73 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:12.043949 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-4f8978df-9d75-4ec5-8929-9a0b742fab73 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042974 Jun 17 13:18:12.047679 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 716/1461] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:18:11 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:18:12.069354 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-d18424a4-d10a-457e-bb7c-d1e51f78c634 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "POST /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/action" status: 200 len: 76323 microversion: 2.1 time: 0.119809 Jun 17 13:18:12.070116 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 746/1462] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Jun 17 13:18:11 2022] POST /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509/action => generated 76323 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:18:13.013110 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-35df796c-ad43-4cff-8d5f-bb6b278d398f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:13.014133 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-35df796c-ad43-4cff-8d5f-bb6b278d398f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:13.021964 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-35df796c-ad43-4cff-8d5f-bb6b278d398f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:13.022500 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-35df796c-ad43-4cff-8d5f-bb6b278d398f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:13.023345 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-35df796c-ad43-4cff-8d5f-bb6b278d398f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:13.023823 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-35df796c-ad43-4cff-8d5f-bb6b278d398f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:13.056644 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-0de75bbd-4a33-468b-8553-8be9d3aca3d3 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:13.057127 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-35df796c-ad43-4cff-8d5f-bb6b278d398f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049047 Jun 17 13:18:13.057704 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-0de75bbd-4a33-468b-8553-8be9d3aca3d3 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:13.058068 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 717/1463] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:18:13 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:18:13.068894 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0de75bbd-4a33-468b-8553-8be9d3aca3d3 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:13.069347 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0de75bbd-4a33-468b-8553-8be9d3aca3d3 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:13.070116 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0de75bbd-4a33-468b-8553-8be9d3aca3d3 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:13.070595 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0de75bbd-4a33-468b-8553-8be9d3aca3d3 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:13.101919 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-0de75bbd-4a33-468b-8553-8be9d3aca3d3 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049904 Jun 17 13:18:13.102990 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 747/1464] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:18:13 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 13:18:14.073215 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-e376fabf-3515-44b7-b29c-51b42b154cb8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:14.074333 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-e376fabf-3515-44b7-b29c-51b42b154cb8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:14.084535 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e376fabf-3515-44b7-b29c-51b42b154cb8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:14.085196 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e376fabf-3515-44b7-b29c-51b42b154cb8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:14.086695 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e376fabf-3515-44b7-b29c-51b42b154cb8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:14.087542 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e376fabf-3515-44b7-b29c-51b42b154cb8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:14.114710 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-1105ba58-9730-43a0-ae51-d40fc1189306 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:14.115633 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-1105ba58-9730-43a0-ae51-d40fc1189306 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:14.119572 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-e376fabf-3515-44b7-b29c-51b42b154cb8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053637 Jun 17 13:18:14.120338 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 718/1465] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:18:14 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:18:14.122460 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-1105ba58-9730-43a0-ae51-d40fc1189306 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:14.122908 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-1105ba58-9730-43a0-ae51-d40fc1189306 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:14.123641 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-1105ba58-9730-43a0-ae51-d40fc1189306 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:14.124103 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-1105ba58-9730-43a0-ae51-d40fc1189306 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:14.154403 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-1105ba58-9730-43a0-ae51-d40fc1189306 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043595 Jun 17 13:18:14.154992 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 748/1466] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:18:14 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:18:15.136336 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-7e85a017-104b-49be-97ab-951b7ff37c48 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:15.137815 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-7e85a017-104b-49be-97ab-951b7ff37c48 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:15.148847 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7e85a017-104b-49be-97ab-951b7ff37c48 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:15.149525 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7e85a017-104b-49be-97ab-951b7ff37c48 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:15.150329 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7e85a017-104b-49be-97ab-951b7ff37c48 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:15.150759 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7e85a017-104b-49be-97ab-951b7ff37c48 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:15.166511 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-49f5d0b9-ada0-4d30-871b-f0d848faa7b6 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:15.167453 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-49f5d0b9-ada0-4d30-871b-f0d848faa7b6 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:15.174179 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-49f5d0b9-ada0-4d30-871b-f0d848faa7b6 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:15.174617 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-49f5d0b9-ada0-4d30-871b-f0d848faa7b6 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:15.175391 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-49f5d0b9-ada0-4d30-871b-f0d848faa7b6 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:15.175853 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-49f5d0b9-ada0-4d30-871b-f0d848faa7b6 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:15.181164 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-7e85a017-104b-49be-97ab-951b7ff37c48 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051802 Jun 17 13:18:15.181866 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 719/1467] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:18:15 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:18:15.208350 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-49f5d0b9-ada0-4d30-871b-f0d848faa7b6 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045925 Jun 17 13:18:15.208914 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 749/1468] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:18:15 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:18:16.196336 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-6a249b30-9523-4668-9fc0-b3ff44e16adf tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:16.197283 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-6a249b30-9523-4668-9fc0-b3ff44e16adf tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:16.204215 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6a249b30-9523-4668-9fc0-b3ff44e16adf tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:16.204657 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6a249b30-9523-4668-9fc0-b3ff44e16adf tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:16.205447 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6a249b30-9523-4668-9fc0-b3ff44e16adf tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:16.205870 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6a249b30-9523-4668-9fc0-b3ff44e16adf tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:16.220611 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-d5b8fe95-5be9-450d-9473-26eb028a8136 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:16.221533 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-d5b8fe95-5be9-450d-9473-26eb028a8136 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:16.228713 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d5b8fe95-5be9-450d-9473-26eb028a8136 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:16.229164 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d5b8fe95-5be9-450d-9473-26eb028a8136 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:16.229947 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d5b8fe95-5be9-450d-9473-26eb028a8136 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:16.230394 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d5b8fe95-5be9-450d-9473-26eb028a8136 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:16.235375 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-6a249b30-9523-4668-9fc0-b3ff44e16adf tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045717 Jun 17 13:18:16.236168 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 720/1469] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:18:16 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:18:16.261700 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-d5b8fe95-5be9-450d-9473-26eb028a8136 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045184 Jun 17 13:18:16.262500 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 750/1470] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:18:16 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:18:17.249911 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-3353173b-6ea0-4eb3-a1b6-38c7aaf00e67 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:17.251082 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-3353173b-6ea0-4eb3-a1b6-38c7aaf00e67 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:17.259610 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3353173b-6ea0-4eb3-a1b6-38c7aaf00e67 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:17.260173 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3353173b-6ea0-4eb3-a1b6-38c7aaf00e67 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:17.261123 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3353173b-6ea0-4eb3-a1b6-38c7aaf00e67 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:17.261666 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3353173b-6ea0-4eb3-a1b6-38c7aaf00e67 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:17.274745 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-8f0b3816-572e-448f-8169-494e2e0b6f19 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:17.275687 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-8f0b3816-572e-448f-8169-494e2e0b6f19 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:17.282563 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8f0b3816-572e-448f-8169-494e2e0b6f19 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:17.283015 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8f0b3816-572e-448f-8169-494e2e0b6f19 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:17.283787 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8f0b3816-572e-448f-8169-494e2e0b6f19 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:17.284226 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8f0b3816-572e-448f-8169-494e2e0b6f19 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:17.294388 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-3353173b-6ea0-4eb3-a1b6-38c7aaf00e67 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049435 Jun 17 13:18:17.298745 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 721/1471] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:18:17 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:18:17.316899 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-8f0b3816-572e-448f-8169-494e2e0b6f19 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047379 Jun 17 13:18:17.317447 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 751/1472] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:18:17 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:18:18.311064 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-ba594076-0805-4bb3-8669-8a9628782560 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:18.312645 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-ba594076-0805-4bb3-8669-8a9628782560 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:18.323000 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ba594076-0805-4bb3-8669-8a9628782560 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:18.323453 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ba594076-0805-4bb3-8669-8a9628782560 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:18.324230 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ba594076-0805-4bb3-8669-8a9628782560 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:18.324660 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ba594076-0805-4bb3-8669-8a9628782560 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:18.329087 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-553d996b-4240-4c36-8eba-be0ec446b07d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:18.330013 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-553d996b-4240-4c36-8eba-be0ec446b07d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:18.337457 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-553d996b-4240-4c36-8eba-be0ec446b07d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:18.337925 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-553d996b-4240-4c36-8eba-be0ec446b07d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:18.338731 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-553d996b-4240-4c36-8eba-be0ec446b07d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:18.339220 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-553d996b-4240-4c36-8eba-be0ec446b07d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:18.355192 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-ba594076-0805-4bb3-8669-8a9628782560 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051388 Jun 17 13:18:18.359597 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 722/1473] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:18:18 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:18:18.370912 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-553d996b-4240-4c36-8eba-be0ec446b07d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045932 Jun 17 13:18:18.371480 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 752/1474] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:18:18 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:18:19.367576 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-d54c9e4a-c396-404c-ad98-a803c1524535 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:19.368595 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-d54c9e4a-c396-404c-ad98-a803c1524535 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:19.375338 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d54c9e4a-c396-404c-ad98-a803c1524535 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:19.377049 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d54c9e4a-c396-404c-ad98-a803c1524535 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:19.378644 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d54c9e4a-c396-404c-ad98-a803c1524535 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:19.379061 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d54c9e4a-c396-404c-ad98-a803c1524535 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:19.384211 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-208c8255-84c1-40df-b585-705b99e8c87b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:19.390529 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-208c8255-84c1-40df-b585-705b99e8c87b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:19.401124 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-208c8255-84c1-40df-b585-705b99e8c87b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:19.401866 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-208c8255-84c1-40df-b585-705b99e8c87b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:19.404468 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-208c8255-84c1-40df-b585-705b99e8c87b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:19.405074 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-208c8255-84c1-40df-b585-705b99e8c87b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:19.422366 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-d54c9e4a-c396-404c-ad98-a803c1524535 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.058452 Jun 17 13:18:19.423852 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 723/1475] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:18:19 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:18:19.444766 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-208c8255-84c1-40df-b585-705b99e8c87b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065230 Jun 17 13:18:19.445827 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 753/1476] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:18:19 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 13:18:20.438372 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-9b9b232d-b80e-4b3a-9c52-4c4bc3f30edc tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:20.439792 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-9b9b232d-b80e-4b3a-9c52-4c4bc3f30edc tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:20.449317 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9b9b232d-b80e-4b3a-9c52-4c4bc3f30edc tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:20.449764 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9b9b232d-b80e-4b3a-9c52-4c4bc3f30edc tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:20.450575 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9b9b232d-b80e-4b3a-9c52-4c4bc3f30edc tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:20.451009 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9b9b232d-b80e-4b3a-9c52-4c4bc3f30edc tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:20.457089 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-d87e1b4a-7969-4200-a090-75b020805812 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:20.458006 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-d87e1b4a-7969-4200-a090-75b020805812 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:20.465149 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d87e1b4a-7969-4200-a090-75b020805812 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:20.465592 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d87e1b4a-7969-4200-a090-75b020805812 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:20.466380 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d87e1b4a-7969-4200-a090-75b020805812 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:20.466807 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d87e1b4a-7969-4200-a090-75b020805812 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:20.468255 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=100 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:18:20.483480 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-9b9b232d-b80e-4b3a-9c52-4c4bc3f30edc tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051288 Jun 17 13:18:20.486557 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 724/1477] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:18:20 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:18:20.497713 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-d87e1b4a-7969-4200-a090-75b020805812 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044554 Jun 17 13:18:20.498590 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 754/1478] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:18:20 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:18:21.499702 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-36acae27-d404-4827-9b25-13cce9477f18 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:21.501358 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-36acae27-d404-4827-9b25-13cce9477f18 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:21.510986 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-36acae27-d404-4827-9b25-13cce9477f18 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:21.511435 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-36acae27-d404-4827-9b25-13cce9477f18 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:21.512094 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-67d76518-c777-4ea4-947c-ae1e25cbc67c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:21.512566 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-36acae27-d404-4827-9b25-13cce9477f18 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:21.512566 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-36acae27-d404-4827-9b25-13cce9477f18 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:21.513027 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-67d76518-c777-4ea4-947c-ae1e25cbc67c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:21.519871 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-67d76518-c777-4ea4-947c-ae1e25cbc67c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:21.520321 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-67d76518-c777-4ea4-947c-ae1e25cbc67c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:21.521083 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-67d76518-c777-4ea4-947c-ae1e25cbc67c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:21.521519 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-67d76518-c777-4ea4-947c-ae1e25cbc67c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:21.539065 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_cell1:SELECT=100 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:18:21.542352 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-36acae27-d404-4827-9b25-13cce9477f18 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049374 Jun 17 13:18:21.546465 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 725/1479] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:18:21 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:18:21.553812 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-67d76518-c777-4ea4-947c-ae1e25cbc67c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047401 Jun 17 13:18:21.554449 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 755/1480] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:18:21 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:18:22.554574 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-9f9b6068-d64e-42e5-afcd-5927ac3b0326 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:22.556129 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-9f9b6068-d64e-42e5-afcd-5927ac3b0326 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:22.563022 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9f9b6068-d64e-42e5-afcd-5927ac3b0326 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:22.563474 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9f9b6068-d64e-42e5-afcd-5927ac3b0326 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:22.564213 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9f9b6068-d64e-42e5-afcd-5927ac3b0326 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:22.564658 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9f9b6068-d64e-42e5-afcd-5927ac3b0326 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:22.565057 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-affdb2e6-4499-4431-b804-198db4d0dbd9 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:22.565976 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-affdb2e6-4499-4431-b804-198db4d0dbd9 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:22.572685 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-affdb2e6-4499-4431-b804-198db4d0dbd9 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:22.573126 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-affdb2e6-4499-4431-b804-198db4d0dbd9 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:22.573877 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-affdb2e6-4499-4431-b804-198db4d0dbd9 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:22.574344 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-affdb2e6-4499-4431-b804-198db4d0dbd9 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:22.595857 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-9f9b6068-d64e-42e5-afcd-5927ac3b0326 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045263 Jun 17 13:18:22.599728 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 726/1481] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:18:22 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:18:22.604121 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-affdb2e6-4499-4431-b804-198db4d0dbd9 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042903 Jun 17 13:18:22.604906 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 756/1482] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:18:22 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:18:23.613333 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-65ff8212-61be-4cfe-9346-5329c75d9ddc tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:23.614869 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-65ff8212-61be-4cfe-9346-5329c75d9ddc tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:23.619473 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-76ce11f0-1f3a-4717-9573-8f74bbec04d6 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:23.620952 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-76ce11f0-1f3a-4717-9573-8f74bbec04d6 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:23.626153 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-65ff8212-61be-4cfe-9346-5329c75d9ddc tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:23.626946 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-65ff8212-61be-4cfe-9346-5329c75d9ddc tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:23.628515 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-65ff8212-61be-4cfe-9346-5329c75d9ddc tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:23.629287 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-65ff8212-61be-4cfe-9346-5329c75d9ddc tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:23.631498 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-76ce11f0-1f3a-4717-9573-8f74bbec04d6 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:23.632229 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-76ce11f0-1f3a-4717-9573-8f74bbec04d6 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:23.633465 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-76ce11f0-1f3a-4717-9573-8f74bbec04d6 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:23.634742 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-76ce11f0-1f3a-4717-9573-8f74bbec04d6 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:23.662111 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-65ff8212-61be-4cfe-9346-5329c75d9ddc tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055938 Jun 17 13:18:23.666625 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 727/1483] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:18:23 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:18:23.666808 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-76ce11f0-1f3a-4717-9573-8f74bbec04d6 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052810 Jun 17 13:18:23.666808 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 757/1484] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:18:23 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:18:24.675981 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-3584f635-da2b-4395-bc0e-e325c39e3dfd tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:24.676934 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-62ad3f9e-6b6a-45e3-b5ab-cb5cfe526f99 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:24.677329 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-3584f635-da2b-4395-bc0e-e325c39e3dfd tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:24.677957 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-62ad3f9e-6b6a-45e3-b5ab-cb5cfe526f99 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:24.684973 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3584f635-da2b-4395-bc0e-e325c39e3dfd tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:24.685165 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-62ad3f9e-6b6a-45e3-b5ab-cb5cfe526f99 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:24.685405 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-62ad3f9e-6b6a-45e3-b5ab-cb5cfe526f99 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:24.685569 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3584f635-da2b-4395-bc0e-e325c39e3dfd tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:24.686197 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3584f635-da2b-4395-bc0e-e325c39e3dfd tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:24.686314 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-62ad3f9e-6b6a-45e3-b5ab-cb5cfe526f99 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:24.686635 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3584f635-da2b-4395-bc0e-e325c39e3dfd tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:24.686766 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-62ad3f9e-6b6a-45e3-b5ab-cb5cfe526f99 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:24.718242 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-62ad3f9e-6b6a-45e3-b5ab-cb5cfe526f99 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045109 Jun 17 13:18:24.718953 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 758/1485] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:18:24 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 13:18:24.720221 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-3584f635-da2b-4395-bc0e-e325c39e3dfd tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048206 Jun 17 13:18:24.721124 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 728/1486] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:18:24 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:18:25.731626 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-ba5a6bf3-0c3e-4f03-894d-dbdc7ea2f081 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:25.732902 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-ba5a6bf3-0c3e-4f03-894d-dbdc7ea2f081 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:25.734112 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-52585033-f632-4a76-9266-9a81d6b887ad tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:25.735041 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-52585033-f632-4a76-9266-9a81d6b887ad tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:25.739824 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ba5a6bf3-0c3e-4f03-894d-dbdc7ea2f081 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:25.740278 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ba5a6bf3-0c3e-4f03-894d-dbdc7ea2f081 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:25.741301 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ba5a6bf3-0c3e-4f03-894d-dbdc7ea2f081 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:25.741727 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ba5a6bf3-0c3e-4f03-894d-dbdc7ea2f081 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:25.742056 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-52585033-f632-4a76-9266-9a81d6b887ad tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:25.742535 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-52585033-f632-4a76-9266-9a81d6b887ad tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:25.743362 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-52585033-f632-4a76-9266-9a81d6b887ad tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:25.743814 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-52585033-f632-4a76-9266-9a81d6b887ad tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:25.772623 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-ba5a6bf3-0c3e-4f03-894d-dbdc7ea2f081 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045703 Jun 17 13:18:25.773457 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 759/1487] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:18:25 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:18:25.774885 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-52585033-f632-4a76-9266-9a81d6b887ad tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045958 Jun 17 13:18:25.775631 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 729/1488] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:18:25 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:18:26.787173 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-22579e8f-79a1-4a1e-8660-53ce317a9f18 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:26.788315 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-22579e8f-79a1-4a1e-8660-53ce317a9f18 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:26.789062 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-7a38ab5c-f163-4420-89ae-9cfbca6525bc tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:26.790304 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-7a38ab5c-f163-4420-89ae-9cfbca6525bc tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:26.796945 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-22579e8f-79a1-4a1e-8660-53ce317a9f18 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:26.797476 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-22579e8f-79a1-4a1e-8660-53ce317a9f18 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:26.798407 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-22579e8f-79a1-4a1e-8660-53ce317a9f18 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:26.798951 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-22579e8f-79a1-4a1e-8660-53ce317a9f18 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:26.799368 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7a38ab5c-f163-4420-89ae-9cfbca6525bc tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:26.799901 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7a38ab5c-f163-4420-89ae-9cfbca6525bc tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:26.800809 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7a38ab5c-f163-4420-89ae-9cfbca6525bc tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:26.801320 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7a38ab5c-f163-4420-89ae-9cfbca6525bc tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:26.832276 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-22579e8f-79a1-4a1e-8660-53ce317a9f18 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050499 Jun 17 13:18:26.836633 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-7a38ab5c-f163-4420-89ae-9cfbca6525bc tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049236 Jun 17 13:18:26.836749 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 760/1489] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:18:26 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:18:26.836834 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 730/1490] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:18:26 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:18:27.845082 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-729ee67d-6204-4e99-ab47-d072ecd8ed09 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:27.845704 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-3d782c60-edb2-4b4b-b93d-facde7301546 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:27.846073 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-3d782c60-edb2-4b4b-b93d-facde7301546 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:27.846211 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-729ee67d-6204-4e99-ab47-d072ecd8ed09 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:27.852942 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-729ee67d-6204-4e99-ab47-d072ecd8ed09 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:27.853098 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3d782c60-edb2-4b4b-b93d-facde7301546 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:27.853367 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3d782c60-edb2-4b4b-b93d-facde7301546 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:27.853533 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-729ee67d-6204-4e99-ab47-d072ecd8ed09 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:27.854130 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3d782c60-edb2-4b4b-b93d-facde7301546 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:27.854275 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-729ee67d-6204-4e99-ab47-d072ecd8ed09 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:27.855186 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3d782c60-edb2-4b4b-b93d-facde7301546 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:27.855334 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-729ee67d-6204-4e99-ab47-d072ecd8ed09 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:27.884989 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-3d782c60-edb2-4b4b-b93d-facde7301546 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043855 Jun 17 13:18:27.885302 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-729ee67d-6204-4e99-ab47-d072ecd8ed09 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044146 Jun 17 13:18:27.885518 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 731/1491] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:18:27 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:18:27.885898 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 761/1492] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:18:27 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:18:28.901482 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-b6d23de4-6a07-4890-a295-8535a7ee31f3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:28.902406 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-6d91da1b-0816-412e-8d3f-f046983d28a5 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:28.903279 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-b6d23de4-6a07-4890-a295-8535a7ee31f3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:28.903475 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-6d91da1b-0816-412e-8d3f-f046983d28a5 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:28.914047 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b6d23de4-6a07-4890-a295-8535a7ee31f3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:28.914365 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6d91da1b-0816-412e-8d3f-f046983d28a5 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:28.914855 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b6d23de4-6a07-4890-a295-8535a7ee31f3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:28.915148 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6d91da1b-0816-412e-8d3f-f046983d28a5 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:28.916151 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b6d23de4-6a07-4890-a295-8535a7ee31f3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:28.916386 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6d91da1b-0816-412e-8d3f-f046983d28a5 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:28.916817 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b6d23de4-6a07-4890-a295-8535a7ee31f3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:28.917095 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6d91da1b-0816-412e-8d3f-f046983d28a5 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:28.947570 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-6d91da1b-0816-412e-8d3f-f046983d28a5 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052804 Jun 17 13:18:28.947837 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-b6d23de4-6a07-4890-a295-8535a7ee31f3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052985 Jun 17 13:18:28.948794 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 762/1493] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:18:28 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:18:28.949174 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 732/1494] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:18:28 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:18:29.960439 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-2f2cbd6d-e0b1-423d-9ab0-ecbed9afeb43 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:29.961589 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-2f2cbd6d-e0b1-423d-9ab0-ecbed9afeb43 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:29.964232 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-d1b7d2d8-1c73-4c1a-8d83-45f680d03dd8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:29.965535 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-d1b7d2d8-1c73-4c1a-8d83-45f680d03dd8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:29.969705 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2f2cbd6d-e0b1-423d-9ab0-ecbed9afeb43 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:29.970185 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2f2cbd6d-e0b1-423d-9ab0-ecbed9afeb43 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:29.970955 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2f2cbd6d-e0b1-423d-9ab0-ecbed9afeb43 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:29.971405 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2f2cbd6d-e0b1-423d-9ab0-ecbed9afeb43 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:29.972459 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d1b7d2d8-1c73-4c1a-8d83-45f680d03dd8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:29.972908 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d1b7d2d8-1c73-4c1a-8d83-45f680d03dd8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:29.973675 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d1b7d2d8-1c73-4c1a-8d83-45f680d03dd8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:29.974129 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d1b7d2d8-1c73-4c1a-8d83-45f680d03dd8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:30.007429 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-d1b7d2d8-1c73-4c1a-8d83-45f680d03dd8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047618 Jun 17 13:18:30.007702 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-2f2cbd6d-e0b1-423d-9ab0-ecbed9afeb43 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052126 Jun 17 13:18:30.008284 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 733/1495] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:18:29 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 17 13:18:30.008574 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 763/1496] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:18:29 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:18:31.021398 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-f9005787-fdc9-4f7f-af9c-4e03de1ec883 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:31.022189 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-cc00d31c-468f-4f7c-b996-a65c35b6ef41 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:31.022696 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-f9005787-fdc9-4f7f-af9c-4e03de1ec883 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:31.023102 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-cc00d31c-468f-4f7c-b996-a65c35b6ef41 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:31.031706 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f9005787-fdc9-4f7f-af9c-4e03de1ec883 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:31.032302 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f9005787-fdc9-4f7f-af9c-4e03de1ec883 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:31.032738 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-cc00d31c-468f-4f7c-b996-a65c35b6ef41 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:31.033315 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f9005787-fdc9-4f7f-af9c-4e03de1ec883 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:31.033509 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-cc00d31c-468f-4f7c-b996-a65c35b6ef41 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:31.033883 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f9005787-fdc9-4f7f-af9c-4e03de1ec883 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:31.034357 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-cc00d31c-468f-4f7c-b996-a65c35b6ef41 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:31.034925 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-cc00d31c-468f-4f7c-b996-a65c35b6ef41 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:31.067050 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-f9005787-fdc9-4f7f-af9c-4e03de1ec883 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051179 Jun 17 13:18:31.068929 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-cc00d31c-468f-4f7c-b996-a65c35b6ef41 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052604 Jun 17 13:18:31.069990 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 734/1497] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:18:31 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:18:31.070179 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 764/1498] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:18:31 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:18:32.084953 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-20c24495-63d5-46af-99a1-563dadb3a01f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:32.085969 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-d3ab577a-d113-4d61-9484-ed3838a30978 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:32.086622 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-20c24495-63d5-46af-99a1-563dadb3a01f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:32.086817 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-d3ab577a-d113-4d61-9484-ed3838a30978 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:32.095449 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-20c24495-63d5-46af-99a1-563dadb3a01f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:32.095902 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-20c24495-63d5-46af-99a1-563dadb3a01f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:32.096061 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d3ab577a-d113-4d61-9484-ed3838a30978 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:32.096345 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d3ab577a-d113-4d61-9484-ed3838a30978 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:32.096818 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-20c24495-63d5-46af-99a1-563dadb3a01f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:32.097254 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d3ab577a-d113-4d61-9484-ed3838a30978 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:32.097399 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-20c24495-63d5-46af-99a1-563dadb3a01f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:32.097808 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d3ab577a-d113-4d61-9484-ed3838a30978 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:32.129569 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-d3ab577a-d113-4d61-9484-ed3838a30978 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051387 Jun 17 13:18:32.130403 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 735/1499] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:18:32 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:18:32.130561 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-20c24495-63d5-46af-99a1-563dadb3a01f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051978 Jun 17 13:18:32.134358 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 765/1500] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:18:32 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 13:18:33.143831 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-f20d0605-432e-4b91-b405-c9206bfbcd30 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:33.144478 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-b67ecd9c-5375-4be7-be40-35bca756f892 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:33.144891 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-f20d0605-432e-4b91-b405-c9206bfbcd30 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:33.145090 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-b67ecd9c-5375-4be7-be40-35bca756f892 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:33.151873 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b67ecd9c-5375-4be7-be40-35bca756f892 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:33.152078 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f20d0605-432e-4b91-b405-c9206bfbcd30 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:33.152346 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f20d0605-432e-4b91-b405-c9206bfbcd30 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:33.152520 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b67ecd9c-5375-4be7-be40-35bca756f892 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:33.153156 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f20d0605-432e-4b91-b405-c9206bfbcd30 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:33.153327 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b67ecd9c-5375-4be7-be40-35bca756f892 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:33.153611 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f20d0605-432e-4b91-b405-c9206bfbcd30 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:33.153868 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b67ecd9c-5375-4be7-be40-35bca756f892 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:33.184500 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-f20d0605-432e-4b91-b405-c9206bfbcd30 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045017 Jun 17 13:18:33.185523 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 736/1501] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:18:33 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:18:33.186444 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-b67ecd9c-5375-4be7-be40-35bca756f892 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046676 Jun 17 13:18:33.190162 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 766/1502] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:18:33 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:18:34.196678 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-d4811416-212c-4f57-a594-00d7cb31c282 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:34.197491 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-22f5d79e-b407-4bd7-9dc9-2b9525c2eb7b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:34.198449 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-22f5d79e-b407-4bd7-9dc9-2b9525c2eb7b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:34.198702 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-d4811416-212c-4f57-a594-00d7cb31c282 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:34.201369 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_api:SELECT=68 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:18:34.205298 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-22f5d79e-b407-4bd7-9dc9-2b9525c2eb7b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:34.205755 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-22f5d79e-b407-4bd7-9dc9-2b9525c2eb7b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:34.206556 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-22f5d79e-b407-4bd7-9dc9-2b9525c2eb7b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:34.206997 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-22f5d79e-b407-4bd7-9dc9-2b9525c2eb7b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:34.207247 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d4811416-212c-4f57-a594-00d7cb31c282 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:34.207695 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d4811416-212c-4f57-a594-00d7cb31c282 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:34.208458 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d4811416-212c-4f57-a594-00d7cb31c282 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:34.208894 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d4811416-212c-4f57-a594-00d7cb31c282 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:34.237640 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-22f5d79e-b407-4bd7-9dc9-2b9525c2eb7b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044060 Jun 17 13:18:34.241567 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 767/1503] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:18:34 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:18:34.241730 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-d4811416-212c-4f57-a594-00d7cb31c282 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046698 Jun 17 13:18:34.241730 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 737/1504] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:18:34 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:18:35.253117 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-3163fe0e-0a90-43d7-aa78-adbf7a172ee5 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:35.253901 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-474b1b2c-04dd-4e50-b20b-1f0aff287318 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:35.254451 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-3163fe0e-0a90-43d7-aa78-adbf7a172ee5 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:35.254548 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-474b1b2c-04dd-4e50-b20b-1f0aff287318 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:35.261104 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-474b1b2c-04dd-4e50-b20b-1f0aff287318 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:35.261297 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3163fe0e-0a90-43d7-aa78-adbf7a172ee5 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:35.261549 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-474b1b2c-04dd-4e50-b20b-1f0aff287318 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:35.261713 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3163fe0e-0a90-43d7-aa78-adbf7a172ee5 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:35.262336 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-474b1b2c-04dd-4e50-b20b-1f0aff287318 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:35.262518 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3163fe0e-0a90-43d7-aa78-adbf7a172ee5 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:35.262752 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-474b1b2c-04dd-4e50-b20b-1f0aff287318 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:35.262972 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3163fe0e-0a90-43d7-aa78-adbf7a172ee5 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:35.294555 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-3163fe0e-0a90-43d7-aa78-adbf7a172ee5 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045661 Jun 17 13:18:35.295225 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 738/1505] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:18:35 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:18:35.295476 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-474b1b2c-04dd-4e50-b20b-1f0aff287318 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046187 Jun 17 13:18:35.296330 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 768/1506] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:18:35 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:18:36.311643 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-ebf9cf32-30cc-4551-a8e8-a12c9efc9357 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:36.312706 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-79946454-ebb5-444d-8783-b2a6b0e0ba90 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:36.313302 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-79946454-ebb5-444d-8783-b2a6b0e0ba90 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:36.313996 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-ebf9cf32-30cc-4551-a8e8-a12c9efc9357 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:36.324395 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-79946454-ebb5-444d-8783-b2a6b0e0ba90 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:36.325140 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-79946454-ebb5-444d-8783-b2a6b0e0ba90 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:36.325465 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ebf9cf32-30cc-4551-a8e8-a12c9efc9357 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:36.326037 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ebf9cf32-30cc-4551-a8e8-a12c9efc9357 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:36.326409 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-79946454-ebb5-444d-8783-b2a6b0e0ba90 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:36.327256 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-79946454-ebb5-444d-8783-b2a6b0e0ba90 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:36.327699 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ebf9cf32-30cc-4551-a8e8-a12c9efc9357 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:36.328322 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ebf9cf32-30cc-4551-a8e8-a12c9efc9357 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:36.358286 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-79946454-ebb5-444d-8783-b2a6b0e0ba90 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053360 Jun 17 13:18:36.359486 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 739/1507] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:18:36 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:18:36.363340 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-ebf9cf32-30cc-4551-a8e8-a12c9efc9357 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.058446 Jun 17 13:18:36.363946 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 769/1508] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:18:36 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:18:37.371345 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-2a1eb975-0975-4a70-b6ea-ff975ee0cf3f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:37.372302 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-2a1eb975-0975-4a70-b6ea-ff975ee0cf3f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:37.374702 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-4c922687-6d9d-4413-9298-0c345e2239b7 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:37.375753 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-4c922687-6d9d-4413-9298-0c345e2239b7 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:37.380128 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2a1eb975-0975-4a70-b6ea-ff975ee0cf3f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:37.380576 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2a1eb975-0975-4a70-b6ea-ff975ee0cf3f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:37.381372 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2a1eb975-0975-4a70-b6ea-ff975ee0cf3f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:37.381804 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2a1eb975-0975-4a70-b6ea-ff975ee0cf3f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:37.382504 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4c922687-6d9d-4413-9298-0c345e2239b7 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:37.382961 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4c922687-6d9d-4413-9298-0c345e2239b7 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:37.383724 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4c922687-6d9d-4413-9298-0c345e2239b7 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:37.384419 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4c922687-6d9d-4413-9298-0c345e2239b7 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:37.416036 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-4c922687-6d9d-4413-9298-0c345e2239b7 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045211 Jun 17 13:18:37.420358 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 770/1509] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:18:37 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:18:37.420495 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-2a1eb975-0975-4a70-b6ea-ff975ee0cf3f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050628 Jun 17 13:18:37.420495 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 740/1510] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:18:37 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:18:38.430749 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-96fc2d66-aa42-4538-a0a5-18f30c98cf34 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:38.431468 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-49619460-ff43-401d-a94f-a4ede79dcabe tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:38.431915 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-96fc2d66-aa42-4538-a0a5-18f30c98cf34 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:38.432034 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-49619460-ff43-401d-a94f-a4ede79dcabe tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:38.440808 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-49619460-ff43-401d-a94f-a4ede79dcabe tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:38.441069 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-96fc2d66-aa42-4538-a0a5-18f30c98cf34 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:38.441430 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-49619460-ff43-401d-a94f-a4ede79dcabe tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:38.441671 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-96fc2d66-aa42-4538-a0a5-18f30c98cf34 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:38.442567 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-49619460-ff43-401d-a94f-a4ede79dcabe tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:38.442776 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-96fc2d66-aa42-4538-a0a5-18f30c98cf34 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:38.443140 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-49619460-ff43-401d-a94f-a4ede79dcabe tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:38.443271 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-96fc2d66-aa42-4538-a0a5-18f30c98cf34 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:38.447837 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=100 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:18:38.476244 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-49619460-ff43-401d-a94f-a4ede79dcabe tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050244 Jun 17 13:18:38.476439 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-96fc2d66-aa42-4538-a0a5-18f30c98cf34 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050681 Jun 17 13:18:38.480332 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 771/1511] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:18:38 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:18:38.480484 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 741/1512] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:18:38 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:18:39.492579 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-09360c07-e72f-42d9-8e0a-115635d98f41 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:39.493825 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-09360c07-e72f-42d9-8e0a-115635d98f41 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:39.495140 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-293283a9-472b-45ec-be6a-86dbd8ae569b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:39.496517 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-293283a9-472b-45ec-be6a-86dbd8ae569b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:39.503313 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-09360c07-e72f-42d9-8e0a-115635d98f41 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:39.503760 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-09360c07-e72f-42d9-8e0a-115635d98f41 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:39.504517 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-09360c07-e72f-42d9-8e0a-115635d98f41 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:39.504702 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-293283a9-472b-45ec-be6a-86dbd8ae569b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:39.504944 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-09360c07-e72f-42d9-8e0a-115635d98f41 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:39.505176 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-293283a9-472b-45ec-be6a-86dbd8ae569b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:39.505935 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-293283a9-472b-45ec-be6a-86dbd8ae569b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:39.506394 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-293283a9-472b-45ec-be6a-86dbd8ae569b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:39.508780 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_cell1:SELECT=100 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:18:39.536155 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-293283a9-472b-45ec-be6a-86dbd8ae569b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047194 Jun 17 13:18:39.536329 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-09360c07-e72f-42d9-8e0a-115635d98f41 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050279 Jun 17 13:18:39.537459 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 742/1513] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:18:39 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:18:39.538611 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 772/1514] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:18:39 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:18:40.552062 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-d4ad38f3-1854-425e-b1ac-53f92222d00d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:40.552751 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-eb6ce62e-73bc-48bf-b76c-e3a7c6955eb2 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:40.553128 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-d4ad38f3-1854-425e-b1ac-53f92222d00d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:40.553236 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-eb6ce62e-73bc-48bf-b76c-e3a7c6955eb2 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:40.560599 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-eb6ce62e-73bc-48bf-b76c-e3a7c6955eb2 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:40.560805 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d4ad38f3-1854-425e-b1ac-53f92222d00d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:40.561072 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-eb6ce62e-73bc-48bf-b76c-e3a7c6955eb2 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:40.561254 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d4ad38f3-1854-425e-b1ac-53f92222d00d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:40.561869 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-eb6ce62e-73bc-48bf-b76c-e3a7c6955eb2 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:40.562021 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d4ad38f3-1854-425e-b1ac-53f92222d00d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:40.562355 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-eb6ce62e-73bc-48bf-b76c-e3a7c6955eb2 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:40.562537 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d4ad38f3-1854-425e-b1ac-53f92222d00d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:40.593884 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-d4ad38f3-1854-425e-b1ac-53f92222d00d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047396 Jun 17 13:18:40.594282 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-eb6ce62e-73bc-48bf-b76c-e3a7c6955eb2 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047744 Jun 17 13:18:40.594742 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 773/1515] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:18:40 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:18:40.595327 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 743/1516] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:18:40 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:18:41.611038 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-ab2c309f-30b5-4b0f-aff2-e88160422e45 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:41.612339 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-fd072b01-8663-4bae-927a-6bbcf6946a83 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:41.612977 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-fd072b01-8663-4bae-927a-6bbcf6946a83 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:41.613166 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-ab2c309f-30b5-4b0f-aff2-e88160422e45 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:41.618553 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_api:SELECT=58 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:18:41.624728 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fd072b01-8663-4bae-927a-6bbcf6946a83 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:41.625222 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ab2c309f-30b5-4b0f-aff2-e88160422e45 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:41.625494 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fd072b01-8663-4bae-927a-6bbcf6946a83 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:41.625964 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ab2c309f-30b5-4b0f-aff2-e88160422e45 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:41.626771 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fd072b01-8663-4bae-927a-6bbcf6946a83 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:41.627287 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ab2c309f-30b5-4b0f-aff2-e88160422e45 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:41.628411 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fd072b01-8663-4bae-927a-6bbcf6946a83 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:41.628539 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ab2c309f-30b5-4b0f-aff2-e88160422e45 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:41.661852 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-ab2c309f-30b5-4b0f-aff2-e88160422e45 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056375 Jun 17 13:18:41.661852 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 774/1517] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:18:41 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:18:41.662319 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-fd072b01-8663-4bae-927a-6bbcf6946a83 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058190 Jun 17 13:18:41.663090 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 744/1518] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:18:41 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:18:42.673369 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-74795c2a-7c7d-4d5a-95c5-f48110e370c1 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:42.674063 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-33a76bee-2e71-46f3-a79b-99e8223990c3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:42.676565 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-74795c2a-7c7d-4d5a-95c5-f48110e370c1 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:42.678719 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-33a76bee-2e71-46f3-a79b-99e8223990c3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:42.683999 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-74795c2a-7c7d-4d5a-95c5-f48110e370c1 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:42.684619 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-74795c2a-7c7d-4d5a-95c5-f48110e370c1 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:42.685432 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-74795c2a-7c7d-4d5a-95c5-f48110e370c1 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:42.685714 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-33a76bee-2e71-46f3-a79b-99e8223990c3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:42.685870 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-74795c2a-7c7d-4d5a-95c5-f48110e370c1 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:42.686192 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-33a76bee-2e71-46f3-a79b-99e8223990c3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:42.687016 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-33a76bee-2e71-46f3-a79b-99e8223990c3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:42.687446 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-33a76bee-2e71-46f3-a79b-99e8223990c3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:42.717759 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-33a76bee-2e71-46f3-a79b-99e8223990c3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048344 Jun 17 13:18:42.718568 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 775/1519] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:18:42 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:18:42.719054 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-74795c2a-7c7d-4d5a-95c5-f48110e370c1 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049391 Jun 17 13:18:42.719729 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 745/1520] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:18:42 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:18:43.733911 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-b83b4a0c-6e3b-4a06-a984-1bf03302f3bc tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:43.734946 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-acd3a655-ea3d-4184-99bf-ec5ba596c656 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:43.735509 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-b83b4a0c-6e3b-4a06-a984-1bf03302f3bc tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:43.735690 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-acd3a655-ea3d-4184-99bf-ec5ba596c656 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:43.743222 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b83b4a0c-6e3b-4a06-a984-1bf03302f3bc tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:43.743692 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b83b4a0c-6e3b-4a06-a984-1bf03302f3bc tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:43.743864 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-acd3a655-ea3d-4184-99bf-ec5ba596c656 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:43.744243 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-acd3a655-ea3d-4184-99bf-ec5ba596c656 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:43.744416 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b83b4a0c-6e3b-4a06-a984-1bf03302f3bc tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:43.745038 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-acd3a655-ea3d-4184-99bf-ec5ba596c656 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:43.745479 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b83b4a0c-6e3b-4a06-a984-1bf03302f3bc tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:43.745641 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-acd3a655-ea3d-4184-99bf-ec5ba596c656 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:43.776271 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-b83b4a0c-6e3b-4a06-a984-1bf03302f3bc tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048722 Jun 17 13:18:43.777043 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 746/1521] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:18:43 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:18:43.777456 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-acd3a655-ea3d-4184-99bf-ec5ba596c656 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050060 Jun 17 13:18:43.778150 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 776/1522] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:18:43 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:18:44.789759 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-6311f8ab-f4ab-4e3a-8606-147a2a3338e6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:44.790432 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-8e8b9bbb-20bd-45c8-ac84-3c28d3375433 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:44.790824 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-6311f8ab-f4ab-4e3a-8606-147a2a3338e6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:44.791106 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-8e8b9bbb-20bd-45c8-ac84-3c28d3375433 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:44.797945 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8e8b9bbb-20bd-45c8-ac84-3c28d3375433 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:44.798420 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6311f8ab-f4ab-4e3a-8606-147a2a3338e6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:44.798591 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8e8b9bbb-20bd-45c8-ac84-3c28d3375433 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:44.798948 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6311f8ab-f4ab-4e3a-8606-147a2a3338e6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:44.799174 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8e8b9bbb-20bd-45c8-ac84-3c28d3375433 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:44.799608 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8e8b9bbb-20bd-45c8-ac84-3c28d3375433 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:44.799818 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6311f8ab-f4ab-4e3a-8606-147a2a3338e6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:44.800305 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6311f8ab-f4ab-4e3a-8606-147a2a3338e6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:44.829772 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-8e8b9bbb-20bd-45c8-ac84-3c28d3375433 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043527 Jun 17 13:18:44.831704 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 777/1523] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:18:44 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:18:44.837864 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-6311f8ab-f4ab-4e3a-8606-147a2a3338e6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052168 Jun 17 13:18:44.838676 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 747/1524] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:18:44 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:18:45.842187 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-19f48783-5a4e-4833-8b9f-60fb64d6a47d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:45.843035 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-19f48783-5a4e-4833-8b9f-60fb64d6a47d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:45.849310 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-da82cd05-a4bf-4306-b7f6-80993148ef00 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:45.850298 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-da82cd05-a4bf-4306-b7f6-80993148ef00 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:45.850852 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-19f48783-5a4e-4833-8b9f-60fb64d6a47d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:45.851169 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-19f48783-5a4e-4833-8b9f-60fb64d6a47d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:45.851943 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-19f48783-5a4e-4833-8b9f-60fb64d6a47d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:45.852422 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-19f48783-5a4e-4833-8b9f-60fb64d6a47d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:45.856927 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-da82cd05-a4bf-4306-b7f6-80993148ef00 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:45.857717 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-da82cd05-a4bf-4306-b7f6-80993148ef00 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:45.858531 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-da82cd05-a4bf-4306-b7f6-80993148ef00 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:45.858963 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-da82cd05-a4bf-4306-b7f6-80993148ef00 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:45.883818 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-19f48783-5a4e-4833-8b9f-60fb64d6a47d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045723 Jun 17 13:18:45.887708 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 778/1525] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:18:45 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:18:45.892411 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-da82cd05-a4bf-4306-b7f6-80993148ef00 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047368 Jun 17 13:18:45.892982 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 748/1526] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:18:45 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:18:46.899912 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-eaf7d675-671b-44c5-ad79-e68db43be486 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:46.901424 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-eaf7d675-671b-44c5-ad79-e68db43be486 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:46.907720 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-f6717161-b6f6-4f22-880c-da419d9d619c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:46.909097 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-f6717161-b6f6-4f22-880c-da419d9d619c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:46.911986 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-eaf7d675-671b-44c5-ad79-e68db43be486 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:46.912784 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-eaf7d675-671b-44c5-ad79-e68db43be486 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:46.914012 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-eaf7d675-671b-44c5-ad79-e68db43be486 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:46.914172 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-eaf7d675-671b-44c5-ad79-e68db43be486 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:46.917392 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f6717161-b6f6-4f22-880c-da419d9d619c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:46.917840 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f6717161-b6f6-4f22-880c-da419d9d619c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:46.918634 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f6717161-b6f6-4f22-880c-da419d9d619c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:46.919053 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f6717161-b6f6-4f22-880c-da419d9d619c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:46.946026 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-eaf7d675-671b-44c5-ad79-e68db43be486 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052931 Jun 17 13:18:46.946991 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 779/1527] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:18:46 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:18:46.952454 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-f6717161-b6f6-4f22-880c-da419d9d619c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050903 Jun 17 13:18:46.953004 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 749/1528] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:18:46 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:18:47.962440 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-f8c91e56-142e-4f2f-964d-289b9250f76b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:47.963419 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-f8c91e56-142e-4f2f-964d-289b9250f76b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:47.965858 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-fae704b0-612f-4ba7-921a-be7df297ac71 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:47.966886 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-fae704b0-612f-4ba7-921a-be7df297ac71 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:47.970301 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f8c91e56-142e-4f2f-964d-289b9250f76b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:47.970925 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f8c91e56-142e-4f2f-964d-289b9250f76b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:47.971702 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f8c91e56-142e-4f2f-964d-289b9250f76b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:47.972142 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f8c91e56-142e-4f2f-964d-289b9250f76b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:47.973995 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fae704b0-612f-4ba7-921a-be7df297ac71 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:47.974525 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fae704b0-612f-4ba7-921a-be7df297ac71 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:47.975647 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fae704b0-612f-4ba7-921a-be7df297ac71 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:47.975789 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fae704b0-612f-4ba7-921a-be7df297ac71 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:48.002262 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-f8c91e56-142e-4f2f-964d-289b9250f76b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045823 Jun 17 13:18:48.006792 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 780/1529] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:18:47 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:18:48.007568 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-fae704b0-612f-4ba7-921a-be7df297ac71 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044702 Jun 17 13:18:48.007568 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 750/1530] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:18:47 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:18:49.014591 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-46d61e6f-5697-4163-8d88-901fa0615c2a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:49.015516 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-46d61e6f-5697-4163-8d88-901fa0615c2a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:49.018934 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-f5ee2d05-24ae-4aab-9480-7d27a1d7ffb6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:49.019893 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-f5ee2d05-24ae-4aab-9480-7d27a1d7ffb6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:49.022456 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-46d61e6f-5697-4163-8d88-901fa0615c2a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:49.023310 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-46d61e6f-5697-4163-8d88-901fa0615c2a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:49.023726 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-46d61e6f-5697-4163-8d88-901fa0615c2a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:49.024162 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-46d61e6f-5697-4163-8d88-901fa0615c2a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:49.026579 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f5ee2d05-24ae-4aab-9480-7d27a1d7ffb6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:49.027030 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f5ee2d05-24ae-4aab-9480-7d27a1d7ffb6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:49.027798 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f5ee2d05-24ae-4aab-9480-7d27a1d7ffb6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:49.028234 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f5ee2d05-24ae-4aab-9480-7d27a1d7ffb6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:49.055638 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-46d61e6f-5697-4163-8d88-901fa0615c2a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045318 Jun 17 13:18:49.056412 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 781/1531] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:18:49 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:18:49.059635 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-f5ee2d05-24ae-4aab-9480-7d27a1d7ffb6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044765 Jun 17 13:18:49.060197 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 751/1532] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:18:49 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:18:50.068041 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-e0b6e4f1-72bd-4e55-9182-3fc7c7c1be11 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:50.068921 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-e0b6e4f1-72bd-4e55-9182-3fc7c7c1be11 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:50.072640 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-dc92d5f6-5aae-41ee-8e52-fe32e638f638 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:50.073608 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-dc92d5f6-5aae-41ee-8e52-fe32e638f638 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:50.076511 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e0b6e4f1-72bd-4e55-9182-3fc7c7c1be11 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:50.076980 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e0b6e4f1-72bd-4e55-9182-3fc7c7c1be11 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:50.077784 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e0b6e4f1-72bd-4e55-9182-3fc7c7c1be11 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:50.078273 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e0b6e4f1-72bd-4e55-9182-3fc7c7c1be11 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:50.080374 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dc92d5f6-5aae-41ee-8e52-fe32e638f638 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:50.080856 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dc92d5f6-5aae-41ee-8e52-fe32e638f638 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:50.081661 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dc92d5f6-5aae-41ee-8e52-fe32e638f638 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:50.082135 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dc92d5f6-5aae-41ee-8e52-fe32e638f638 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:50.108523 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-e0b6e4f1-72bd-4e55-9182-3fc7c7c1be11 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044756 Jun 17 13:18:50.110762 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 782/1533] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:18:50 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:18:50.113009 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-dc92d5f6-5aae-41ee-8e52-fe32e638f638 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045008 Jun 17 13:18:50.113347 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 752/1534] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:18:50 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:18:51.123776 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-a9467e5e-4299-4b96-ba0f-93574fc41eb2 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:51.124720 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-a9467e5e-4299-4b96-ba0f-93574fc41eb2 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:51.124877 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-855b971d-4a84-4738-aa29-0d639503b497 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:51.125813 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-855b971d-4a84-4738-aa29-0d639503b497 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:51.131766 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a9467e5e-4299-4b96-ba0f-93574fc41eb2 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:51.132219 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a9467e5e-4299-4b96-ba0f-93574fc41eb2 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:51.132744 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-855b971d-4a84-4738-aa29-0d639503b497 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:51.132987 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a9467e5e-4299-4b96-ba0f-93574fc41eb2 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:51.133201 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-855b971d-4a84-4738-aa29-0d639503b497 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:51.133462 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a9467e5e-4299-4b96-ba0f-93574fc41eb2 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:51.134363 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-855b971d-4a84-4738-aa29-0d639503b497 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:51.134912 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-855b971d-4a84-4738-aa29-0d639503b497 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:51.164315 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-a9467e5e-4299-4b96-ba0f-93574fc41eb2 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044997 Jun 17 13:18:51.166905 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 783/1535] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:18:51 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:18:51.167650 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-855b971d-4a84-4738-aa29-0d639503b497 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044112 Jun 17 13:18:51.167650 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 753/1536] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:18:51 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:18:52.176661 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-7819451f-f971-49b9-a300-044ea531a914 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:52.177173 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-94e451a0-5f19-448c-b46a-3c45656a12b5 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:52.177542 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-7819451f-f971-49b9-a300-044ea531a914 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:52.178126 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-94e451a0-5f19-448c-b46a-3c45656a12b5 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:52.184502 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7819451f-f971-49b9-a300-044ea531a914 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:52.184952 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7819451f-f971-49b9-a300-044ea531a914 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:52.185204 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-94e451a0-5f19-448c-b46a-3c45656a12b5 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:52.185650 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-94e451a0-5f19-448c-b46a-3c45656a12b5 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:52.185825 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7819451f-f971-49b9-a300-044ea531a914 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:52.186121 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7819451f-f971-49b9-a300-044ea531a914 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:52.186425 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-94e451a0-5f19-448c-b46a-3c45656a12b5 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:52.186848 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-94e451a0-5f19-448c-b46a-3c45656a12b5 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:52.215951 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-7819451f-f971-49b9-a300-044ea531a914 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043337 Jun 17 13:18:52.216404 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-94e451a0-5f19-448c-b46a-3c45656a12b5 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043298 Jun 17 13:18:52.216547 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 784/1537] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:18:52 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:18:52.217033 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 754/1538] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:18:52 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:18:53.229204 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-2ba53467-7144-411a-95a3-02dbd6ede1d4 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:53.229847 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-3d0fd729-0812-43f4-8d9f-310071c95185 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:53.230295 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-2ba53467-7144-411a-95a3-02dbd6ede1d4 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:53.230717 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-3d0fd729-0812-43f4-8d9f-310071c95185 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:53.239253 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2ba53467-7144-411a-95a3-02dbd6ede1d4 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:53.239497 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3d0fd729-0812-43f4-8d9f-310071c95185 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:53.239699 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2ba53467-7144-411a-95a3-02dbd6ede1d4 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:53.240143 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3d0fd729-0812-43f4-8d9f-310071c95185 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:53.240750 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2ba53467-7144-411a-95a3-02dbd6ede1d4 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:53.241113 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3d0fd729-0812-43f4-8d9f-310071c95185 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:53.241295 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2ba53467-7144-411a-95a3-02dbd6ede1d4 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:53.241684 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3d0fd729-0812-43f4-8d9f-310071c95185 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:53.273409 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-2ba53467-7144-411a-95a3-02dbd6ede1d4 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048421 Jun 17 13:18:53.273719 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-3d0fd729-0812-43f4-8d9f-310071c95185 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048313 Jun 17 13:18:53.273991 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 785/1539] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:18:53 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:18:53.278601 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 755/1540] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:18:53 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:18:54.290702 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-e1928bfa-1448-45c1-9dfc-e870e37ea47f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:54.291367 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-0b98405e-e688-4317-bb20-99e3fbf6e677 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:54.291742 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-e1928bfa-1448-45c1-9dfc-e870e37ea47f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:54.291845 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-0b98405e-e688-4317-bb20-99e3fbf6e677 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:54.298737 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e1928bfa-1448-45c1-9dfc-e870e37ea47f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:54.298939 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0b98405e-e688-4317-bb20-99e3fbf6e677 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:54.299105 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e1928bfa-1448-45c1-9dfc-e870e37ea47f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:54.299228 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0b98405e-e688-4317-bb20-99e3fbf6e677 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:54.299889 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e1928bfa-1448-45c1-9dfc-e870e37ea47f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:54.300039 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0b98405e-e688-4317-bb20-99e3fbf6e677 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:54.300333 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0b98405e-e688-4317-bb20-99e3fbf6e677 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:54.300578 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e1928bfa-1448-45c1-9dfc-e870e37ea47f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:54.330818 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-0b98405e-e688-4317-bb20-99e3fbf6e677 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046418 Jun 17 13:18:54.331052 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-e1928bfa-1448-45c1-9dfc-e870e37ea47f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046965 Jun 17 13:18:54.331377 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 756/1541] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:18:54 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:18:54.331714 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 786/1542] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:18:54 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:18:55.343849 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-e87ae3d2-d5cd-41fb-8166-ecc09e39e23a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:55.344495 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-e0a28147-ef3d-48ef-8bfa-cce6ac9a5ffa tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:55.344867 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-e0a28147-ef3d-48ef-8bfa-cce6ac9a5ffa tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:55.344974 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-e87ae3d2-d5cd-41fb-8166-ecc09e39e23a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:55.351654 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e0a28147-ef3d-48ef-8bfa-cce6ac9a5ffa tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:55.351834 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e87ae3d2-d5cd-41fb-8166-ecc09e39e23a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:55.352096 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e0a28147-ef3d-48ef-8bfa-cce6ac9a5ffa tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:55.352261 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e87ae3d2-d5cd-41fb-8166-ecc09e39e23a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:55.352850 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e0a28147-ef3d-48ef-8bfa-cce6ac9a5ffa tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:55.352997 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e87ae3d2-d5cd-41fb-8166-ecc09e39e23a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:55.353355 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e87ae3d2-d5cd-41fb-8166-ecc09e39e23a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:55.353614 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e0a28147-ef3d-48ef-8bfa-cce6ac9a5ffa tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:55.379980 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=100 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:18:55.384441 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-e87ae3d2-d5cd-41fb-8166-ecc09e39e23a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044555 Jun 17 13:18:55.385546 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 787/1543] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:18:55 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:18:55.385838 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-e0a28147-ef3d-48ef-8bfa-cce6ac9a5ffa tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045985 Jun 17 13:18:55.386590 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 757/1544] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:18:55 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:18:56.397335 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-829c9eec-da06-4d68-9a96-bf1a1514952d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:56.397991 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-47c3c6b3-533f-44f1-9122-4e011edc3f5c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:56.398395 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-829c9eec-da06-4d68-9a96-bf1a1514952d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:56.398482 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-47c3c6b3-533f-44f1-9122-4e011edc3f5c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:56.405161 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-829c9eec-da06-4d68-9a96-bf1a1514952d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:56.405357 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-47c3c6b3-533f-44f1-9122-4e011edc3f5c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:56.405696 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-47c3c6b3-533f-44f1-9122-4e011edc3f5c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:56.405846 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-829c9eec-da06-4d68-9a96-bf1a1514952d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:56.406491 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-47c3c6b3-533f-44f1-9122-4e011edc3f5c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:56.406642 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-829c9eec-da06-4d68-9a96-bf1a1514952d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:56.406925 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-47c3c6b3-533f-44f1-9122-4e011edc3f5c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:56.407077 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-829c9eec-da06-4d68-9a96-bf1a1514952d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:56.433019 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_cell1:SELECT=100 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:18:56.437461 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-829c9eec-da06-4d68-9a96-bf1a1514952d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044314 Jun 17 13:18:56.438049 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 758/1545] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:18:56 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:18:56.438230 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-47c3c6b3-533f-44f1-9122-4e011edc3f5c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045101 Jun 17 13:18:56.438711 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 788/1546] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:18:56 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:18:57.453333 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-4b5c2e7e-1305-47e1-84a7-c1b27886a29a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:57.453886 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-be313f19-10e9-49d4-aaa8-945482373549 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:57.454282 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-4b5c2e7e-1305-47e1-84a7-c1b27886a29a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:57.454849 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-be313f19-10e9-49d4-aaa8-945482373549 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:57.461298 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4b5c2e7e-1305-47e1-84a7-c1b27886a29a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:57.461753 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4b5c2e7e-1305-47e1-84a7-c1b27886a29a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:57.462110 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-be313f19-10e9-49d4-aaa8-945482373549 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:57.462569 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4b5c2e7e-1305-47e1-84a7-c1b27886a29a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:57.462716 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-be313f19-10e9-49d4-aaa8-945482373549 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:57.462987 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4b5c2e7e-1305-47e1-84a7-c1b27886a29a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:57.463362 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-be313f19-10e9-49d4-aaa8-945482373549 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:57.463788 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-be313f19-10e9-49d4-aaa8-945482373549 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:57.494147 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-be313f19-10e9-49d4-aaa8-945482373549 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046538 Jun 17 13:18:57.494768 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 789/1547] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:18:57 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:18:57.494917 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-4b5c2e7e-1305-47e1-84a7-c1b27886a29a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047993 Jun 17 13:18:57.495099 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 759/1548] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:18:57 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:18:58.511031 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-a769e3e7-bc86-4aa0-a57f-0cd346201069 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:58.511958 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-0fe7603f-e5a8-4316-bd50-e69461110ee3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:58.512590 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-a769e3e7-bc86-4aa0-a57f-0cd346201069 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:58.513324 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-0fe7603f-e5a8-4316-bd50-e69461110ee3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:58.524599 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a769e3e7-bc86-4aa0-a57f-0cd346201069 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:58.524990 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0fe7603f-e5a8-4316-bd50-e69461110ee3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:58.525443 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0fe7603f-e5a8-4316-bd50-e69461110ee3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:58.525729 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a769e3e7-bc86-4aa0-a57f-0cd346201069 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:58.526700 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0fe7603f-e5a8-4316-bd50-e69461110ee3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:58.526983 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a769e3e7-bc86-4aa0-a57f-0cd346201069 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:58.527421 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0fe7603f-e5a8-4316-bd50-e69461110ee3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:58.527665 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a769e3e7-bc86-4aa0-a57f-0cd346201069 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:58.559454 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-0fe7603f-e5a8-4316-bd50-e69461110ee3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054154 Jun 17 13:18:58.559761 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-a769e3e7-bc86-4aa0-a57f-0cd346201069 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055325 Jun 17 13:18:58.560158 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 760/1549] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:18:58 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:18:58.560355 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 790/1550] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:18:58 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:18:59.571056 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-e253dbea-6308-4544-a718-09b7be66a18e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:59.571704 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-91785559-93f9-42fb-adce-1b5dce422cca tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:18:59.572073 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-91785559-93f9-42fb-adce-1b5dce422cca tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:59.572168 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-e253dbea-6308-4544-a718-09b7be66a18e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:18:59.578903 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-91785559-93f9-42fb-adce-1b5dce422cca tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:59.579187 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e253dbea-6308-4544-a718-09b7be66a18e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:59.579358 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-91785559-93f9-42fb-adce-1b5dce422cca tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:59.579627 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e253dbea-6308-4544-a718-09b7be66a18e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:59.580090 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-91785559-93f9-42fb-adce-1b5dce422cca tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:59.580409 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e253dbea-6308-4544-a718-09b7be66a18e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:18:59.580558 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-91785559-93f9-42fb-adce-1b5dce422cca tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:59.580852 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e253dbea-6308-4544-a718-09b7be66a18e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:18:59.611579 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-91785559-93f9-42fb-adce-1b5dce422cca tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044621 Jun 17 13:18:59.612036 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-e253dbea-6308-4544-a718-09b7be66a18e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045016 Jun 17 13:18:59.612501 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 761/1551] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:18:59 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:18:59.612665 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 791/1552] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:18:59 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:19:00.628022 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-c4b606c9-c54f-4481-9cd6-b18bc31e03f4 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:00.629038 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-6e3a41f0-2786-4eea-bb8c-a56f9d3bd122 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:00.629666 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-c4b606c9-c54f-4481-9cd6-b18bc31e03f4 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:00.629849 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-6e3a41f0-2786-4eea-bb8c-a56f9d3bd122 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:00.640654 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6e3a41f0-2786-4eea-bb8c-a56f9d3bd122 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:00.641126 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c4b606c9-c54f-4481-9cd6-b18bc31e03f4 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:00.641708 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6e3a41f0-2786-4eea-bb8c-a56f9d3bd122 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:00.641835 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c4b606c9-c54f-4481-9cd6-b18bc31e03f4 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:00.642122 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6e3a41f0-2786-4eea-bb8c-a56f9d3bd122 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:00.642271 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c4b606c9-c54f-4481-9cd6-b18bc31e03f4 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:00.642567 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6e3a41f0-2786-4eea-bb8c-a56f9d3bd122 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:00.642739 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c4b606c9-c54f-4481-9cd6-b18bc31e03f4 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:00.672790 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-6e3a41f0-2786-4eea-bb8c-a56f9d3bd122 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051616 Jun 17 13:19:00.673026 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-c4b606c9-c54f-4481-9cd6-b18bc31e03f4 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051700 Jun 17 13:19:00.673630 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 762/1554] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:19:00 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:19:00.673775 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 792/1554] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:19:00 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:19:01.229364 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 13:19:01.229868 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Fri Jun 17 13:19:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 17 13:19:01.688605 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-3c2295da-9a05-4465-92c2-67e9b5d3149e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:01.689209 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-8611c3fb-7989-4482-80db-cb4dc0665c7a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:01.689583 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-3c2295da-9a05-4465-92c2-67e9b5d3149e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:01.689688 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-8611c3fb-7989-4482-80db-cb4dc0665c7a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:01.696591 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3c2295da-9a05-4465-92c2-67e9b5d3149e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:01.696779 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8611c3fb-7989-4482-80db-cb4dc0665c7a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:01.697033 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3c2295da-9a05-4465-92c2-67e9b5d3149e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:01.697164 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8611c3fb-7989-4482-80db-cb4dc0665c7a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:01.697826 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3c2295da-9a05-4465-92c2-67e9b5d3149e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:01.697986 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8611c3fb-7989-4482-80db-cb4dc0665c7a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:01.698291 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3c2295da-9a05-4465-92c2-67e9b5d3149e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:01.698455 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8611c3fb-7989-4482-80db-cb4dc0665c7a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:01.729256 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-8611c3fb-7989-4482-80db-cb4dc0665c7a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046903 Jun 17 13:19:01.729634 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-3c2295da-9a05-4465-92c2-67e9b5d3149e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047407 Jun 17 13:19:01.729782 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 793/1555] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:19:01 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 17 13:19:01.730391 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 763/1556] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:19:01 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:19:02.741744 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-f501577b-a9a5-4b05-9240-c679f8e2f1a1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:02.742404 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-4df996a2-a275-4fea-ad04-65d96d587e0d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:02.742779 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-f501577b-a9a5-4b05-9240-c679f8e2f1a1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:02.743156 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-4df996a2-a275-4fea-ad04-65d96d587e0d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:02.749424 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f501577b-a9a5-4b05-9240-c679f8e2f1a1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:02.749874 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f501577b-a9a5-4b05-9240-c679f8e2f1a1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:02.750030 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4df996a2-a275-4fea-ad04-65d96d587e0d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:02.750559 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4df996a2-a275-4fea-ad04-65d96d587e0d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:02.751066 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f501577b-a9a5-4b05-9240-c679f8e2f1a1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:02.751173 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4df996a2-a275-4fea-ad04-65d96d587e0d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:02.751283 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f501577b-a9a5-4b05-9240-c679f8e2f1a1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:02.751621 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4df996a2-a275-4fea-ad04-65d96d587e0d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:02.781395 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-f501577b-a9a5-4b05-9240-c679f8e2f1a1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043835 Jun 17 13:19:02.781724 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-4df996a2-a275-4fea-ad04-65d96d587e0d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043451 Jun 17 13:19:02.782324 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 764/1557] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:19:02 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:19:02.785500 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 794/1558] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:19:02 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:19:03.794490 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-cb4195fe-79ce-4e11-bd31-0a5436d066b6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:03.795267 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-b309c4c6-105b-4d18-8022-fe9c27617a7b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:03.795801 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-cb4195fe-79ce-4e11-bd31-0a5436d066b6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:03.796579 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-b309c4c6-105b-4d18-8022-fe9c27617a7b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:03.804448 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cb4195fe-79ce-4e11-bd31-0a5436d066b6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:03.805046 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cb4195fe-79ce-4e11-bd31-0a5436d066b6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:03.805419 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b309c4c6-105b-4d18-8022-fe9c27617a7b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:03.806015 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b309c4c6-105b-4d18-8022-fe9c27617a7b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:03.806285 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cb4195fe-79ce-4e11-bd31-0a5436d066b6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:03.806646 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cb4195fe-79ce-4e11-bd31-0a5436d066b6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:03.807026 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b309c4c6-105b-4d18-8022-fe9c27617a7b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:03.807613 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b309c4c6-105b-4d18-8022-fe9c27617a7b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:03.837812 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-cb4195fe-79ce-4e11-bd31-0a5436d066b6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048632 Jun 17 13:19:03.838417 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 765/1559] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:19:03 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:19:03.838974 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-b309c4c6-105b-4d18-8022-fe9c27617a7b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049165 Jun 17 13:19:03.839585 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 795/1560] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:19:03 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:19:04.854023 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-f22b5ca4-3af1-4737-a3f6-58bb0110c382 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:04.854934 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-7e2eb456-22ab-4f6b-b426-d4f41df07621 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:04.855511 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-f22b5ca4-3af1-4737-a3f6-58bb0110c382 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:04.856181 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-7e2eb456-22ab-4f6b-b426-d4f41df07621 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:04.859242 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_api:SELECT=58 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:19:04.864923 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7e2eb456-22ab-4f6b-b426-d4f41df07621 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:04.865227 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f22b5ca4-3af1-4737-a3f6-58bb0110c382 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:04.865393 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7e2eb456-22ab-4f6b-b426-d4f41df07621 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:04.865678 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f22b5ca4-3af1-4737-a3f6-58bb0110c382 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:04.866082 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7e2eb456-22ab-4f6b-b426-d4f41df07621 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:04.866471 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f22b5ca4-3af1-4737-a3f6-58bb0110c382 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:04.866585 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7e2eb456-22ab-4f6b-b426-d4f41df07621 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:04.866903 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f22b5ca4-3af1-4737-a3f6-58bb0110c382 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:04.897724 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-f22b5ca4-3af1-4737-a3f6-58bb0110c382 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050143 Jun 17 13:19:04.898019 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-7e2eb456-22ab-4f6b-b426-d4f41df07621 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049179 Jun 17 13:19:04.898281 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 766/1561] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:19:04 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:19:04.898514 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 796/1562] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:19:04 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:19:05.910005 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-1aa696c7-e9c9-4e0d-8514-9a6c0be812f1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:05.910773 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-8a1c63c0-ce40-476c-9a24-954c10db3e1d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:05.911448 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-1aa696c7-e9c9-4e0d-8514-9a6c0be812f1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:05.911620 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-8a1c63c0-ce40-476c-9a24-954c10db3e1d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:05.918346 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8a1c63c0-ce40-476c-9a24-954c10db3e1d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:05.918790 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8a1c63c0-ce40-476c-9a24-954c10db3e1d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:05.919782 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1aa696c7-e9c9-4e0d-8514-9a6c0be812f1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:05.919958 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8a1c63c0-ce40-476c-9a24-954c10db3e1d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:05.920230 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1aa696c7-e9c9-4e0d-8514-9a6c0be812f1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:05.920392 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8a1c63c0-ce40-476c-9a24-954c10db3e1d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:05.921012 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1aa696c7-e9c9-4e0d-8514-9a6c0be812f1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:05.921444 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1aa696c7-e9c9-4e0d-8514-9a6c0be812f1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:05.961442 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-1aa696c7-e9c9-4e0d-8514-9a6c0be812f1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054535 Jun 17 13:19:05.962050 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 767/1563] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:19:05 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:19:05.962986 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-8a1c63c0-ce40-476c-9a24-954c10db3e1d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057117 Jun 17 13:19:05.963560 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 797/1564] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:19:05 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:19:06.976143 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-7a729d03-ecaf-4715-ba51-8f02968caac2 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:06.976741 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-92507913-fec4-4b18-bacb-ae0f88022e37 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:06.977180 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-7a729d03-ecaf-4715-ba51-8f02968caac2 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:06.977414 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-92507913-fec4-4b18-bacb-ae0f88022e37 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:06.985280 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7a729d03-ecaf-4715-ba51-8f02968caac2 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:06.985478 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-92507913-fec4-4b18-bacb-ae0f88022e37 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:06.985765 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7a729d03-ecaf-4715-ba51-8f02968caac2 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:06.985952 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-92507913-fec4-4b18-bacb-ae0f88022e37 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:06.986657 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7a729d03-ecaf-4715-ba51-8f02968caac2 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:06.986820 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-92507913-fec4-4b18-bacb-ae0f88022e37 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:06.987137 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7a729d03-ecaf-4715-ba51-8f02968caac2 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:06.987327 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-92507913-fec4-4b18-bacb-ae0f88022e37 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:07.019044 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-7a729d03-ecaf-4715-ba51-8f02968caac2 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047108 Jun 17 13:19:07.019332 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-92507913-fec4-4b18-bacb-ae0f88022e37 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046900 Jun 17 13:19:07.019625 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 768/1565] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:19:06 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:19:07.022225 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 798/1566] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:19:06 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:19:07.819866 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 13:19:07.820234 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Fri Jun 17 13:19:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 17 13:19:08.034682 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-407a7013-890d-4aef-8ba3-3987a8d3616a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:08.035683 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-63ccd5a5-8871-4de6-837f-40509eb1b080 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:08.036270 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-407a7013-890d-4aef-8ba3-3987a8d3616a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:08.036661 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-63ccd5a5-8871-4de6-837f-40509eb1b080 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:08.047137 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-407a7013-890d-4aef-8ba3-3987a8d3616a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:08.047736 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-63ccd5a5-8871-4de6-837f-40509eb1b080 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:08.047931 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-407a7013-890d-4aef-8ba3-3987a8d3616a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:08.048167 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-63ccd5a5-8871-4de6-837f-40509eb1b080 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:08.048568 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-407a7013-890d-4aef-8ba3-3987a8d3616a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:08.048959 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-63ccd5a5-8871-4de6-837f-40509eb1b080 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:08.049105 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-407a7013-890d-4aef-8ba3-3987a8d3616a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:08.049357 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-63ccd5a5-8871-4de6-837f-40509eb1b080 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:08.080035 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-407a7013-890d-4aef-8ba3-3987a8d3616a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052322 Jun 17 13:19:08.080281 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-63ccd5a5-8871-4de6-837f-40509eb1b080 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051480 Jun 17 13:19:08.083783 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 799/1568] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:19:08 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:19:08.083943 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 769/1568] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:19:08 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:19:09.095606 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-cf56872c-a0a2-488f-adf6-7f05145cbdcf tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:09.096292 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-b95a2124-cbb4-492a-9017-1e5e6fa21e74 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:09.096675 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-cf56872c-a0a2-488f-adf6-7f05145cbdcf tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:09.096784 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-b95a2124-cbb4-492a-9017-1e5e6fa21e74 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:09.103404 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cf56872c-a0a2-488f-adf6-7f05145cbdcf tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:09.103594 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b95a2124-cbb4-492a-9017-1e5e6fa21e74 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:09.103844 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cf56872c-a0a2-488f-adf6-7f05145cbdcf tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:09.104001 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b95a2124-cbb4-492a-9017-1e5e6fa21e74 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:09.104580 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cf56872c-a0a2-488f-adf6-7f05145cbdcf tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:09.104720 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b95a2124-cbb4-492a-9017-1e5e6fa21e74 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:09.105035 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cf56872c-a0a2-488f-adf6-7f05145cbdcf tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:09.105183 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b95a2124-cbb4-492a-9017-1e5e6fa21e74 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:09.135419 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-b95a2124-cbb4-492a-9017-1e5e6fa21e74 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046243 Jun 17 13:19:09.135747 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-cf56872c-a0a2-488f-adf6-7f05145cbdcf tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046563 Jun 17 13:19:09.136336 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 800/1569] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:19:09 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:19:09.136552 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 770/1570] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:19:09 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:19:10.152035 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-ea91bde0-58a5-4c30-8f4c-f52e37ca494c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:10.153073 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-095cac3c-2523-4a82-9778-aaf98a150c4d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:10.153727 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-ea91bde0-58a5-4c30-8f4c-f52e37ca494c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:10.153909 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-095cac3c-2523-4a82-9778-aaf98a150c4d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:10.164416 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-095cac3c-2523-4a82-9778-aaf98a150c4d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:10.164984 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ea91bde0-58a5-4c30-8f4c-f52e37ca494c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:10.165284 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-095cac3c-2523-4a82-9778-aaf98a150c4d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:10.165746 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ea91bde0-58a5-4c30-8f4c-f52e37ca494c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:10.166465 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-095cac3c-2523-4a82-9778-aaf98a150c4d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:10.167078 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ea91bde0-58a5-4c30-8f4c-f52e37ca494c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:10.167326 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-095cac3c-2523-4a82-9778-aaf98a150c4d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:10.167801 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ea91bde0-58a5-4c30-8f4c-f52e37ca494c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:10.200263 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-095cac3c-2523-4a82-9778-aaf98a150c4d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054934 Jun 17 13:19:10.200848 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-ea91bde0-58a5-4c30-8f4c-f52e37ca494c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055381 Jun 17 13:19:10.201034 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 801/1571] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:19:10 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:19:10.201394 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 771/1572] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:19:10 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 13:19:11.289090 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-0375fe48-7347-43de-8d20-0d775db7b787 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:11.290002 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-0375fe48-7347-43de-8d20-0d775db7b787 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:11.293639 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-06c04973-47be-4649-891b-2be8812053bb tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:11.294699 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-06c04973-47be-4649-891b-2be8812053bb tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:11.296712 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0375fe48-7347-43de-8d20-0d775db7b787 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:11.297108 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0375fe48-7347-43de-8d20-0d775db7b787 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:11.298760 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0375fe48-7347-43de-8d20-0d775db7b787 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:11.299201 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0375fe48-7347-43de-8d20-0d775db7b787 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:11.302279 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-06c04973-47be-4649-891b-2be8812053bb tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:11.302725 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-06c04973-47be-4649-891b-2be8812053bb tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:11.303702 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-06c04973-47be-4649-891b-2be8812053bb tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:11.304136 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-06c04973-47be-4649-891b-2be8812053bb tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:11.335244 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-06c04973-47be-4649-891b-2be8812053bb tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.124378 Jun 17 13:19:11.338331 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-0375fe48-7347-43de-8d20-0d775db7b787 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.127827 Jun 17 13:19:11.338980 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 802/1573] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:19:11 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:19:11.339314 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 772/1574] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:19:11 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:19:12.347358 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-0ac4eaf9-729a-48bf-9cda-45b7ae05a4ce tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:12.348448 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-0ac4eaf9-729a-48bf-9cda-45b7ae05a4ce tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:12.351023 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_api:SELECT=58 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:19:12.351181 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-93f84c9e-3f91-4a1a-9b34-08f7edbab62a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:12.352176 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-93f84c9e-3f91-4a1a-9b34-08f7edbab62a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:12.357659 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0ac4eaf9-729a-48bf-9cda-45b7ae05a4ce tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:12.358832 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0ac4eaf9-729a-48bf-9cda-45b7ae05a4ce tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:12.359511 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-93f84c9e-3f91-4a1a-9b34-08f7edbab62a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:12.359647 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0ac4eaf9-729a-48bf-9cda-45b7ae05a4ce tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:12.360079 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-93f84c9e-3f91-4a1a-9b34-08f7edbab62a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:12.360224 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0ac4eaf9-729a-48bf-9cda-45b7ae05a4ce tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:12.360844 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-93f84c9e-3f91-4a1a-9b34-08f7edbab62a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:12.361310 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-93f84c9e-3f91-4a1a-9b34-08f7edbab62a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:12.393855 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-0ac4eaf9-729a-48bf-9cda-45b7ae05a4ce tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050828 Jun 17 13:19:12.394475 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 803/1575] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:19:12 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:19:12.395743 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-93f84c9e-3f91-4a1a-9b34-08f7edbab62a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048811 Jun 17 13:19:12.396332 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 773/1576] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:19:12 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:19:13.405176 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-ebae0103-361e-40c0-8771-8e41437009c9 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:13.406122 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-ebae0103-361e-40c0-8771-8e41437009c9 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:13.407766 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-42cd4846-de76-4aaf-ab5f-602667c10500 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:13.408769 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-42cd4846-de76-4aaf-ab5f-602667c10500 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:13.413146 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ebae0103-361e-40c0-8771-8e41437009c9 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:13.413598 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ebae0103-361e-40c0-8771-8e41437009c9 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:13.414415 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ebae0103-361e-40c0-8771-8e41437009c9 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:13.414823 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ebae0103-361e-40c0-8771-8e41437009c9 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:13.415585 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-42cd4846-de76-4aaf-ab5f-602667c10500 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:13.416011 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-42cd4846-de76-4aaf-ab5f-602667c10500 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:13.416792 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-42cd4846-de76-4aaf-ab5f-602667c10500 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:13.417210 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-42cd4846-de76-4aaf-ab5f-602667c10500 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:13.434766 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=100 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:19:13.446179 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-ebae0103-361e-40c0-8771-8e41437009c9 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045086 Jun 17 13:19:13.446746 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 804/1577] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:19:13 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:19:13.452559 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-42cd4846-de76-4aaf-ab5f-602667c10500 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049012 Jun 17 13:19:13.453111 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 774/1578] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:19:13 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:19:14.460178 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-ad077045-4d9e-4fac-8e97-d5c081c2d5df tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:14.461156 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-ad077045-4d9e-4fac-8e97-d5c081c2d5df tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:14.465172 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-86f9f0f8-8ac8-46ba-a14f-6338ee77b0b7 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:14.466941 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-86f9f0f8-8ac8-46ba-a14f-6338ee77b0b7 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:14.468878 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ad077045-4d9e-4fac-8e97-d5c081c2d5df tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:14.469502 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ad077045-4d9e-4fac-8e97-d5c081c2d5df tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:14.470729 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ad077045-4d9e-4fac-8e97-d5c081c2d5df tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:14.471480 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ad077045-4d9e-4fac-8e97-d5c081c2d5df tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:14.475072 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-86f9f0f8-8ac8-46ba-a14f-6338ee77b0b7 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:14.475664 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-86f9f0f8-8ac8-46ba-a14f-6338ee77b0b7 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:14.476305 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-86f9f0f8-8ac8-46ba-a14f-6338ee77b0b7 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:14.476765 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-86f9f0f8-8ac8-46ba-a14f-6338ee77b0b7 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:14.493041 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_cell1:SELECT=100 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:19:14.504541 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-ad077045-4d9e-4fac-8e97-d5c081c2d5df tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049990 Jun 17 13:19:14.506187 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 805/1579] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:19:14 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:19:14.514275 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-86f9f0f8-8ac8-46ba-a14f-6338ee77b0b7 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053239 Jun 17 13:19:14.514834 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 775/1580] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:19:14 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:19:15.518491 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-9a05fc7e-6f8d-4e5b-b75f-761743ad8146 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:15.519889 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-9a05fc7e-6f8d-4e5b-b75f-761743ad8146 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:15.525256 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-460803d7-0691-40dc-a2a6-c9641ace2fa1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:15.526445 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9a05fc7e-6f8d-4e5b-b75f-761743ad8146 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:15.526931 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9a05fc7e-6f8d-4e5b-b75f-761743ad8146 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:15.527615 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-460803d7-0691-40dc-a2a6-c9641ace2fa1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:15.527887 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9a05fc7e-6f8d-4e5b-b75f-761743ad8146 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:15.528329 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9a05fc7e-6f8d-4e5b-b75f-761743ad8146 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:15.534922 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-460803d7-0691-40dc-a2a6-c9641ace2fa1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:15.535486 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-460803d7-0691-40dc-a2a6-c9641ace2fa1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:15.536288 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-460803d7-0691-40dc-a2a6-c9641ace2fa1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:15.536730 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-460803d7-0691-40dc-a2a6-c9641ace2fa1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:15.561336 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-9a05fc7e-6f8d-4e5b-b75f-761743ad8146 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047870 Jun 17 13:19:15.562236 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 806/1581] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:19:15 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:19:15.571691 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-460803d7-0691-40dc-a2a6-c9641ace2fa1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050339 Jun 17 13:19:15.572258 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 776/1582] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:19:15 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:19:16.576507 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-25fc54b6-86b8-43b5-9468-572234b6c2c9 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:16.577740 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-25fc54b6-86b8-43b5-9468-572234b6c2c9 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:16.585067 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-db6bf1ff-b924-40d7-b4a4-2d1d807697ff tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:16.586503 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-25fc54b6-86b8-43b5-9468-572234b6c2c9 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:16.586962 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-25fc54b6-86b8-43b5-9468-572234b6c2c9 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:16.587511 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-db6bf1ff-b924-40d7-b4a4-2d1d807697ff tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:16.587762 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-25fc54b6-86b8-43b5-9468-572234b6c2c9 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:16.588213 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-25fc54b6-86b8-43b5-9468-572234b6c2c9 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:16.595868 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-db6bf1ff-b924-40d7-b4a4-2d1d807697ff tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:16.596287 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-db6bf1ff-b924-40d7-b4a4-2d1d807697ff tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:16.597056 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-db6bf1ff-b924-40d7-b4a4-2d1d807697ff tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:16.597491 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-db6bf1ff-b924-40d7-b4a4-2d1d807697ff tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:16.619229 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-25fc54b6-86b8-43b5-9468-572234b6c2c9 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049443 Jun 17 13:19:16.626754 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 807/1583] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:19:16 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:19:16.636324 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-db6bf1ff-b924-40d7-b4a4-2d1d807697ff tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056392 Jun 17 13:19:16.637330 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 777/1584] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:19:16 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:19:17.631288 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-2555fe0e-44ec-4d13-82f4-e80adbf25c04 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:17.632214 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-2555fe0e-44ec-4d13-82f4-e80adbf25c04 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:17.639182 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2555fe0e-44ec-4d13-82f4-e80adbf25c04 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:17.639622 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2555fe0e-44ec-4d13-82f4-e80adbf25c04 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:17.640380 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2555fe0e-44ec-4d13-82f4-e80adbf25c04 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:17.640806 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2555fe0e-44ec-4d13-82f4-e80adbf25c04 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:17.649185 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-0e6e64b8-9594-4a88-9db9-432f03b20d2d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:17.650283 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-0e6e64b8-9594-4a88-9db9-432f03b20d2d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:17.657248 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0e6e64b8-9594-4a88-9db9-432f03b20d2d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:17.657694 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0e6e64b8-9594-4a88-9db9-432f03b20d2d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:17.658495 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0e6e64b8-9594-4a88-9db9-432f03b20d2d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:17.659039 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0e6e64b8-9594-4a88-9db9-432f03b20d2d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:17.671207 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-2555fe0e-44ec-4d13-82f4-e80adbf25c04 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044059 Jun 17 13:19:17.671980 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 808/1585] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:19:17 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:19:17.694975 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-0e6e64b8-9594-4a88-9db9-432f03b20d2d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049892 Jun 17 13:19:17.699130 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 778/1586] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:19:17 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:19:18.686331 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-0ddbd710-be08-413a-9e87-4b800f20f4b7 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:18.687542 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-0ddbd710-be08-413a-9e87-4b800f20f4b7 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:18.697559 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0ddbd710-be08-413a-9e87-4b800f20f4b7 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:18.698208 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0ddbd710-be08-413a-9e87-4b800f20f4b7 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:18.699364 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0ddbd710-be08-413a-9e87-4b800f20f4b7 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:18.699978 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0ddbd710-be08-413a-9e87-4b800f20f4b7 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:18.707530 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-ed159a90-42f1-436b-9a09-618dca934fde tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:18.708493 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-ed159a90-42f1-436b-9a09-618dca934fde tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:18.715135 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ed159a90-42f1-436b-9a09-618dca934fde tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:18.715587 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ed159a90-42f1-436b-9a09-618dca934fde tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:18.716360 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ed159a90-42f1-436b-9a09-618dca934fde tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:18.716777 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ed159a90-42f1-436b-9a09-618dca934fde tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:18.733984 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-0ddbd710-be08-413a-9e87-4b800f20f4b7 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054227 Jun 17 13:19:18.737853 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 809/1587] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:19:18 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:19:18.747627 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-ed159a90-42f1-436b-9a09-618dca934fde tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044283 Jun 17 13:19:18.748204 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 779/1588] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:19:18 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:19:19.745956 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-4fa81754-fd81-4265-a19a-17a67d3af8ae tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:19.746863 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-4fa81754-fd81-4265-a19a-17a67d3af8ae tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:19.754461 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4fa81754-fd81-4265-a19a-17a67d3af8ae tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:19.754941 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4fa81754-fd81-4265-a19a-17a67d3af8ae tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:19.755698 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4fa81754-fd81-4265-a19a-17a67d3af8ae tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:19.756318 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4fa81754-fd81-4265-a19a-17a67d3af8ae tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:19.759779 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-d133f646-d2a5-4976-9cd0-fb3cb49e6579 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:19.762160 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-d133f646-d2a5-4976-9cd0-fb3cb49e6579 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:19.767671 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d133f646-d2a5-4976-9cd0-fb3cb49e6579 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:19.768138 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d133f646-d2a5-4976-9cd0-fb3cb49e6579 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:19.768871 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d133f646-d2a5-4976-9cd0-fb3cb49e6579 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:19.769328 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d133f646-d2a5-4976-9cd0-fb3cb49e6579 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:19.787941 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-4fa81754-fd81-4265-a19a-17a67d3af8ae tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045822 Jun 17 13:19:19.792730 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 810/1589] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:19:19 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:19:19.803431 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-d133f646-d2a5-4976-9cd0-fb3cb49e6579 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047639 Jun 17 13:19:19.804031 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 780/1590] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:19:19 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:19:20.800796 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-384c9592-1984-49b2-9044-d92b3eb773e8 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:20.801880 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-384c9592-1984-49b2-9044-d92b3eb773e8 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:20.810896 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-384c9592-1984-49b2-9044-d92b3eb773e8 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:20.811341 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-384c9592-1984-49b2-9044-d92b3eb773e8 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:20.812263 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-384c9592-1984-49b2-9044-d92b3eb773e8 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:20.812702 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-384c9592-1984-49b2-9044-d92b3eb773e8 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:20.815072 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-77dc6c8c-b7a2-427c-95c2-d3eb2ed2aa47 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:20.815988 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-77dc6c8c-b7a2-427c-95c2-d3eb2ed2aa47 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:20.823403 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-77dc6c8c-b7a2-427c-95c2-d3eb2ed2aa47 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:20.824036 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-77dc6c8c-b7a2-427c-95c2-d3eb2ed2aa47 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:20.824970 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-77dc6c8c-b7a2-427c-95c2-d3eb2ed2aa47 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:20.825546 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-77dc6c8c-b7a2-427c-95c2-d3eb2ed2aa47 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:20.846245 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-384c9592-1984-49b2-9044-d92b3eb773e8 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049539 Jun 17 13:19:20.847540 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 811/1591] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:19:20 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:19:20.862181 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-77dc6c8c-b7a2-427c-95c2-d3eb2ed2aa47 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051314 Jun 17 13:19:20.863328 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 781/1592] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:19:20 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 17 13:19:21.859383 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-d9177c68-4faf-4d06-a4fb-baf88a2de98f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:21.860310 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-d9177c68-4faf-4d06-a4fb-baf88a2de98f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:21.867130 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d9177c68-4faf-4d06-a4fb-baf88a2de98f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:21.867967 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d9177c68-4faf-4d06-a4fb-baf88a2de98f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:21.868469 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d9177c68-4faf-4d06-a4fb-baf88a2de98f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:21.868916 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d9177c68-4faf-4d06-a4fb-baf88a2de98f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:21.874621 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-eb8c1f6b-1e7c-4c60-958a-21d9e7d447a8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:21.875605 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-eb8c1f6b-1e7c-4c60-958a-21d9e7d447a8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:21.882873 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-eb8c1f6b-1e7c-4c60-958a-21d9e7d447a8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:21.884226 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-eb8c1f6b-1e7c-4c60-958a-21d9e7d447a8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:21.884888 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-eb8c1f6b-1e7c-4c60-958a-21d9e7d447a8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:21.885313 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-eb8c1f6b-1e7c-4c60-958a-21d9e7d447a8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:21.901584 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-d9177c68-4faf-4d06-a4fb-baf88a2de98f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046438 Jun 17 13:19:21.904430 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 812/1593] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:19:21 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:19:21.921028 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-eb8c1f6b-1e7c-4c60-958a-21d9e7d447a8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050566 Jun 17 13:19:21.921608 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 782/1594] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:19:21 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:19:22.916673 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-373a11e5-04e1-46db-9fe7-7fc097ad797f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:22.917599 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-373a11e5-04e1-46db-9fe7-7fc097ad797f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:22.925063 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-373a11e5-04e1-46db-9fe7-7fc097ad797f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:22.925518 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-373a11e5-04e1-46db-9fe7-7fc097ad797f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:22.926330 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-373a11e5-04e1-46db-9fe7-7fc097ad797f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:22.926771 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-373a11e5-04e1-46db-9fe7-7fc097ad797f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:22.934114 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-59044f18-cc28-4cd3-9079-fbc9ad4f8eb9 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:22.935028 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-59044f18-cc28-4cd3-9079-fbc9ad4f8eb9 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:22.941881 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-59044f18-cc28-4cd3-9079-fbc9ad4f8eb9 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:22.942429 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-59044f18-cc28-4cd3-9079-fbc9ad4f8eb9 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:22.943204 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-59044f18-cc28-4cd3-9079-fbc9ad4f8eb9 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:22.943874 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-59044f18-cc28-4cd3-9079-fbc9ad4f8eb9 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:22.958232 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-373a11e5-04e1-46db-9fe7-7fc097ad797f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046771 Jun 17 13:19:22.958816 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 813/1595] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:19:22 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:19:22.976603 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-59044f18-cc28-4cd3-9079-fbc9ad4f8eb9 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047292 Jun 17 13:19:22.978156 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 783/1596] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:19:22 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:19:23.974563 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-1bea503f-7b0c-417b-bdaa-0af637a083aa tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:23.975919 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-1bea503f-7b0c-417b-bdaa-0af637a083aa tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:23.984446 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-1bea503f-7b0c-417b-bdaa-0af637a083aa tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:23.984894 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-1bea503f-7b0c-417b-bdaa-0af637a083aa tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:23.985659 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-1bea503f-7b0c-417b-bdaa-0af637a083aa tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:23.986067 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-1bea503f-7b0c-417b-bdaa-0af637a083aa tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:23.989272 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-cb2e4da9-616e-425c-8d85-2027b3cb0580 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:23.990229 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-cb2e4da9-616e-425c-8d85-2027b3cb0580 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:23.997177 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cb2e4da9-616e-425c-8d85-2027b3cb0580 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:23.999228 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cb2e4da9-616e-425c-8d85-2027b3cb0580 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:24.000642 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cb2e4da9-616e-425c-8d85-2027b3cb0580 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:24.000642 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cb2e4da9-616e-425c-8d85-2027b3cb0580 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:24.016653 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-1bea503f-7b0c-417b-bdaa-0af637a083aa tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048561 Jun 17 13:19:24.017425 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 814/1597] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:19:23 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:19:24.031398 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-cb2e4da9-616e-425c-8d85-2027b3cb0580 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046320 Jun 17 13:19:24.032174 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 784/1598] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:19:23 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:19:24.615893 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 13:19:24.615893 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Fri Jun 17 13:19:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 17 13:19:25.029257 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-3eb30367-7881-4799-ad60-8e99bd0240cb tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:25.030239 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-3eb30367-7881-4799-ad60-8e99bd0240cb tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:25.037345 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-3eb30367-7881-4799-ad60-8e99bd0240cb tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:25.037888 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-3eb30367-7881-4799-ad60-8e99bd0240cb tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:25.038697 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-3eb30367-7881-4799-ad60-8e99bd0240cb tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:25.039135 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-3eb30367-7881-4799-ad60-8e99bd0240cb tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:25.043722 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-a6afac9a-4088-4a6b-b7ef-5e90ec9ce2a0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:25.044684 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-a6afac9a-4088-4a6b-b7ef-5e90ec9ce2a0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:25.050782 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a6afac9a-4088-4a6b-b7ef-5e90ec9ce2a0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:25.051226 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a6afac9a-4088-4a6b-b7ef-5e90ec9ce2a0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:25.051983 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a6afac9a-4088-4a6b-b7ef-5e90ec9ce2a0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:25.052411 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a6afac9a-4088-4a6b-b7ef-5e90ec9ce2a0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:25.071072 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-3eb30367-7881-4799-ad60-8e99bd0240cb tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046311 Jun 17 13:19:25.075247 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 815/1599] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:19:25 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:19:25.084901 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-a6afac9a-4088-4a6b-b7ef-5e90ec9ce2a0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045755 Jun 17 13:19:25.085460 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 785/1600] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:19:25 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 17 13:19:26.086031 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-2f281c6b-8b9f-42f7-a3f5-67660de971dc tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:26.087499 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-2f281c6b-8b9f-42f7-a3f5-67660de971dc tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:26.094940 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2f281c6b-8b9f-42f7-a3f5-67660de971dc tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:26.095397 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2f281c6b-8b9f-42f7-a3f5-67660de971dc tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:26.096165 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2f281c6b-8b9f-42f7-a3f5-67660de971dc tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:26.096601 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2f281c6b-8b9f-42f7-a3f5-67660de971dc tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:26.096930 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-c62042cb-c65d-4763-86da-fb0ab1c38317 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:26.097867 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-c62042cb-c65d-4763-86da-fb0ab1c38317 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:26.105063 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c62042cb-c65d-4763-86da-fb0ab1c38317 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:26.105577 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c62042cb-c65d-4763-86da-fb0ab1c38317 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:26.106371 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c62042cb-c65d-4763-86da-fb0ab1c38317 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:26.107140 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c62042cb-c65d-4763-86da-fb0ab1c38317 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:26.128611 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-2f281c6b-8b9f-42f7-a3f5-67660de971dc tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048792 Jun 17 13:19:26.129381 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 816/1601] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:19:26 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:19:26.136944 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-c62042cb-c65d-4763-86da-fb0ab1c38317 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043869 Jun 17 13:19:26.137519 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 786/1602] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:19:26 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:19:27.139923 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-8ce0ffbc-9add-4031-b9be-49ef852e1aa3 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:27.140882 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-8ce0ffbc-9add-4031-b9be-49ef852e1aa3 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:27.150380 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8ce0ffbc-9add-4031-b9be-49ef852e1aa3 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:27.150932 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8ce0ffbc-9add-4031-b9be-49ef852e1aa3 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:27.152240 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8ce0ffbc-9add-4031-b9be-49ef852e1aa3 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:27.152945 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8ce0ffbc-9add-4031-b9be-49ef852e1aa3 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:27.153501 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-3faa3909-fb97-413a-a9f2-7b643a28b68e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:27.154722 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-3faa3909-fb97-413a-a9f2-7b643a28b68e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:27.162307 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3faa3909-fb97-413a-a9f2-7b643a28b68e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:27.162755 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3faa3909-fb97-413a-a9f2-7b643a28b68e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:27.163520 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3faa3909-fb97-413a-a9f2-7b643a28b68e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:27.163949 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3faa3909-fb97-413a-a9f2-7b643a28b68e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:27.184157 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-8ce0ffbc-9add-4031-b9be-49ef852e1aa3 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048254 Jun 17 13:19:27.184994 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 817/1603] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:19:27 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:19:27.194881 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-3faa3909-fb97-413a-a9f2-7b643a28b68e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049198 Jun 17 13:19:27.195703 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 787/1604] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:19:27 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 17 13:19:28.196334 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-e8746626-cc91-4cf2-a0de-23aa68b92149 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:28.197259 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-e8746626-cc91-4cf2-a0de-23aa68b92149 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:28.204333 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e8746626-cc91-4cf2-a0de-23aa68b92149 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:28.204781 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e8746626-cc91-4cf2-a0de-23aa68b92149 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:28.205577 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e8746626-cc91-4cf2-a0de-23aa68b92149 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:28.206008 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e8746626-cc91-4cf2-a0de-23aa68b92149 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:28.206683 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-676f2f48-41bc-49d7-932e-3ccec2355bc0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:28.207607 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-676f2f48-41bc-49d7-932e-3ccec2355bc0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:28.214118 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-676f2f48-41bc-49d7-932e-3ccec2355bc0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:28.214602 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-676f2f48-41bc-49d7-932e-3ccec2355bc0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:28.215346 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-676f2f48-41bc-49d7-932e-3ccec2355bc0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:28.215844 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-676f2f48-41bc-49d7-932e-3ccec2355bc0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:28.236580 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-e8746626-cc91-4cf2-a0de-23aa68b92149 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044226 Jun 17 13:19:28.237364 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 818/1605] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:19:28 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:19:28.245763 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-676f2f48-41bc-49d7-932e-3ccec2355bc0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042992 Jun 17 13:19:28.246339 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 788/1606] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:19:28 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 17 13:19:29.248854 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-4709cbbf-3e05-443f-abc8-fe63e45359cb tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:29.249866 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-4709cbbf-3e05-443f-abc8-fe63e45359cb tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:29.256836 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4709cbbf-3e05-443f-abc8-fe63e45359cb tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:29.257430 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4709cbbf-3e05-443f-abc8-fe63e45359cb tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:29.258181 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-ac99bb9c-2625-4914-8808-668a750c69b2 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:29.258638 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4709cbbf-3e05-443f-abc8-fe63e45359cb tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:29.258638 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4709cbbf-3e05-443f-abc8-fe63e45359cb tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:29.259815 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-ac99bb9c-2625-4914-8808-668a750c69b2 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:29.266980 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ac99bb9c-2625-4914-8808-668a750c69b2 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:29.267678 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ac99bb9c-2625-4914-8808-668a750c69b2 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:29.268450 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ac99bb9c-2625-4914-8808-668a750c69b2 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:29.268880 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ac99bb9c-2625-4914-8808-668a750c69b2 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:29.289476 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-4709cbbf-3e05-443f-abc8-fe63e45359cb tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044717 Jun 17 13:19:29.290027 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 819/1607] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:19:29 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:19:29.298861 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-ac99bb9c-2625-4914-8808-668a750c69b2 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045606 Jun 17 13:19:29.299309 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 789/1608] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:19:29 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:19:30.301319 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-7c1418e5-8124-4189-b78f-b9c4f5c419f8 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:30.302283 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-7c1418e5-8124-4189-b78f-b9c4f5c419f8 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:30.310614 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7c1418e5-8124-4189-b78f-b9c4f5c419f8 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:30.310614 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7c1418e5-8124-4189-b78f-b9c4f5c419f8 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:30.310614 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7c1418e5-8124-4189-b78f-b9c4f5c419f8 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:30.310614 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7c1418e5-8124-4189-b78f-b9c4f5c419f8 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:30.317243 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-2cc914ba-08ad-4e34-bc62-9f7f935f0643 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:30.318748 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-2cc914ba-08ad-4e34-bc62-9f7f935f0643 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:30.325293 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2cc914ba-08ad-4e34-bc62-9f7f935f0643 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:30.326011 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2cc914ba-08ad-4e34-bc62-9f7f935f0643 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:30.326813 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2cc914ba-08ad-4e34-bc62-9f7f935f0643 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:30.327260 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2cc914ba-08ad-4e34-bc62-9f7f935f0643 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:30.343729 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-7c1418e5-8124-4189-b78f-b9c4f5c419f8 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046427 Jun 17 13:19:30.344285 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 820/1609] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:19:30 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:19:30.358014 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-2cc914ba-08ad-4e34-bc62-9f7f935f0643 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051154 Jun 17 13:19:30.358802 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 790/1610] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:19:30 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:19:31.355481 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-d84c85bf-7f34-4f0b-a565-12997f2cfa50 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:31.356435 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-d84c85bf-7f34-4f0b-a565-12997f2cfa50 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:31.363728 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d84c85bf-7f34-4f0b-a565-12997f2cfa50 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:31.364472 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d84c85bf-7f34-4f0b-a565-12997f2cfa50 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:31.365295 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d84c85bf-7f34-4f0b-a565-12997f2cfa50 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:31.365758 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d84c85bf-7f34-4f0b-a565-12997f2cfa50 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:31.370604 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-df65ceb2-7f12-4931-ab9c-867cba6e1db3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:31.371536 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-df65ceb2-7f12-4931-ab9c-867cba6e1db3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:31.378448 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-df65ceb2-7f12-4931-ab9c-867cba6e1db3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:31.378895 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-df65ceb2-7f12-4931-ab9c-867cba6e1db3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:31.379656 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-df65ceb2-7f12-4931-ab9c-867cba6e1db3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:31.380106 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-df65ceb2-7f12-4931-ab9c-867cba6e1db3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:31.383976 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=100 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:19:31.401599 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-d84c85bf-7f34-4f0b-a565-12997f2cfa50 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050124 Jun 17 13:19:31.405394 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 821/1611] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:19:31 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:19:31.412463 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-df65ceb2-7f12-4931-ab9c-867cba6e1db3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045981 Jun 17 13:19:31.413066 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 791/1612] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:19:31 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:19:32.412934 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-1c20673e-916b-4b61-aeb4-47629c56a16a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:32.413857 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-1c20673e-916b-4b61-aeb4-47629c56a16a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:32.420944 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-1c20673e-916b-4b61-aeb4-47629c56a16a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:32.421414 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-1c20673e-916b-4b61-aeb4-47629c56a16a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:32.422197 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-1c20673e-916b-4b61-aeb4-47629c56a16a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:32.422628 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-1c20673e-916b-4b61-aeb4-47629c56a16a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:32.425092 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-02f76677-c5d8-4de8-b7b9-b7945a795eb6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:32.426203 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-02f76677-c5d8-4de8-b7b9-b7945a795eb6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:32.426533 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_cell1:SELECT=100 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:19:32.433823 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-02f76677-c5d8-4de8-b7b9-b7945a795eb6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:32.434294 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-02f76677-c5d8-4de8-b7b9-b7945a795eb6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:32.435067 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-02f76677-c5d8-4de8-b7b9-b7945a795eb6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:32.435669 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-02f76677-c5d8-4de8-b7b9-b7945a795eb6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:32.455928 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-1c20673e-916b-4b61-aeb4-47629c56a16a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046908 Jun 17 13:19:32.456477 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 822/1613] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:19:32 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:19:32.469870 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-02f76677-c5d8-4de8-b7b9-b7945a795eb6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048956 Jun 17 13:19:32.470523 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 792/1614] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:19:32 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:19:33.472204 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-98dd4dea-de43-41af-a247-f4050f8af746 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:33.473814 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-98dd4dea-de43-41af-a247-f4050f8af746 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:33.485171 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-98dd4dea-de43-41af-a247-f4050f8af746 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:33.485640 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-98dd4dea-de43-41af-a247-f4050f8af746 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:33.486422 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-98dd4dea-de43-41af-a247-f4050f8af746 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:33.486858 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-98dd4dea-de43-41af-a247-f4050f8af746 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:33.487303 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-ae4be202-ab10-492a-b5b9-0f9131102f75 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:33.488316 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-ae4be202-ab10-492a-b5b9-0f9131102f75 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:33.495451 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ae4be202-ab10-492a-b5b9-0f9131102f75 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:33.495881 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ae4be202-ab10-492a-b5b9-0f9131102f75 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:33.496913 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ae4be202-ab10-492a-b5b9-0f9131102f75 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:33.497344 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ae4be202-ab10-492a-b5b9-0f9131102f75 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:33.518980 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-98dd4dea-de43-41af-a247-f4050f8af746 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053710 Jun 17 13:19:33.519685 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 823/1615] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:19:33 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:19:33.529578 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-ae4be202-ab10-492a-b5b9-0f9131102f75 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050091 Jun 17 13:19:33.530336 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 793/1616] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:19:33 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:19:34.535770 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-ff92f38e-174c-4c19-8c1d-0dd7c8022ac6 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:34.544336 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-ff92f38e-174c-4c19-8c1d-0dd7c8022ac6 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:34.549987 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-151bac42-e9df-47e8-99e2-ee75ee71aec4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:34.550492 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ff92f38e-174c-4c19-8c1d-0dd7c8022ac6 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:34.550492 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ff92f38e-174c-4c19-8c1d-0dd7c8022ac6 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:34.551207 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-151bac42-e9df-47e8-99e2-ee75ee71aec4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:34.551331 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ff92f38e-174c-4c19-8c1d-0dd7c8022ac6 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:34.551695 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ff92f38e-174c-4c19-8c1d-0dd7c8022ac6 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:34.559665 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-151bac42-e9df-47e8-99e2-ee75ee71aec4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:34.560108 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-151bac42-e9df-47e8-99e2-ee75ee71aec4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:34.561261 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-151bac42-e9df-47e8-99e2-ee75ee71aec4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:34.561669 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-151bac42-e9df-47e8-99e2-ee75ee71aec4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:34.582751 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-ff92f38e-174c-4c19-8c1d-0dd7c8022ac6 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053919 Jun 17 13:19:34.583353 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 824/1617] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:19:34 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:19:34.596690 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-151bac42-e9df-47e8-99e2-ee75ee71aec4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053516 Jun 17 13:19:34.600541 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 794/1618] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:19:34 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:19:35.596094 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-fd3ce595-8e5c-4cb1-862f-81c3eac3934a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:35.597062 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-fd3ce595-8e5c-4cb1-862f-81c3eac3934a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:35.604091 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-fd3ce595-8e5c-4cb1-862f-81c3eac3934a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:35.604543 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-fd3ce595-8e5c-4cb1-862f-81c3eac3934a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:35.605318 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-fd3ce595-8e5c-4cb1-862f-81c3eac3934a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:35.605757 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-fd3ce595-8e5c-4cb1-862f-81c3eac3934a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:35.608163 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-95389037-9fe7-4028-a8cf-df1397efabeb tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:35.609613 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-95389037-9fe7-4028-a8cf-df1397efabeb tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:35.612452 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_api:SELECT=58 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:19:35.617715 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-95389037-9fe7-4028-a8cf-df1397efabeb tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:35.618180 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-95389037-9fe7-4028-a8cf-df1397efabeb tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:35.618939 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-95389037-9fe7-4028-a8cf-df1397efabeb tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:35.619376 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-95389037-9fe7-4028-a8cf-df1397efabeb tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:35.637855 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-fd3ce595-8e5c-4cb1-862f-81c3eac3934a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045887 Jun 17 13:19:35.638475 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 825/1619] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:19:35 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:19:35.651395 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-95389037-9fe7-4028-a8cf-df1397efabeb tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047766 Jun 17 13:19:35.652080 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 795/1620] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:19:35 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 17 13:19:36.649563 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-cfdab88b-b048-46c4-bcb1-105edb2769a8 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:36.650545 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-cfdab88b-b048-46c4-bcb1-105edb2769a8 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:36.657837 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-cfdab88b-b048-46c4-bcb1-105edb2769a8 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:36.658342 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-cfdab88b-b048-46c4-bcb1-105edb2769a8 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:36.659115 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-cfdab88b-b048-46c4-bcb1-105edb2769a8 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:36.659557 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-cfdab88b-b048-46c4-bcb1-105edb2769a8 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:36.663437 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-ab3eb0e7-0c48-4061-845e-ce9bc9b8bc26 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:36.664529 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-ab3eb0e7-0c48-4061-845e-ce9bc9b8bc26 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:36.671802 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ab3eb0e7-0c48-4061-845e-ce9bc9b8bc26 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:36.672335 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ab3eb0e7-0c48-4061-845e-ce9bc9b8bc26 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:36.673190 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ab3eb0e7-0c48-4061-845e-ce9bc9b8bc26 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:36.673618 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ab3eb0e7-0c48-4061-845e-ce9bc9b8bc26 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:36.693730 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-cfdab88b-b048-46c4-bcb1-105edb2769a8 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048185 Jun 17 13:19:36.694334 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 826/1621] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:19:36 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:19:36.708951 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-ab3eb0e7-0c48-4061-845e-ce9bc9b8bc26 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049609 Jun 17 13:19:36.709549 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 796/1622] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:19:36 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:19:37.710349 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-9dc6848d-f5d7-4cec-8bcb-46e93bfdeff2 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:37.711850 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-9dc6848d-f5d7-4cec-8bcb-46e93bfdeff2 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:37.721534 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9dc6848d-f5d7-4cec-8bcb-46e93bfdeff2 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:37.721988 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9dc6848d-f5d7-4cec-8bcb-46e93bfdeff2 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:37.722780 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9dc6848d-f5d7-4cec-8bcb-46e93bfdeff2 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:37.723215 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9dc6848d-f5d7-4cec-8bcb-46e93bfdeff2 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:37.733783 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-5335e87b-eb35-4bca-bf90-6987a539c793 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:37.734984 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-5335e87b-eb35-4bca-bf90-6987a539c793 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:37.741985 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5335e87b-eb35-4bca-bf90-6987a539c793 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:37.742453 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5335e87b-eb35-4bca-bf90-6987a539c793 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:37.743853 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5335e87b-eb35-4bca-bf90-6987a539c793 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:37.744284 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5335e87b-eb35-4bca-bf90-6987a539c793 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:37.755603 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-9dc6848d-f5d7-4cec-8bcb-46e93bfdeff2 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052538 Jun 17 13:19:37.756190 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 827/1623] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:19:37 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:19:37.775596 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-5335e87b-eb35-4bca-bf90-6987a539c793 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.057133 Jun 17 13:19:37.776371 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 797/1624] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:19:37 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:19:38.770254 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-93c1c514-295c-48a0-9efc-abf82f571ca1 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:38.771280 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-93c1c514-295c-48a0-9efc-abf82f571ca1 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:38.778959 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-93c1c514-295c-48a0-9efc-abf82f571ca1 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:38.779455 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-93c1c514-295c-48a0-9efc-abf82f571ca1 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:38.780296 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-93c1c514-295c-48a0-9efc-abf82f571ca1 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:38.780769 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-93c1c514-295c-48a0-9efc-abf82f571ca1 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:38.789154 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-b48e447a-cc72-479b-98e7-1e4d5122b357 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:38.790384 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-b48e447a-cc72-479b-98e7-1e4d5122b357 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:38.798867 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b48e447a-cc72-479b-98e7-1e4d5122b357 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:38.799404 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b48e447a-cc72-479b-98e7-1e4d5122b357 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:38.800176 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b48e447a-cc72-479b-98e7-1e4d5122b357 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:38.800615 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b48e447a-cc72-479b-98e7-1e4d5122b357 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:38.815785 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-93c1c514-295c-48a0-9efc-abf82f571ca1 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050792 Jun 17 13:19:38.816356 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 828/1625] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:19:38 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:19:38.831721 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-b48e447a-cc72-479b-98e7-1e4d5122b357 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046992 Jun 17 13:19:38.832249 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 798/1626] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:19:38 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:19:39.832567 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-3cd9051c-ffb9-4217-aa5f-c3e16addcc46 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:39.833932 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-3cd9051c-ffb9-4217-aa5f-c3e16addcc46 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:39.844880 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-3cd9051c-ffb9-4217-aa5f-c3e16addcc46 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:39.845374 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-3cd9051c-ffb9-4217-aa5f-c3e16addcc46 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:39.846160 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-3cd9051c-ffb9-4217-aa5f-c3e16addcc46 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:39.846599 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-3cd9051c-ffb9-4217-aa5f-c3e16addcc46 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:39.847114 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-123afd1e-04ed-47ea-a9c4-e396d91811b3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:39.848134 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-123afd1e-04ed-47ea-a9c4-e396d91811b3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:39.855181 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-123afd1e-04ed-47ea-a9c4-e396d91811b3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:39.855632 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-123afd1e-04ed-47ea-a9c4-e396d91811b3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:39.856734 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-123afd1e-04ed-47ea-a9c4-e396d91811b3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:39.857191 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-123afd1e-04ed-47ea-a9c4-e396d91811b3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:39.879279 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-3cd9051c-ffb9-4217-aa5f-c3e16addcc46 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053754 Jun 17 13:19:39.880050 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 829/1627] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:19:39 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:19:39.889384 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-123afd1e-04ed-47ea-a9c4-e396d91811b3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048652 Jun 17 13:19:39.889935 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 799/1628] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:19:39 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:19:40.894150 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-3470ab2b-cf8f-44ef-8cda-957d953b5e96 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:40.895132 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-3470ab2b-cf8f-44ef-8cda-957d953b5e96 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:40.901986 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-3470ab2b-cf8f-44ef-8cda-957d953b5e96 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:40.902220 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-6d1d6929-581a-4734-a44e-2a20ad4dea32 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:40.902649 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-3470ab2b-cf8f-44ef-8cda-957d953b5e96 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:40.902989 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-6d1d6929-581a-4734-a44e-2a20ad4dea32 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:40.903253 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-3470ab2b-cf8f-44ef-8cda-957d953b5e96 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:40.903682 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-3470ab2b-cf8f-44ef-8cda-957d953b5e96 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:40.909900 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6d1d6929-581a-4734-a44e-2a20ad4dea32 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:40.910365 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6d1d6929-581a-4734-a44e-2a20ad4dea32 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:40.911131 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6d1d6929-581a-4734-a44e-2a20ad4dea32 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:40.911567 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6d1d6929-581a-4734-a44e-2a20ad4dea32 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:40.934417 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-3470ab2b-cf8f-44ef-8cda-957d953b5e96 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045666 Jun 17 13:19:40.935227 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 830/1629] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:19:40 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:19:40.944920 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-6d1d6929-581a-4734-a44e-2a20ad4dea32 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046897 Jun 17 13:19:40.945668 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 800/1630] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:19:40 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:19:41.950572 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-d3c40753-aafc-4cbd-9705-7cbf505ba2ad tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:41.952049 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-d3c40753-aafc-4cbd-9705-7cbf505ba2ad tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:41.958554 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-942bf39a-69a3-4b2f-9205-6b9d5faa7e30 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:41.959480 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-942bf39a-69a3-4b2f-9205-6b9d5faa7e30 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:41.959777 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d3c40753-aafc-4cbd-9705-7cbf505ba2ad tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:41.960228 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d3c40753-aafc-4cbd-9705-7cbf505ba2ad tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:41.960996 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d3c40753-aafc-4cbd-9705-7cbf505ba2ad tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:41.961433 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d3c40753-aafc-4cbd-9705-7cbf505ba2ad tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:41.966215 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-942bf39a-69a3-4b2f-9205-6b9d5faa7e30 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:41.966689 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-942bf39a-69a3-4b2f-9205-6b9d5faa7e30 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:41.967449 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-942bf39a-69a3-4b2f-9205-6b9d5faa7e30 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:41.967879 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-942bf39a-69a3-4b2f-9205-6b9d5faa7e30 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:41.993525 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-d3c40753-aafc-4cbd-9705-7cbf505ba2ad tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049552 Jun 17 13:19:41.994121 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 831/1631] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:19:41 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:19:41.998858 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-942bf39a-69a3-4b2f-9205-6b9d5faa7e30 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044787 Jun 17 13:19:41.999437 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 801/1632] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:19:41 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:19:43.010265 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-36f89e56-e90a-4359-a5e2-dd8f067f7e86 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:43.011669 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-36f89e56-e90a-4359-a5e2-dd8f067f7e86 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:43.014789 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-4cd740d7-939b-416e-b2f2-345f4144f431 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:43.015533 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_api:SELECT=58 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:19:43.016275 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-4cd740d7-939b-416e-b2f2-345f4144f431 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:43.025794 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-36f89e56-e90a-4359-a5e2-dd8f067f7e86 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:43.026664 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-36f89e56-e90a-4359-a5e2-dd8f067f7e86 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:43.027924 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-36f89e56-e90a-4359-a5e2-dd8f067f7e86 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:43.028176 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4cd740d7-939b-416e-b2f2-345f4144f431 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:43.028712 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4cd740d7-939b-416e-b2f2-345f4144f431 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:43.029694 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-36f89e56-e90a-4359-a5e2-dd8f067f7e86 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:43.030220 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4cd740d7-939b-416e-b2f2-345f4144f431 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:43.030723 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4cd740d7-939b-416e-b2f2-345f4144f431 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:43.063337 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-36f89e56-e90a-4359-a5e2-dd8f067f7e86 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060018 Jun 17 13:19:43.063935 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 832/1633] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:19:43 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:19:43.067787 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-4cd740d7-939b-416e-b2f2-345f4144f431 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056358 Jun 17 13:19:43.068377 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 802/1634] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:19:43 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:19:44.082445 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-506e6c39-63c6-4ae1-971b-e5b56c43c187 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:44.083119 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-bcbe7814-bf6e-431e-95d4-b2b71085c8ea tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:44.083522 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-506e6c39-63c6-4ae1-971b-e5b56c43c187 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:44.083883 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-bcbe7814-bf6e-431e-95d4-b2b71085c8ea tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:44.090286 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-506e6c39-63c6-4ae1-971b-e5b56c43c187 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:44.090465 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-bcbe7814-bf6e-431e-95d4-b2b71085c8ea tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:44.090694 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-506e6c39-63c6-4ae1-971b-e5b56c43c187 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:44.090892 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-bcbe7814-bf6e-431e-95d4-b2b71085c8ea tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:44.091464 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-506e6c39-63c6-4ae1-971b-e5b56c43c187 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:44.091674 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-bcbe7814-bf6e-431e-95d4-b2b71085c8ea tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:44.091902 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-506e6c39-63c6-4ae1-971b-e5b56c43c187 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:44.092117 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-bcbe7814-bf6e-431e-95d4-b2b71085c8ea tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:44.123569 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-506e6c39-63c6-4ae1-971b-e5b56c43c187 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046525 Jun 17 13:19:44.124128 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 803/1635] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:19:44 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:19:44.124536 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-bcbe7814-bf6e-431e-95d4-b2b71085c8ea tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051654 Jun 17 13:19:44.125066 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 833/1636] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:19:44 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:19:45.136103 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-74b98fe1-da9d-4847-8d53-720594772592 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:45.136706 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-76a62b16-3800-42e8-958f-2594aa578dcc tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:45.137084 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-76a62b16-3800-42e8-958f-2594aa578dcc tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:45.137191 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-74b98fe1-da9d-4847-8d53-720594772592 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:45.144364 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-76a62b16-3800-42e8-958f-2594aa578dcc tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:45.144612 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-74b98fe1-da9d-4847-8d53-720594772592 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:45.144807 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-76a62b16-3800-42e8-958f-2594aa578dcc tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:45.144975 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-74b98fe1-da9d-4847-8d53-720594772592 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:45.145568 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-76a62b16-3800-42e8-958f-2594aa578dcc tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:45.145719 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-74b98fe1-da9d-4847-8d53-720594772592 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:45.145992 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-76a62b16-3800-42e8-958f-2594aa578dcc tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:45.146198 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-74b98fe1-da9d-4847-8d53-720594772592 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:45.178463 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-74b98fe1-da9d-4847-8d53-720594772592 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046003 Jun 17 13:19:45.178740 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-76a62b16-3800-42e8-958f-2594aa578dcc tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046322 Jun 17 13:19:45.179801 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 804/1638] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:19:45 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:19:45.179953 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 834/1638] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:19:45 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:19:46.194486 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-c70d5cd6-bcaf-41e1-b82d-7f19f83baf8a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:46.195365 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-c1ba0582-c7bd-4d10-a6b6-231d79f5e141 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:46.196002 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-c70d5cd6-bcaf-41e1-b82d-7f19f83baf8a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:46.196883 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-c1ba0582-c7bd-4d10-a6b6-231d79f5e141 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:46.206811 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c70d5cd6-bcaf-41e1-b82d-7f19f83baf8a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:46.207264 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c70d5cd6-bcaf-41e1-b82d-7f19f83baf8a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:46.207698 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c1ba0582-c7bd-4d10-a6b6-231d79f5e141 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:46.208019 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c70d5cd6-bcaf-41e1-b82d-7f19f83baf8a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:46.208178 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c1ba0582-c7bd-4d10-a6b6-231d79f5e141 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:46.208476 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c70d5cd6-bcaf-41e1-b82d-7f19f83baf8a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:46.208976 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c1ba0582-c7bd-4d10-a6b6-231d79f5e141 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:46.209439 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c1ba0582-c7bd-4d10-a6b6-231d79f5e141 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:46.238596 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-c70d5cd6-bcaf-41e1-b82d-7f19f83baf8a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050687 Jun 17 13:19:46.239112 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 805/1639] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:19:46 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:19:46.243510 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-c1ba0582-c7bd-4d10-a6b6-231d79f5e141 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055671 Jun 17 13:19:46.244156 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 835/1640] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:19:46 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:19:47.252582 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-7b419871-ed81-49f8-86dd-b73efbeb6256 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:47.253833 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-7b419871-ed81-49f8-86dd-b73efbeb6256 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:47.256582 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-f8707a6d-8dc2-4f68-9616-9b46beab87bc tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:47.257801 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-f8707a6d-8dc2-4f68-9616-9b46beab87bc tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:47.261327 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7b419871-ed81-49f8-86dd-b73efbeb6256 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:47.261752 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7b419871-ed81-49f8-86dd-b73efbeb6256 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:47.262566 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7b419871-ed81-49f8-86dd-b73efbeb6256 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:47.263004 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7b419871-ed81-49f8-86dd-b73efbeb6256 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:47.264497 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f8707a6d-8dc2-4f68-9616-9b46beab87bc tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:47.264948 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f8707a6d-8dc2-4f68-9616-9b46beab87bc tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:47.265702 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f8707a6d-8dc2-4f68-9616-9b46beab87bc tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:47.266123 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f8707a6d-8dc2-4f68-9616-9b46beab87bc tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:47.294125 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-7b419871-ed81-49f8-86dd-b73efbeb6256 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046767 Jun 17 13:19:47.298254 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 806/1641] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:19:47 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:19:47.298435 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-f8707a6d-8dc2-4f68-9616-9b46beab87bc tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044660 Jun 17 13:19:47.298435 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 836/1642] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:19:47 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:19:48.310937 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-a7ea42f4-97a2-4bb0-b80c-28e39e7b7a9b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:48.312683 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-6e21657f-0092-4dfa-a583-a23cb2defcf1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:48.313376 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-a7ea42f4-97a2-4bb0-b80c-28e39e7b7a9b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:48.314514 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-6e21657f-0092-4dfa-a583-a23cb2defcf1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:48.324757 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a7ea42f4-97a2-4bb0-b80c-28e39e7b7a9b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:48.325501 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a7ea42f4-97a2-4bb0-b80c-28e39e7b7a9b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:48.326776 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6e21657f-0092-4dfa-a583-a23cb2defcf1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:48.326979 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a7ea42f4-97a2-4bb0-b80c-28e39e7b7a9b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:48.327532 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6e21657f-0092-4dfa-a583-a23cb2defcf1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:48.327726 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a7ea42f4-97a2-4bb0-b80c-28e39e7b7a9b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:48.328800 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6e21657f-0092-4dfa-a583-a23cb2defcf1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:48.329526 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6e21657f-0092-4dfa-a583-a23cb2defcf1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:48.355535 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=100 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:19:48.361605 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-a7ea42f4-97a2-4bb0-b80c-28e39e7b7a9b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057371 Jun 17 13:19:48.362345 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-6e21657f-0092-4dfa-a583-a23cb2defcf1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056064 Jun 17 13:19:48.362494 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 807/1643] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:19:48 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:19:48.366780 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 837/1644] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:19:48 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:19:49.377453 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-4902b4e0-6b65-42c8-9029-9b84e7f3dd66 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:49.378778 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-4902b4e0-6b65-42c8-9029-9b84e7f3dd66 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:49.379628 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-9f37ff44-c883-4f99-b3bd-4b9519866ed0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:49.380994 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-9f37ff44-c883-4f99-b3bd-4b9519866ed0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:49.390305 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4902b4e0-6b65-42c8-9029-9b84e7f3dd66 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:49.390305 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4902b4e0-6b65-42c8-9029-9b84e7f3dd66 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:49.390305 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4902b4e0-6b65-42c8-9029-9b84e7f3dd66 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:49.391116 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9f37ff44-c883-4f99-b3bd-4b9519866ed0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:49.391254 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4902b4e0-6b65-42c8-9029-9b84e7f3dd66 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:49.391373 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9f37ff44-c883-4f99-b3bd-4b9519866ed0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:49.395561 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9f37ff44-c883-4f99-b3bd-4b9519866ed0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:49.395561 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9f37ff44-c883-4f99-b3bd-4b9519866ed0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:49.423705 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_cell1:SELECT=100 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:19:49.426146 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-9f37ff44-c883-4f99-b3bd-4b9519866ed0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052327 Jun 17 13:19:49.427398 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 838/1645] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:19:49 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:19:49.429102 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-4902b4e0-6b65-42c8-9029-9b84e7f3dd66 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057826 Jun 17 13:19:49.429807 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 808/1646] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:19:49 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:19:50.440469 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-91bca2b7-0a62-400d-ae64-b99cc5d2909e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:50.441075 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-c3960179-6546-422e-8215-0970c233026f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:50.441461 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-91bca2b7-0a62-400d-ae64-b99cc5d2909e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:50.441666 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-c3960179-6546-422e-8215-0970c233026f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:50.448633 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-91bca2b7-0a62-400d-ae64-b99cc5d2909e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:50.448824 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c3960179-6546-422e-8215-0970c233026f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:50.449066 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-91bca2b7-0a62-400d-ae64-b99cc5d2909e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:50.449310 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c3960179-6546-422e-8215-0970c233026f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:50.449831 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-91bca2b7-0a62-400d-ae64-b99cc5d2909e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:50.450028 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c3960179-6546-422e-8215-0970c233026f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:50.450263 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-91bca2b7-0a62-400d-ae64-b99cc5d2909e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:50.450497 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c3960179-6546-422e-8215-0970c233026f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:50.481891 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-c3960179-6546-422e-8215-0970c233026f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044629 Jun 17 13:19:50.482686 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-91bca2b7-0a62-400d-ae64-b99cc5d2909e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046765 Jun 17 13:19:50.482856 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 809/1647] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:19:50 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:19:50.483226 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 839/1648] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:19:50 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:19:51.495115 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-a1ab2933-7a0d-4e06-a81c-5c1455fd4ec9 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:51.495836 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-d1746510-3f36-466b-ab7f-b494e282821a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:51.496233 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-a1ab2933-7a0d-4e06-a81c-5c1455fd4ec9 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:51.496325 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-d1746510-3f36-466b-ab7f-b494e282821a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:51.503452 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d1746510-3f36-466b-ab7f-b494e282821a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:51.503635 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a1ab2933-7a0d-4e06-a81c-5c1455fd4ec9 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:51.503909 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a1ab2933-7a0d-4e06-a81c-5c1455fd4ec9 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:51.504086 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d1746510-3f36-466b-ab7f-b494e282821a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:51.504707 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a1ab2933-7a0d-4e06-a81c-5c1455fd4ec9 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:51.504824 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d1746510-3f36-466b-ab7f-b494e282821a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:51.505163 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d1746510-3f36-466b-ab7f-b494e282821a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:51.505285 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a1ab2933-7a0d-4e06-a81c-5c1455fd4ec9 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:51.536245 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-a1ab2933-7a0d-4e06-a81c-5c1455fd4ec9 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045624 Jun 17 13:19:51.537085 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 840/1649] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:19:51 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:19:51.539156 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-d1746510-3f36-466b-ab7f-b494e282821a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048916 Jun 17 13:19:51.542921 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 810/1650] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:19:51 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:19:52.548628 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-4c1e2226-cf20-43d2-bb1b-e354871a421e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:52.549667 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-4c1e2226-cf20-43d2-bb1b-e354871a421e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:52.550627 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-5c8034aa-8e12-4474-8099-393ae7e3f083 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:52.551542 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-5c8034aa-8e12-4474-8099-393ae7e3f083 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:52.557308 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4c1e2226-cf20-43d2-bb1b-e354871a421e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:52.557781 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4c1e2226-cf20-43d2-bb1b-e354871a421e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:52.557938 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5c8034aa-8e12-4474-8099-393ae7e3f083 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:52.558306 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5c8034aa-8e12-4474-8099-393ae7e3f083 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:52.558579 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4c1e2226-cf20-43d2-bb1b-e354871a421e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:52.558994 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4c1e2226-cf20-43d2-bb1b-e354871a421e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:52.559113 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5c8034aa-8e12-4474-8099-393ae7e3f083 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:52.559453 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5c8034aa-8e12-4474-8099-393ae7e3f083 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:52.590747 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-5c8034aa-8e12-4474-8099-393ae7e3f083 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043986 Jun 17 13:19:52.591543 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 811/1651] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:19:52 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:19:52.592682 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-4c1e2226-cf20-43d2-bb1b-e354871a421e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048284 Jun 17 13:19:52.593236 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 841/1652] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:19:52 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:19:53.604013 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-243c9dc7-1f94-434b-9bb4-a98fb15165c3 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:53.605111 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-243c9dc7-1f94-434b-9bb4-a98fb15165c3 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:53.605561 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-219b476e-f305-4065-93b9-1f2877ff2dd2 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:53.607016 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-219b476e-f305-4065-93b9-1f2877ff2dd2 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:53.613922 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-243c9dc7-1f94-434b-9bb4-a98fb15165c3 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:53.614483 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-243c9dc7-1f94-434b-9bb4-a98fb15165c3 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:53.614988 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-219b476e-f305-4065-93b9-1f2877ff2dd2 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:53.615370 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-243c9dc7-1f94-434b-9bb4-a98fb15165c3 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:53.615548 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-219b476e-f305-4065-93b9-1f2877ff2dd2 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:53.615982 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-243c9dc7-1f94-434b-9bb4-a98fb15165c3 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:53.616723 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-219b476e-f305-4065-93b9-1f2877ff2dd2 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:53.617161 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-219b476e-f305-4065-93b9-1f2877ff2dd2 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:53.645901 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-243c9dc7-1f94-434b-9bb4-a98fb15165c3 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046793 Jun 17 13:19:53.649657 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 812/1653] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:19:53 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:19:53.650075 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-219b476e-f305-4065-93b9-1f2877ff2dd2 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047220 Jun 17 13:19:53.650075 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 842/1654] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:19:53 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:19:54.661893 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-237c9615-17d7-4ab6-a5ec-c589d1281fcc tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:54.662959 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-02abc87a-697f-4b33-96b9-0e0cb8a05427 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:54.663547 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-237c9615-17d7-4ab6-a5ec-c589d1281fcc tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:54.663959 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-02abc87a-697f-4b33-96b9-0e0cb8a05427 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:54.670187 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-237c9615-17d7-4ab6-a5ec-c589d1281fcc tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:54.670562 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-02abc87a-697f-4b33-96b9-0e0cb8a05427 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:54.670685 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-237c9615-17d7-4ab6-a5ec-c589d1281fcc tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:54.671010 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-02abc87a-697f-4b33-96b9-0e0cb8a05427 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:54.671390 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-237c9615-17d7-4ab6-a5ec-c589d1281fcc tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:54.671766 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-02abc87a-697f-4b33-96b9-0e0cb8a05427 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:54.671881 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-237c9615-17d7-4ab6-a5ec-c589d1281fcc tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:54.672198 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-02abc87a-697f-4b33-96b9-0e0cb8a05427 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:54.702293 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-02abc87a-697f-4b33-96b9-0e0cb8a05427 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045304 Jun 17 13:19:54.706888 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 843/1655] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:19:54 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:19:54.707403 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-237c9615-17d7-4ab6-a5ec-c589d1281fcc tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049102 Jun 17 13:19:54.707403 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 813/1656] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:19:54 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:19:55.715596 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-28b154f8-49ef-4a01-bd53-34543ffd4ecb tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:55.716177 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-676f4f60-ed6a-4867-b147-f690187532b7 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:55.716692 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-28b154f8-49ef-4a01-bd53-34543ffd4ecb tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:55.717000 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-676f4f60-ed6a-4867-b147-f690187532b7 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:55.723370 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-28b154f8-49ef-4a01-bd53-34543ffd4ecb tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:55.723811 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-28b154f8-49ef-4a01-bd53-34543ffd4ecb tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:55.723978 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-676f4f60-ed6a-4867-b147-f690187532b7 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:55.724377 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-676f4f60-ed6a-4867-b147-f690187532b7 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:55.724528 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-28b154f8-49ef-4a01-bd53-34543ffd4ecb tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:55.724978 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-28b154f8-49ef-4a01-bd53-34543ffd4ecb tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:55.725126 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-676f4f60-ed6a-4867-b147-f690187532b7 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:55.725984 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-676f4f60-ed6a-4867-b147-f690187532b7 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:55.755559 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-28b154f8-49ef-4a01-bd53-34543ffd4ecb tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043904 Jun 17 13:19:55.756303 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 844/1657] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:19:55 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 17 13:19:55.757880 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-676f4f60-ed6a-4867-b147-f690187532b7 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045345 Jun 17 13:19:55.761544 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 814/1658] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:19:55 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 13:19:56.772414 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-a9bdfcf1-e3a0-40ea-a0f2-d21ce0306b20 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:56.773043 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-f5ef2529-3ea4-41da-aac4-85594344aba7 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:56.773444 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-a9bdfcf1-e3a0-40ea-a0f2-d21ce0306b20 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:56.773785 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-f5ef2529-3ea4-41da-aac4-85594344aba7 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:56.780351 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a9bdfcf1-e3a0-40ea-a0f2-d21ce0306b20 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:56.780514 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f5ef2529-3ea4-41da-aac4-85594344aba7 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:56.780787 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a9bdfcf1-e3a0-40ea-a0f2-d21ce0306b20 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:56.781011 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f5ef2529-3ea4-41da-aac4-85594344aba7 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:56.781571 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a9bdfcf1-e3a0-40ea-a0f2-d21ce0306b20 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:56.781772 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f5ef2529-3ea4-41da-aac4-85594344aba7 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:56.781995 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a9bdfcf1-e3a0-40ea-a0f2-d21ce0306b20 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:56.782242 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f5ef2529-3ea4-41da-aac4-85594344aba7 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:56.812530 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-a9bdfcf1-e3a0-40ea-a0f2-d21ce0306b20 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046781 Jun 17 13:19:56.813303 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 845/1659] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:19:56 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:19:56.814344 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-f5ef2529-3ea4-41da-aac4-85594344aba7 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048492 Jun 17 13:19:56.815696 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 815/1660] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:19:56 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:19:57.827474 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-ab37e3f8-c6d5-44af-a393-a51d560607ec tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:57.828339 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-68e93c62-865e-430d-b4f5-bac63e97b6fb tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:57.828800 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-68e93c62-865e-430d-b4f5-bac63e97b6fb tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:57.828907 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-ab37e3f8-c6d5-44af-a393-a51d560607ec tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:57.837381 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ab37e3f8-c6d5-44af-a393-a51d560607ec tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:57.837870 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-68e93c62-865e-430d-b4f5-bac63e97b6fb tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:57.838039 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ab37e3f8-c6d5-44af-a393-a51d560607ec tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:57.838455 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-68e93c62-865e-430d-b4f5-bac63e97b6fb tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:57.838949 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ab37e3f8-c6d5-44af-a393-a51d560607ec tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:57.839394 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-68e93c62-865e-430d-b4f5-bac63e97b6fb tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:57.839534 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ab37e3f8-c6d5-44af-a393-a51d560607ec tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:57.839929 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-68e93c62-865e-430d-b4f5-bac63e97b6fb tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:57.872191 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-ab37e3f8-c6d5-44af-a393-a51d560607ec tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049623 Jun 17 13:19:57.872451 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-68e93c62-865e-430d-b4f5-bac63e97b6fb tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049967 Jun 17 13:19:57.873104 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 846/1661] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:19:57 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 17 13:19:57.873424 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 816/1662] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:19:57 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:19:58.888187 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-bcc4d366-ef51-4e4e-9da0-d994d9651e8e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:58.889043 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-98165b53-559b-44f9-a088-718e42cd17ed tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:58.889710 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-bcc4d366-ef51-4e4e-9da0-d994d9651e8e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:58.891063 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-98165b53-559b-44f9-a088-718e42cd17ed tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:58.900054 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-bcc4d366-ef51-4e4e-9da0-d994d9651e8e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:58.900618 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-bcc4d366-ef51-4e4e-9da0-d994d9651e8e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:58.901072 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-98165b53-559b-44f9-a088-718e42cd17ed tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:58.901378 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-bcc4d366-ef51-4e4e-9da0-d994d9651e8e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:58.901508 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-98165b53-559b-44f9-a088-718e42cd17ed tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:58.901802 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-bcc4d366-ef51-4e4e-9da0-d994d9651e8e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:58.902324 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-98165b53-559b-44f9-a088-718e42cd17ed tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:58.902761 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-98165b53-559b-44f9-a088-718e42cd17ed tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:58.933661 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-98165b53-559b-44f9-a088-718e42cd17ed tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052247 Jun 17 13:19:58.933968 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-bcc4d366-ef51-4e4e-9da0-d994d9651e8e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052340 Jun 17 13:19:58.934391 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 817/1664] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:19:58 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:19:58.934621 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 847/1664] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:19:58 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:19:59.948280 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-bedc7803-f374-45d0-b13e-2b6e035f2150 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:59.948999 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-e6e50c48-6e08-4e59-9c03-80cb61b2ed1e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:19:59.949381 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-bedc7803-f374-45d0-b13e-2b6e035f2150 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:59.949481 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-e6e50c48-6e08-4e59-9c03-80cb61b2ed1e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:19:59.956070 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e6e50c48-6e08-4e59-9c03-80cb61b2ed1e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:59.956258 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bedc7803-f374-45d0-b13e-2b6e035f2150 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:59.956508 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bedc7803-f374-45d0-b13e-2b6e035f2150 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:59.956687 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e6e50c48-6e08-4e59-9c03-80cb61b2ed1e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:59.957258 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e6e50c48-6e08-4e59-9c03-80cb61b2ed1e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:59.957425 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bedc7803-f374-45d0-b13e-2b6e035f2150 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:19:59.957684 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bedc7803-f374-45d0-b13e-2b6e035f2150 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:59.957831 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e6e50c48-6e08-4e59-9c03-80cb61b2ed1e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:19:59.988621 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-bedc7803-f374-45d0-b13e-2b6e035f2150 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045585 Jun 17 13:19:59.989172 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 818/1665] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:19:59 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:19:59.989320 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-e6e50c48-6e08-4e59-9c03-80cb61b2ed1e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046237 Jun 17 13:19:59.989726 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 848/1666] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:19:59 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:20:01.005472 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-807f3f24-788b-4334-be71-549ec36dd85d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:01.006585 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-bc3b214b-a464-43a0-aebc-52404f5b68b1 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:01.007199 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-bc3b214b-a464-43a0-aebc-52404f5b68b1 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:01.007385 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-807f3f24-788b-4334-be71-549ec36dd85d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:01.018642 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-807f3f24-788b-4334-be71-549ec36dd85d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:01.019380 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-807f3f24-788b-4334-be71-549ec36dd85d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:01.020622 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bc3b214b-a464-43a0-aebc-52404f5b68b1 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:01.020926 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-807f3f24-788b-4334-be71-549ec36dd85d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:01.021349 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-807f3f24-788b-4334-be71-549ec36dd85d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:01.021616 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bc3b214b-a464-43a0-aebc-52404f5b68b1 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:01.022872 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bc3b214b-a464-43a0-aebc-52404f5b68b1 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:01.023986 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bc3b214b-a464-43a0-aebc-52404f5b68b1 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:01.052599 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-807f3f24-788b-4334-be71-549ec36dd85d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054322 Jun 17 13:20:01.053172 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 849/1667] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:20:00 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:20:01.053603 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-bc3b214b-a464-43a0-aebc-52404f5b68b1 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055391 Jun 17 13:20:01.054264 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 819/1668] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:20:00 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:20:02.066720 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-f644346d-7fc0-40cb-a0c5-bff147314de0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:02.067716 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-843af2e2-77e2-476e-b215-30881e13d1b2 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:02.068492 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-f644346d-7fc0-40cb-a0c5-bff147314de0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:02.069193 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-843af2e2-77e2-476e-b215-30881e13d1b2 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:02.076113 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f644346d-7fc0-40cb-a0c5-bff147314de0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:02.076560 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f644346d-7fc0-40cb-a0c5-bff147314de0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:02.077008 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-843af2e2-77e2-476e-b215-30881e13d1b2 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:02.077293 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f644346d-7fc0-40cb-a0c5-bff147314de0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:02.077432 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-843af2e2-77e2-476e-b215-30881e13d1b2 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:02.077754 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f644346d-7fc0-40cb-a0c5-bff147314de0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:02.078232 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-843af2e2-77e2-476e-b215-30881e13d1b2 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:02.078661 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-843af2e2-77e2-476e-b215-30881e13d1b2 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:02.108599 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-f644346d-7fc0-40cb-a0c5-bff147314de0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047428 Jun 17 13:20:02.108844 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-843af2e2-77e2-476e-b215-30881e13d1b2 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045978 Jun 17 13:20:02.109087 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 850/1669] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:20:02 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:20:02.109258 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 820/1670] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:20:02 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:20:03.123330 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-f0f7aeca-8a7a-4ba5-b875-a811cb8c4fb5 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:03.124055 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-2f4828b6-49ff-48f6-b84f-e426c72f8350 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:03.124437 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-f0f7aeca-8a7a-4ba5-b875-a811cb8c4fb5 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:03.124557 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-2f4828b6-49ff-48f6-b84f-e426c72f8350 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:03.131329 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2f4828b6-49ff-48f6-b84f-e426c72f8350 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:03.131647 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f0f7aeca-8a7a-4ba5-b875-a811cb8c4fb5 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:03.131809 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2f4828b6-49ff-48f6-b84f-e426c72f8350 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:03.132095 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f0f7aeca-8a7a-4ba5-b875-a811cb8c4fb5 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:03.132724 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2f4828b6-49ff-48f6-b84f-e426c72f8350 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:03.132841 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f0f7aeca-8a7a-4ba5-b875-a811cb8c4fb5 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:03.133170 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2f4828b6-49ff-48f6-b84f-e426c72f8350 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:03.133303 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f0f7aeca-8a7a-4ba5-b875-a811cb8c4fb5 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:03.162994 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-f0f7aeca-8a7a-4ba5-b875-a811cb8c4fb5 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045347 Jun 17 13:20:03.163518 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 821/1671] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:20:03 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:20:03.163755 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-2f4828b6-49ff-48f6-b84f-e426c72f8350 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046281 Jun 17 13:20:03.165052 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 851/1672] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:20:03 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:20:04.176965 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-e4f99479-8331-4553-9210-04acd4c1a46d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:04.177838 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-35c6ea48-49c0-48ad-8699-30ab48e6dc1f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:04.178345 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-e4f99479-8331-4553-9210-04acd4c1a46d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:04.179174 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-35c6ea48-49c0-48ad-8699-30ab48e6dc1f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:04.185024 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e4f99479-8331-4553-9210-04acd4c1a46d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:04.185492 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e4f99479-8331-4553-9210-04acd4c1a46d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:04.186297 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e4f99479-8331-4553-9210-04acd4c1a46d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:04.186728 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e4f99479-8331-4553-9210-04acd4c1a46d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:04.187191 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-35c6ea48-49c0-48ad-8699-30ab48e6dc1f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:04.187752 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-35c6ea48-49c0-48ad-8699-30ab48e6dc1f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:04.188671 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-35c6ea48-49c0-48ad-8699-30ab48e6dc1f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:04.189334 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-35c6ea48-49c0-48ad-8699-30ab48e6dc1f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:04.217300 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-e4f99479-8331-4553-9210-04acd4c1a46d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044345 Jun 17 13:20:04.217849 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 822/1673] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:20:04 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:20:04.222220 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-35c6ea48-49c0-48ad-8699-30ab48e6dc1f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048177 Jun 17 13:20:04.222895 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 852/1674] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:20:04 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:20:05.231781 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-88712cd3-bbe5-488f-b729-d023574b3370 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:05.232978 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-88712cd3-bbe5-488f-b729-d023574b3370 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:05.237591 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-7d342caf-261c-4b8c-825d-d5eb7cc93c81 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:05.238586 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-7d342caf-261c-4b8c-825d-d5eb7cc93c81 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:05.240733 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-88712cd3-bbe5-488f-b729-d023574b3370 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:05.241197 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-88712cd3-bbe5-488f-b729-d023574b3370 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:05.241970 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-88712cd3-bbe5-488f-b729-d023574b3370 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:05.242435 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-88712cd3-bbe5-488f-b729-d023574b3370 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:05.245573 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7d342caf-261c-4b8c-825d-d5eb7cc93c81 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:05.246028 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7d342caf-261c-4b8c-825d-d5eb7cc93c81 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:05.246854 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7d342caf-261c-4b8c-825d-d5eb7cc93c81 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:05.247298 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7d342caf-261c-4b8c-825d-d5eb7cc93c81 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:05.275017 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-88712cd3-bbe5-488f-b729-d023574b3370 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048826 Jun 17 13:20:05.275769 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 823/1675] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:20:05 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:20:05.280110 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-7d342caf-261c-4b8c-825d-d5eb7cc93c81 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047935 Jun 17 13:20:05.280681 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 853/1676] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:20:05 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:20:06.288232 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-4128fed8-91b5-4c6f-8671-d84188899546 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:06.289221 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-4128fed8-91b5-4c6f-8671-d84188899546 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:06.291760 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_api:SELECT=58 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:20:06.293215 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-27a4d5ec-dc0b-4a1a-8adf-01af39ab651d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:06.294173 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-27a4d5ec-dc0b-4a1a-8adf-01af39ab651d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:06.297994 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4128fed8-91b5-4c6f-8671-d84188899546 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:06.298488 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4128fed8-91b5-4c6f-8671-d84188899546 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:06.299738 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4128fed8-91b5-4c6f-8671-d84188899546 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:06.300213 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4128fed8-91b5-4c6f-8671-d84188899546 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:06.302253 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-27a4d5ec-dc0b-4a1a-8adf-01af39ab651d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:06.302756 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-27a4d5ec-dc0b-4a1a-8adf-01af39ab651d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:06.303576 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-27a4d5ec-dc0b-4a1a-8adf-01af39ab651d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:06.304084 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-27a4d5ec-dc0b-4a1a-8adf-01af39ab651d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:06.318469 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=100 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:20:06.332178 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-4128fed8-91b5-4c6f-8671-d84188899546 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048736 Jun 17 13:20:06.332741 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 824/1677] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:20:06 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:20:06.335759 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-27a4d5ec-dc0b-4a1a-8adf-01af39ab651d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046825 Jun 17 13:20:06.336321 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 854/1678] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:20:06 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:20:07.345461 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-0f1fa38b-c25a-4360-8ee8-5fced026971f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:07.347010 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-0f1fa38b-c25a-4360-8ee8-5fced026971f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:07.348326 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-1d05f82f-fc85-4d15-aaba-622f74979f62 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:07.349374 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-1d05f82f-fc85-4d15-aaba-622f74979f62 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:07.354758 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0f1fa38b-c25a-4360-8ee8-5fced026971f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:07.355157 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0f1fa38b-c25a-4360-8ee8-5fced026971f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:07.355958 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0f1fa38b-c25a-4360-8ee8-5fced026971f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:07.356727 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0f1fa38b-c25a-4360-8ee8-5fced026971f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:07.358309 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-1d05f82f-fc85-4d15-aaba-622f74979f62 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:07.358763 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-1d05f82f-fc85-4d15-aaba-622f74979f62 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:07.359533 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-1d05f82f-fc85-4d15-aaba-622f74979f62 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:07.359970 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-1d05f82f-fc85-4d15-aaba-622f74979f62 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:07.382884 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_cell1:SELECT=100 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:20:07.390890 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-0f1fa38b-c25a-4360-8ee8-5fced026971f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049333 Jun 17 13:20:07.391478 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 825/1679] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:20:07 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:20:07.399697 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-1d05f82f-fc85-4d15-aaba-622f74979f62 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055449 Jun 17 13:20:07.400279 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 855/1680] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:20:07 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:20:08.407176 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-3bfdc71e-27a5-4fe5-953c-c2256d95a58d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:08.409538 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-3bfdc71e-27a5-4fe5-953c-c2256d95a58d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:08.414237 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-36a6d3fa-5d9d-46ae-a321-07216c4dc8e0 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:08.415187 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-36a6d3fa-5d9d-46ae-a321-07216c4dc8e0 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:08.416465 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3bfdc71e-27a5-4fe5-953c-c2256d95a58d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:08.416920 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3bfdc71e-27a5-4fe5-953c-c2256d95a58d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:08.417697 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3bfdc71e-27a5-4fe5-953c-c2256d95a58d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:08.418173 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3bfdc71e-27a5-4fe5-953c-c2256d95a58d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:08.421727 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-36a6d3fa-5d9d-46ae-a321-07216c4dc8e0 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:08.422313 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-36a6d3fa-5d9d-46ae-a321-07216c4dc8e0 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:08.423075 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-36a6d3fa-5d9d-46ae-a321-07216c4dc8e0 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:08.423518 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-36a6d3fa-5d9d-46ae-a321-07216c4dc8e0 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:08.448769 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-3bfdc71e-27a5-4fe5-953c-c2256d95a58d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048364 Jun 17 13:20:08.449291 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 826/1681] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:20:08 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:20:08.453935 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-36a6d3fa-5d9d-46ae-a321-07216c4dc8e0 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043963 Jun 17 13:20:08.454555 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 856/1682] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:20:08 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:20:09.463822 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-12dd8afd-1434-44bd-8810-5ad7d2d3597b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:09.464757 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-12dd8afd-1434-44bd-8810-5ad7d2d3597b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:09.466312 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-e8f1cd1f-fdc0-47fd-83a6-781d8ef25ceb tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:09.467320 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-e8f1cd1f-fdc0-47fd-83a6-781d8ef25ceb tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:09.471715 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-12dd8afd-1434-44bd-8810-5ad7d2d3597b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:09.472086 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-12dd8afd-1434-44bd-8810-5ad7d2d3597b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:09.472985 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-12dd8afd-1434-44bd-8810-5ad7d2d3597b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:09.473297 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-12dd8afd-1434-44bd-8810-5ad7d2d3597b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:09.474213 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e8f1cd1f-fdc0-47fd-83a6-781d8ef25ceb tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:09.474702 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e8f1cd1f-fdc0-47fd-83a6-781d8ef25ceb tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:09.475620 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e8f1cd1f-fdc0-47fd-83a6-781d8ef25ceb tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:09.476019 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e8f1cd1f-fdc0-47fd-83a6-781d8ef25ceb tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:09.505266 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-12dd8afd-1434-44bd-8810-5ad7d2d3597b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046949 Jun 17 13:20:09.505838 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 827/1683] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:20:09 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:20:09.506329 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-e8f1cd1f-fdc0-47fd-83a6-781d8ef25ceb tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044654 Jun 17 13:20:09.506993 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 857/1684] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:20:09 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 13:20:10.518826 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-a416f8fa-1ec3-48ef-98df-59c84473ee8e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:10.519633 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-9889d316-a529-4dd7-9035-54b5e5ed5a80 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:10.520151 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-a416f8fa-1ec3-48ef-98df-59c84473ee8e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:10.520776 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-9889d316-a529-4dd7-9035-54b5e5ed5a80 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:10.527424 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a416f8fa-1ec3-48ef-98df-59c84473ee8e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:10.527861 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a416f8fa-1ec3-48ef-98df-59c84473ee8e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:10.528739 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a416f8fa-1ec3-48ef-98df-59c84473ee8e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:10.528903 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9889d316-a529-4dd7-9035-54b5e5ed5a80 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:10.529213 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a416f8fa-1ec3-48ef-98df-59c84473ee8e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:10.529391 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9889d316-a529-4dd7-9035-54b5e5ed5a80 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:10.530125 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9889d316-a529-4dd7-9035-54b5e5ed5a80 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:10.530621 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9889d316-a529-4dd7-9035-54b5e5ed5a80 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:10.559821 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-a416f8fa-1ec3-48ef-98df-59c84473ee8e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045491 Jun 17 13:20:10.560383 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 828/1685] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:20:10 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:20:10.561623 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-9889d316-a529-4dd7-9035-54b5e5ed5a80 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046566 Jun 17 13:20:10.562223 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 858/1686] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:20:10 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:20:11.577245 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-049b3b66-2fcb-4d1e-9b33-f9f667f518dc tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:11.578366 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-d6b40ace-24e5-4f2d-90f2-fb607c801758 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:11.578366 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-d6b40ace-24e5-4f2d-90f2-fb607c801758 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:11.578838 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-049b3b66-2fcb-4d1e-9b33-f9f667f518dc tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:11.585358 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d6b40ace-24e5-4f2d-90f2-fb607c801758 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:11.585808 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d6b40ace-24e5-4f2d-90f2-fb607c801758 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:11.585982 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-049b3b66-2fcb-4d1e-9b33-f9f667f518dc tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:11.586420 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-049b3b66-2fcb-4d1e-9b33-f9f667f518dc tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:11.586585 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d6b40ace-24e5-4f2d-90f2-fb607c801758 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:11.587081 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d6b40ace-24e5-4f2d-90f2-fb607c801758 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:11.587247 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-049b3b66-2fcb-4d1e-9b33-f9f667f518dc tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:11.587628 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-049b3b66-2fcb-4d1e-9b33-f9f667f518dc tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:11.618956 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-d6b40ace-24e5-4f2d-90f2-fb607c801758 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048503 Jun 17 13:20:11.619194 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-049b3b66-2fcb-4d1e-9b33-f9f667f518dc tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049720 Jun 17 13:20:11.619728 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 859/1687] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:20:11 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:20:11.619858 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 829/1688] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:20:11 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:20:12.631325 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-6241d619-de59-4742-a80c-7913e77e3ba7 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:12.631950 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-183aadc8-ee8e-46c7-9036-80a78f49017f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:12.632344 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-6241d619-de59-4742-a80c-7913e77e3ba7 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:12.632504 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-183aadc8-ee8e-46c7-9036-80a78f49017f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:12.639351 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6241d619-de59-4742-a80c-7913e77e3ba7 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:12.639805 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6241d619-de59-4742-a80c-7913e77e3ba7 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:12.639981 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-183aadc8-ee8e-46c7-9036-80a78f49017f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:12.640304 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-183aadc8-ee8e-46c7-9036-80a78f49017f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:12.640903 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6241d619-de59-4742-a80c-7913e77e3ba7 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:12.641033 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6241d619-de59-4742-a80c-7913e77e3ba7 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:12.641134 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-183aadc8-ee8e-46c7-9036-80a78f49017f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:12.641715 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-183aadc8-ee8e-46c7-9036-80a78f49017f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:12.672638 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-183aadc8-ee8e-46c7-9036-80a78f49017f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045109 Jun 17 13:20:12.673138 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-6241d619-de59-4742-a80c-7913e77e3ba7 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045896 Jun 17 13:20:12.673295 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 830/1689] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:20:12 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:20:12.673826 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 860/1690] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:20:12 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:20:13.684971 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-94611a26-88ed-4096-93c4-2f8d523e29f4 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:13.685647 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-7f89bda0-1367-4695-8899-98067e2f5d1d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:20:13.686020 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-94611a26-88ed-4096-93c4-2f8d523e29f4 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:13.686166 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-7f89bda0-1367-4695-8899-98067e2f5d1d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:13.688839 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_api:SELECT=58 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:20:13.692778 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7f89bda0-1367-4695-8899-98067e2f5d1d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:13.693212 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7f89bda0-1367-4695-8899-98067e2f5d1d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:13.693966 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7f89bda0-1367-4695-8899-98067e2f5d1d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:13.694424 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7f89bda0-1367-4695-8899-98067e2f5d1d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:13.695035 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-94611a26-88ed-4096-93c4-2f8d523e29f4 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:13.695542 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-94611a26-88ed-4096-93c4-2f8d523e29f4 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:13.696406 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-94611a26-88ed-4096-93c4-2f8d523e29f4 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:13.696880 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-94611a26-88ed-4096-93c4-2f8d523e29f4 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:13.731794 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-94611a26-88ed-4096-93c4-2f8d523e29f4 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050442 Jun 17 13:20:13.732399 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 861/1691] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:20:13 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:20:13.792963 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-7f89bda0-1367-4695-8899-98067e2f5d1d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "POST /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/action" status: 200 len: 37897 microversion: 2.20 time: 0.111478 Jun 17 13:20:13.793797 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 831/1692] 10.222.0.48 () {62 vars in 1318 bytes} [Fri Jun 17 13:20:13 2022] POST /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6/action => generated 37897 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jun 17 13:20:13.914397 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-c831c33b-bcb2-4c50-bb2a-d6e48808b628 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:13.914907 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-c831c33b-bcb2-4c50-bb2a-d6e48808b628 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:13.921307 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c831c33b-bcb2-4c50-bb2a-d6e48808b628 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:13.921756 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c831c33b-bcb2-4c50-bb2a-d6e48808b628 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:13.922628 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c831c33b-bcb2-4c50-bb2a-d6e48808b628 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:13.923057 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c831c33b-bcb2-4c50-bb2a-d6e48808b628 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:13.952502 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-c831c33b-bcb2-4c50-bb2a-d6e48808b628 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Going to try to terminate instance {{(pid=117659) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 17 13:20:14.032820 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-c831c33b-bcb2-4c50-bb2a-d6e48808b628 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "DELETE /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 204 len: 0 microversion: 2.1 time: 0.122074 Jun 17 13:20:14.033614 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 862/1693] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Jun 17 13:20:13 2022] DELETE /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 17 13:20:14.043245 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-56944919-8b46-4b23-b1ba-e60db5ea82be tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:14.043961 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-56944919-8b46-4b23-b1ba-e60db5ea82be tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:14.051484 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-56944919-8b46-4b23-b1ba-e60db5ea82be tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:14.051932 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-56944919-8b46-4b23-b1ba-e60db5ea82be tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:14.052693 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-56944919-8b46-4b23-b1ba-e60db5ea82be tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:14.053127 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-56944919-8b46-4b23-b1ba-e60db5ea82be tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:14.232333 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-56944919-8b46-4b23-b1ba-e60db5ea82be tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:14.241591 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-56944919-8b46-4b23-b1ba-e60db5ea82be tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.202541 Jun 17 13:20:14.242183 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 832/1694] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:20:14 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:20:14.411936 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-47907ba7-9cdf-479f-acdf-f72cbb3c8fb6 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:14.412506 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-47907ba7-9cdf-479f-acdf-f72cbb3c8fb6 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:14.418956 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-47907ba7-9cdf-479f-acdf-f72cbb3c8fb6 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:14.419402 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-47907ba7-9cdf-479f-acdf-f72cbb3c8fb6 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:14.420158 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-47907ba7-9cdf-479f-acdf-f72cbb3c8fb6 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:14.420590 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-47907ba7-9cdf-479f-acdf-f72cbb3c8fb6 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:14.446507 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-47907ba7-9cdf-479f-acdf-f72cbb3c8fb6 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Going to try to terminate instance {{(pid=117659) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 17 13:20:14.529593 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-47907ba7-9cdf-479f-acdf-f72cbb3c8fb6 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "DELETE /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 204 len: 0 microversion: 2.1 time: 0.121831 Jun 17 13:20:14.530199 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 863/1695] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Jun 17 13:20:14 2022] DELETE /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 17 13:20:14.541322 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-049451f6-dc4b-40a7-b5fc-27d260ca5eb8 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:14.542293 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-049451f6-dc4b-40a7-b5fc-27d260ca5eb8 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:14.551400 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-049451f6-dc4b-40a7-b5fc-27d260ca5eb8 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:14.551849 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-049451f6-dc4b-40a7-b5fc-27d260ca5eb8 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:14.552648 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-049451f6-dc4b-40a7-b5fc-27d260ca5eb8 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:14.553112 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-049451f6-dc4b-40a7-b5fc-27d260ca5eb8 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:14.692121 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-049451f6-dc4b-40a7-b5fc-27d260ca5eb8 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:14.700538 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-049451f6-dc4b-40a7-b5fc-27d260ca5eb8 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.165461 Jun 17 13:20:14.701104 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 833/1696] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:20:14 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:20:14.744377 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-c26c17ce-a976-4e33-abe2-2378d760c920 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:14.745388 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-c26c17ce-a976-4e33-abe2-2378d760c920 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:14.752807 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c26c17ce-a976-4e33-abe2-2378d760c920 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:14.753247 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c26c17ce-a976-4e33-abe2-2378d760c920 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:14.754003 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c26c17ce-a976-4e33-abe2-2378d760c920 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:14.754467 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c26c17ce-a976-4e33-abe2-2378d760c920 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:14.784379 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-c26c17ce-a976-4e33-abe2-2378d760c920 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044325 Jun 17 13:20:14.784927 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 864/1697] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:20:14 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:20:15.262837 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-8f4210de-a1a2-4dce-b565-4ecfa9f7a888 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:15.263576 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-8f4210de-a1a2-4dce-b565-4ecfa9f7a888 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:15.272081 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8f4210de-a1a2-4dce-b565-4ecfa9f7a888 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:15.272537 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8f4210de-a1a2-4dce-b565-4ecfa9f7a888 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:15.273386 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8f4210de-a1a2-4dce-b565-4ecfa9f7a888 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:15.273895 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8f4210de-a1a2-4dce-b565-4ecfa9f7a888 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:15.409999 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-8f4210de-a1a2-4dce-b565-4ecfa9f7a888 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:15.418358 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-8f4210de-a1a2-4dce-b565-4ecfa9f7a888 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.161340 Jun 17 13:20:15.418942 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 834/1698] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:20:15 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:20:15.723239 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-d106e754-7d57-43ae-86ab-ee588b035e40 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:15.723851 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-d106e754-7d57-43ae-86ab-ee588b035e40 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:15.730417 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d106e754-7d57-43ae-86ab-ee588b035e40 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:15.730869 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d106e754-7d57-43ae-86ab-ee588b035e40 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:15.731981 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d106e754-7d57-43ae-86ab-ee588b035e40 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:15.732416 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d106e754-7d57-43ae-86ab-ee588b035e40 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:15.796492 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-f7f443b4-49ae-4af2-931a-f10ed27011b7 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:20:15.797486 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-f7f443b4-49ae-4af2-931a-f10ed27011b7 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:15.804661 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f7f443b4-49ae-4af2-931a-f10ed27011b7 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:15.805129 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f7f443b4-49ae-4af2-931a-f10ed27011b7 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:15.805883 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f7f443b4-49ae-4af2-931a-f10ed27011b7 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:15.806345 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f7f443b4-49ae-4af2-931a-f10ed27011b7 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:15.912443 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-f7f443b4-49ae-4af2-931a-f10ed27011b7 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "POST /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/action" status: 200 len: 115180 microversion: 2.1 time: 0.119748 Jun 17 13:20:15.913265 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 835/1699] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Jun 17 13:20:15 2022] POST /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2/action => generated 115180 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:20:15.930139 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-d106e754-7d57-43ae-86ab-ee588b035e40 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:15.938559 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-d106e754-7d57-43ae-86ab-ee588b035e40 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.219314 Jun 17 13:20:15.939138 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 865/1700] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:20:15 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:20:16.293171 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-c91e5ee8-5ece-4e1c-b0ef-e8747415b50e tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] Calling method '.version_select at 0x7f0183e5b430>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:16.319740 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-c91e5ee8-5ece-4e1c-b0ef-e8747415b50e tempest-TestVolumeBootPattern-1633287944 tempest-TestVolumeBootPattern-1633287944-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-892142400" status: 202 len: 0 microversion: 2.1 time: 0.030900 Jun 17 13:20:16.320317 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 836/1701] 10.222.0.48 () {58 vars in 1259 bytes} [Fri Jun 17 13:20:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-892142400 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 13:20:16.435545 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-c88314e7-9762-43df-99a7-612eb02af776 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:16.436164 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-c88314e7-9762-43df-99a7-612eb02af776 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:16.442562 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c88314e7-9762-43df-99a7-612eb02af776 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:16.443011 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c88314e7-9762-43df-99a7-612eb02af776 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:16.443768 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c88314e7-9762-43df-99a7-612eb02af776 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:16.444210 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c88314e7-9762-43df-99a7-612eb02af776 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:16.583640 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-c88314e7-9762-43df-99a7-612eb02af776 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:16.592180 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-c88314e7-9762-43df-99a7-612eb02af776 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.160480 Jun 17 13:20:16.592917 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 866/1702] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:20:16 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:20:16.957508 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-4400298c-186a-4c17-b2ec-0cf23e22cde6 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:16.958392 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-4400298c-186a-4c17-b2ec-0cf23e22cde6 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:16.965430 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4400298c-186a-4c17-b2ec-0cf23e22cde6 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:16.965868 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4400298c-186a-4c17-b2ec-0cf23e22cde6 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:16.966676 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4400298c-186a-4c17-b2ec-0cf23e22cde6 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:16.967103 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4400298c-186a-4c17-b2ec-0cf23e22cde6 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:17.229584 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-4400298c-186a-4c17-b2ec-0cf23e22cde6 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:17.238636 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-4400298c-186a-4c17-b2ec-0cf23e22cde6 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.285459 Jun 17 13:20:17.239215 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 837/1703] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:20:16 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:20:17.609187 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-ed9c0246-3e17-4e97-8ad5-7d2966e91005 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:17.609913 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-ed9c0246-3e17-4e97-8ad5-7d2966e91005 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:17.616781 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ed9c0246-3e17-4e97-8ad5-7d2966e91005 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:17.617291 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ed9c0246-3e17-4e97-8ad5-7d2966e91005 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:17.618124 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ed9c0246-3e17-4e97-8ad5-7d2966e91005 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:17.618622 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ed9c0246-3e17-4e97-8ad5-7d2966e91005 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:17.824166 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-ed9c0246-3e17-4e97-8ad5-7d2966e91005 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:17.832722 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-ed9c0246-3e17-4e97-8ad5-7d2966e91005 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.227750 Jun 17 13:20:17.833289 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 867/1704] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:20:17 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:20:18.256105 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-87d7bbb5-20ae-4e03-a4f3-7f2608ad59a7 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:18.256694 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-87d7bbb5-20ae-4e03-a4f3-7f2608ad59a7 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:18.263589 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-87d7bbb5-20ae-4e03-a4f3-7f2608ad59a7 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:18.264028 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-87d7bbb5-20ae-4e03-a4f3-7f2608ad59a7 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:18.264783 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-87d7bbb5-20ae-4e03-a4f3-7f2608ad59a7 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:18.265209 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-87d7bbb5-20ae-4e03-a4f3-7f2608ad59a7 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:18.485048 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-87d7bbb5-20ae-4e03-a4f3-7f2608ad59a7 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:18.493635 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-87d7bbb5-20ae-4e03-a4f3-7f2608ad59a7 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.241590 Jun 17 13:20:18.494323 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 838/1705] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:20:18 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:20:18.855439 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-dccdd377-b62e-49cc-a4d9-51d46d618108 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:18.856597 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-dccdd377-b62e-49cc-a4d9-51d46d618108 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:18.863874 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-dccdd377-b62e-49cc-a4d9-51d46d618108 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:18.864278 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-dccdd377-b62e-49cc-a4d9-51d46d618108 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:18.865034 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-dccdd377-b62e-49cc-a4d9-51d46d618108 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:18.865440 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-dccdd377-b62e-49cc-a4d9-51d46d618108 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:19.083058 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-dccdd377-b62e-49cc-a4d9-51d46d618108 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:19.086726 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:20:19.093351 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-dccdd377-b62e-49cc-a4d9-51d46d618108 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.241837 Jun 17 13:20:19.093900 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 868/1706] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:20:18 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:20:19.511882 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-8b746db6-20ea-49a5-a495-cc69b013db44 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:19.513105 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-8b746db6-20ea-49a5-a495-cc69b013db44 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:19.519962 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8b746db6-20ea-49a5-a495-cc69b013db44 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:19.520412 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8b746db6-20ea-49a5-a495-cc69b013db44 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:19.521198 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8b746db6-20ea-49a5-a495-cc69b013db44 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:19.521821 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8b746db6-20ea-49a5-a495-cc69b013db44 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:19.824815 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-8b746db6-20ea-49a5-a495-cc69b013db44 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:19.834110 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-8b746db6-20ea-49a5-a495-cc69b013db44 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.326720 Jun 17 13:20:19.834690 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 839/1707] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:20:19 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:20:20.111908 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-b98f34fe-6b53-4925-a288-ee3c3356ac2a tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:20.112832 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-b98f34fe-6b53-4925-a288-ee3c3356ac2a tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:20.124136 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b98f34fe-6b53-4925-a288-ee3c3356ac2a tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:20.125116 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b98f34fe-6b53-4925-a288-ee3c3356ac2a tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:20.126794 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b98f34fe-6b53-4925-a288-ee3c3356ac2a tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:20.127456 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b98f34fe-6b53-4925-a288-ee3c3356ac2a tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:20.374169 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-b98f34fe-6b53-4925-a288-ee3c3356ac2a tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:20.383604 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-b98f34fe-6b53-4925-a288-ee3c3356ac2a tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.276010 Jun 17 13:20:20.384765 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 869/1708] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:20:20 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:20:20.851367 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-3708190e-c997-46e5-85d0-bff4435d35ec tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:20.852203 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-3708190e-c997-46e5-85d0-bff4435d35ec tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:20.859863 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3708190e-c997-46e5-85d0-bff4435d35ec tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:20.860508 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3708190e-c997-46e5-85d0-bff4435d35ec tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:20.861287 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3708190e-c997-46e5-85d0-bff4435d35ec tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:20.861718 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3708190e-c997-46e5-85d0-bff4435d35ec tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:21.003358 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-3708190e-c997-46e5-85d0-bff4435d35ec tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:21.011560 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-3708190e-c997-46e5-85d0-bff4435d35ec tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.164062 Jun 17 13:20:21.012223 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 840/1709] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:20:20 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:20:21.402529 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-768dd7e7-b773-489e-85d5-494bb4fbf94d tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:21.403734 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-768dd7e7-b773-489e-85d5-494bb4fbf94d tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:21.410172 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-768dd7e7-b773-489e-85d5-494bb4fbf94d tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:21.410612 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-768dd7e7-b773-489e-85d5-494bb4fbf94d tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:21.411365 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-768dd7e7-b773-489e-85d5-494bb4fbf94d tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:21.411836 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-768dd7e7-b773-489e-85d5-494bb4fbf94d tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:21.638821 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-768dd7e7-b773-489e-85d5-494bb4fbf94d tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:21.650064 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-768dd7e7-b773-489e-85d5-494bb4fbf94d tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.251501 Jun 17 13:20:21.661847 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 870/1710] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:20:21 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:20:22.029378 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-52263dd2-b16d-4200-b584-8ba5240c40f9 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:22.029963 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-52263dd2-b16d-4200-b584-8ba5240c40f9 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:22.037022 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-52263dd2-b16d-4200-b584-8ba5240c40f9 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:22.037459 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-52263dd2-b16d-4200-b584-8ba5240c40f9 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:22.038482 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-52263dd2-b16d-4200-b584-8ba5240c40f9 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:22.039079 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-52263dd2-b16d-4200-b584-8ba5240c40f9 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:22.188797 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-52263dd2-b16d-4200-b584-8ba5240c40f9 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:22.198334 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-52263dd2-b16d-4200-b584-8ba5240c40f9 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.173074 Jun 17 13:20:22.199004 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 841/1711] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:20:22 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:20:22.669230 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-1f4caad7-27ae-46ed-aaeb-107adb4ec23a tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:22.670155 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-1f4caad7-27ae-46ed-aaeb-107adb4ec23a tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:22.682802 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-1f4caad7-27ae-46ed-aaeb-107adb4ec23a tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:22.683676 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-1f4caad7-27ae-46ed-aaeb-107adb4ec23a tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:22.685460 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-1f4caad7-27ae-46ed-aaeb-107adb4ec23a tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:22.686181 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-1f4caad7-27ae-46ed-aaeb-107adb4ec23a tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:22.852783 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-1f4caad7-27ae-46ed-aaeb-107adb4ec23a tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:22.861715 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-1f4caad7-27ae-46ed-aaeb-107adb4ec23a tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.196998 Jun 17 13:20:22.862473 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 871/1712] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:20:22 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:20:23.215238 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-52bfbf1a-05d2-4e28-9fb5-f7965823b754 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:23.215806 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-52bfbf1a-05d2-4e28-9fb5-f7965823b754 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:23.222248 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-52bfbf1a-05d2-4e28-9fb5-f7965823b754 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:23.222898 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-52bfbf1a-05d2-4e28-9fb5-f7965823b754 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:23.224032 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-52bfbf1a-05d2-4e28-9fb5-f7965823b754 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:23.224606 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-52bfbf1a-05d2-4e28-9fb5-f7965823b754 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:23.438225 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-52bfbf1a-05d2-4e28-9fb5-f7965823b754 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:23.443368 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=100 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:20:23.448685 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-52bfbf1a-05d2-4e28-9fb5-f7965823b754 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.237380 Jun 17 13:20:23.449227 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 842/1713] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:20:23 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:20:23.879536 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-d2e97c82-46ea-44a9-86b6-d5ca4fca55f0 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:23.880148 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-d2e97c82-46ea-44a9-86b6-d5ca4fca55f0 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:23.888649 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d2e97c82-46ea-44a9-86b6-d5ca4fca55f0 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:23.889202 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d2e97c82-46ea-44a9-86b6-d5ca4fca55f0 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:23.889948 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d2e97c82-46ea-44a9-86b6-d5ca4fca55f0 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:23.890404 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d2e97c82-46ea-44a9-86b6-d5ca4fca55f0 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:24.034550 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-d2e97c82-46ea-44a9-86b6-d5ca4fca55f0 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:24.042693 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-d2e97c82-46ea-44a9-86b6-d5ca4fca55f0 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.167390 Jun 17 13:20:24.043397 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 872/1714] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:20:23 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:20:24.466652 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-391f3def-24d9-453a-b49c-5a4792164cc2 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:24.467373 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-391f3def-24d9-453a-b49c-5a4792164cc2 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:24.476369 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-391f3def-24d9-453a-b49c-5a4792164cc2 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:24.477544 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-391f3def-24d9-453a-b49c-5a4792164cc2 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:24.487878 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-391f3def-24d9-453a-b49c-5a4792164cc2 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:24.488316 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-391f3def-24d9-453a-b49c-5a4792164cc2 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:24.626947 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-391f3def-24d9-453a-b49c-5a4792164cc2 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:24.635052 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-391f3def-24d9-453a-b49c-5a4792164cc2 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.172719 Jun 17 13:20:24.635615 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 843/1715] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:20:24 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:20:25.061058 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-8cb51f25-6f1f-4b6e-a4e0-6314305898f9 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:25.061659 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-8cb51f25-6f1f-4b6e-a4e0-6314305898f9 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:25.069219 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8cb51f25-6f1f-4b6e-a4e0-6314305898f9 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:25.069781 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8cb51f25-6f1f-4b6e-a4e0-6314305898f9 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:25.070745 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8cb51f25-6f1f-4b6e-a4e0-6314305898f9 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:25.071304 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8cb51f25-6f1f-4b6e-a4e0-6314305898f9 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:25.214324 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-8cb51f25-6f1f-4b6e-a4e0-6314305898f9 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:25.223228 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-8cb51f25-6f1f-4b6e-a4e0-6314305898f9 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.166120 Jun 17 13:20:25.223854 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 873/1716] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:20:25 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:20:25.658550 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-cca8d4de-b1c2-41f2-a67e-6843e60a8083 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:25.659584 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-cca8d4de-b1c2-41f2-a67e-6843e60a8083 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:25.669113 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cca8d4de-b1c2-41f2-a67e-6843e60a8083 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:25.669750 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cca8d4de-b1c2-41f2-a67e-6843e60a8083 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:25.670844 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cca8d4de-b1c2-41f2-a67e-6843e60a8083 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:25.671501 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cca8d4de-b1c2-41f2-a67e-6843e60a8083 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:25.807540 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-cca8d4de-b1c2-41f2-a67e-6843e60a8083 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:25.816255 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-cca8d4de-b1c2-41f2-a67e-6843e60a8083 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.163434 Jun 17 13:20:25.821695 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 844/1717] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:20:25 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:20:26.241801 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-8f5967ff-e574-4d54-bb20-4eb46250c7bd tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:26.242443 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-8f5967ff-e574-4d54-bb20-4eb46250c7bd tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:26.249664 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8f5967ff-e574-4d54-bb20-4eb46250c7bd tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:26.250116 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8f5967ff-e574-4d54-bb20-4eb46250c7bd tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:26.250918 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8f5967ff-e574-4d54-bb20-4eb46250c7bd tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:26.251349 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8f5967ff-e574-4d54-bb20-4eb46250c7bd tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:26.392465 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-8f5967ff-e574-4d54-bb20-4eb46250c7bd tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:26.401365 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-8f5967ff-e574-4d54-bb20-4eb46250c7bd tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.163610 Jun 17 13:20:26.401964 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 874/1718] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:20:26 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:20:26.837531 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-190c4922-8f4f-48a5-b87f-212190d48d35 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:26.838341 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-190c4922-8f4f-48a5-b87f-212190d48d35 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:26.848091 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-190c4922-8f4f-48a5-b87f-212190d48d35 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:26.848534 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-190c4922-8f4f-48a5-b87f-212190d48d35 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:26.849298 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-190c4922-8f4f-48a5-b87f-212190d48d35 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:26.849725 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-190c4922-8f4f-48a5-b87f-212190d48d35 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:26.983024 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-190c4922-8f4f-48a5-b87f-212190d48d35 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:26.992799 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-190c4922-8f4f-48a5-b87f-212190d48d35 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.162488 Jun 17 13:20:26.993333 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 845/1719] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:20:26 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:20:27.420597 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-a9ae551b-3aba-4392-9469-038016cfcbd1 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:27.421313 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-a9ae551b-3aba-4392-9469-038016cfcbd1 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:27.429674 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a9ae551b-3aba-4392-9469-038016cfcbd1 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:27.430245 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a9ae551b-3aba-4392-9469-038016cfcbd1 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:27.431138 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a9ae551b-3aba-4392-9469-038016cfcbd1 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:27.431649 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a9ae551b-3aba-4392-9469-038016cfcbd1 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:27.571034 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-a9ae551b-3aba-4392-9469-038016cfcbd1 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:27.582934 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-a9ae551b-3aba-4392-9469-038016cfcbd1 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.166564 Jun 17 13:20:27.583692 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 875/1720] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:20:27 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:20:28.014363 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-b2b53c8d-68da-4b23-9f5b-3ced28bfa3aa tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:28.015370 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-b2b53c8d-68da-4b23-9f5b-3ced28bfa3aa tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:28.023428 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b2b53c8d-68da-4b23-9f5b-3ced28bfa3aa tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:28.023874 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b2b53c8d-68da-4b23-9f5b-3ced28bfa3aa tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:28.024640 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b2b53c8d-68da-4b23-9f5b-3ced28bfa3aa tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:28.025073 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b2b53c8d-68da-4b23-9f5b-3ced28bfa3aa tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:28.162370 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-b2b53c8d-68da-4b23-9f5b-3ced28bfa3aa tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:28.170498 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-b2b53c8d-68da-4b23-9f5b-3ced28bfa3aa tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.162984 Jun 17 13:20:28.171061 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 846/1721] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:20:28 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:20:28.609428 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-71ce0e00-6521-48d9-b884-56e1d30230ac tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:28.610327 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-71ce0e00-6521-48d9-b884-56e1d30230ac tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:28.617941 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-71ce0e00-6521-48d9-b884-56e1d30230ac tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:28.618428 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-71ce0e00-6521-48d9-b884-56e1d30230ac tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:28.619227 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-71ce0e00-6521-48d9-b884-56e1d30230ac tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:28.619659 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-71ce0e00-6521-48d9-b884-56e1d30230ac tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:28.758075 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-71ce0e00-6521-48d9-b884-56e1d30230ac tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:28.765847 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-71ce0e00-6521-48d9-b884-56e1d30230ac tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.163605 Jun 17 13:20:28.766457 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 876/1722] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:20:28 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:20:29.191723 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-24dd3a5e-c375-4ac7-acba-744352badcc5 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:29.192326 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-24dd3a5e-c375-4ac7-acba-744352badcc5 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:29.199531 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-24dd3a5e-c375-4ac7-acba-744352badcc5 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:29.200003 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-24dd3a5e-c375-4ac7-acba-744352badcc5 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:29.200810 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-24dd3a5e-c375-4ac7-acba-744352badcc5 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:29.201263 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-24dd3a5e-c375-4ac7-acba-744352badcc5 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:29.336738 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-24dd3a5e-c375-4ac7-acba-744352badcc5 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:29.344895 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-24dd3a5e-c375-4ac7-acba-744352badcc5 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.159944 Jun 17 13:20:29.345473 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 847/1723] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:20:29 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:20:29.783648 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-947fc096-b63d-441e-81e6-ad8a5e8c8167 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:29.784567 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-947fc096-b63d-441e-81e6-ad8a5e8c8167 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:29.792023 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-947fc096-b63d-441e-81e6-ad8a5e8c8167 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:29.792532 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-947fc096-b63d-441e-81e6-ad8a5e8c8167 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:29.793478 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-947fc096-b63d-441e-81e6-ad8a5e8c8167 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:29.794042 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-947fc096-b63d-441e-81e6-ad8a5e8c8167 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:29.941461 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-947fc096-b63d-441e-81e6-ad8a5e8c8167 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:29.949551 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-947fc096-b63d-441e-81e6-ad8a5e8c8167 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.169777 Jun 17 13:20:29.950136 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 877/1724] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:20:29 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:20:30.365856 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-b87f1b17-25fc-4950-a565-65f4d58d220f tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:30.366911 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-b87f1b17-25fc-4950-a565-65f4d58d220f tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:30.377960 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b87f1b17-25fc-4950-a565-65f4d58d220f tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:30.378444 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b87f1b17-25fc-4950-a565-65f4d58d220f tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:30.379216 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b87f1b17-25fc-4950-a565-65f4d58d220f tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:30.379648 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b87f1b17-25fc-4950-a565-65f4d58d220f tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:30.516103 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-b87f1b17-25fc-4950-a565-65f4d58d220f tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:30.529958 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-b87f1b17-25fc-4950-a565-65f4d58d220f tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.170457 Jun 17 13:20:30.530947 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 848/1725] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:20:30 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:20:30.970345 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-608b0e18-9d2a-46cc-aec4-ef62bfc03a46 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:30.971974 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-608b0e18-9d2a-46cc-aec4-ef62bfc03a46 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:30.983068 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-608b0e18-9d2a-46cc-aec4-ef62bfc03a46 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:30.983809 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-608b0e18-9d2a-46cc-aec4-ef62bfc03a46 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:30.985059 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-608b0e18-9d2a-46cc-aec4-ef62bfc03a46 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:30.985771 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-608b0e18-9d2a-46cc-aec4-ef62bfc03a46 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:31.121810 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-608b0e18-9d2a-46cc-aec4-ef62bfc03a46 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:31.132488 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-608b0e18-9d2a-46cc-aec4-ef62bfc03a46 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.168610 Jun 17 13:20:31.133071 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 878/1726] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:20:30 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:20:31.552951 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-d3fbd2a0-fdbf-4483-acbc-53bd6701ef0c tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:31.553966 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-d3fbd2a0-fdbf-4483-acbc-53bd6701ef0c tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:31.564905 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d3fbd2a0-fdbf-4483-acbc-53bd6701ef0c tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:31.565977 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d3fbd2a0-fdbf-4483-acbc-53bd6701ef0c tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:31.567440 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d3fbd2a0-fdbf-4483-acbc-53bd6701ef0c tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:31.568514 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d3fbd2a0-fdbf-4483-acbc-53bd6701ef0c tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:31.722954 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-d3fbd2a0-fdbf-4483-acbc-53bd6701ef0c tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:31.731754 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-d3fbd2a0-fdbf-4483-acbc-53bd6701ef0c tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.185562 Jun 17 13:20:31.732334 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 849/1727] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:20:31 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:20:32.152942 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-ce5682b6-e1e6-4653-b05c-577e7044c600 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:32.153912 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-ce5682b6-e1e6-4653-b05c-577e7044c600 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:32.163007 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ce5682b6-e1e6-4653-b05c-577e7044c600 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:32.163442 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ce5682b6-e1e6-4653-b05c-577e7044c600 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:32.164217 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ce5682b6-e1e6-4653-b05c-577e7044c600 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:32.164636 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ce5682b6-e1e6-4653-b05c-577e7044c600 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:32.301351 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-ce5682b6-e1e6-4653-b05c-577e7044c600 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:32.309989 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-ce5682b6-e1e6-4653-b05c-577e7044c600 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.163393 Jun 17 13:20:32.310593 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 879/1728] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:20:32 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:20:32.753444 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-b5a7bcbe-045d-4145-b306-e475cc5808d3 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:32.754001 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-b5a7bcbe-045d-4145-b306-e475cc5808d3 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:32.760912 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b5a7bcbe-045d-4145-b306-e475cc5808d3 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:32.761356 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b5a7bcbe-045d-4145-b306-e475cc5808d3 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:32.762116 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b5a7bcbe-045d-4145-b306-e475cc5808d3 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:32.762581 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b5a7bcbe-045d-4145-b306-e475cc5808d3 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:32.897536 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-b5a7bcbe-045d-4145-b306-e475cc5808d3 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:32.909222 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-b5a7bcbe-045d-4145-b306-e475cc5808d3 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.162029 Jun 17 13:20:32.909754 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 850/1729] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:20:32 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:20:33.335166 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-bb4fdded-8dd8-47c3-9014-a2fcd37581d8 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:33.335779 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-bb4fdded-8dd8-47c3-9014-a2fcd37581d8 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:33.342484 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-bb4fdded-8dd8-47c3-9014-a2fcd37581d8 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:33.342937 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-bb4fdded-8dd8-47c3-9014-a2fcd37581d8 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:33.343690 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-bb4fdded-8dd8-47c3-9014-a2fcd37581d8 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:33.344125 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-bb4fdded-8dd8-47c3-9014-a2fcd37581d8 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:33.476359 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-bb4fdded-8dd8-47c3-9014-a2fcd37581d8 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:33.485288 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-bb4fdded-8dd8-47c3-9014-a2fcd37581d8 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.154882 Jun 17 13:20:33.485892 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 880/1730] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:20:33 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:20:33.928726 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-5d35c6b6-5972-4bf6-a732-2cae62dbcbf1 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:33.929570 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-5d35c6b6-5972-4bf6-a732-2cae62dbcbf1 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:33.939693 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5d35c6b6-5972-4bf6-a732-2cae62dbcbf1 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:33.940437 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5d35c6b6-5972-4bf6-a732-2cae62dbcbf1 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:33.941663 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5d35c6b6-5972-4bf6-a732-2cae62dbcbf1 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:33.942395 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5d35c6b6-5972-4bf6-a732-2cae62dbcbf1 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:34.079638 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-5d35c6b6-5972-4bf6-a732-2cae62dbcbf1 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:34.087728 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-5d35c6b6-5972-4bf6-a732-2cae62dbcbf1 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.164424 Jun 17 13:20:34.088219 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 851/1731] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:20:33 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:20:34.506977 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-f2e4ca8a-cb0d-4c47-a438-ae3a882fdfae tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:34.507934 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-f2e4ca8a-cb0d-4c47-a438-ae3a882fdfae tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:34.518988 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f2e4ca8a-cb0d-4c47-a438-ae3a882fdfae tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:34.519437 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f2e4ca8a-cb0d-4c47-a438-ae3a882fdfae tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:34.520200 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f2e4ca8a-cb0d-4c47-a438-ae3a882fdfae tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:34.520641 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f2e4ca8a-cb0d-4c47-a438-ae3a882fdfae tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:34.669928 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-f2e4ca8a-cb0d-4c47-a438-ae3a882fdfae tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:34.678665 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-f2e4ca8a-cb0d-4c47-a438-ae3a882fdfae tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.178488 Jun 17 13:20:34.679238 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 881/1732] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:20:34 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:20:35.104812 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-bd25c8eb-bdec-48bb-a9d6-001411dce832 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:35.105455 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-bd25c8eb-bdec-48bb-a9d6-001411dce832 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:35.113331 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bd25c8eb-bdec-48bb-a9d6-001411dce832 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:35.113782 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bd25c8eb-bdec-48bb-a9d6-001411dce832 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:35.114593 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bd25c8eb-bdec-48bb-a9d6-001411dce832 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:35.115037 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bd25c8eb-bdec-48bb-a9d6-001411dce832 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:35.248477 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-bd25c8eb-bdec-48bb-a9d6-001411dce832 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:35.261158 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-bd25c8eb-bdec-48bb-a9d6-001411dce832 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.159966 Jun 17 13:20:35.262263 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 852/1733] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:20:35 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:20:35.696650 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-b02a042a-6d29-4c17-837f-4e9c19bcfc24 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:35.697524 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-b02a042a-6d29-4c17-837f-4e9c19bcfc24 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:35.705224 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b02a042a-6d29-4c17-837f-4e9c19bcfc24 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:35.705931 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b02a042a-6d29-4c17-837f-4e9c19bcfc24 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:35.706761 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b02a042a-6d29-4c17-837f-4e9c19bcfc24 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:35.707369 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b02a042a-6d29-4c17-837f-4e9c19bcfc24 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:35.841903 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-b02a042a-6d29-4c17-837f-4e9c19bcfc24 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:35.852059 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-b02a042a-6d29-4c17-837f-4e9c19bcfc24 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.159429 Jun 17 13:20:35.853126 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 882/1734] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:20:35 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:20:36.281964 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-e2cc2a2e-3e27-4362-9d13-ad4acda23be8 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:36.283029 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-e2cc2a2e-3e27-4362-9d13-ad4acda23be8 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:36.293956 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e2cc2a2e-3e27-4362-9d13-ad4acda23be8 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:36.294754 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e2cc2a2e-3e27-4362-9d13-ad4acda23be8 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:36.296012 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e2cc2a2e-3e27-4362-9d13-ad4acda23be8 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:36.296743 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e2cc2a2e-3e27-4362-9d13-ad4acda23be8 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:36.431473 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-e2cc2a2e-3e27-4362-9d13-ad4acda23be8 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:36.439640 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-e2cc2a2e-3e27-4362-9d13-ad4acda23be8 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.164195 Jun 17 13:20:36.440799 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 853/1735] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:20:36 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:20:36.871729 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-a2ad12cb-bcec-4cbf-a3ae-397b9c39ee6a tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:36.872421 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-a2ad12cb-bcec-4cbf-a3ae-397b9c39ee6a tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:36.881633 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a2ad12cb-bcec-4cbf-a3ae-397b9c39ee6a tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:36.882148 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a2ad12cb-bcec-4cbf-a3ae-397b9c39ee6a tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:36.883279 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a2ad12cb-bcec-4cbf-a3ae-397b9c39ee6a tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:36.883783 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a2ad12cb-bcec-4cbf-a3ae-397b9c39ee6a tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:37.020078 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-a2ad12cb-bcec-4cbf-a3ae-397b9c39ee6a tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:37.028770 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-a2ad12cb-bcec-4cbf-a3ae-397b9c39ee6a tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.162474 Jun 17 13:20:37.029352 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 883/1736] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:20:36 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:20:37.461896 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-b2ed032d-05a0-40b3-aac5-fa706d41e4e7 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:37.462863 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-b2ed032d-05a0-40b3-aac5-fa706d41e4e7 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:37.466468 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_api:SELECT=61,nova_api:DELETE=1 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:20:37.475229 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b2ed032d-05a0-40b3-aac5-fa706d41e4e7 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:37.475961 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b2ed032d-05a0-40b3-aac5-fa706d41e4e7 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:37.477224 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b2ed032d-05a0-40b3-aac5-fa706d41e4e7 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:37.477940 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b2ed032d-05a0-40b3-aac5-fa706d41e4e7 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:37.623314 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-b2ed032d-05a0-40b3-aac5-fa706d41e4e7 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:37.635830 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-b2ed032d-05a0-40b3-aac5-fa706d41e4e7 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.180349 Jun 17 13:20:37.636650 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 854/1737] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:20:37 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:20:38.051308 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-31783e6c-2a27-4a6b-ab53-faae09c8d0a7 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:38.052265 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-31783e6c-2a27-4a6b-ab53-faae09c8d0a7 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:38.063597 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-31783e6c-2a27-4a6b-ab53-faae09c8d0a7 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:38.064347 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-31783e6c-2a27-4a6b-ab53-faae09c8d0a7 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:38.065899 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-31783e6c-2a27-4a6b-ab53-faae09c8d0a7 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:38.066700 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-31783e6c-2a27-4a6b-ab53-faae09c8d0a7 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:38.207154 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-31783e6c-2a27-4a6b-ab53-faae09c8d0a7 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:38.215389 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-31783e6c-2a27-4a6b-ab53-faae09c8d0a7 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.171468 Jun 17 13:20:38.215970 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 884/1738] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:20:38 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:20:38.657326 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-226896d6-be87-409e-8d98-52435a043e18 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:38.658506 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-226896d6-be87-409e-8d98-52435a043e18 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:38.665955 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-226896d6-be87-409e-8d98-52435a043e18 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:38.666439 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-226896d6-be87-409e-8d98-52435a043e18 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:38.667232 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-226896d6-be87-409e-8d98-52435a043e18 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:38.667657 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-226896d6-be87-409e-8d98-52435a043e18 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:38.807449 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-226896d6-be87-409e-8d98-52435a043e18 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:38.815813 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-226896d6-be87-409e-8d98-52435a043e18 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.165052 Jun 17 13:20:38.816497 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 855/1739] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:20:38 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:20:39.237570 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-1c899794-e3d7-4917-891c-c7a56bf4e782 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:39.238460 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-1c899794-e3d7-4917-891c-c7a56bf4e782 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:39.245535 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-1c899794-e3d7-4917-891c-c7a56bf4e782 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:39.246013 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-1c899794-e3d7-4917-891c-c7a56bf4e782 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:39.246848 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-1c899794-e3d7-4917-891c-c7a56bf4e782 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:39.247306 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-1c899794-e3d7-4917-891c-c7a56bf4e782 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:39.266323 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_cell1:SELECT=100 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:20:39.382015 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-1c899794-e3d7-4917-891c-c7a56bf4e782 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:39.397489 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-1c899794-e3d7-4917-891c-c7a56bf4e782 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.166972 Jun 17 13:20:39.398063 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 885/1740] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:20:39 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:20:39.838324 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-818fe5dd-7b8c-4e56-b393-25a17a9cdb87 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:39.839250 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-818fe5dd-7b8c-4e56-b393-25a17a9cdb87 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:39.849600 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-818fe5dd-7b8c-4e56-b393-25a17a9cdb87 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:39.850054 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-818fe5dd-7b8c-4e56-b393-25a17a9cdb87 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:39.850857 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-818fe5dd-7b8c-4e56-b393-25a17a9cdb87 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:39.851294 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-818fe5dd-7b8c-4e56-b393-25a17a9cdb87 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:39.985568 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-818fe5dd-7b8c-4e56-b393-25a17a9cdb87 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:39.993971 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-818fe5dd-7b8c-4e56-b393-25a17a9cdb87 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.163245 Jun 17 13:20:39.994577 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 856/1741] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:20:39 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:20:40.416027 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-dcedd3ae-1196-4290-ac52-cfa9937489ed tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:40.416614 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-dcedd3ae-1196-4290-ac52-cfa9937489ed tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:40.423373 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-dcedd3ae-1196-4290-ac52-cfa9937489ed tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:40.423828 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-dcedd3ae-1196-4290-ac52-cfa9937489ed tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:40.424670 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-dcedd3ae-1196-4290-ac52-cfa9937489ed tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:40.425098 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-dcedd3ae-1196-4290-ac52-cfa9937489ed tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:40.571296 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-dcedd3ae-1196-4290-ac52-cfa9937489ed tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:40.583496 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-dcedd3ae-1196-4290-ac52-cfa9937489ed tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.171584 Jun 17 13:20:40.584296 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 886/1742] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:20:40 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:20:41.011449 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-00ce0fc5-1f7e-4f3a-8f14-ccbd86855ae3 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:41.012067 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-00ce0fc5-1f7e-4f3a-8f14-ccbd86855ae3 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:41.019184 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-00ce0fc5-1f7e-4f3a-8f14-ccbd86855ae3 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:41.019694 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-00ce0fc5-1f7e-4f3a-8f14-ccbd86855ae3 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:41.020481 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-00ce0fc5-1f7e-4f3a-8f14-ccbd86855ae3 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:41.020914 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-00ce0fc5-1f7e-4f3a-8f14-ccbd86855ae3 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:41.154704 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-00ce0fc5-1f7e-4f3a-8f14-ccbd86855ae3 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:41.166829 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-00ce0fc5-1f7e-4f3a-8f14-ccbd86855ae3 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.159064 Jun 17 13:20:41.167648 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 857/1743] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:20:41 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:20:41.605777 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-f5adbf61-222a-4ebd-b118-a806a965f063 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:41.606761 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-f5adbf61-222a-4ebd-b118-a806a965f063 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:41.614538 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f5adbf61-222a-4ebd-b118-a806a965f063 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:41.614995 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f5adbf61-222a-4ebd-b118-a806a965f063 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:41.615761 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f5adbf61-222a-4ebd-b118-a806a965f063 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:41.616199 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f5adbf61-222a-4ebd-b118-a806a965f063 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:41.763465 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-f5adbf61-222a-4ebd-b118-a806a965f063 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:41.772177 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-f5adbf61-222a-4ebd-b118-a806a965f063 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.170413 Jun 17 13:20:41.772757 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 887/1744] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:20:41 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:20:42.188281 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-14b8c492-2f8b-43ba-8f87-80738c8ac40e tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:42.189215 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-14b8c492-2f8b-43ba-8f87-80738c8ac40e tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:42.197128 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-14b8c492-2f8b-43ba-8f87-80738c8ac40e tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:42.197576 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-14b8c492-2f8b-43ba-8f87-80738c8ac40e tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:42.198377 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-14b8c492-2f8b-43ba-8f87-80738c8ac40e tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:42.198814 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-14b8c492-2f8b-43ba-8f87-80738c8ac40e tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:42.331574 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-14b8c492-2f8b-43ba-8f87-80738c8ac40e tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:42.340179 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-14b8c492-2f8b-43ba-8f87-80738c8ac40e tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.158083 Jun 17 13:20:42.340722 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 858/1745] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:20:42 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:20:42.789280 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-d894d07a-4a19-4b66-a499-dd355dc6cfeb tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:42.789863 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-d894d07a-4a19-4b66-a499-dd355dc6cfeb tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:42.796970 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d894d07a-4a19-4b66-a499-dd355dc6cfeb tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:42.797417 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d894d07a-4a19-4b66-a499-dd355dc6cfeb tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:42.798214 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d894d07a-4a19-4b66-a499-dd355dc6cfeb tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:42.798655 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d894d07a-4a19-4b66-a499-dd355dc6cfeb tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:42.939853 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-d894d07a-4a19-4b66-a499-dd355dc6cfeb tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:42.948534 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-d894d07a-4a19-4b66-a499-dd355dc6cfeb tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.163434 Jun 17 13:20:42.949129 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 888/1746] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:20:42 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:20:43.363133 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-13de7c9a-fb83-44ab-9499-cfb427595abe tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:43.364005 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-13de7c9a-fb83-44ab-9499-cfb427595abe tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:43.370713 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-13de7c9a-fb83-44ab-9499-cfb427595abe tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:43.371148 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-13de7c9a-fb83-44ab-9499-cfb427595abe tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:43.371896 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-13de7c9a-fb83-44ab-9499-cfb427595abe tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:43.372317 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-13de7c9a-fb83-44ab-9499-cfb427595abe tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:43.390513 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=100 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:20:43.517524 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-13de7c9a-fb83-44ab-9499-cfb427595abe tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:43.530861 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-13de7c9a-fb83-44ab-9499-cfb427595abe tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.171213 Jun 17 13:20:43.531641 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 859/1747] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:20:43 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:20:43.969404 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-b403281b-3af1-4cbf-9349-b41b999f625f tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:43.970054 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-b403281b-3af1-4cbf-9349-b41b999f625f tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:43.973460 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=2 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:20:43.981552 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b403281b-3af1-4cbf-9349-b41b999f625f tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:43.982105 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b403281b-3af1-4cbf-9349-b41b999f625f tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:43.982895 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b403281b-3af1-4cbf-9349-b41b999f625f tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:43.983509 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b403281b-3af1-4cbf-9349-b41b999f625f tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:44.121487 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-b403281b-3af1-4cbf-9349-b41b999f625f tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:44.129657 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-b403281b-3af1-4cbf-9349-b41b999f625f tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.166364 Jun 17 13:20:44.130335 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 889/1748] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:20:43 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:20:44.553081 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-1ba85864-1987-4bff-a03a-f1b4d89d00b0 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:44.553676 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-1ba85864-1987-4bff-a03a-f1b4d89d00b0 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:44.562661 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1ba85864-1987-4bff-a03a-f1b4d89d00b0 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:44.563105 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1ba85864-1987-4bff-a03a-f1b4d89d00b0 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:44.563861 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1ba85864-1987-4bff-a03a-f1b4d89d00b0 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:44.564289 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1ba85864-1987-4bff-a03a-f1b4d89d00b0 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:44.698390 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-1ba85864-1987-4bff-a03a-f1b4d89d00b0 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:44.706661 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-1ba85864-1987-4bff-a03a-f1b4d89d00b0 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.159336 Jun 17 13:20:44.707224 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 860/1749] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:20:44 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:20:45.151119 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-baa65e6e-8173-4dbd-a589-c1104fe43de9 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:45.152106 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-baa65e6e-8173-4dbd-a589-c1104fe43de9 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:45.163005 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-baa65e6e-8173-4dbd-a589-c1104fe43de9 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:45.163850 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-baa65e6e-8173-4dbd-a589-c1104fe43de9 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:45.164572 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-baa65e6e-8173-4dbd-a589-c1104fe43de9 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:45.165002 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-baa65e6e-8173-4dbd-a589-c1104fe43de9 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:45.303932 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-baa65e6e-8173-4dbd-a589-c1104fe43de9 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:45.312355 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-baa65e6e-8173-4dbd-a589-c1104fe43de9 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.168387 Jun 17 13:20:45.313225 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 890/1750] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:20:45 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:20:45.723416 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-4caca3bb-e1c2-410e-b82a-2a1c3c22691d tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:45.724064 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-4caca3bb-e1c2-410e-b82a-2a1c3c22691d tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:45.730458 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4caca3bb-e1c2-410e-b82a-2a1c3c22691d tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:45.731220 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4caca3bb-e1c2-410e-b82a-2a1c3c22691d tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:45.732221 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4caca3bb-e1c2-410e-b82a-2a1c3c22691d tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:45.732664 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4caca3bb-e1c2-410e-b82a-2a1c3c22691d tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:45.902405 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-4caca3bb-e1c2-410e-b82a-2a1c3c22691d tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:45.910918 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-4caca3bb-e1c2-410e-b82a-2a1c3c22691d tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.191339 Jun 17 13:20:45.911668 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 861/1751] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:20:45 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:20:46.335249 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-990cbb9c-2cb2-4f7c-bd90-7509d3461767 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:46.335921 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-990cbb9c-2cb2-4f7c-bd90-7509d3461767 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:46.342980 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-990cbb9c-2cb2-4f7c-bd90-7509d3461767 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:46.343432 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-990cbb9c-2cb2-4f7c-bd90-7509d3461767 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:46.344193 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-990cbb9c-2cb2-4f7c-bd90-7509d3461767 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:46.344626 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-990cbb9c-2cb2-4f7c-bd90-7509d3461767 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:46.485368 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-990cbb9c-2cb2-4f7c-bd90-7509d3461767 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:46.494320 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-990cbb9c-2cb2-4f7c-bd90-7509d3461767 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.162701 Jun 17 13:20:46.495264 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 891/1752] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:20:46 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:20:46.931521 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-4ab454bd-9fb7-495d-b07d-109fcf5141a1 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:46.932086 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-4ab454bd-9fb7-495d-b07d-109fcf5141a1 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:46.939139 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4ab454bd-9fb7-495d-b07d-109fcf5141a1 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:46.939585 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4ab454bd-9fb7-495d-b07d-109fcf5141a1 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:46.940349 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4ab454bd-9fb7-495d-b07d-109fcf5141a1 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:46.940775 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4ab454bd-9fb7-495d-b07d-109fcf5141a1 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:47.083841 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-4ab454bd-9fb7-495d-b07d-109fcf5141a1 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:47.097240 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-4ab454bd-9fb7-495d-b07d-109fcf5141a1 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.171578 Jun 17 13:20:47.098165 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 862/1753] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:20:46 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:20:47.520501 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-5bca197f-ded5-413f-a6f9-0db467d0797d tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:47.521510 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-5bca197f-ded5-413f-a6f9-0db467d0797d tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:47.530083 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-5bca197f-ded5-413f-a6f9-0db467d0797d tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:47.530575 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-5bca197f-ded5-413f-a6f9-0db467d0797d tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:47.531324 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-5bca197f-ded5-413f-a6f9-0db467d0797d tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:47.531756 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-5bca197f-ded5-413f-a6f9-0db467d0797d tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:47.664964 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-5bca197f-ded5-413f-a6f9-0db467d0797d tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:47.674435 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-5bca197f-ded5-413f-a6f9-0db467d0797d tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.160466 Jun 17 13:20:47.675018 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 892/1754] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:20:47 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:20:48.122553 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-c0542994-f502-4404-af5b-a3c54bdaec83 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:48.123901 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-c0542994-f502-4404-af5b-a3c54bdaec83 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:48.134919 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c0542994-f502-4404-af5b-a3c54bdaec83 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:48.135361 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c0542994-f502-4404-af5b-a3c54bdaec83 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:48.136129 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c0542994-f502-4404-af5b-a3c54bdaec83 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:48.136557 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c0542994-f502-4404-af5b-a3c54bdaec83 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:48.279559 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-c0542994-f502-4404-af5b-a3c54bdaec83 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:48.290778 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-c0542994-f502-4404-af5b-a3c54bdaec83 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.175443 Jun 17 13:20:48.291471 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 863/1755] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:20:48 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:20:48.696361 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-23bc6492-c81a-4d7e-b975-b421a3d2bdc4 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:48.697263 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-23bc6492-c81a-4d7e-b975-b421a3d2bdc4 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:48.708475 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-23bc6492-c81a-4d7e-b975-b421a3d2bdc4 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:48.709231 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-23bc6492-c81a-4d7e-b975-b421a3d2bdc4 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:48.710544 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-23bc6492-c81a-4d7e-b975-b421a3d2bdc4 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:48.711258 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-23bc6492-c81a-4d7e-b975-b421a3d2bdc4 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:48.856967 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-23bc6492-c81a-4d7e-b975-b421a3d2bdc4 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:48.865147 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-23bc6492-c81a-4d7e-b975-b421a3d2bdc4 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.175551 Jun 17 13:20:48.875053 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 893/1756] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:20:48 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:20:49.312913 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-dda8395f-66b2-49cd-85a3-35a098eeaedc tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:49.314118 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-dda8395f-66b2-49cd-85a3-35a098eeaedc tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:49.321012 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dda8395f-66b2-49cd-85a3-35a098eeaedc tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:49.321559 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dda8395f-66b2-49cd-85a3-35a098eeaedc tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:49.322416 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dda8395f-66b2-49cd-85a3-35a098eeaedc tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:49.323245 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dda8395f-66b2-49cd-85a3-35a098eeaedc tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:49.462237 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-dda8395f-66b2-49cd-85a3-35a098eeaedc tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:49.470966 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-dda8395f-66b2-49cd-85a3-35a098eeaedc tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.162593 Jun 17 13:20:49.471541 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 864/1757] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:20:49 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:20:49.599909 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 13:20:49.600073 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Fri Jun 17 13:20:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 17 13:20:49.886593 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-403ac069-fff4-461f-b4d0-773346253bae tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:49.887278 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-403ac069-fff4-461f-b4d0-773346253bae tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:49.894040 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-403ac069-fff4-461f-b4d0-773346253bae tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:49.894965 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-403ac069-fff4-461f-b4d0-773346253bae tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:49.895436 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-403ac069-fff4-461f-b4d0-773346253bae tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:49.897408 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-403ac069-fff4-461f-b4d0-773346253bae tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:50.037155 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-403ac069-fff4-461f-b4d0-773346253bae tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:50.046996 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-403ac069-fff4-461f-b4d0-773346253bae tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.166086 Jun 17 13:20:50.047582 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 894/1758] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:20:49 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:20:50.492194 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-e5d93ab3-4468-4477-b853-9f84c7d81d7c tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:50.492896 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-e5d93ab3-4468-4477-b853-9f84c7d81d7c tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:50.503590 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e5d93ab3-4468-4477-b853-9f84c7d81d7c tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:50.504171 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e5d93ab3-4468-4477-b853-9f84c7d81d7c tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:50.505410 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e5d93ab3-4468-4477-b853-9f84c7d81d7c tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:50.506082 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e5d93ab3-4468-4477-b853-9f84c7d81d7c tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:50.648384 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-e5d93ab3-4468-4477-b853-9f84c7d81d7c tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:50.660924 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-e5d93ab3-4468-4477-b853-9f84c7d81d7c tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.174895 Jun 17 13:20:50.661670 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 865/1759] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:20:50 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:20:51.066914 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-517b8734-363d-4b7b-b4f4-121270c595d9 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:51.067525 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-517b8734-363d-4b7b-b4f4-121270c595d9 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:51.074191 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-517b8734-363d-4b7b-b4f4-121270c595d9 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:51.074711 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-517b8734-363d-4b7b-b4f4-121270c595d9 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:51.075529 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-517b8734-363d-4b7b-b4f4-121270c595d9 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:51.075978 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-517b8734-363d-4b7b-b4f4-121270c595d9 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:51.216160 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-517b8734-363d-4b7b-b4f4-121270c595d9 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:51.227669 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-517b8734-363d-4b7b-b4f4-121270c595d9 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.164633 Jun 17 13:20:51.228251 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 895/1760] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:20:51 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:20:51.683637 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-cf39fd45-a5fd-4d7e-ac71-290f83cc9b2c tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:51.684697 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-cf39fd45-a5fd-4d7e-ac71-290f83cc9b2c tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:51.691980 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cf39fd45-a5fd-4d7e-ac71-290f83cc9b2c tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:51.692426 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cf39fd45-a5fd-4d7e-ac71-290f83cc9b2c tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:51.693195 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cf39fd45-a5fd-4d7e-ac71-290f83cc9b2c tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:51.693626 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cf39fd45-a5fd-4d7e-ac71-290f83cc9b2c tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:51.826449 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-cf39fd45-a5fd-4d7e-ac71-290f83cc9b2c tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:51.835176 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-cf39fd45-a5fd-4d7e-ac71-290f83cc9b2c tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.157479 Jun 17 13:20:51.835677 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 866/1761] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:20:51 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:20:52.249712 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-6833a212-cf54-42b6-a820-06c160be8418 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:52.250304 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-6833a212-cf54-42b6-a820-06c160be8418 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:52.257344 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6833a212-cf54-42b6-a820-06c160be8418 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:52.257794 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6833a212-cf54-42b6-a820-06c160be8418 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:52.258598 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6833a212-cf54-42b6-a820-06c160be8418 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:52.259036 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6833a212-cf54-42b6-a820-06c160be8418 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:52.391188 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-6833a212-cf54-42b6-a820-06c160be8418 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:52.399669 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-6833a212-cf54-42b6-a820-06c160be8418 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.155369 Jun 17 13:20:52.400244 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 896/1762] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:20:52 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:20:52.857243 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-677b44b5-8633-4bfd-9fff-459ab79c04bf tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:52.858410 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-677b44b5-8633-4bfd-9fff-459ab79c04bf tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:52.869921 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-677b44b5-8633-4bfd-9fff-459ab79c04bf tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:52.870736 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-677b44b5-8633-4bfd-9fff-459ab79c04bf tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:52.871981 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-677b44b5-8633-4bfd-9fff-459ab79c04bf tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:52.872709 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-677b44b5-8633-4bfd-9fff-459ab79c04bf tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:53.007029 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-677b44b5-8633-4bfd-9fff-459ab79c04bf tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:53.015351 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-677b44b5-8633-4bfd-9fff-459ab79c04bf tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.165038 Jun 17 13:20:53.015798 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 867/1763] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:20:52 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:20:53.417803 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-131338d1-6085-482a-af83-93f611031aa2 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:53.418428 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-131338d1-6085-482a-af83-93f611031aa2 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:53.426243 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-131338d1-6085-482a-af83-93f611031aa2 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:53.426691 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-131338d1-6085-482a-af83-93f611031aa2 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:53.427453 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-131338d1-6085-482a-af83-93f611031aa2 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:53.427888 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-131338d1-6085-482a-af83-93f611031aa2 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:53.559479 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-131338d1-6085-482a-af83-93f611031aa2 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:53.570469 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-131338d1-6085-482a-af83-93f611031aa2 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.156158 Jun 17 13:20:53.571145 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 897/1764] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:20:53 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:20:54.036862 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-bd27e12b-204d-4c4c-b413-e5bd5fbd4262 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:54.037865 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-bd27e12b-204d-4c4c-b413-e5bd5fbd4262 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:54.048126 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bd27e12b-204d-4c4c-b413-e5bd5fbd4262 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:54.048574 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bd27e12b-204d-4c4c-b413-e5bd5fbd4262 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:54.049377 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bd27e12b-204d-4c4c-b413-e5bd5fbd4262 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:54.049810 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bd27e12b-204d-4c4c-b413-e5bd5fbd4262 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:54.192914 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-bd27e12b-204d-4c4c-b413-e5bd5fbd4262 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:54.201123 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-bd27e12b-204d-4c4c-b413-e5bd5fbd4262 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.170964 Jun 17 13:20:54.201660 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 868/1765] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:20:54 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:20:54.591481 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-d36d3eb9-d1cd-47fb-98cf-942a0c6a767b tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:54.592349 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-d36d3eb9-d1cd-47fb-98cf-942a0c6a767b tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:54.603545 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d36d3eb9-d1cd-47fb-98cf-942a0c6a767b tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:54.604342 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d36d3eb9-d1cd-47fb-98cf-942a0c6a767b tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:54.605644 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d36d3eb9-d1cd-47fb-98cf-942a0c6a767b tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:54.606803 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d36d3eb9-d1cd-47fb-98cf-942a0c6a767b tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:54.994532 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-d36d3eb9-d1cd-47fb-98cf-942a0c6a767b tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:55.004053 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-d36d3eb9-d1cd-47fb-98cf-942a0c6a767b tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.419339 Jun 17 13:20:55.004621 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 898/1766] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:20:54 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:20:55.218674 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-6169f06f-b91a-488a-a038-28d1a2ae23f3 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:55.219298 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-6169f06f-b91a-488a-a038-28d1a2ae23f3 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:55.226303 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6169f06f-b91a-488a-a038-28d1a2ae23f3 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:55.226754 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6169f06f-b91a-488a-a038-28d1a2ae23f3 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:55.227550 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6169f06f-b91a-488a-a038-28d1a2ae23f3 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:55.227988 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6169f06f-b91a-488a-a038-28d1a2ae23f3 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:55.359615 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-6169f06f-b91a-488a-a038-28d1a2ae23f3 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:55.368021 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-6169f06f-b91a-488a-a038-28d1a2ae23f3 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.153378 Jun 17 13:20:55.368595 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 869/1767] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:20:55 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:20:56.022431 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-6ce8e32a-c48f-41c3-9230-63acca8a1fcf tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:56.023022 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-6ce8e32a-c48f-41c3-9230-63acca8a1fcf tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:56.030073 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6ce8e32a-c48f-41c3-9230-63acca8a1fcf tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:56.030716 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6ce8e32a-c48f-41c3-9230-63acca8a1fcf tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:56.032135 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6ce8e32a-c48f-41c3-9230-63acca8a1fcf tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:56.032712 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6ce8e32a-c48f-41c3-9230-63acca8a1fcf tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:56.177365 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-6ce8e32a-c48f-41c3-9230-63acca8a1fcf tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:56.185701 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-6ce8e32a-c48f-41c3-9230-63acca8a1fcf tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.167225 Jun 17 13:20:56.186314 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 899/1768] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:20:56 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:20:56.389006 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-1a0b44f8-b2e3-4662-80ed-54c542adc5c3 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:56.389854 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-1a0b44f8-b2e3-4662-80ed-54c542adc5c3 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:56.401838 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1a0b44f8-b2e3-4662-80ed-54c542adc5c3 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:56.402650 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1a0b44f8-b2e3-4662-80ed-54c542adc5c3 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:56.403996 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1a0b44f8-b2e3-4662-80ed-54c542adc5c3 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:56.404740 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1a0b44f8-b2e3-4662-80ed-54c542adc5c3 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:56.552068 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-1a0b44f8-b2e3-4662-80ed-54c542adc5c3 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:56.564444 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-1a0b44f8-b2e3-4662-80ed-54c542adc5c3 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.182126 Jun 17 13:20:56.564986 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 870/1769] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:20:56 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:20:57.207084 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-63cfa979-ea99-4037-a768-b42e982c30d5 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:57.208045 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-63cfa979-ea99-4037-a768-b42e982c30d5 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:57.219248 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-63cfa979-ea99-4037-a768-b42e982c30d5 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:57.219986 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-63cfa979-ea99-4037-a768-b42e982c30d5 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:57.221419 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-63cfa979-ea99-4037-a768-b42e982c30d5 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:57.221893 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-63cfa979-ea99-4037-a768-b42e982c30d5 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:57.360562 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-63cfa979-ea99-4037-a768-b42e982c30d5 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:57.368601 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-63cfa979-ea99-4037-a768-b42e982c30d5 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.168190 Jun 17 13:20:57.369477 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 900/1770] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:20:57 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:20:57.585873 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-fd041846-71ea-45ad-bb08-3279404243f0 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:57.586907 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-fd041846-71ea-45ad-bb08-3279404243f0 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:57.597988 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fd041846-71ea-45ad-bb08-3279404243f0 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:57.598787 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fd041846-71ea-45ad-bb08-3279404243f0 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:57.600028 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fd041846-71ea-45ad-bb08-3279404243f0 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:57.600738 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fd041846-71ea-45ad-bb08-3279404243f0 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:57.743091 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-fd041846-71ea-45ad-bb08-3279404243f0 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:57.751478 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-fd041846-71ea-45ad-bb08-3279404243f0 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.172312 Jun 17 13:20:57.752055 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 871/1771] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:20:57 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:20:58.388169 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-4a57d4d8-e3c4-4df4-8fd2-aa7012cfe985 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:58.388810 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-4a57d4d8-e3c4-4df4-8fd2-aa7012cfe985 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:58.396057 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4a57d4d8-e3c4-4df4-8fd2-aa7012cfe985 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:58.396504 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4a57d4d8-e3c4-4df4-8fd2-aa7012cfe985 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:58.397265 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4a57d4d8-e3c4-4df4-8fd2-aa7012cfe985 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:58.397700 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4a57d4d8-e3c4-4df4-8fd2-aa7012cfe985 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:58.530513 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-4a57d4d8-e3c4-4df4-8fd2-aa7012cfe985 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:58.539182 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-4a57d4d8-e3c4-4df4-8fd2-aa7012cfe985 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.155755 Jun 17 13:20:58.539778 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 901/1772] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:20:58 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:20:58.773082 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-646bb224-00d9-4bf4-87ce-8cca165b9b4d tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:58.774166 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-646bb224-00d9-4bf4-87ce-8cca165b9b4d tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:58.785068 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-646bb224-00d9-4bf4-87ce-8cca165b9b4d tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:58.785627 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-646bb224-00d9-4bf4-87ce-8cca165b9b4d tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:58.786420 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-646bb224-00d9-4bf4-87ce-8cca165b9b4d tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:58.786856 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-646bb224-00d9-4bf4-87ce-8cca165b9b4d tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:58.937496 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-646bb224-00d9-4bf4-87ce-8cca165b9b4d tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:58.949001 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-646bb224-00d9-4bf4-87ce-8cca165b9b4d tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.182147 Jun 17 13:20:58.949636 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 872/1773] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:20:58 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:20:59.558729 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-18edec7f-5ce6-4cdd-81e4-2ff6e0dbeb07 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:59.559454 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-18edec7f-5ce6-4cdd-81e4-2ff6e0dbeb07 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:59.567603 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-18edec7f-5ce6-4cdd-81e4-2ff6e0dbeb07 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:59.567987 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-18edec7f-5ce6-4cdd-81e4-2ff6e0dbeb07 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:59.568752 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-18edec7f-5ce6-4cdd-81e4-2ff6e0dbeb07 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:59.569191 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-18edec7f-5ce6-4cdd-81e4-2ff6e0dbeb07 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:59.573145 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_cell1:SELECT=100 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:20:59.701909 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-18edec7f-5ce6-4cdd-81e4-2ff6e0dbeb07 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:20:59.710895 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-18edec7f-5ce6-4cdd-81e4-2ff6e0dbeb07 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.158770 Jun 17 13:20:59.711468 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 902/1774] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:20:59 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:20:59.972629 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-0559739e-648c-4474-b8de-1de456b7cc99 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:20:59.973627 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-0559739e-648c-4474-b8de-1de456b7cc99 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:20:59.985008 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0559739e-648c-4474-b8de-1de456b7cc99 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:59.985736 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0559739e-648c-4474-b8de-1de456b7cc99 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:20:59.987040 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0559739e-648c-4474-b8de-1de456b7cc99 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:20:59.987735 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0559739e-648c-4474-b8de-1de456b7cc99 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:00.128795 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-0559739e-648c-4474-b8de-1de456b7cc99 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:00.137212 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-0559739e-648c-4474-b8de-1de456b7cc99 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.171052 Jun 17 13:21:00.137774 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 873/1775] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:20:59 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:00.731313 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-24a1b0fd-22c9-490d-8382-0a78590593c5 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:00.732055 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-24a1b0fd-22c9-490d-8382-0a78590593c5 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:00.740526 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-24a1b0fd-22c9-490d-8382-0a78590593c5 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:00.740986 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-24a1b0fd-22c9-490d-8382-0a78590593c5 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:00.741735 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-24a1b0fd-22c9-490d-8382-0a78590593c5 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:00.742172 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-24a1b0fd-22c9-490d-8382-0a78590593c5 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:00.884628 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-24a1b0fd-22c9-490d-8382-0a78590593c5 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:00.897003 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-24a1b0fd-22c9-490d-8382-0a78590593c5 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.170960 Jun 17 13:21:00.897896 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 903/1776] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:00 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:01.154963 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-2a532abd-1382-4ca8-80bf-f145801615d6 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:01.155594 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-2a532abd-1382-4ca8-80bf-f145801615d6 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:01.162720 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2a532abd-1382-4ca8-80bf-f145801615d6 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:01.163166 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2a532abd-1382-4ca8-80bf-f145801615d6 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:01.163937 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2a532abd-1382-4ca8-80bf-f145801615d6 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:01.164358 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2a532abd-1382-4ca8-80bf-f145801615d6 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:01.298356 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-2a532abd-1382-4ca8-80bf-f145801615d6 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:01.307114 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-2a532abd-1382-4ca8-80bf-f145801615d6 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.156922 Jun 17 13:21:01.307683 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 874/1777] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:01 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:01.918918 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-44a41204-659f-4a32-bc4d-1735c178e947 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:01.919873 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-44a41204-659f-4a32-bc4d-1735c178e947 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:01.929360 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-44a41204-659f-4a32-bc4d-1735c178e947 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:01.929811 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-44a41204-659f-4a32-bc4d-1735c178e947 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:01.930630 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-44a41204-659f-4a32-bc4d-1735c178e947 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:01.931067 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-44a41204-659f-4a32-bc4d-1735c178e947 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:02.071651 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-44a41204-659f-4a32-bc4d-1735c178e947 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:02.080298 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-44a41204-659f-4a32-bc4d-1735c178e947 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.168018 Jun 17 13:21:02.081052 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 904/1778] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:01 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:02.324873 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-c954ccf8-9f8f-4913-8cdb-3c56518356bb tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:02.325500 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-c954ccf8-9f8f-4913-8cdb-3c56518356bb tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:02.332775 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c954ccf8-9f8f-4913-8cdb-3c56518356bb tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:02.333228 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c954ccf8-9f8f-4913-8cdb-3c56518356bb tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:02.333991 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c954ccf8-9f8f-4913-8cdb-3c56518356bb tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:02.334604 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c954ccf8-9f8f-4913-8cdb-3c56518356bb tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:02.478237 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-c954ccf8-9f8f-4913-8cdb-3c56518356bb tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:02.486667 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-c954ccf8-9f8f-4913-8cdb-3c56518356bb tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.165742 Jun 17 13:21:02.487426 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 875/1779] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:02 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:03.101851 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-8c7b9e4c-e4dd-48e8-9276-0aaf4ebf1090 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:03.102667 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-8c7b9e4c-e4dd-48e8-9276-0aaf4ebf1090 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:03.112178 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8c7b9e4c-e4dd-48e8-9276-0aaf4ebf1090 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:03.112773 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8c7b9e4c-e4dd-48e8-9276-0aaf4ebf1090 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:03.113764 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8c7b9e4c-e4dd-48e8-9276-0aaf4ebf1090 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:03.114489 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8c7b9e4c-e4dd-48e8-9276-0aaf4ebf1090 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:03.264994 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-8c7b9e4c-e4dd-48e8-9276-0aaf4ebf1090 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:03.273695 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-8c7b9e4c-e4dd-48e8-9276-0aaf4ebf1090 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.177748 Jun 17 13:21:03.274397 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 905/1780] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:03 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:03.505971 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-13d30d99-f42d-4eac-ac64-36800a2361c8 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:03.506565 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-13d30d99-f42d-4eac-ac64-36800a2361c8 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:03.513747 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-13d30d99-f42d-4eac-ac64-36800a2361c8 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:03.514222 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-13d30d99-f42d-4eac-ac64-36800a2361c8 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:03.514984 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-13d30d99-f42d-4eac-ac64-36800a2361c8 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:03.515415 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-13d30d99-f42d-4eac-ac64-36800a2361c8 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:03.519393 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=100 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:21:03.650563 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-13d30d99-f42d-4eac-ac64-36800a2361c8 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:03.664226 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-13d30d99-f42d-4eac-ac64-36800a2361c8 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.162018 Jun 17 13:21:03.665104 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 876/1781] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:03 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:04.291599 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-0738e4c0-9617-4e4b-80e1-14ff627515a4 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:04.292294 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-0738e4c0-9617-4e4b-80e1-14ff627515a4 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:04.299448 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0738e4c0-9617-4e4b-80e1-14ff627515a4 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:04.299976 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0738e4c0-9617-4e4b-80e1-14ff627515a4 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:04.300850 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0738e4c0-9617-4e4b-80e1-14ff627515a4 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:04.301356 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0738e4c0-9617-4e4b-80e1-14ff627515a4 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:04.439057 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-0738e4c0-9617-4e4b-80e1-14ff627515a4 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:04.447173 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-0738e4c0-9617-4e4b-80e1-14ff627515a4 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.159703 Jun 17 13:21:04.447851 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 906/1782] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:04 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:04.691419 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-98f3434b-5bf0-4a59-9fb6-b26a1c2d601b tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:04.692838 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-98f3434b-5bf0-4a59-9fb6-b26a1c2d601b tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:04.699833 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-98f3434b-5bf0-4a59-9fb6-b26a1c2d601b tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:04.700261 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-98f3434b-5bf0-4a59-9fb6-b26a1c2d601b tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:04.701040 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-98f3434b-5bf0-4a59-9fb6-b26a1c2d601b tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:04.701474 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-98f3434b-5bf0-4a59-9fb6-b26a1c2d601b tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:04.835250 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-98f3434b-5bf0-4a59-9fb6-b26a1c2d601b tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:04.844249 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-98f3434b-5bf0-4a59-9fb6-b26a1c2d601b tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.159483 Jun 17 13:21:04.844875 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 877/1783] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:04 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:05.468064 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-19883ed7-a367-4ff3-8e21-6c4bd583a59f tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:05.468634 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-19883ed7-a367-4ff3-8e21-6c4bd583a59f tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:05.477251 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-19883ed7-a367-4ff3-8e21-6c4bd583a59f tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:05.477700 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-19883ed7-a367-4ff3-8e21-6c4bd583a59f tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:05.478501 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-19883ed7-a367-4ff3-8e21-6c4bd583a59f tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:05.478932 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-19883ed7-a367-4ff3-8e21-6c4bd583a59f tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:05.612974 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-19883ed7-a367-4ff3-8e21-6c4bd583a59f tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:05.623792 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-19883ed7-a367-4ff3-8e21-6c4bd583a59f tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.161419 Jun 17 13:21:05.624619 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 907/1784] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:05 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:05.861807 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-5ada18d5-8068-4c45-b72e-b5244874aacc tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:05.862428 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-5ada18d5-8068-4c45-b72e-b5244874aacc tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:05.869492 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5ada18d5-8068-4c45-b72e-b5244874aacc tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:05.869940 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5ada18d5-8068-4c45-b72e-b5244874aacc tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:05.870727 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5ada18d5-8068-4c45-b72e-b5244874aacc tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:05.871159 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5ada18d5-8068-4c45-b72e-b5244874aacc tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:06.008633 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-5ada18d5-8068-4c45-b72e-b5244874aacc tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:06.020167 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-5ada18d5-8068-4c45-b72e-b5244874aacc tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.162065 Jun 17 13:21:06.020945 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 878/1785] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:05 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:06.643310 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-87f68b87-c43b-42f2-80f7-f1447633cbd1 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:06.643745 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-87f68b87-c43b-42f2-80f7-f1447633cbd1 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:06.651963 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-87f68b87-c43b-42f2-80f7-f1447633cbd1 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:06.652414 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-87f68b87-c43b-42f2-80f7-f1447633cbd1 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:06.653185 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-87f68b87-c43b-42f2-80f7-f1447633cbd1 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:06.653625 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-87f68b87-c43b-42f2-80f7-f1447633cbd1 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:06.799273 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-87f68b87-c43b-42f2-80f7-f1447633cbd1 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:06.807534 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-87f68b87-c43b-42f2-80f7-f1447633cbd1 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.169942 Jun 17 13:21:06.808110 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 908/1786] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:06 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:07.044886 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-7179751e-a5c9-49b8-a1b8-d2225e4f9786 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:07.045837 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-7179751e-a5c9-49b8-a1b8-d2225e4f9786 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:07.058019 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7179751e-a5c9-49b8-a1b8-d2225e4f9786 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:07.058828 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7179751e-a5c9-49b8-a1b8-d2225e4f9786 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:07.060083 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7179751e-a5c9-49b8-a1b8-d2225e4f9786 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:07.060806 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7179751e-a5c9-49b8-a1b8-d2225e4f9786 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:07.202327 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-7179751e-a5c9-49b8-a1b8-d2225e4f9786 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:07.211066 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-7179751e-a5c9-49b8-a1b8-d2225e4f9786 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.172874 Jun 17 13:21:07.211638 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 879/1787] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:07 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:07.825675 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-9d16c3bf-929e-430a-b829-d03af5135c58 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:07.826275 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-9d16c3bf-929e-430a-b829-d03af5135c58 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:07.833658 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9d16c3bf-929e-430a-b829-d03af5135c58 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:07.834120 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9d16c3bf-929e-430a-b829-d03af5135c58 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:07.834906 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9d16c3bf-929e-430a-b829-d03af5135c58 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:07.835357 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9d16c3bf-929e-430a-b829-d03af5135c58 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:07.996483 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-9d16c3bf-929e-430a-b829-d03af5135c58 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:08.006493 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-9d16c3bf-929e-430a-b829-d03af5135c58 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.184720 Jun 17 13:21:08.007071 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 909/1788] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:07 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:08.229726 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-2a84a94e-a041-4aa9-a5f9-89b66ea9594c tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:08.230401 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-2a84a94e-a041-4aa9-a5f9-89b66ea9594c tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:08.233100 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_api:SELECT=52 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:21:08.238764 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2a84a94e-a041-4aa9-a5f9-89b66ea9594c tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:08.239189 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2a84a94e-a041-4aa9-a5f9-89b66ea9594c tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:08.240044 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2a84a94e-a041-4aa9-a5f9-89b66ea9594c tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:08.240411 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2a84a94e-a041-4aa9-a5f9-89b66ea9594c tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:08.383199 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-2a84a94e-a041-4aa9-a5f9-89b66ea9594c tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:08.393066 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-2a84a94e-a041-4aa9-a5f9-89b66ea9594c tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.167259 Jun 17 13:21:08.393620 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 880/1789] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:08 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:09.024059 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-d52e0bc7-8d07-4cd2-bc6c-5eed1e67cf66 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:09.024656 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-d52e0bc7-8d07-4cd2-bc6c-5eed1e67cf66 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:09.031619 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d52e0bc7-8d07-4cd2-bc6c-5eed1e67cf66 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:09.032062 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d52e0bc7-8d07-4cd2-bc6c-5eed1e67cf66 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:09.032813 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d52e0bc7-8d07-4cd2-bc6c-5eed1e67cf66 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:09.033267 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d52e0bc7-8d07-4cd2-bc6c-5eed1e67cf66 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:09.168513 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-d52e0bc7-8d07-4cd2-bc6c-5eed1e67cf66 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:09.177180 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-d52e0bc7-8d07-4cd2-bc6c-5eed1e67cf66 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.157123 Jun 17 13:21:09.177850 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 910/1790] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:09 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:09.416617 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-a9cbf8cc-702f-43eb-8ce7-d2a9a14f9b8d tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:09.417269 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-a9cbf8cc-702f-43eb-8ce7-d2a9a14f9b8d tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:09.427774 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a9cbf8cc-702f-43eb-8ce7-d2a9a14f9b8d tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:09.428212 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a9cbf8cc-702f-43eb-8ce7-d2a9a14f9b8d tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:09.428963 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a9cbf8cc-702f-43eb-8ce7-d2a9a14f9b8d tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:09.429385 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a9cbf8cc-702f-43eb-8ce7-d2a9a14f9b8d tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:09.577398 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-a9cbf8cc-702f-43eb-8ce7-d2a9a14f9b8d tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:09.586225 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-a9cbf8cc-702f-43eb-8ce7-d2a9a14f9b8d tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.176078 Jun 17 13:21:09.586799 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 881/1791] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:09 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:10.199409 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-e434563a-9fe8-403c-9598-3257995b0e92 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:10.200578 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-e434563a-9fe8-403c-9598-3257995b0e92 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:10.210809 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e434563a-9fe8-403c-9598-3257995b0e92 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:10.211263 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e434563a-9fe8-403c-9598-3257995b0e92 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:10.212023 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e434563a-9fe8-403c-9598-3257995b0e92 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:10.212455 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e434563a-9fe8-403c-9598-3257995b0e92 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:10.362129 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-e434563a-9fe8-403c-9598-3257995b0e92 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:10.370501 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-e434563a-9fe8-403c-9598-3257995b0e92 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.178311 Jun 17 13:21:10.371063 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 911/1792] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:10 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:10.609198 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-39af2c4e-0ccb-4425-9d52-d2a9f1567e62 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:10.610118 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-39af2c4e-0ccb-4425-9d52-d2a9f1567e62 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:10.621269 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-39af2c4e-0ccb-4425-9d52-d2a9f1567e62 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:10.622014 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-39af2c4e-0ccb-4425-9d52-d2a9f1567e62 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:10.623329 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-39af2c4e-0ccb-4425-9d52-d2a9f1567e62 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:10.624056 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-39af2c4e-0ccb-4425-9d52-d2a9f1567e62 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:10.764097 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-39af2c4e-0ccb-4425-9d52-d2a9f1567e62 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:10.772899 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-39af2c4e-0ccb-4425-9d52-d2a9f1567e62 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.170983 Jun 17 13:21:10.773466 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 882/1793] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:10 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:11.392099 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-9cf95e9b-00f1-4e64-98d3-9d858ca88dca tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:11.393153 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-9cf95e9b-00f1-4e64-98d3-9d858ca88dca tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:11.404975 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9cf95e9b-00f1-4e64-98d3-9d858ca88dca tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:11.405725 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9cf95e9b-00f1-4e64-98d3-9d858ca88dca tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:11.407111 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9cf95e9b-00f1-4e64-98d3-9d858ca88dca tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:11.407820 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9cf95e9b-00f1-4e64-98d3-9d858ca88dca tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:11.563155 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-9cf95e9b-00f1-4e64-98d3-9d858ca88dca tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:11.576106 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-9cf95e9b-00f1-4e64-98d3-9d858ca88dca tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.190237 Jun 17 13:21:11.576891 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 912/1794] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:11 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:11.793382 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-1abccb61-3689-43eb-bc9a-df432f5e5723 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:11.794464 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-1abccb61-3689-43eb-bc9a-df432f5e5723 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:11.804668 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1abccb61-3689-43eb-bc9a-df432f5e5723 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:11.805124 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1abccb61-3689-43eb-bc9a-df432f5e5723 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:11.805870 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1abccb61-3689-43eb-bc9a-df432f5e5723 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:11.806370 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1abccb61-3689-43eb-bc9a-df432f5e5723 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:11.934576 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-1abccb61-3689-43eb-bc9a-df432f5e5723 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:11.942990 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-1abccb61-3689-43eb-bc9a-df432f5e5723 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.155671 Jun 17 13:21:11.943613 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 883/1795] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:11 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:12.600107 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-e9a2fe46-6546-4053-9da0-00d0bace4bbf tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:12.600806 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-e9a2fe46-6546-4053-9da0-00d0bace4bbf tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:12.611699 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e9a2fe46-6546-4053-9da0-00d0bace4bbf tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:12.612366 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e9a2fe46-6546-4053-9da0-00d0bace4bbf tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:12.613553 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e9a2fe46-6546-4053-9da0-00d0bace4bbf tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:12.614232 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e9a2fe46-6546-4053-9da0-00d0bace4bbf tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:12.748623 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-e9a2fe46-6546-4053-9da0-00d0bace4bbf tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:12.757498 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-e9a2fe46-6546-4053-9da0-00d0bace4bbf tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.163725 Jun 17 13:21:12.758074 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 913/1796] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:12 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:12.964643 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-b2d9cf94-4c0e-41d6-9b8a-f449ffe996fc tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:12.965689 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-b2d9cf94-4c0e-41d6-9b8a-f449ffe996fc tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:12.976175 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b2d9cf94-4c0e-41d6-9b8a-f449ffe996fc tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:12.976614 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b2d9cf94-4c0e-41d6-9b8a-f449ffe996fc tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:12.977360 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b2d9cf94-4c0e-41d6-9b8a-f449ffe996fc tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:12.977785 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b2d9cf94-4c0e-41d6-9b8a-f449ffe996fc tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:13.138059 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-b2d9cf94-4c0e-41d6-9b8a-f449ffe996fc tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:13.146461 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-b2d9cf94-4c0e-41d6-9b8a-f449ffe996fc tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.188280 Jun 17 13:21:13.147284 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 884/1797] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:12 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:13.779334 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-ea0dac5e-9985-45cf-bde7-4df801edd69c tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:13.780375 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-ea0dac5e-9985-45cf-bde7-4df801edd69c tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:13.790364 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ea0dac5e-9985-45cf-bde7-4df801edd69c tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:13.790812 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ea0dac5e-9985-45cf-bde7-4df801edd69c tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:13.791581 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ea0dac5e-9985-45cf-bde7-4df801edd69c tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:13.792024 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ea0dac5e-9985-45cf-bde7-4df801edd69c tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:13.944302 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-ea0dac5e-9985-45cf-bde7-4df801edd69c tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:13.952696 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-ea0dac5e-9985-45cf-bde7-4df801edd69c tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.180329 Jun 17 13:21:13.953261 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 914/1798] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:13 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:14.166544 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-bf804267-c223-46e1-b60b-c61f409b2313 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:14.167141 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-bf804267-c223-46e1-b60b-c61f409b2313 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:14.174704 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bf804267-c223-46e1-b60b-c61f409b2313 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:14.175199 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bf804267-c223-46e1-b60b-c61f409b2313 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:14.176049 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bf804267-c223-46e1-b60b-c61f409b2313 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:14.176498 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bf804267-c223-46e1-b60b-c61f409b2313 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:14.322055 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-bf804267-c223-46e1-b60b-c61f409b2313 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:14.330158 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-bf804267-c223-46e1-b60b-c61f409b2313 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.168546 Jun 17 13:21:14.330732 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 885/1799] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:14 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:14.970791 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-97d3c781-22e6-41e1-9041-3e770088ac97 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:14.971875 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-97d3c781-22e6-41e1-9041-3e770088ac97 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:14.975147 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_api:SELECT=52 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:21:14.981163 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-97d3c781-22e6-41e1-9041-3e770088ac97 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:14.981620 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-97d3c781-22e6-41e1-9041-3e770088ac97 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:14.982454 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-97d3c781-22e6-41e1-9041-3e770088ac97 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:14.982875 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-97d3c781-22e6-41e1-9041-3e770088ac97 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:15.118847 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-97d3c781-22e6-41e1-9041-3e770088ac97 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:15.127326 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-97d3c781-22e6-41e1-9041-3e770088ac97 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.161047 Jun 17 13:21:15.127943 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 915/1800] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:14 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:15.347291 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-64b8f8a5-593e-463b-b858-da2a3cb365a2 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:15.347925 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-64b8f8a5-593e-463b-b858-da2a3cb365a2 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:15.355111 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-64b8f8a5-593e-463b-b858-da2a3cb365a2 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:15.355903 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-64b8f8a5-593e-463b-b858-da2a3cb365a2 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:15.356665 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-64b8f8a5-593e-463b-b858-da2a3cb365a2 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:15.357088 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-64b8f8a5-593e-463b-b858-da2a3cb365a2 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:15.492056 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-64b8f8a5-593e-463b-b858-da2a3cb365a2 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:15.500768 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-64b8f8a5-593e-463b-b858-da2a3cb365a2 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.157508 Jun 17 13:21:15.501344 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 886/1801] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:15 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:16.148068 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-e15951a7-fef4-4c17-b6c1-f41b0f2c1c37 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:16.148967 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-e15951a7-fef4-4c17-b6c1-f41b0f2c1c37 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:16.159251 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e15951a7-fef4-4c17-b6c1-f41b0f2c1c37 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:16.159946 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e15951a7-fef4-4c17-b6c1-f41b0f2c1c37 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:16.161103 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e15951a7-fef4-4c17-b6c1-f41b0f2c1c37 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:16.161766 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e15951a7-fef4-4c17-b6c1-f41b0f2c1c37 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:16.296954 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-e15951a7-fef4-4c17-b6c1-f41b0f2c1c37 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:16.308456 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-e15951a7-fef4-4c17-b6c1-f41b0f2c1c37 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.166555 Jun 17 13:21:16.309070 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 916/1802] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:16 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:16.518008 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-09e1cba7-918e-43df-81a9-76946c969f4c tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:16.518649 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-09e1cba7-918e-43df-81a9-76946c969f4c tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:16.525865 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-09e1cba7-918e-43df-81a9-76946c969f4c tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:16.526349 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-09e1cba7-918e-43df-81a9-76946c969f4c tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:16.527115 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-09e1cba7-918e-43df-81a9-76946c969f4c tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:16.527549 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-09e1cba7-918e-43df-81a9-76946c969f4c tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:16.668203 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-09e1cba7-918e-43df-81a9-76946c969f4c tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:16.676587 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-09e1cba7-918e-43df-81a9-76946c969f4c tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.162441 Jun 17 13:21:16.677157 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 887/1803] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:16 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:17.332300 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-908faf71-600c-4369-908f-77274dbaaaf9 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:17.333145 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-908faf71-600c-4369-908f-77274dbaaaf9 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:17.340852 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-908faf71-600c-4369-908f-77274dbaaaf9 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:17.341307 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-908faf71-600c-4369-908f-77274dbaaaf9 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:17.342065 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-908faf71-600c-4369-908f-77274dbaaaf9 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:17.342536 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-908faf71-600c-4369-908f-77274dbaaaf9 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:17.500748 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-908faf71-600c-4369-908f-77274dbaaaf9 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:17.509051 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-908faf71-600c-4369-908f-77274dbaaaf9 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.182849 Jun 17 13:21:17.509625 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 917/1804] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:17 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:17.696122 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-58f20155-ade4-4dea-a13e-4f5df0d5e074 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:17.696701 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-58f20155-ade4-4dea-a13e-4f5df0d5e074 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:17.703801 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-58f20155-ade4-4dea-a13e-4f5df0d5e074 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:17.704278 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-58f20155-ade4-4dea-a13e-4f5df0d5e074 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:17.705029 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-58f20155-ade4-4dea-a13e-4f5df0d5e074 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:17.705452 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-58f20155-ade4-4dea-a13e-4f5df0d5e074 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:17.846285 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-58f20155-ade4-4dea-a13e-4f5df0d5e074 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:17.855033 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-58f20155-ade4-4dea-a13e-4f5df0d5e074 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.163962 Jun 17 13:21:17.855951 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 888/1805] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:17 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:18.527998 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-01cce9fb-ba5c-4e9e-be7e-949c2cc25aba tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:18.528626 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-01cce9fb-ba5c-4e9e-be7e-949c2cc25aba tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:18.536020 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-01cce9fb-ba5c-4e9e-be7e-949c2cc25aba tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:18.536471 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-01cce9fb-ba5c-4e9e-be7e-949c2cc25aba tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:18.537230 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-01cce9fb-ba5c-4e9e-be7e-949c2cc25aba tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:18.537662 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-01cce9fb-ba5c-4e9e-be7e-949c2cc25aba tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:18.673087 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-01cce9fb-ba5c-4e9e-be7e-949c2cc25aba tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:18.678139 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_cell1:SELECT=100 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:21:18.683305 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-01cce9fb-ba5c-4e9e-be7e-949c2cc25aba tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.159232 Jun 17 13:21:18.683855 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 918/1806] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:18 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:18.877020 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-8e1a45d7-a315-4e1c-92bf-7077b27bd7bb tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:18.877956 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-8e1a45d7-a315-4e1c-92bf-7077b27bd7bb tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:18.889101 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8e1a45d7-a315-4e1c-92bf-7077b27bd7bb tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:18.889848 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8e1a45d7-a315-4e1c-92bf-7077b27bd7bb tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:18.891158 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8e1a45d7-a315-4e1c-92bf-7077b27bd7bb tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:18.891880 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8e1a45d7-a315-4e1c-92bf-7077b27bd7bb tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:19.027403 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-8e1a45d7-a315-4e1c-92bf-7077b27bd7bb tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:19.035836 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-8e1a45d7-a315-4e1c-92bf-7077b27bd7bb tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.165365 Jun 17 13:21:19.036408 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 889/1807] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:18 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:19.700863 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-8aba4445-8b98-4b74-ab8c-dc02d8781ca3 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:19.701502 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-8aba4445-8b98-4b74-ab8c-dc02d8781ca3 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:19.708409 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8aba4445-8b98-4b74-ab8c-dc02d8781ca3 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:19.708850 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8aba4445-8b98-4b74-ab8c-dc02d8781ca3 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:19.709601 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8aba4445-8b98-4b74-ab8c-dc02d8781ca3 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:19.710032 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8aba4445-8b98-4b74-ab8c-dc02d8781ca3 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:19.861244 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-8aba4445-8b98-4b74-ab8c-dc02d8781ca3 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:19.874610 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-8aba4445-8b98-4b74-ab8c-dc02d8781ca3 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.177411 Jun 17 13:21:19.875346 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 919/1808] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:19 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:20.058567 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-294c11e5-5119-41a2-826d-6fee0ba27a2c tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:20.059647 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-294c11e5-5119-41a2-826d-6fee0ba27a2c tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:20.070028 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-294c11e5-5119-41a2-826d-6fee0ba27a2c tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:20.070830 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-294c11e5-5119-41a2-826d-6fee0ba27a2c tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:20.072271 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-294c11e5-5119-41a2-826d-6fee0ba27a2c tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:20.072711 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-294c11e5-5119-41a2-826d-6fee0ba27a2c tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:20.213137 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-294c11e5-5119-41a2-826d-6fee0ba27a2c tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:20.221769 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-294c11e5-5119-41a2-826d-6fee0ba27a2c tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.170863 Jun 17 13:21:20.222391 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 890/1809] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:20 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:20.896386 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-27233579-1eb9-4fb9-a370-998946f818e7 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:20.897272 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-27233579-1eb9-4fb9-a370-998946f818e7 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:20.906273 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-27233579-1eb9-4fb9-a370-998946f818e7 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:20.906722 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-27233579-1eb9-4fb9-a370-998946f818e7 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:20.907475 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-27233579-1eb9-4fb9-a370-998946f818e7 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:20.907902 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-27233579-1eb9-4fb9-a370-998946f818e7 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:21.046004 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-27233579-1eb9-4fb9-a370-998946f818e7 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:21.054655 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-27233579-1eb9-4fb9-a370-998946f818e7 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.164957 Jun 17 13:21:21.055266 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 920/1810] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:20 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:21.243350 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-321b297c-10f6-4ab6-904d-897e248d2e65 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:21.244281 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-321b297c-10f6-4ab6-904d-897e248d2e65 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:21.255360 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-321b297c-10f6-4ab6-904d-897e248d2e65 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:21.256097 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-321b297c-10f6-4ab6-904d-897e248d2e65 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:21.257366 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-321b297c-10f6-4ab6-904d-897e248d2e65 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:21.258233 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-321b297c-10f6-4ab6-904d-897e248d2e65 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:21.396937 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-321b297c-10f6-4ab6-904d-897e248d2e65 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:21.405325 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-321b297c-10f6-4ab6-904d-897e248d2e65 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.168727 Jun 17 13:21:21.405883 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 891/1811] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:21 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:22.076279 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-058b4b8e-f914-4fef-8b97-03f040c5a02b tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:22.077156 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-058b4b8e-f914-4fef-8b97-03f040c5a02b tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:22.088102 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-058b4b8e-f914-4fef-8b97-03f040c5a02b tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:22.088764 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-058b4b8e-f914-4fef-8b97-03f040c5a02b tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:22.089880 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-058b4b8e-f914-4fef-8b97-03f040c5a02b tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:22.090508 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-058b4b8e-f914-4fef-8b97-03f040c5a02b tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:22.231197 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-058b4b8e-f914-4fef-8b97-03f040c5a02b tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:22.239327 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-058b4b8e-f914-4fef-8b97-03f040c5a02b tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.169923 Jun 17 13:21:22.239902 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 921/1812] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:22 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:22.422999 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-45e6efde-93f0-43c4-8022-7e658714db77 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:22.423780 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-45e6efde-93f0-43c4-8022-7e658714db77 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:22.430593 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-45e6efde-93f0-43c4-8022-7e658714db77 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:22.431029 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-45e6efde-93f0-43c4-8022-7e658714db77 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:22.431797 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-45e6efde-93f0-43c4-8022-7e658714db77 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:22.432229 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-45e6efde-93f0-43c4-8022-7e658714db77 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:22.571472 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-45e6efde-93f0-43c4-8022-7e658714db77 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:22.575159 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=100 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:21:22.581059 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-45e6efde-93f0-43c4-8022-7e658714db77 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.162038 Jun 17 13:21:22.581617 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 892/1813] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:22 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:23.265243 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-b2fda45f-596a-4287-bf48-d2aa366b0116 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:23.266247 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-b2fda45f-596a-4287-bf48-d2aa366b0116 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:23.277492 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b2fda45f-596a-4287-bf48-d2aa366b0116 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:23.277971 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b2fda45f-596a-4287-bf48-d2aa366b0116 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:23.278768 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b2fda45f-596a-4287-bf48-d2aa366b0116 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:23.279202 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b2fda45f-596a-4287-bf48-d2aa366b0116 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:23.471143 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-b2fda45f-596a-4287-bf48-d2aa366b0116 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:23.479693 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-b2fda45f-596a-4287-bf48-d2aa366b0116 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.221002 Jun 17 13:21:23.490494 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 922/1814] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:23 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:23.598760 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-4d3989f6-9447-4fec-a5e1-f7a115ce7adb tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:23.599360 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-4d3989f6-9447-4fec-a5e1-f7a115ce7adb tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:23.606914 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4d3989f6-9447-4fec-a5e1-f7a115ce7adb tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:23.607360 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4d3989f6-9447-4fec-a5e1-f7a115ce7adb tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:23.608129 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4d3989f6-9447-4fec-a5e1-f7a115ce7adb tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:23.608558 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4d3989f6-9447-4fec-a5e1-f7a115ce7adb tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:23.788721 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-4d3989f6-9447-4fec-a5e1-f7a115ce7adb tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:23.797779 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-4d3989f6-9447-4fec-a5e1-f7a115ce7adb tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.202979 Jun 17 13:21:23.798364 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 893/1815] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:23 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:24.502596 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-ebb76ca8-89b7-4cfb-8d70-fcc25ad12c75 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:24.503545 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-ebb76ca8-89b7-4cfb-8d70-fcc25ad12c75 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:24.513995 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ebb76ca8-89b7-4cfb-8d70-fcc25ad12c75 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:24.514485 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ebb76ca8-89b7-4cfb-8d70-fcc25ad12c75 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:24.515234 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ebb76ca8-89b7-4cfb-8d70-fcc25ad12c75 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:24.515847 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ebb76ca8-89b7-4cfb-8d70-fcc25ad12c75 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:24.652957 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-ebb76ca8-89b7-4cfb-8d70-fcc25ad12c75 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:24.661583 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-ebb76ca8-89b7-4cfb-8d70-fcc25ad12c75 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.165786 Jun 17 13:21:24.662152 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 923/1816] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:24 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:24.816929 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-ea2d1ebd-9fba-4599-bc0e-7d676e614fdd tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:24.817661 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-ea2d1ebd-9fba-4599-bc0e-7d676e614fdd tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:24.827170 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ea2d1ebd-9fba-4599-bc0e-7d676e614fdd tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:24.827775 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ea2d1ebd-9fba-4599-bc0e-7d676e614fdd tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:24.828826 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ea2d1ebd-9fba-4599-bc0e-7d676e614fdd tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:24.829414 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ea2d1ebd-9fba-4599-bc0e-7d676e614fdd tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:24.975097 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-ea2d1ebd-9fba-4599-bc0e-7d676e614fdd tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:24.984109 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-ea2d1ebd-9fba-4599-bc0e-7d676e614fdd tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.172398 Jun 17 13:21:24.984782 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 894/1817] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:24 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:25.680434 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-cea244ad-b810-4eb4-a332-c26c48ed353a tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:25.681062 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-cea244ad-b810-4eb4-a332-c26c48ed353a tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:25.689146 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-cea244ad-b810-4eb4-a332-c26c48ed353a tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:25.689660 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-cea244ad-b810-4eb4-a332-c26c48ed353a tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:25.690572 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-cea244ad-b810-4eb4-a332-c26c48ed353a tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:25.691065 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-cea244ad-b810-4eb4-a332-c26c48ed353a tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:25.826471 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-cea244ad-b810-4eb4-a332-c26c48ed353a tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:25.834762 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-cea244ad-b810-4eb4-a332-c26c48ed353a tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.158888 Jun 17 13:21:25.835387 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 924/1818] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:25 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:26.001520 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-b549bc90-cd2c-4f8a-905f-11cff82797d2 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:26.002121 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-b549bc90-cd2c-4f8a-905f-11cff82797d2 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:26.009082 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b549bc90-cd2c-4f8a-905f-11cff82797d2 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:26.009530 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b549bc90-cd2c-4f8a-905f-11cff82797d2 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:26.010387 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b549bc90-cd2c-4f8a-905f-11cff82797d2 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:26.010756 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b549bc90-cd2c-4f8a-905f-11cff82797d2 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:26.141097 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-b549bc90-cd2c-4f8a-905f-11cff82797d2 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:26.149731 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-b549bc90-cd2c-4f8a-905f-11cff82797d2 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.152843 Jun 17 13:21:26.150309 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 895/1819] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:25 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:26.852414 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-204b82b4-65b7-48b1-80d1-7b4cfb768323 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:26.853053 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-204b82b4-65b7-48b1-80d1-7b4cfb768323 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:26.860022 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-204b82b4-65b7-48b1-80d1-7b4cfb768323 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:26.860471 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-204b82b4-65b7-48b1-80d1-7b4cfb768323 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:26.861226 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-204b82b4-65b7-48b1-80d1-7b4cfb768323 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:26.861663 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-204b82b4-65b7-48b1-80d1-7b4cfb768323 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:26.997067 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-204b82b4-65b7-48b1-80d1-7b4cfb768323 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:27.006128 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-204b82b4-65b7-48b1-80d1-7b4cfb768323 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.157470 Jun 17 13:21:27.006750 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 925/1820] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:26 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:27.170451 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-97422895-0da9-4fbb-afce-f2f70f474913 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:27.171851 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-97422895-0da9-4fbb-afce-f2f70f474913 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:27.179010 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-97422895-0da9-4fbb-afce-f2f70f474913 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:27.179453 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-97422895-0da9-4fbb-afce-f2f70f474913 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:27.180218 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-97422895-0da9-4fbb-afce-f2f70f474913 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:27.180649 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-97422895-0da9-4fbb-afce-f2f70f474913 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:27.317031 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-97422895-0da9-4fbb-afce-f2f70f474913 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:27.328920 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-97422895-0da9-4fbb-afce-f2f70f474913 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.165105 Jun 17 13:21:27.329527 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 896/1821] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:27 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:28.027585 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-ad18d09f-c3cd-4129-8fa6-a3869ec5b5b1 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:28.028617 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-ad18d09f-c3cd-4129-8fa6-a3869ec5b5b1 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:28.039744 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ad18d09f-c3cd-4129-8fa6-a3869ec5b5b1 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:28.040481 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ad18d09f-c3cd-4129-8fa6-a3869ec5b5b1 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:28.041716 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ad18d09f-c3cd-4129-8fa6-a3869ec5b5b1 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:28.042590 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ad18d09f-c3cd-4129-8fa6-a3869ec5b5b1 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:28.186516 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-ad18d09f-c3cd-4129-8fa6-a3869ec5b5b1 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:28.195675 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-ad18d09f-c3cd-4129-8fa6-a3869ec5b5b1 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.174602 Jun 17 13:21:28.196255 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 926/1822] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:28 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:28.353177 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-9be26856-ff55-486e-8ba5-708e9e381ee4 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:28.353953 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-9be26856-ff55-486e-8ba5-708e9e381ee4 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:28.363396 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9be26856-ff55-486e-8ba5-708e9e381ee4 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:28.364010 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9be26856-ff55-486e-8ba5-708e9e381ee4 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:28.365061 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9be26856-ff55-486e-8ba5-708e9e381ee4 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:28.365687 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9be26856-ff55-486e-8ba5-708e9e381ee4 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:28.504917 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-9be26856-ff55-486e-8ba5-708e9e381ee4 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:28.518340 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-9be26856-ff55-486e-8ba5-708e9e381ee4 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.170561 Jun 17 13:21:28.519272 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 897/1823] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:28 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:29.212780 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-9415186b-43c3-4d89-a714-2d9835638a5c tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:29.213398 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-9415186b-43c3-4d89-a714-2d9835638a5c tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:29.221998 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9415186b-43c3-4d89-a714-2d9835638a5c tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:29.222701 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9415186b-43c3-4d89-a714-2d9835638a5c tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:29.223872 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9415186b-43c3-4d89-a714-2d9835638a5c tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:29.224544 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9415186b-43c3-4d89-a714-2d9835638a5c tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:29.373380 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-9415186b-43c3-4d89-a714-2d9835638a5c tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:29.383141 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-9415186b-43c3-4d89-a714-2d9835638a5c tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.174247 Jun 17 13:21:29.383714 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 927/1824] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:29 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:29.540888 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-8aa4edfb-1e96-4f08-afbd-f882da9851f1 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:29.541893 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-8aa4edfb-1e96-4f08-afbd-f882da9851f1 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:29.551432 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8aa4edfb-1e96-4f08-afbd-f882da9851f1 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:29.551881 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8aa4edfb-1e96-4f08-afbd-f882da9851f1 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:29.552645 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8aa4edfb-1e96-4f08-afbd-f882da9851f1 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:29.553075 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8aa4edfb-1e96-4f08-afbd-f882da9851f1 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:29.688798 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-8aa4edfb-1e96-4f08-afbd-f882da9851f1 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:29.697592 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-8aa4edfb-1e96-4f08-afbd-f882da9851f1 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.164161 Jun 17 13:21:29.698204 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 898/1825] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:29 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:30.404159 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-402d4ff8-ec25-474e-87a6-8adee934382a tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:30.405111 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-402d4ff8-ec25-474e-87a6-8adee934382a tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:30.415145 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-402d4ff8-ec25-474e-87a6-8adee934382a tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:30.415771 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-402d4ff8-ec25-474e-87a6-8adee934382a tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:30.416994 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-402d4ff8-ec25-474e-87a6-8adee934382a tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:30.417694 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-402d4ff8-ec25-474e-87a6-8adee934382a tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:30.553657 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-402d4ff8-ec25-474e-87a6-8adee934382a tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:30.565161 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-402d4ff8-ec25-474e-87a6-8adee934382a tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.166494 Jun 17 13:21:30.565986 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 928/1826] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:30 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:30.718895 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-4cb3bb77-d079-46f1-bda3-6a46d328410b tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:30.719869 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-4cb3bb77-d079-46f1-bda3-6a46d328410b tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:30.731487 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4cb3bb77-d079-46f1-bda3-6a46d328410b tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:30.732233 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4cb3bb77-d079-46f1-bda3-6a46d328410b tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:30.733470 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4cb3bb77-d079-46f1-bda3-6a46d328410b tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:30.734178 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4cb3bb77-d079-46f1-bda3-6a46d328410b tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:30.886157 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-4cb3bb77-d079-46f1-bda3-6a46d328410b tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:30.895069 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-4cb3bb77-d079-46f1-bda3-6a46d328410b tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.182699 Jun 17 13:21:30.895692 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 899/1827] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:30 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:31.592107 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-643cf80e-bd90-4586-aef8-5912b246fbb7 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:31.592989 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-643cf80e-bd90-4586-aef8-5912b246fbb7 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:31.601491 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-643cf80e-bd90-4586-aef8-5912b246fbb7 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:31.601943 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-643cf80e-bd90-4586-aef8-5912b246fbb7 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:31.602737 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-643cf80e-bd90-4586-aef8-5912b246fbb7 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:31.603167 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-643cf80e-bd90-4586-aef8-5912b246fbb7 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:31.737977 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-643cf80e-bd90-4586-aef8-5912b246fbb7 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:31.746078 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-643cf80e-bd90-4586-aef8-5912b246fbb7 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.160726 Jun 17 13:21:31.746670 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 929/1828] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:31 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:31.916989 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-16c2cc69-6ea5-4b40-9fc0-15057ceec30c tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:31.917995 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-16c2cc69-6ea5-4b40-9fc0-15057ceec30c tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:31.927669 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-16c2cc69-6ea5-4b40-9fc0-15057ceec30c tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:31.928122 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-16c2cc69-6ea5-4b40-9fc0-15057ceec30c tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:31.928886 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-16c2cc69-6ea5-4b40-9fc0-15057ceec30c tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:31.929314 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-16c2cc69-6ea5-4b40-9fc0-15057ceec30c tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:32.068727 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-16c2cc69-6ea5-4b40-9fc0-15057ceec30c tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:32.085760 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-16c2cc69-6ea5-4b40-9fc0-15057ceec30c tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.175148 Jun 17 13:21:32.086624 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 900/1829] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:31 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:32.767732 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-03f930b8-6448-4d1b-b6c7-faf5eab25bdc tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:32.768712 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-03f930b8-6448-4d1b-b6c7-faf5eab25bdc tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:32.777141 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-03f930b8-6448-4d1b-b6c7-faf5eab25bdc tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:32.777589 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-03f930b8-6448-4d1b-b6c7-faf5eab25bdc tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:32.778399 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-03f930b8-6448-4d1b-b6c7-faf5eab25bdc tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:32.778834 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-03f930b8-6448-4d1b-b6c7-faf5eab25bdc tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:32.911049 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-03f930b8-6448-4d1b-b6c7-faf5eab25bdc tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:32.920002 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-03f930b8-6448-4d1b-b6c7-faf5eab25bdc tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.158941 Jun 17 13:21:32.920622 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 930/1830] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:32 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:33.112758 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-8de4fc05-041a-4cd5-a2a1-5f535ec39230 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:33.113677 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-8de4fc05-041a-4cd5-a2a1-5f535ec39230 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:33.124813 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8de4fc05-041a-4cd5-a2a1-5f535ec39230 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:33.125547 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8de4fc05-041a-4cd5-a2a1-5f535ec39230 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:33.126847 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8de4fc05-041a-4cd5-a2a1-5f535ec39230 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:33.127550 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8de4fc05-041a-4cd5-a2a1-5f535ec39230 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:33.259060 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-8de4fc05-041a-4cd5-a2a1-5f535ec39230 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:33.267445 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-8de4fc05-041a-4cd5-a2a1-5f535ec39230 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.161189 Jun 17 13:21:33.268024 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 901/1831] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:33 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:33.940529 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-18de873b-fa02-40e1-932c-5aa74b4c7d43 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:33.941512 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-18de873b-fa02-40e1-932c-5aa74b4c7d43 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:33.949604 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-18de873b-fa02-40e1-932c-5aa74b4c7d43 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:33.950051 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-18de873b-fa02-40e1-932c-5aa74b4c7d43 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:33.950829 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-18de873b-fa02-40e1-932c-5aa74b4c7d43 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:33.951256 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-18de873b-fa02-40e1-932c-5aa74b4c7d43 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:34.094062 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-18de873b-fa02-40e1-932c-5aa74b4c7d43 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:34.102482 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-18de873b-fa02-40e1-932c-5aa74b4c7d43 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.168140 Jun 17 13:21:34.103055 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 931/1832] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:33 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:34.288958 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-8d0c054d-3523-42f5-a8b3-6c7992425932 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:34.289872 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-8d0c054d-3523-42f5-a8b3-6c7992425932 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:34.300672 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8d0c054d-3523-42f5-a8b3-6c7992425932 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:34.301412 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8d0c054d-3523-42f5-a8b3-6c7992425932 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:34.302720 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8d0c054d-3523-42f5-a8b3-6c7992425932 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:34.303548 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8d0c054d-3523-42f5-a8b3-6c7992425932 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:34.438289 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-8d0c054d-3523-42f5-a8b3-6c7992425932 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:34.446609 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-8d0c054d-3523-42f5-a8b3-6c7992425932 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.164379 Jun 17 13:21:34.447347 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 902/1833] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:34 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:35.119691 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-02932c82-5c3c-41b8-a04f-0686a096ca71 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:35.120441 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-02932c82-5c3c-41b8-a04f-0686a096ca71 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:35.127408 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-02932c82-5c3c-41b8-a04f-0686a096ca71 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:35.129599 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-02932c82-5c3c-41b8-a04f-0686a096ca71 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:35.130410 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-02932c82-5c3c-41b8-a04f-0686a096ca71 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:35.130981 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-02932c82-5c3c-41b8-a04f-0686a096ca71 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:35.270726 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-02932c82-5c3c-41b8-a04f-0686a096ca71 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:35.279256 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-02932c82-5c3c-41b8-a04f-0686a096ca71 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.163728 Jun 17 13:21:35.279897 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 932/1834] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:35 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:35.467607 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-bdd013b4-3c5e-4c9e-9045-769f36228918 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:35.468681 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-bdd013b4-3c5e-4c9e-9045-769f36228918 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:35.477998 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bdd013b4-3c5e-4c9e-9045-769f36228918 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:35.478472 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bdd013b4-3c5e-4c9e-9045-769f36228918 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:35.479232 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bdd013b4-3c5e-4c9e-9045-769f36228918 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:35.479657 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bdd013b4-3c5e-4c9e-9045-769f36228918 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:35.619096 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-bdd013b4-3c5e-4c9e-9045-769f36228918 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:35.627327 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-bdd013b4-3c5e-4c9e-9045-769f36228918 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.165725 Jun 17 13:21:35.627896 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 903/1835] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:35 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:36.300786 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-f6f22e26-e132-4fd7-b440-8bed0cc0d682 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:36.301796 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-f6f22e26-e132-4fd7-b440-8bed0cc0d682 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:36.309528 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f6f22e26-e132-4fd7-b440-8bed0cc0d682 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:36.309976 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f6f22e26-e132-4fd7-b440-8bed0cc0d682 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:36.310798 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f6f22e26-e132-4fd7-b440-8bed0cc0d682 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:36.311231 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f6f22e26-e132-4fd7-b440-8bed0cc0d682 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:36.452417 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-f6f22e26-e132-4fd7-b440-8bed0cc0d682 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:36.465438 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-f6f22e26-e132-4fd7-b440-8bed0cc0d682 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.171119 Jun 17 13:21:36.466283 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 933/1836] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:36 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:36.644446 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-a9fd2fbf-8b36-4068-b7dc-c205a1e9e4d1 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:36.645260 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-a9fd2fbf-8b36-4068-b7dc-c205a1e9e4d1 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:36.653023 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a9fd2fbf-8b36-4068-b7dc-c205a1e9e4d1 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:36.653483 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a9fd2fbf-8b36-4068-b7dc-c205a1e9e4d1 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:36.654276 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a9fd2fbf-8b36-4068-b7dc-c205a1e9e4d1 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:36.654706 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a9fd2fbf-8b36-4068-b7dc-c205a1e9e4d1 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:36.789976 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-a9fd2fbf-8b36-4068-b7dc-c205a1e9e4d1 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:36.798127 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-a9fd2fbf-8b36-4068-b7dc-c205a1e9e4d1 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.157545 Jun 17 13:21:36.798704 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 904/1837] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:36 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:37.493423 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-c609480d-2c8d-476f-8a09-7127a6a04e67 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:37.494495 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-c609480d-2c8d-476f-8a09-7127a6a04e67 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:37.505544 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c609480d-2c8d-476f-8a09-7127a6a04e67 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:37.506236 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c609480d-2c8d-476f-8a09-7127a6a04e67 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:37.507581 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c609480d-2c8d-476f-8a09-7127a6a04e67 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:37.508025 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c609480d-2c8d-476f-8a09-7127a6a04e67 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:37.655191 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-c609480d-2c8d-476f-8a09-7127a6a04e67 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:37.663376 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-c609480d-2c8d-476f-8a09-7127a6a04e67 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.176995 Jun 17 13:21:37.664069 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 934/1838] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:37 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:37.819772 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-290346f6-0543-4b42-89f4-8bdf73d83cbd tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:37.821015 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-290346f6-0543-4b42-89f4-8bdf73d83cbd tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:37.832268 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-290346f6-0543-4b42-89f4-8bdf73d83cbd tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:37.833066 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-290346f6-0543-4b42-89f4-8bdf73d83cbd tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:37.834526 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-290346f6-0543-4b42-89f4-8bdf73d83cbd tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:37.835437 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-290346f6-0543-4b42-89f4-8bdf73d83cbd tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:37.979748 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-290346f6-0543-4b42-89f4-8bdf73d83cbd tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:37.988652 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-290346f6-0543-4b42-89f4-8bdf73d83cbd tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.175622 Jun 17 13:21:37.989229 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 905/1839] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:37 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:38.681900 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-5fe6ce17-5cb4-4ee6-a2d7-f839534e1b38 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:38.682519 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-5fe6ce17-5cb4-4ee6-a2d7-f839534e1b38 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:38.689454 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-5fe6ce17-5cb4-4ee6-a2d7-f839534e1b38 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:38.689908 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-5fe6ce17-5cb4-4ee6-a2d7-f839534e1b38 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:38.690684 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-5fe6ce17-5cb4-4ee6-a2d7-f839534e1b38 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:38.691286 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-5fe6ce17-5cb4-4ee6-a2d7-f839534e1b38 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:38.709541 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_cell1:SELECT=100 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:21:38.824544 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-5fe6ce17-5cb4-4ee6-a2d7-f839534e1b38 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:38.832752 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-5fe6ce17-5cb4-4ee6-a2d7-f839534e1b38 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.155369 Jun 17 13:21:38.833325 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 935/1840] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:38 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:39.006700 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-da49c428-3012-4ea5-9a02-ec6843a7153d tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:39.007794 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-da49c428-3012-4ea5-9a02-ec6843a7153d tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:39.010284 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_api:SELECT=52 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:21:39.015873 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-da49c428-3012-4ea5-9a02-ec6843a7153d tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:39.016317 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-da49c428-3012-4ea5-9a02-ec6843a7153d tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:39.017085 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-da49c428-3012-4ea5-9a02-ec6843a7153d tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:39.017518 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-da49c428-3012-4ea5-9a02-ec6843a7153d tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:39.158623 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-da49c428-3012-4ea5-9a02-ec6843a7153d tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:39.168758 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-da49c428-3012-4ea5-9a02-ec6843a7153d tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.166113 Jun 17 13:21:39.169309 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 906/1841] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:39 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:39.849981 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-c320f022-c145-4036-8ea1-83d3c9501dcd tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:39.850644 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-c320f022-c145-4036-8ea1-83d3c9501dcd tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:39.858602 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c320f022-c145-4036-8ea1-83d3c9501dcd tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:39.858988 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c320f022-c145-4036-8ea1-83d3c9501dcd tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:39.859751 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c320f022-c145-4036-8ea1-83d3c9501dcd tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:39.860191 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c320f022-c145-4036-8ea1-83d3c9501dcd tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:40.001042 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-c320f022-c145-4036-8ea1-83d3c9501dcd tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:40.009643 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-c320f022-c145-4036-8ea1-83d3c9501dcd tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.163563 Jun 17 13:21:40.010244 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 936/1842] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:39 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:40.190486 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-e5407ec1-758f-47bd-b553-4365ddee4c90 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:40.191503 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-e5407ec1-758f-47bd-b553-4365ddee4c90 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:40.202880 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e5407ec1-758f-47bd-b553-4365ddee4c90 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:40.203624 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e5407ec1-758f-47bd-b553-4365ddee4c90 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:40.204927 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e5407ec1-758f-47bd-b553-4365ddee4c90 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:40.205644 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e5407ec1-758f-47bd-b553-4365ddee4c90 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:40.345985 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-e5407ec1-758f-47bd-b553-4365ddee4c90 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:40.358830 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-e5407ec1-758f-47bd-b553-4365ddee4c90 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.174477 Jun 17 13:21:40.359571 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 907/1843] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:40 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:41.030932 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-355f1352-0a5c-4a14-b7cd-2e8a5fb5ae75 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:41.031911 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-355f1352-0a5c-4a14-b7cd-2e8a5fb5ae75 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:41.043491 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-355f1352-0a5c-4a14-b7cd-2e8a5fb5ae75 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:41.044101 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-355f1352-0a5c-4a14-b7cd-2e8a5fb5ae75 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:41.045379 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-355f1352-0a5c-4a14-b7cd-2e8a5fb5ae75 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:41.046139 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-355f1352-0a5c-4a14-b7cd-2e8a5fb5ae75 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:41.187570 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-355f1352-0a5c-4a14-b7cd-2e8a5fb5ae75 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:41.198706 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-355f1352-0a5c-4a14-b7cd-2e8a5fb5ae75 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.174293 Jun 17 13:21:41.199283 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 937/1844] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:41 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:41.380640 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-6fbbd88b-7144-4c52-bb18-8d5c3cd97fc0 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:41.381398 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-6fbbd88b-7144-4c52-bb18-8d5c3cd97fc0 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:41.388865 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6fbbd88b-7144-4c52-bb18-8d5c3cd97fc0 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:41.389313 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6fbbd88b-7144-4c52-bb18-8d5c3cd97fc0 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:41.390116 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6fbbd88b-7144-4c52-bb18-8d5c3cd97fc0 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:41.390550 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6fbbd88b-7144-4c52-bb18-8d5c3cd97fc0 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:41.525015 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-6fbbd88b-7144-4c52-bb18-8d5c3cd97fc0 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:41.533208 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-6fbbd88b-7144-4c52-bb18-8d5c3cd97fc0 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.157253 Jun 17 13:21:41.533980 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 908/1845] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:41 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:42.220402 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-bbd640d4-6195-4da0-b5a8-00c7596d1367 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:42.221372 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-bbd640d4-6195-4da0-b5a8-00c7596d1367 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:42.232914 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-bbd640d4-6195-4da0-b5a8-00c7596d1367 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:42.233662 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-bbd640d4-6195-4da0-b5a8-00c7596d1367 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:42.235079 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-bbd640d4-6195-4da0-b5a8-00c7596d1367 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:42.235851 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-bbd640d4-6195-4da0-b5a8-00c7596d1367 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:42.382120 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-bbd640d4-6195-4da0-b5a8-00c7596d1367 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:42.390927 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-bbd640d4-6195-4da0-b5a8-00c7596d1367 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.177309 Jun 17 13:21:42.391537 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 938/1846] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:42 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:42.553840 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-e22b553c-7714-461c-bc22-4008940e1c72 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:42.554445 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-e22b553c-7714-461c-bc22-4008940e1c72 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:42.560984 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e22b553c-7714-461c-bc22-4008940e1c72 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:42.561457 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e22b553c-7714-461c-bc22-4008940e1c72 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:42.562268 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e22b553c-7714-461c-bc22-4008940e1c72 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:42.562701 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e22b553c-7714-461c-bc22-4008940e1c72 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:42.581702 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=100 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:21:42.704680 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-e22b553c-7714-461c-bc22-4008940e1c72 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:42.715810 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-e22b553c-7714-461c-bc22-4008940e1c72 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.167785 Jun 17 13:21:42.716386 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 909/1847] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:42 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:43.409397 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-6e801d08-e1a9-4e65-ad80-5facd0ef7169 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:43.409996 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-6e801d08-e1a9-4e65-ad80-5facd0ef7169 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:43.417394 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6e801d08-e1a9-4e65-ad80-5facd0ef7169 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:43.417860 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6e801d08-e1a9-4e65-ad80-5facd0ef7169 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:43.418793 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6e801d08-e1a9-4e65-ad80-5facd0ef7169 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:43.419252 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6e801d08-e1a9-4e65-ad80-5facd0ef7169 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:43.555919 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-6e801d08-e1a9-4e65-ad80-5facd0ef7169 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:43.565083 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-6e801d08-e1a9-4e65-ad80-5facd0ef7169 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.159770 Jun 17 13:21:43.565592 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 939/1848] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:43 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:43.742810 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-d183f93c-639a-4253-a933-3d700c256995 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:43.743874 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-d183f93c-639a-4253-a933-3d700c256995 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:43.755025 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d183f93c-639a-4253-a933-3d700c256995 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:43.755771 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d183f93c-639a-4253-a933-3d700c256995 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:43.757051 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d183f93c-639a-4253-a933-3d700c256995 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:43.757771 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d183f93c-639a-4253-a933-3d700c256995 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:43.890785 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-d183f93c-639a-4253-a933-3d700c256995 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:43.902864 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-d183f93c-639a-4253-a933-3d700c256995 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.166480 Jun 17 13:21:43.903558 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 910/1849] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:43 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:44.586337 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-73204739-e1dd-4301-8c02-e4354f6aaa0a tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:44.587299 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-73204739-e1dd-4301-8c02-e4354f6aaa0a tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:44.598421 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-73204739-e1dd-4301-8c02-e4354f6aaa0a tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:44.599172 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-73204739-e1dd-4301-8c02-e4354f6aaa0a tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:44.600389 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-73204739-e1dd-4301-8c02-e4354f6aaa0a tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:44.601204 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-73204739-e1dd-4301-8c02-e4354f6aaa0a tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:44.735594 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-73204739-e1dd-4301-8c02-e4354f6aaa0a tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:44.743895 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-73204739-e1dd-4301-8c02-e4354f6aaa0a tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.164051 Jun 17 13:21:44.744449 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 940/1850] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:44 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:44.920449 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-598e6962-8b26-4c00-af78-1d5a3f9ae4b6 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:44.921224 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-598e6962-8b26-4c00-af78-1d5a3f9ae4b6 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:44.931492 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-598e6962-8b26-4c00-af78-1d5a3f9ae4b6 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:44.932072 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-598e6962-8b26-4c00-af78-1d5a3f9ae4b6 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:44.933150 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-598e6962-8b26-4c00-af78-1d5a3f9ae4b6 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:44.933832 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-598e6962-8b26-4c00-af78-1d5a3f9ae4b6 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:45.083035 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-598e6962-8b26-4c00-af78-1d5a3f9ae4b6 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:45.091270 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-598e6962-8b26-4c00-af78-1d5a3f9ae4b6 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.174881 Jun 17 13:21:45.091856 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 911/1851] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:44 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:45.765981 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-3be20244-eae3-446b-a397-f510a96009fb tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:45.767062 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-3be20244-eae3-446b-a397-f510a96009fb tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:45.770752 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_api:SELECT=52 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:21:45.780182 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-3be20244-eae3-446b-a397-f510a96009fb tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:45.780634 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-3be20244-eae3-446b-a397-f510a96009fb tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:45.781424 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-3be20244-eae3-446b-a397-f510a96009fb tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:45.781858 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-3be20244-eae3-446b-a397-f510a96009fb tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:45.925701 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-3be20244-eae3-446b-a397-f510a96009fb tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:45.933950 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-3be20244-eae3-446b-a397-f510a96009fb tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.175473 Jun 17 13:21:45.934915 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 941/1852] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:45 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:46.114612 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-73c598f2-ef21-4686-bdba-ea072309e3a6 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:46.115696 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-73c598f2-ef21-4686-bdba-ea072309e3a6 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:46.126564 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-73c598f2-ef21-4686-bdba-ea072309e3a6 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:46.127306 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-73c598f2-ef21-4686-bdba-ea072309e3a6 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:46.128551 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-73c598f2-ef21-4686-bdba-ea072309e3a6 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:46.129258 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-73c598f2-ef21-4686-bdba-ea072309e3a6 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:46.267543 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-73c598f2-ef21-4686-bdba-ea072309e3a6 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:46.280394 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-73c598f2-ef21-4686-bdba-ea072309e3a6 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.171896 Jun 17 13:21:46.281556 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 912/1853] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:46 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:46.953317 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-70520c90-ed0f-46fa-976c-62d1297cf58d tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:46.953927 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-70520c90-ed0f-46fa-976c-62d1297cf58d tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:46.960962 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-70520c90-ed0f-46fa-976c-62d1297cf58d tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:46.961412 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-70520c90-ed0f-46fa-976c-62d1297cf58d tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:46.962202 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-70520c90-ed0f-46fa-976c-62d1297cf58d tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:46.962633 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-70520c90-ed0f-46fa-976c-62d1297cf58d tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:47.099202 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-70520c90-ed0f-46fa-976c-62d1297cf58d tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:47.108143 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-70520c90-ed0f-46fa-976c-62d1297cf58d tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.159450 Jun 17 13:21:47.108770 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 942/1854] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:46 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:47.303748 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-036a9e45-d469-4ea5-9b0d-46a8b0791f6c tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:47.304308 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-036a9e45-d469-4ea5-9b0d-46a8b0791f6c tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:47.311461 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-036a9e45-d469-4ea5-9b0d-46a8b0791f6c tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:47.311910 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-036a9e45-d469-4ea5-9b0d-46a8b0791f6c tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:47.312691 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-036a9e45-d469-4ea5-9b0d-46a8b0791f6c tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:47.313157 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-036a9e45-d469-4ea5-9b0d-46a8b0791f6c tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:47.450022 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-036a9e45-d469-4ea5-9b0d-46a8b0791f6c tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:47.458742 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-036a9e45-d469-4ea5-9b0d-46a8b0791f6c tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.158826 Jun 17 13:21:47.459279 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 913/1855] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:47 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:48.128518 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-09f09ae7-a65a-4c46-935c-c7ec9f530b02 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:48.129491 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-09f09ae7-a65a-4c46-935c-c7ec9f530b02 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:48.140426 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-09f09ae7-a65a-4c46-935c-c7ec9f530b02 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:48.140918 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-09f09ae7-a65a-4c46-935c-c7ec9f530b02 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:48.141755 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-09f09ae7-a65a-4c46-935c-c7ec9f530b02 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:48.142246 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-09f09ae7-a65a-4c46-935c-c7ec9f530b02 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:48.280200 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-09f09ae7-a65a-4c46-935c-c7ec9f530b02 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:48.288857 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-09f09ae7-a65a-4c46-935c-c7ec9f530b02 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.166614 Jun 17 13:21:48.289444 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 943/1856] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:48 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:48.480227 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-befc86c5-a54a-4e54-9c78-69c9c420ce1d tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:48.481476 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-befc86c5-a54a-4e54-9c78-69c9c420ce1d tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:48.489475 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-befc86c5-a54a-4e54-9c78-69c9c420ce1d tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:48.489914 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-befc86c5-a54a-4e54-9c78-69c9c420ce1d tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:48.490772 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-befc86c5-a54a-4e54-9c78-69c9c420ce1d tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:48.491196 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-befc86c5-a54a-4e54-9c78-69c9c420ce1d tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:48.627639 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-befc86c5-a54a-4e54-9c78-69c9c420ce1d tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:48.635782 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-befc86c5-a54a-4e54-9c78-69c9c420ce1d tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.162326 Jun 17 13:21:48.636356 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 914/1857] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:48 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:49.310199 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-974b8648-df00-45a9-882e-bc18adccebfe tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:49.311352 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-974b8648-df00-45a9-882e-bc18adccebfe tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:49.318780 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-974b8648-df00-45a9-882e-bc18adccebfe tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:49.319237 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-974b8648-df00-45a9-882e-bc18adccebfe tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:49.320026 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-974b8648-df00-45a9-882e-bc18adccebfe tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:49.320609 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-974b8648-df00-45a9-882e-bc18adccebfe tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:49.459719 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-974b8648-df00-45a9-882e-bc18adccebfe tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:49.468252 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-974b8648-df00-45a9-882e-bc18adccebfe tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.164444 Jun 17 13:21:49.468824 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 944/1858] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:49 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 13:21:49.653284 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-b4f2e2fe-f215-4b68-ace4-20b0f5e7e0e7 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:49.653964 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-b4f2e2fe-f215-4b68-ace4-20b0f5e7e0e7 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:49.660666 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b4f2e2fe-f215-4b68-ace4-20b0f5e7e0e7 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:49.661117 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b4f2e2fe-f215-4b68-ace4-20b0f5e7e0e7 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:49.661879 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b4f2e2fe-f215-4b68-ace4-20b0f5e7e0e7 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:49.662350 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b4f2e2fe-f215-4b68-ace4-20b0f5e7e0e7 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:49.805699 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-b4f2e2fe-f215-4b68-ace4-20b0f5e7e0e7 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:49.816429 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-b4f2e2fe-f215-4b68-ace4-20b0f5e7e0e7 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.167054 Jun 17 13:21:49.817333 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 915/1859] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:49 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:50.488129 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-6145ca06-d580-4987-9e48-7c539a7e49ee tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:50.488736 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-6145ca06-d580-4987-9e48-7c539a7e49ee tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:50.498008 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6145ca06-d580-4987-9e48-7c539a7e49ee tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:50.498598 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6145ca06-d580-4987-9e48-7c539a7e49ee tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:50.499767 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6145ca06-d580-4987-9e48-7c539a7e49ee tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:50.500180 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6145ca06-d580-4987-9e48-7c539a7e49ee tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:50.650539 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-6145ca06-d580-4987-9e48-7c539a7e49ee tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:50.662880 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-6145ca06-d580-4987-9e48-7c539a7e49ee tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.179005 Jun 17 13:21:50.663733 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 945/1860] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:50 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:50.839959 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-a300beb2-ddb1-46bd-b293-dfaa3f2bb1a4 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:50.840866 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-a300beb2-ddb1-46bd-b293-dfaa3f2bb1a4 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:50.849188 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a300beb2-ddb1-46bd-b293-dfaa3f2bb1a4 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:50.849632 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a300beb2-ddb1-46bd-b293-dfaa3f2bb1a4 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:50.850415 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a300beb2-ddb1-46bd-b293-dfaa3f2bb1a4 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:50.850843 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a300beb2-ddb1-46bd-b293-dfaa3f2bb1a4 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:50.995619 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-a300beb2-ddb1-46bd-b293-dfaa3f2bb1a4 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:51.004765 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-a300beb2-ddb1-46bd-b293-dfaa3f2bb1a4 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.171021 Jun 17 13:21:51.005526 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 916/1861] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:50 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:51.687537 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-930ee6c0-8da9-462b-953b-68a2ebef150a tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:51.688481 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-930ee6c0-8da9-462b-953b-68a2ebef150a tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:51.697475 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-930ee6c0-8da9-462b-953b-68a2ebef150a tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:51.698150 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-930ee6c0-8da9-462b-953b-68a2ebef150a tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:51.699245 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-930ee6c0-8da9-462b-953b-68a2ebef150a tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:51.699878 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-930ee6c0-8da9-462b-953b-68a2ebef150a tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:51.844702 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-930ee6c0-8da9-462b-953b-68a2ebef150a tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:51.857150 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-930ee6c0-8da9-462b-953b-68a2ebef150a tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.175903 Jun 17 13:21:51.857753 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 946/1862] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:51 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:52.027010 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-295e14e7-aad5-4ad8-8300-309bf81363d6 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:52.028007 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-295e14e7-aad5-4ad8-8300-309bf81363d6 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:52.039301 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-295e14e7-aad5-4ad8-8300-309bf81363d6 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:52.039936 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-295e14e7-aad5-4ad8-8300-309bf81363d6 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:52.041181 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-295e14e7-aad5-4ad8-8300-309bf81363d6 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:52.041889 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-295e14e7-aad5-4ad8-8300-309bf81363d6 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:52.430330 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-295e14e7-aad5-4ad8-8300-309bf81363d6 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:52.438777 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-295e14e7-aad5-4ad8-8300-309bf81363d6 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.418365 Jun 17 13:21:52.439373 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 917/1863] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:52 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:52.875666 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-adff03dc-be70-46e3-8cb5-85aac5147e6d tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:52.876276 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-adff03dc-be70-46e3-8cb5-85aac5147e6d tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:52.883045 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-adff03dc-be70-46e3-8cb5-85aac5147e6d tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:52.883491 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-adff03dc-be70-46e3-8cb5-85aac5147e6d tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:52.884236 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-adff03dc-be70-46e3-8cb5-85aac5147e6d tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:52.884663 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-adff03dc-be70-46e3-8cb5-85aac5147e6d tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:53.021962 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-adff03dc-be70-46e3-8cb5-85aac5147e6d tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:53.033439 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-adff03dc-be70-46e3-8cb5-85aac5147e6d tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.161622 Jun 17 13:21:53.033997 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 947/1864] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:52 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:53.456465 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-d460e09d-1d8b-43a6-ae0b-cd6f03b15320 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:53.457086 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-d460e09d-1d8b-43a6-ae0b-cd6f03b15320 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:53.464275 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d460e09d-1d8b-43a6-ae0b-cd6f03b15320 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:53.464722 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d460e09d-1d8b-43a6-ae0b-cd6f03b15320 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:53.465495 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d460e09d-1d8b-43a6-ae0b-cd6f03b15320 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:53.465920 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d460e09d-1d8b-43a6-ae0b-cd6f03b15320 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:53.606860 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-d460e09d-1d8b-43a6-ae0b-cd6f03b15320 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:53.616414 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-d460e09d-1d8b-43a6-ae0b-cd6f03b15320 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.163871 Jun 17 13:21:53.617131 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 918/1865] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:53 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:54.054475 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-0a3ad7c1-3a86-4588-8878-4e6d35670a38 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:54.055469 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-0a3ad7c1-3a86-4588-8878-4e6d35670a38 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:54.065334 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0a3ad7c1-3a86-4588-8878-4e6d35670a38 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:54.065777 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0a3ad7c1-3a86-4588-8878-4e6d35670a38 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:54.066567 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0a3ad7c1-3a86-4588-8878-4e6d35670a38 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:54.067005 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0a3ad7c1-3a86-4588-8878-4e6d35670a38 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:54.201685 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-0a3ad7c1-3a86-4588-8878-4e6d35670a38 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:54.210381 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-0a3ad7c1-3a86-4588-8878-4e6d35670a38 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.162405 Jun 17 13:21:54.210979 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 948/1866] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:54 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:54.632805 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-cb251c16-8514-4a2e-bd74-51a451d080b4 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:54.633371 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-cb251c16-8514-4a2e-bd74-51a451d080b4 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:54.640217 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cb251c16-8514-4a2e-bd74-51a451d080b4 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:54.640642 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cb251c16-8514-4a2e-bd74-51a451d080b4 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:54.641458 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cb251c16-8514-4a2e-bd74-51a451d080b4 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:54.641849 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cb251c16-8514-4a2e-bd74-51a451d080b4 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:54.775328 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-cb251c16-8514-4a2e-bd74-51a451d080b4 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:54.785065 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-cb251c16-8514-4a2e-bd74-51a451d080b4 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.156228 Jun 17 13:21:54.785637 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 919/1867] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:54 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:55.232228 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-baddb594-e9b3-4a38-bc00-ef2612aeb15b tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:55.233238 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-baddb594-e9b3-4a38-bc00-ef2612aeb15b tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:55.244237 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-baddb594-e9b3-4a38-bc00-ef2612aeb15b tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:55.244932 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-baddb594-e9b3-4a38-bc00-ef2612aeb15b tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:55.246261 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-baddb594-e9b3-4a38-bc00-ef2612aeb15b tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:55.246976 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-baddb594-e9b3-4a38-bc00-ef2612aeb15b tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:55.384032 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-baddb594-e9b3-4a38-bc00-ef2612aeb15b tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:55.393830 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-baddb594-e9b3-4a38-bc00-ef2612aeb15b tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.168243 Jun 17 13:21:55.394679 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 949/1868] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:55 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:55.804894 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-9a83ff50-ad4a-4a30-bae3-069dc4d13d41 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:55.805670 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-9a83ff50-ad4a-4a30-bae3-069dc4d13d41 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:55.816157 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9a83ff50-ad4a-4a30-bae3-069dc4d13d41 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:55.816841 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9a83ff50-ad4a-4a30-bae3-069dc4d13d41 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:55.818005 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9a83ff50-ad4a-4a30-bae3-069dc4d13d41 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:55.818721 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9a83ff50-ad4a-4a30-bae3-069dc4d13d41 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:55.962898 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-9a83ff50-ad4a-4a30-bae3-069dc4d13d41 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:55.971262 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-9a83ff50-ad4a-4a30-bae3-069dc4d13d41 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.172580 Jun 17 13:21:55.971825 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 920/1869] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:55 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:56.417663 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-367b0847-c250-4fb3-9d05-fb57598e1f4f tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:56.418457 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-367b0847-c250-4fb3-9d05-fb57598e1f4f tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:56.426844 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-367b0847-c250-4fb3-9d05-fb57598e1f4f tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:56.427294 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-367b0847-c250-4fb3-9d05-fb57598e1f4f tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:56.428050 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-367b0847-c250-4fb3-9d05-fb57598e1f4f tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:56.428481 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-367b0847-c250-4fb3-9d05-fb57598e1f4f tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:56.570416 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-367b0847-c250-4fb3-9d05-fb57598e1f4f tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:56.578706 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-367b0847-c250-4fb3-9d05-fb57598e1f4f tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.166096 Jun 17 13:21:56.579646 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 950/1870] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:56 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:56.990976 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-dc57277f-5151-4c16-9cfc-ed0659a75896 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:56.991746 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-dc57277f-5151-4c16-9cfc-ed0659a75896 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:57.000160 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dc57277f-5151-4c16-9cfc-ed0659a75896 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:57.000956 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dc57277f-5151-4c16-9cfc-ed0659a75896 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:57.001826 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dc57277f-5151-4c16-9cfc-ed0659a75896 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:57.002306 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dc57277f-5151-4c16-9cfc-ed0659a75896 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:57.142037 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-dc57277f-5151-4c16-9cfc-ed0659a75896 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:57.150450 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-dc57277f-5151-4c16-9cfc-ed0659a75896 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.164380 Jun 17 13:21:57.151031 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 921/1871] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:56 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:57.600258 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-fe087eb2-e181-4f6e-ac85-018a5b4fb573 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:57.600636 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-fe087eb2-e181-4f6e-ac85-018a5b4fb573 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:57.608050 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-fe087eb2-e181-4f6e-ac85-018a5b4fb573 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:57.608524 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-fe087eb2-e181-4f6e-ac85-018a5b4fb573 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:57.609302 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-fe087eb2-e181-4f6e-ac85-018a5b4fb573 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:57.609742 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-fe087eb2-e181-4f6e-ac85-018a5b4fb573 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:57.756908 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-fe087eb2-e181-4f6e-ac85-018a5b4fb573 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:57.765515 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-fe087eb2-e181-4f6e-ac85-018a5b4fb573 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.170866 Jun 17 13:21:57.765994 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 951/1872] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:57 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:58.167659 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-b5ed8c9f-18ac-4543-8f4a-90d0c6038b89 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:58.168262 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-b5ed8c9f-18ac-4543-8f4a-90d0c6038b89 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:58.175968 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b5ed8c9f-18ac-4543-8f4a-90d0c6038b89 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:58.176418 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b5ed8c9f-18ac-4543-8f4a-90d0c6038b89 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:58.177180 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b5ed8c9f-18ac-4543-8f4a-90d0c6038b89 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:58.177607 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b5ed8c9f-18ac-4543-8f4a-90d0c6038b89 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:58.318578 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-b5ed8c9f-18ac-4543-8f4a-90d0c6038b89 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:58.326927 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-b5ed8c9f-18ac-4543-8f4a-90d0c6038b89 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.163271 Jun 17 13:21:58.327467 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 922/1873] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:58 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:58.786901 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-be30f7b5-b392-441e-b957-ca34845be073 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:58.787859 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-be30f7b5-b392-441e-b957-ca34845be073 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:58.798611 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-be30f7b5-b392-441e-b957-ca34845be073 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:58.799604 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-be30f7b5-b392-441e-b957-ca34845be073 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:58.800381 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-be30f7b5-b392-441e-b957-ca34845be073 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:58.800816 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-be30f7b5-b392-441e-b957-ca34845be073 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:58.804875 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_cell1:SELECT=100 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:21:58.940578 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-be30f7b5-b392-441e-b957-ca34845be073 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:58.948795 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-be30f7b5-b392-441e-b957-ca34845be073 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.168931 Jun 17 13:21:58.949373 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 952/1874] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:58 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:59.345712 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-9d615a04-9195-4432-9611-a71c2cac0a53 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:59.346654 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-9d615a04-9195-4432-9611-a71c2cac0a53 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:59.354376 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9d615a04-9195-4432-9611-a71c2cac0a53 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:59.354872 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9d615a04-9195-4432-9611-a71c2cac0a53 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:59.356072 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9d615a04-9195-4432-9611-a71c2cac0a53 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:59.356560 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9d615a04-9195-4432-9611-a71c2cac0a53 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:59.490644 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-9d615a04-9195-4432-9611-a71c2cac0a53 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:21:59.498984 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-9d615a04-9195-4432-9611-a71c2cac0a53 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.157853 Jun 17 13:21:59.499563 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 923/1875] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:59 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:21:59.970466 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-506f656a-a8dc-4ac7-ae1e-8faf3bfb0850 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:21:59.971129 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-506f656a-a8dc-4ac7-ae1e-8faf3bfb0850 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:21:59.977924 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-506f656a-a8dc-4ac7-ae1e-8faf3bfb0850 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:59.978501 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-506f656a-a8dc-4ac7-ae1e-8faf3bfb0850 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:21:59.979152 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-506f656a-a8dc-4ac7-ae1e-8faf3bfb0850 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:21:59.979578 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-506f656a-a8dc-4ac7-ae1e-8faf3bfb0850 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:00.109787 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-506f656a-a8dc-4ac7-ae1e-8faf3bfb0850 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:00.117892 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-506f656a-a8dc-4ac7-ae1e-8faf3bfb0850 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.151246 Jun 17 13:22:00.118494 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 953/1876] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:21:59 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:00.521232 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-d49b2a02-0bc3-4f4d-9d63-9f9bececa4f9 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:00.522355 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-d49b2a02-0bc3-4f4d-9d63-9f9bececa4f9 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:00.534081 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d49b2a02-0bc3-4f4d-9d63-9f9bececa4f9 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:00.534560 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d49b2a02-0bc3-4f4d-9d63-9f9bececa4f9 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:00.535364 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d49b2a02-0bc3-4f4d-9d63-9f9bececa4f9 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:00.535798 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d49b2a02-0bc3-4f4d-9d63-9f9bececa4f9 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:00.676988 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-d49b2a02-0bc3-4f4d-9d63-9f9bececa4f9 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:00.689708 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-d49b2a02-0bc3-4f4d-9d63-9f9bececa4f9 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.175462 Jun 17 13:22:00.690322 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 924/1877] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:00 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:01.136193 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-119986bc-5b31-4a54-84f4-aed5538de6d8 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:01.136910 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-119986bc-5b31-4a54-84f4-aed5538de6d8 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:01.144952 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-119986bc-5b31-4a54-84f4-aed5538de6d8 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:01.145399 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-119986bc-5b31-4a54-84f4-aed5538de6d8 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:01.146159 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-119986bc-5b31-4a54-84f4-aed5538de6d8 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:01.146618 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-119986bc-5b31-4a54-84f4-aed5538de6d8 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:01.286703 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-119986bc-5b31-4a54-84f4-aed5538de6d8 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:01.300164 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-119986bc-5b31-4a54-84f4-aed5538de6d8 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.168277 Jun 17 13:22:01.301006 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 954/1878] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:01 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:01.711416 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-b763ebdb-ce73-45e4-910a-47197ff2a93b tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:01.712334 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-b763ebdb-ce73-45e4-910a-47197ff2a93b tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:01.723715 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b763ebdb-ce73-45e4-910a-47197ff2a93b tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:01.724444 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b763ebdb-ce73-45e4-910a-47197ff2a93b tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:01.725683 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b763ebdb-ce73-45e4-910a-47197ff2a93b tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:01.726446 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b763ebdb-ce73-45e4-910a-47197ff2a93b tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:01.877366 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-b763ebdb-ce73-45e4-910a-47197ff2a93b tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:01.886116 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-b763ebdb-ce73-45e4-910a-47197ff2a93b tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.181630 Jun 17 13:22:01.886728 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 925/1879] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:01 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:02.326296 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-e514800a-82aa-4854-b881-ee8a05a21ec3 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:02.327344 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-e514800a-82aa-4854-b881-ee8a05a21ec3 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:02.335607 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e514800a-82aa-4854-b881-ee8a05a21ec3 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:02.336052 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e514800a-82aa-4854-b881-ee8a05a21ec3 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:02.336808 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e514800a-82aa-4854-b881-ee8a05a21ec3 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:02.337241 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e514800a-82aa-4854-b881-ee8a05a21ec3 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:02.469731 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-e514800a-82aa-4854-b881-ee8a05a21ec3 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:02.478336 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-e514800a-82aa-4854-b881-ee8a05a21ec3 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.158466 Jun 17 13:22:02.478913 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 955/1880] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:02 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:02.904115 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-e97d59d8-79ba-49c9-94b7-aec73064d6e9 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:02.904737 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-e97d59d8-79ba-49c9-94b7-aec73064d6e9 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:02.911867 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e97d59d8-79ba-49c9-94b7-aec73064d6e9 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:02.912318 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e97d59d8-79ba-49c9-94b7-aec73064d6e9 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:02.913083 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e97d59d8-79ba-49c9-94b7-aec73064d6e9 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:02.913515 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e97d59d8-79ba-49c9-94b7-aec73064d6e9 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:02.917539 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=100 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:22:03.047215 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-e97d59d8-79ba-49c9-94b7-aec73064d6e9 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:03.055393 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-e97d59d8-79ba-49c9-94b7-aec73064d6e9 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.155197 Jun 17 13:22:03.055971 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 926/1881] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:02 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:03.502570 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-b8185569-a7fe-46d7-ac1e-6f024a72f134 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:03.503258 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-b8185569-a7fe-46d7-ac1e-6f024a72f134 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:03.511206 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b8185569-a7fe-46d7-ac1e-6f024a72f134 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:03.511730 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b8185569-a7fe-46d7-ac1e-6f024a72f134 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:03.512602 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b8185569-a7fe-46d7-ac1e-6f024a72f134 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:03.513102 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b8185569-a7fe-46d7-ac1e-6f024a72f134 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:03.660066 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-b8185569-a7fe-46d7-ac1e-6f024a72f134 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:03.668260 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-b8185569-a7fe-46d7-ac1e-6f024a72f134 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.172148 Jun 17 13:22:03.669405 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 956/1882] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:03 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:04.078239 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-2a98c865-81ee-4e0b-8264-8ece071a3a9c tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:04.078797 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-2a98c865-81ee-4e0b-8264-8ece071a3a9c tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:04.086117 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2a98c865-81ee-4e0b-8264-8ece071a3a9c tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:04.086564 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2a98c865-81ee-4e0b-8264-8ece071a3a9c tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:04.087319 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2a98c865-81ee-4e0b-8264-8ece071a3a9c tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:04.087741 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2a98c865-81ee-4e0b-8264-8ece071a3a9c tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:04.233686 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-2a98c865-81ee-4e0b-8264-8ece071a3a9c tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:04.241878 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-2a98c865-81ee-4e0b-8264-8ece071a3a9c tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.167553 Jun 17 13:22:04.242401 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 927/1883] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:04 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:04.701068 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-c733469e-3a5e-4ab9-9121-86c085817497 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:04.701750 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-c733469e-3a5e-4ab9-9121-86c085817497 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:04.709722 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c733469e-3a5e-4ab9-9121-86c085817497 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:04.710189 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c733469e-3a5e-4ab9-9121-86c085817497 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:04.710930 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c733469e-3a5e-4ab9-9121-86c085817497 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:04.711355 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c733469e-3a5e-4ab9-9121-86c085817497 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:04.857261 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-c733469e-3a5e-4ab9-9121-86c085817497 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:04.866120 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-c733469e-3a5e-4ab9-9121-86c085817497 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.171449 Jun 17 13:22:04.866717 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 957/1884] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:04 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:05.258341 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-702e98a5-2618-4d14-8d16-1ae637fe0264 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:05.259085 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-702e98a5-2618-4d14-8d16-1ae637fe0264 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:05.265947 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-702e98a5-2618-4d14-8d16-1ae637fe0264 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:05.266446 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-702e98a5-2618-4d14-8d16-1ae637fe0264 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:05.267220 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-702e98a5-2618-4d14-8d16-1ae637fe0264 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:05.267713 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-702e98a5-2618-4d14-8d16-1ae637fe0264 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:05.398838 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-702e98a5-2618-4d14-8d16-1ae637fe0264 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:05.411630 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-702e98a5-2618-4d14-8d16-1ae637fe0264 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.157134 Jun 17 13:22:05.412414 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 928/1885] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:05 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:05.883208 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-11f41271-af0c-45a5-828b-e8721a61257e tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:05.883785 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-11f41271-af0c-45a5-828b-e8721a61257e tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:05.890731 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-11f41271-af0c-45a5-828b-e8721a61257e tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:05.891176 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-11f41271-af0c-45a5-828b-e8721a61257e tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:05.891917 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-11f41271-af0c-45a5-828b-e8721a61257e tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:05.892547 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-11f41271-af0c-45a5-828b-e8721a61257e tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:06.027294 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-11f41271-af0c-45a5-828b-e8721a61257e tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:06.036073 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-11f41271-af0c-45a5-828b-e8721a61257e tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.156891 Jun 17 13:22:06.036651 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 958/1886] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:05 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:06.438360 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-31259bc7-08c7-4dee-8217-5f38098c45de tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:06.439472 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-31259bc7-08c7-4dee-8217-5f38098c45de tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:06.446656 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-31259bc7-08c7-4dee-8217-5f38098c45de tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:06.447100 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-31259bc7-08c7-4dee-8217-5f38098c45de tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:06.447863 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-31259bc7-08c7-4dee-8217-5f38098c45de tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:06.448295 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-31259bc7-08c7-4dee-8217-5f38098c45de tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:06.586352 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-31259bc7-08c7-4dee-8217-5f38098c45de tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:06.594763 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-31259bc7-08c7-4dee-8217-5f38098c45de tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.163020 Jun 17 13:22:06.595408 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 929/1887] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:06 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:07.062165 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-7a92427b-69f8-4682-9391-7992812d19f1 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:07.063228 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-7a92427b-69f8-4682-9391-7992812d19f1 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:07.074943 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7a92427b-69f8-4682-9391-7992812d19f1 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:07.075670 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7a92427b-69f8-4682-9391-7992812d19f1 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:07.076905 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7a92427b-69f8-4682-9391-7992812d19f1 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:07.077610 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7a92427b-69f8-4682-9391-7992812d19f1 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:07.377940 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-7a92427b-69f8-4682-9391-7992812d19f1 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:07.386473 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-7a92427b-69f8-4682-9391-7992812d19f1 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.330934 Jun 17 13:22:07.394309 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 959/1888] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:07 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:07.615194 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-ff4be812-3b34-49cd-8591-dbae74f0856c tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:07.615907 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-ff4be812-3b34-49cd-8591-dbae74f0856c tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:07.623904 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ff4be812-3b34-49cd-8591-dbae74f0856c tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:07.624423 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ff4be812-3b34-49cd-8591-dbae74f0856c tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:07.625303 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ff4be812-3b34-49cd-8591-dbae74f0856c tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:07.625803 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ff4be812-3b34-49cd-8591-dbae74f0856c tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:07.771287 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-ff4be812-3b34-49cd-8591-dbae74f0856c tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:07.779754 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-ff4be812-3b34-49cd-8591-dbae74f0856c tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.169884 Jun 17 13:22:07.780293 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 930/1889] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:07 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:08.404380 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-290e24d1-83be-4b37-ab45-48e4f186d43d tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:08.405138 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-290e24d1-83be-4b37-ab45-48e4f186d43d tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:08.412567 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-290e24d1-83be-4b37-ab45-48e4f186d43d tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:08.413034 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-290e24d1-83be-4b37-ab45-48e4f186d43d tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:08.413778 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-290e24d1-83be-4b37-ab45-48e4f186d43d tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:08.414247 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-290e24d1-83be-4b37-ab45-48e4f186d43d tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:08.550697 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-290e24d1-83be-4b37-ab45-48e4f186d43d tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:08.559350 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-290e24d1-83be-4b37-ab45-48e4f186d43d tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.158804 Jun 17 13:22:08.559925 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 960/1890] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:08 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:08.801636 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-801ec4a2-adfc-4d5e-baff-7ebbae3c9aa0 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:08.802681 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-801ec4a2-adfc-4d5e-baff-7ebbae3c9aa0 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:08.813691 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-801ec4a2-adfc-4d5e-baff-7ebbae3c9aa0 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:08.814509 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-801ec4a2-adfc-4d5e-baff-7ebbae3c9aa0 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:08.815798 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-801ec4a2-adfc-4d5e-baff-7ebbae3c9aa0 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:08.816238 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-801ec4a2-adfc-4d5e-baff-7ebbae3c9aa0 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:08.965839 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-801ec4a2-adfc-4d5e-baff-7ebbae3c9aa0 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:08.975790 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-801ec4a2-adfc-4d5e-baff-7ebbae3c9aa0 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.180880 Jun 17 13:22:08.976353 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 931/1891] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:08 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:09.584034 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-73e38537-a0c5-4fd4-8d52-f06a1d32365a tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:09.584866 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-73e38537-a0c5-4fd4-8d52-f06a1d32365a tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:09.597860 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-73e38537-a0c5-4fd4-8d52-f06a1d32365a tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:09.598495 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-73e38537-a0c5-4fd4-8d52-f06a1d32365a tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:09.599648 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-73e38537-a0c5-4fd4-8d52-f06a1d32365a tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:09.600186 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-73e38537-a0c5-4fd4-8d52-f06a1d32365a tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:09.741600 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-73e38537-a0c5-4fd4-8d52-f06a1d32365a tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:09.750296 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-73e38537-a0c5-4fd4-8d52-f06a1d32365a tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.176192 Jun 17 13:22:09.750876 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 961/1892] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:09 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:10.001083 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-967f51f0-d63a-4318-867f-ba800795b591 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:10.001722 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-967f51f0-d63a-4318-867f-ba800795b591 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:10.005373 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_api:SELECT=52 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:22:10.015416 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-967f51f0-d63a-4318-867f-ba800795b591 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:10.015416 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-967f51f0-d63a-4318-867f-ba800795b591 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:10.015416 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-967f51f0-d63a-4318-867f-ba800795b591 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:10.017062 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-967f51f0-d63a-4318-867f-ba800795b591 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:10.176978 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-967f51f0-d63a-4318-867f-ba800795b591 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:10.189244 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-967f51f0-d63a-4318-867f-ba800795b591 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.193043 Jun 17 13:22:10.190120 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 932/1893] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:09 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:10.768510 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-f15b17b7-1913-409c-aa06-17fc331226a0 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:10.769150 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-f15b17b7-1913-409c-aa06-17fc331226a0 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:10.785497 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f15b17b7-1913-409c-aa06-17fc331226a0 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:10.785942 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f15b17b7-1913-409c-aa06-17fc331226a0 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:10.786758 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f15b17b7-1913-409c-aa06-17fc331226a0 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:10.787331 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f15b17b7-1913-409c-aa06-17fc331226a0 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:10.935118 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-f15b17b7-1913-409c-aa06-17fc331226a0 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:10.943532 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-f15b17b7-1913-409c-aa06-17fc331226a0 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.179372 Jun 17 13:22:10.944105 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 962/1894] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:10 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:11.211375 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-3eb23d99-0e19-4202-9799-e640d05f73d7 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:11.212259 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-3eb23d99-0e19-4202-9799-e640d05f73d7 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:11.223337 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3eb23d99-0e19-4202-9799-e640d05f73d7 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:11.223786 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3eb23d99-0e19-4202-9799-e640d05f73d7 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:11.224547 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3eb23d99-0e19-4202-9799-e640d05f73d7 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:11.224973 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3eb23d99-0e19-4202-9799-e640d05f73d7 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:11.361490 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-3eb23d99-0e19-4202-9799-e640d05f73d7 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:11.370356 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-3eb23d99-0e19-4202-9799-e640d05f73d7 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.165804 Jun 17 13:22:11.370935 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 933/1895] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:11 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:11.964986 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-d79b01a4-59a6-49ca-9e5a-149b32a53a63 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:11.965996 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-d79b01a4-59a6-49ca-9e5a-149b32a53a63 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:11.975895 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d79b01a4-59a6-49ca-9e5a-149b32a53a63 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:11.976348 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d79b01a4-59a6-49ca-9e5a-149b32a53a63 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:11.977113 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d79b01a4-59a6-49ca-9e5a-149b32a53a63 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:11.977543 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d79b01a4-59a6-49ca-9e5a-149b32a53a63 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:12.122964 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-d79b01a4-59a6-49ca-9e5a-149b32a53a63 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:12.134917 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-d79b01a4-59a6-49ca-9e5a-149b32a53a63 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.176135 Jun 17 13:22:12.135628 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 963/1896] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:11 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:12.396309 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-2371b6ea-37cf-4a7f-a6c7-2f70a3e53e89 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:12.397396 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-2371b6ea-37cf-4a7f-a6c7-2f70a3e53e89 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:12.408520 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2371b6ea-37cf-4a7f-a6c7-2f70a3e53e89 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:12.409257 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2371b6ea-37cf-4a7f-a6c7-2f70a3e53e89 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:12.410444 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2371b6ea-37cf-4a7f-a6c7-2f70a3e53e89 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:12.410880 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2371b6ea-37cf-4a7f-a6c7-2f70a3e53e89 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:12.559045 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-2371b6ea-37cf-4a7f-a6c7-2f70a3e53e89 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:12.567522 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-2371b6ea-37cf-4a7f-a6c7-2f70a3e53e89 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.178128 Jun 17 13:22:12.568028 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 934/1897] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:12 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:13.159379 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-252641ef-c687-471f-b272-0fb5a6e79322 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:13.160176 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-252641ef-c687-471f-b272-0fb5a6e79322 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:13.167874 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-252641ef-c687-471f-b272-0fb5a6e79322 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:13.168374 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-252641ef-c687-471f-b272-0fb5a6e79322 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:13.169211 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-252641ef-c687-471f-b272-0fb5a6e79322 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:13.169692 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-252641ef-c687-471f-b272-0fb5a6e79322 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:13.324929 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-252641ef-c687-471f-b272-0fb5a6e79322 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:13.333220 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-252641ef-c687-471f-b272-0fb5a6e79322 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.180419 Jun 17 13:22:13.333804 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 964/1898] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:13 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:13.590181 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-e67fdf9a-ffd3-479f-96fa-abd378845749 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:13.590824 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-e67fdf9a-ffd3-479f-96fa-abd378845749 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:13.597812 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e67fdf9a-ffd3-479f-96fa-abd378845749 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:13.598502 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e67fdf9a-ffd3-479f-96fa-abd378845749 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:13.599269 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e67fdf9a-ffd3-479f-96fa-abd378845749 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:13.599697 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e67fdf9a-ffd3-479f-96fa-abd378845749 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:13.737887 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-e67fdf9a-ffd3-479f-96fa-abd378845749 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:13.746098 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-e67fdf9a-ffd3-479f-96fa-abd378845749 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.160033 Jun 17 13:22:13.746677 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 935/1899] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:13 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:14.351563 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-a5f3b741-4af9-4a60-9db4-8fb86536e67a tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:14.352238 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-a5f3b741-4af9-4a60-9db4-8fb86536e67a tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:14.359908 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a5f3b741-4af9-4a60-9db4-8fb86536e67a tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:14.360384 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a5f3b741-4af9-4a60-9db4-8fb86536e67a tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:14.361178 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a5f3b741-4af9-4a60-9db4-8fb86536e67a tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:14.361627 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a5f3b741-4af9-4a60-9db4-8fb86536e67a tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:14.494944 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-a5f3b741-4af9-4a60-9db4-8fb86536e67a tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:14.503656 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-a5f3b741-4af9-4a60-9db4-8fb86536e67a tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.156281 Jun 17 13:22:14.504221 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 965/1900] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:14 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:14.763759 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-e700449c-9d08-4e79-a5e2-2aa5315e895e tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:14.764351 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-e700449c-9d08-4e79-a5e2-2aa5315e895e tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:14.772699 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e700449c-9d08-4e79-a5e2-2aa5315e895e tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:14.773304 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e700449c-9d08-4e79-a5e2-2aa5315e895e tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:14.774486 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e700449c-9d08-4e79-a5e2-2aa5315e895e tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:14.774940 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e700449c-9d08-4e79-a5e2-2aa5315e895e tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:14.915994 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-e700449c-9d08-4e79-a5e2-2aa5315e895e tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:14.926626 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-e700449c-9d08-4e79-a5e2-2aa5315e895e tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.167375 Jun 17 13:22:14.927178 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 936/1901] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:14 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:15.525903 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-cc9c58bb-8292-407e-87a4-d7071bface65 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:15.526935 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-cc9c58bb-8292-407e-87a4-d7071bface65 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:15.536257 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-cc9c58bb-8292-407e-87a4-d7071bface65 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:15.536719 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-cc9c58bb-8292-407e-87a4-d7071bface65 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:15.537474 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-cc9c58bb-8292-407e-87a4-d7071bface65 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:15.537909 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-cc9c58bb-8292-407e-87a4-d7071bface65 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:15.682732 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-cc9c58bb-8292-407e-87a4-d7071bface65 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:15.691867 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-cc9c58bb-8292-407e-87a4-d7071bface65 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.172713 Jun 17 13:22:15.692458 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 966/1902] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:15 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:15.945949 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-1ffafd9a-a1ef-4278-b8ed-20d2d316b004 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:15.946556 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-1ffafd9a-a1ef-4278-b8ed-20d2d316b004 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:15.953733 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1ffafd9a-a1ef-4278-b8ed-20d2d316b004 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:15.954212 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1ffafd9a-a1ef-4278-b8ed-20d2d316b004 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:15.954974 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1ffafd9a-a1ef-4278-b8ed-20d2d316b004 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:15.955402 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1ffafd9a-a1ef-4278-b8ed-20d2d316b004 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:16.107803 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-1ffafd9a-a1ef-4278-b8ed-20d2d316b004 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:16.117864 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-1ffafd9a-a1ef-4278-b8ed-20d2d316b004 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.175862 Jun 17 13:22:16.118473 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 937/1903] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:15 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:16.709609 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-7605ece4-a295-4da6-bcd4-dcf935eb5699 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:16.710246 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-7605ece4-a295-4da6-bcd4-dcf935eb5699 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:16.712740 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_api:SELECT=52 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:22:16.718125 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7605ece4-a295-4da6-bcd4-dcf935eb5699 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:16.718592 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7605ece4-a295-4da6-bcd4-dcf935eb5699 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:16.719352 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7605ece4-a295-4da6-bcd4-dcf935eb5699 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:16.719783 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7605ece4-a295-4da6-bcd4-dcf935eb5699 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:16.851953 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-7605ece4-a295-4da6-bcd4-dcf935eb5699 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:16.860620 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-7605ece4-a295-4da6-bcd4-dcf935eb5699 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.155179 Jun 17 13:22:16.861194 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 967/1904] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:16 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:17.135677 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-3fc13525-d31e-4c62-8e6e-6bd7f925357a tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:17.136336 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-3fc13525-d31e-4c62-8e6e-6bd7f925357a tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:17.144814 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3fc13525-d31e-4c62-8e6e-6bd7f925357a tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:17.145556 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3fc13525-d31e-4c62-8e6e-6bd7f925357a tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:17.146958 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3fc13525-d31e-4c62-8e6e-6bd7f925357a tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:17.147570 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3fc13525-d31e-4c62-8e6e-6bd7f925357a tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:17.280923 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-3fc13525-d31e-4c62-8e6e-6bd7f925357a tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:17.289652 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-3fc13525-d31e-4c62-8e6e-6bd7f925357a tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.158495 Jun 17 13:22:17.290434 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 938/1905] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:17 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:17.878625 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-398ee533-864b-4ba5-96b2-d88b995dcd00 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:17.879230 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-398ee533-864b-4ba5-96b2-d88b995dcd00 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:17.886383 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-398ee533-864b-4ba5-96b2-d88b995dcd00 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:17.886840 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-398ee533-864b-4ba5-96b2-d88b995dcd00 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:17.887605 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-398ee533-864b-4ba5-96b2-d88b995dcd00 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:17.888040 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-398ee533-864b-4ba5-96b2-d88b995dcd00 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:18.027254 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-398ee533-864b-4ba5-96b2-d88b995dcd00 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:18.030732 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_cell1:SELECT=100 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:22:18.035840 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-398ee533-864b-4ba5-96b2-d88b995dcd00 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.161436 Jun 17 13:22:18.036440 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 968/1906] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:17 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:18.315032 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-117da355-aac1-4f20-b5cf-4572b7121088 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:18.315959 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-117da355-aac1-4f20-b5cf-4572b7121088 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:18.327598 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-117da355-aac1-4f20-b5cf-4572b7121088 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:18.328304 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-117da355-aac1-4f20-b5cf-4572b7121088 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:18.329573 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-117da355-aac1-4f20-b5cf-4572b7121088 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:18.330352 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-117da355-aac1-4f20-b5cf-4572b7121088 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:18.473680 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-117da355-aac1-4f20-b5cf-4572b7121088 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:18.482463 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-117da355-aac1-4f20-b5cf-4572b7121088 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.174094 Jun 17 13:22:18.483035 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 939/1907] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:18 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:18.850139 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 13:22:18.850643 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Fri Jun 17 13:22:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 17 13:22:19.052973 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-b613d5c6-2dd4-4619-ac24-4a7562f0c4a2 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:19.053596 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-b613d5c6-2dd4-4619-ac24-4a7562f0c4a2 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:19.060698 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b613d5c6-2dd4-4619-ac24-4a7562f0c4a2 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:19.061148 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b613d5c6-2dd4-4619-ac24-4a7562f0c4a2 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:19.061912 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b613d5c6-2dd4-4619-ac24-4a7562f0c4a2 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:19.062393 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b613d5c6-2dd4-4619-ac24-4a7562f0c4a2 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:19.195139 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-b613d5c6-2dd4-4619-ac24-4a7562f0c4a2 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:19.203806 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-b613d5c6-2dd4-4619-ac24-4a7562f0c4a2 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.154800 Jun 17 13:22:19.204381 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 969/1908] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:19 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:19.503672 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-e7afc72c-c5a8-4b42-aa9e-e9604651d5fc tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:19.504528 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-e7afc72c-c5a8-4b42-aa9e-e9604651d5fc tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:19.515034 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e7afc72c-c5a8-4b42-aa9e-e9604651d5fc tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:19.515725 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e7afc72c-c5a8-4b42-aa9e-e9604651d5fc tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:19.516929 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e7afc72c-c5a8-4b42-aa9e-e9604651d5fc tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:19.517602 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e7afc72c-c5a8-4b42-aa9e-e9604651d5fc tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:19.664832 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-e7afc72c-c5a8-4b42-aa9e-e9604651d5fc tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:19.673214 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-e7afc72c-c5a8-4b42-aa9e-e9604651d5fc tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.176308 Jun 17 13:22:19.673714 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 940/1909] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:19 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:20.225439 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-6fbffd05-0b3a-4214-acfa-b6a402ea24e7 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:20.226140 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-6fbffd05-0b3a-4214-acfa-b6a402ea24e7 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:20.235559 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6fbffd05-0b3a-4214-acfa-b6a402ea24e7 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:20.236160 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6fbffd05-0b3a-4214-acfa-b6a402ea24e7 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:20.237170 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6fbffd05-0b3a-4214-acfa-b6a402ea24e7 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:20.237754 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6fbffd05-0b3a-4214-acfa-b6a402ea24e7 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:20.389476 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-6fbffd05-0b3a-4214-acfa-b6a402ea24e7 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:20.399154 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-6fbffd05-0b3a-4214-acfa-b6a402ea24e7 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.180827 Jun 17 13:22:20.399723 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 970/1910] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:20 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:20.692413 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-9d69a927-1084-4135-a153-a8fda4785eb4 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:20.693033 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-9d69a927-1084-4135-a153-a8fda4785eb4 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:20.700294 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9d69a927-1084-4135-a153-a8fda4785eb4 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:20.700731 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9d69a927-1084-4135-a153-a8fda4785eb4 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:20.701518 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9d69a927-1084-4135-a153-a8fda4785eb4 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:20.701960 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9d69a927-1084-4135-a153-a8fda4785eb4 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:20.844428 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-9d69a927-1084-4135-a153-a8fda4785eb4 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:20.852952 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-9d69a927-1084-4135-a153-a8fda4785eb4 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.165647 Jun 17 13:22:20.853556 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 941/1911] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:20 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:21.241837 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 13:22:21.242397 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Fri Jun 17 13:22:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 17 13:22:21.418783 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-25e09f79-b1b4-4801-8267-0de75372c163 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:21.419407 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-25e09f79-b1b4-4801-8267-0de75372c163 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:21.426408 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-25e09f79-b1b4-4801-8267-0de75372c163 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:21.426864 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-25e09f79-b1b4-4801-8267-0de75372c163 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:21.427615 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-25e09f79-b1b4-4801-8267-0de75372c163 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:21.428046 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-25e09f79-b1b4-4801-8267-0de75372c163 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:21.563154 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-25e09f79-b1b4-4801-8267-0de75372c163 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:21.571385 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-25e09f79-b1b4-4801-8267-0de75372c163 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.156587 Jun 17 13:22:21.571929 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 971/1912] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:21 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:21.874652 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-4983c972-9aca-428d-8cd9-8a20b01cb365 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:21.875273 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-4983c972-9aca-428d-8cd9-8a20b01cb365 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:21.885372 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4983c972-9aca-428d-8cd9-8a20b01cb365 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:21.885966 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4983c972-9aca-428d-8cd9-8a20b01cb365 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:21.887279 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4983c972-9aca-428d-8cd9-8a20b01cb365 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:21.887868 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4983c972-9aca-428d-8cd9-8a20b01cb365 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:22.034790 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-4983c972-9aca-428d-8cd9-8a20b01cb365 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:22.038790 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=100 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:22:22.043681 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-4983c972-9aca-428d-8cd9-8a20b01cb365 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.175325 Jun 17 13:22:22.044271 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 942/1913] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:21 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:22.593715 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-2a484561-cbdd-4ab1-bcc5-0746f3fd324b tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:22.594342 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-2a484561-cbdd-4ab1-bcc5-0746f3fd324b tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:22.601478 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2a484561-cbdd-4ab1-bcc5-0746f3fd324b tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:22.601929 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2a484561-cbdd-4ab1-bcc5-0746f3fd324b tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:22.602730 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2a484561-cbdd-4ab1-bcc5-0746f3fd324b tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:22.603187 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2a484561-cbdd-4ab1-bcc5-0746f3fd324b tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:22.749026 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-2a484561-cbdd-4ab1-bcc5-0746f3fd324b tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:22.761420 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-2a484561-cbdd-4ab1-bcc5-0746f3fd324b tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.171494 Jun 17 13:22:22.762180 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 972/1914] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:22 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:23.064597 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-478f3d33-357d-4e4d-b855-19b68d457e55 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:23.065609 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-478f3d33-357d-4e4d-b855-19b68d457e55 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:23.074775 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-478f3d33-357d-4e4d-b855-19b68d457e55 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:23.075224 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-478f3d33-357d-4e4d-b855-19b68d457e55 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:23.075986 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-478f3d33-357d-4e4d-b855-19b68d457e55 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:23.076418 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-478f3d33-357d-4e4d-b855-19b68d457e55 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:23.216520 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-478f3d33-357d-4e4d-b855-19b68d457e55 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:23.228902 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-478f3d33-357d-4e4d-b855-19b68d457e55 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.170556 Jun 17 13:22:23.229641 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 943/1915] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:23 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:23.785344 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-15bc862f-ae9f-417d-99f0-5dcdcf5f6cae tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:23.786033 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-15bc862f-ae9f-417d-99f0-5dcdcf5f6cae tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:23.793959 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-15bc862f-ae9f-417d-99f0-5dcdcf5f6cae tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:23.794442 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-15bc862f-ae9f-417d-99f0-5dcdcf5f6cae tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:23.795202 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-15bc862f-ae9f-417d-99f0-5dcdcf5f6cae tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:23.795632 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-15bc862f-ae9f-417d-99f0-5dcdcf5f6cae tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:23.928874 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-15bc862f-ae9f-417d-99f0-5dcdcf5f6cae tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:23.936990 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-15bc862f-ae9f-417d-99f0-5dcdcf5f6cae tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.157746 Jun 17 13:22:23.937606 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 973/1916] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:23 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:24.254778 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-c0807d03-c627-4ccf-bb1f-c106f59d4ad0 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:24.255971 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-c0807d03-c627-4ccf-bb1f-c106f59d4ad0 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:24.267032 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c0807d03-c627-4ccf-bb1f-c106f59d4ad0 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:24.267784 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c0807d03-c627-4ccf-bb1f-c106f59d4ad0 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:24.269025 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c0807d03-c627-4ccf-bb1f-c106f59d4ad0 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:24.269749 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c0807d03-c627-4ccf-bb1f-c106f59d4ad0 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:24.410110 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-c0807d03-c627-4ccf-bb1f-c106f59d4ad0 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:24.418352 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-c0807d03-c627-4ccf-bb1f-c106f59d4ad0 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.170131 Jun 17 13:22:24.418913 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 944/1917] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:24 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:24.956737 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-2139ac8c-f629-4615-ad86-d6b905deb9c8 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:24.957459 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-2139ac8c-f629-4615-ad86-d6b905deb9c8 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:24.965128 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2139ac8c-f629-4615-ad86-d6b905deb9c8 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:24.965577 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2139ac8c-f629-4615-ad86-d6b905deb9c8 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:24.966378 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2139ac8c-f629-4615-ad86-d6b905deb9c8 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:24.966815 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2139ac8c-f629-4615-ad86-d6b905deb9c8 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:25.106357 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-2139ac8c-f629-4615-ad86-d6b905deb9c8 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:25.118793 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-2139ac8c-f629-4615-ad86-d6b905deb9c8 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.167943 Jun 17 13:22:25.119585 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 974/1918] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:24 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 13:22:25.435873 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-56af18e5-4ba7-4768-8251-1271ef89d585 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:25.436491 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-56af18e5-4ba7-4768-8251-1271ef89d585 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:25.442942 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-56af18e5-4ba7-4768-8251-1271ef89d585 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:25.443392 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-56af18e5-4ba7-4768-8251-1271ef89d585 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:25.444149 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-56af18e5-4ba7-4768-8251-1271ef89d585 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:25.444671 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-56af18e5-4ba7-4768-8251-1271ef89d585 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:25.587910 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-56af18e5-4ba7-4768-8251-1271ef89d585 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:25.596542 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-56af18e5-4ba7-4768-8251-1271ef89d585 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.164414 Jun 17 13:22:25.597118 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 945/1919] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:25 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:26.144553 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-5cd7d225-65a4-4e8b-b221-50c618dd8539 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:26.145375 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-5cd7d225-65a4-4e8b-b221-50c618dd8539 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:26.153468 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-5cd7d225-65a4-4e8b-b221-50c618dd8539 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:26.153922 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-5cd7d225-65a4-4e8b-b221-50c618dd8539 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:26.154791 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-5cd7d225-65a4-4e8b-b221-50c618dd8539 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:26.155224 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-5cd7d225-65a4-4e8b-b221-50c618dd8539 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:26.289623 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-5cd7d225-65a4-4e8b-b221-50c618dd8539 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:26.298415 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-5cd7d225-65a4-4e8b-b221-50c618dd8539 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.160023 Jun 17 13:22:26.299017 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 975/1920] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:26 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:26.623557 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-6da05086-4c44-41c1-9efb-a0a07d2bc818 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:26.624632 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-6da05086-4c44-41c1-9efb-a0a07d2bc818 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:26.635218 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6da05086-4c44-41c1-9efb-a0a07d2bc818 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:26.635653 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6da05086-4c44-41c1-9efb-a0a07d2bc818 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:26.636435 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6da05086-4c44-41c1-9efb-a0a07d2bc818 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:26.636870 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6da05086-4c44-41c1-9efb-a0a07d2bc818 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:26.776954 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-6da05086-4c44-41c1-9efb-a0a07d2bc818 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:26.789446 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-6da05086-4c44-41c1-9efb-a0a07d2bc818 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.172329 Jun 17 13:22:26.790281 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 946/1921] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:26 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:27.321042 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-38551b6c-c0ca-4d6d-b7f7-5bc04f7bc240 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:27.321851 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-38551b6c-c0ca-4d6d-b7f7-5bc04f7bc240 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:27.328868 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-38551b6c-c0ca-4d6d-b7f7-5bc04f7bc240 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:27.329317 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-38551b6c-c0ca-4d6d-b7f7-5bc04f7bc240 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:27.330102 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-38551b6c-c0ca-4d6d-b7f7-5bc04f7bc240 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:27.330556 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-38551b6c-c0ca-4d6d-b7f7-5bc04f7bc240 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:27.467751 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-38551b6c-c0ca-4d6d-b7f7-5bc04f7bc240 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:27.479360 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-38551b6c-c0ca-4d6d-b7f7-5bc04f7bc240 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.164878 Jun 17 13:22:27.479924 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 976/1922] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:27 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:27.807354 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-8a18fa2e-e485-4335-a3ff-3d19e2dd2035 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:27.807916 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-8a18fa2e-e485-4335-a3ff-3d19e2dd2035 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:27.815038 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8a18fa2e-e485-4335-a3ff-3d19e2dd2035 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:27.815484 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8a18fa2e-e485-4335-a3ff-3d19e2dd2035 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:27.816245 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8a18fa2e-e485-4335-a3ff-3d19e2dd2035 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:27.816677 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8a18fa2e-e485-4335-a3ff-3d19e2dd2035 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:27.832895 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 13:22:27.833052 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Fri Jun 17 13:22:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a (ip 10.222.0.48) !!! Jun 17 13:22:27.957006 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-8a18fa2e-e485-4335-a3ff-3d19e2dd2035 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:27.965817 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-8a18fa2e-e485-4335-a3ff-3d19e2dd2035 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.162571 Jun 17 13:22:27.966422 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 947/1923] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:27 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:28.499622 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-5b87c964-2a19-48cd-a1a7-7f5c68fa708f tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:28.500641 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-5b87c964-2a19-48cd-a1a7-7f5c68fa708f tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:28.510784 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-5b87c964-2a19-48cd-a1a7-7f5c68fa708f tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:28.511423 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-5b87c964-2a19-48cd-a1a7-7f5c68fa708f tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:28.512501 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-5b87c964-2a19-48cd-a1a7-7f5c68fa708f tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:28.513123 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-5b87c964-2a19-48cd-a1a7-7f5c68fa708f tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:28.672832 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-5b87c964-2a19-48cd-a1a7-7f5c68fa708f tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:28.682594 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-5b87c964-2a19-48cd-a1a7-7f5c68fa708f tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.189456 Jun 17 13:22:28.683161 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 977/1924] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:28 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:28.987473 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-42012f98-1793-4701-bf5f-dfef38d0e379 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:28.988098 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-42012f98-1793-4701-bf5f-dfef38d0e379 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:28.995077 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-42012f98-1793-4701-bf5f-dfef38d0e379 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:28.995542 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-42012f98-1793-4701-bf5f-dfef38d0e379 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:28.996292 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-42012f98-1793-4701-bf5f-dfef38d0e379 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:28.996716 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-42012f98-1793-4701-bf5f-dfef38d0e379 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:29.135953 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-42012f98-1793-4701-bf5f-dfef38d0e379 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:29.144067 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-42012f98-1793-4701-bf5f-dfef38d0e379 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.160568 Jun 17 13:22:29.144650 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 948/1925] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:28 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:29.698898 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-dedb5e95-8980-4642-83f8-00bedaba33e5 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:29.699532 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-dedb5e95-8980-4642-83f8-00bedaba33e5 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:29.706382 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-dedb5e95-8980-4642-83f8-00bedaba33e5 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:29.706831 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-dedb5e95-8980-4642-83f8-00bedaba33e5 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:29.707580 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-dedb5e95-8980-4642-83f8-00bedaba33e5 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:29.708009 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-dedb5e95-8980-4642-83f8-00bedaba33e5 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:29.837633 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-dedb5e95-8980-4642-83f8-00bedaba33e5 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:29.846357 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-dedb5e95-8980-4642-83f8-00bedaba33e5 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.151259 Jun 17 13:22:29.846928 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 978/1926] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:29 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:30.166023 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-bc43bcab-1856-4d0b-bb1f-f89c5b1c3115 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:30.167105 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-bc43bcab-1856-4d0b-bb1f-f89c5b1c3115 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:30.177733 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bc43bcab-1856-4d0b-bb1f-f89c5b1c3115 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:30.178581 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bc43bcab-1856-4d0b-bb1f-f89c5b1c3115 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:30.179827 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bc43bcab-1856-4d0b-bb1f-f89c5b1c3115 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:30.180546 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bc43bcab-1856-4d0b-bb1f-f89c5b1c3115 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:30.320922 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-bc43bcab-1856-4d0b-bb1f-f89c5b1c3115 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:30.332282 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-bc43bcab-1856-4d0b-bb1f-f89c5b1c3115 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.172774 Jun 17 13:22:30.333020 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 949/1927] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:30 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:30.869825 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-b7627297-9921-4577-bc69-ca72eb2fda62 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:30.870457 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-b7627297-9921-4577-bc69-ca72eb2fda62 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:30.878033 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b7627297-9921-4577-bc69-ca72eb2fda62 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:30.878558 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b7627297-9921-4577-bc69-ca72eb2fda62 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:30.879392 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b7627297-9921-4577-bc69-ca72eb2fda62 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:30.879865 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b7627297-9921-4577-bc69-ca72eb2fda62 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:31.029150 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-b7627297-9921-4577-bc69-ca72eb2fda62 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:31.037537 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-b7627297-9921-4577-bc69-ca72eb2fda62 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.173933 Jun 17 13:22:31.038119 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 979/1928] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:30 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:31.349627 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-cec6364e-c19f-4e60-81ba-0da1a9763246 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:31.350270 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-cec6364e-c19f-4e60-81ba-0da1a9763246 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:31.357969 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cec6364e-c19f-4e60-81ba-0da1a9763246 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:31.358448 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cec6364e-c19f-4e60-81ba-0da1a9763246 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:31.359221 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cec6364e-c19f-4e60-81ba-0da1a9763246 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:31.359655 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cec6364e-c19f-4e60-81ba-0da1a9763246 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:31.505006 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-cec6364e-c19f-4e60-81ba-0da1a9763246 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:31.513390 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-cec6364e-c19f-4e60-81ba-0da1a9763246 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.167736 Jun 17 13:22:31.513958 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 950/1929] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:31 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:32.059719 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-8d687d48-068c-4ed1-96c5-405192eea70d tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:32.060727 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-8d687d48-068c-4ed1-96c5-405192eea70d tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:32.072079 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8d687d48-068c-4ed1-96c5-405192eea70d tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:32.072536 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8d687d48-068c-4ed1-96c5-405192eea70d tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:32.073308 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8d687d48-068c-4ed1-96c5-405192eea70d tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:32.073744 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8d687d48-068c-4ed1-96c5-405192eea70d tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:32.209601 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-8d687d48-068c-4ed1-96c5-405192eea70d tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:32.218051 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-8d687d48-068c-4ed1-96c5-405192eea70d tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.165462 Jun 17 13:22:32.218664 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 980/1930] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:32 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:32.530761 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-fa25d364-ab9c-4ada-9fbc-ca507d25ef20 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:32.531362 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-fa25d364-ab9c-4ada-9fbc-ca507d25ef20 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:32.538554 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fa25d364-ab9c-4ada-9fbc-ca507d25ef20 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:32.539006 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fa25d364-ab9c-4ada-9fbc-ca507d25ef20 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:32.539772 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fa25d364-ab9c-4ada-9fbc-ca507d25ef20 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:32.540208 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fa25d364-ab9c-4ada-9fbc-ca507d25ef20 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:32.682969 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-fa25d364-ab9c-4ada-9fbc-ca507d25ef20 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:32.691450 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-fa25d364-ab9c-4ada-9fbc-ca507d25ef20 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.164683 Jun 17 13:22:32.692019 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 951/1931] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:32 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:33.240148 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-918350b3-fc66-4959-bff3-4e26f1ea2287 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:33.241159 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-918350b3-fc66-4959-bff3-4e26f1ea2287 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:33.252963 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-918350b3-fc66-4959-bff3-4e26f1ea2287 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:33.253720 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-918350b3-fc66-4959-bff3-4e26f1ea2287 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:33.255038 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-918350b3-fc66-4959-bff3-4e26f1ea2287 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:33.255765 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-918350b3-fc66-4959-bff3-4e26f1ea2287 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:33.403825 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-918350b3-fc66-4959-bff3-4e26f1ea2287 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:33.412220 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-918350b3-fc66-4959-bff3-4e26f1ea2287 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.179101 Jun 17 13:22:33.412786 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 981/1932] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:33 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:33.712742 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-592feba8-aecd-4f81-945f-806b0f6cd290 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:33.713517 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-592feba8-aecd-4f81-945f-806b0f6cd290 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:33.720374 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-592feba8-aecd-4f81-945f-806b0f6cd290 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:33.720841 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-592feba8-aecd-4f81-945f-806b0f6cd290 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:33.721613 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-592feba8-aecd-4f81-945f-806b0f6cd290 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:33.722043 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-592feba8-aecd-4f81-945f-806b0f6cd290 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:33.854049 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-592feba8-aecd-4f81-945f-806b0f6cd290 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:33.865381 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-592feba8-aecd-4f81-945f-806b0f6cd290 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.159104 Jun 17 13:22:33.865783 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 952/1933] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:33 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:34.432814 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-eedcb63b-ee8b-4235-bb52-677f5c31b558 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:34.433753 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-eedcb63b-ee8b-4235-bb52-677f5c31b558 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:34.440902 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-eedcb63b-ee8b-4235-bb52-677f5c31b558 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:34.441369 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-eedcb63b-ee8b-4235-bb52-677f5c31b558 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:34.442141 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-eedcb63b-ee8b-4235-bb52-677f5c31b558 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:34.442595 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-eedcb63b-ee8b-4235-bb52-677f5c31b558 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:34.589103 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-eedcb63b-ee8b-4235-bb52-677f5c31b558 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:34.598007 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-eedcb63b-ee8b-4235-bb52-677f5c31b558 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.169952 Jun 17 13:22:34.598631 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 982/1934] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:34 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:34.887040 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-71353b56-4184-4f30-b058-8dd1b4297aa4 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:34.887660 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-71353b56-4184-4f30-b058-8dd1b4297aa4 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:34.894990 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-71353b56-4184-4f30-b058-8dd1b4297aa4 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:34.895437 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-71353b56-4184-4f30-b058-8dd1b4297aa4 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:34.896203 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-71353b56-4184-4f30-b058-8dd1b4297aa4 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:34.896639 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-71353b56-4184-4f30-b058-8dd1b4297aa4 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:35.032596 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-71353b56-4184-4f30-b058-8dd1b4297aa4 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:35.041295 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-71353b56-4184-4f30-b058-8dd1b4297aa4 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.161307 Jun 17 13:22:35.041881 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 953/1935] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:34 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:35.617638 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-227465cf-72d8-40c5-979c-6173f9b56909 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:35.618306 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-227465cf-72d8-40c5-979c-6173f9b56909 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:35.626601 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-227465cf-72d8-40c5-979c-6173f9b56909 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:35.627135 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-227465cf-72d8-40c5-979c-6173f9b56909 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:35.628029 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-227465cf-72d8-40c5-979c-6173f9b56909 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:35.628542 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-227465cf-72d8-40c5-979c-6173f9b56909 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:35.774561 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-227465cf-72d8-40c5-979c-6173f9b56909 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:35.783801 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-227465cf-72d8-40c5-979c-6173f9b56909 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.171091 Jun 17 13:22:35.784416 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 983/1936] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:35 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:36.064264 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-38604982-b70a-4eb5-8e76-68c3bd282906 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:36.064884 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-38604982-b70a-4eb5-8e76-68c3bd282906 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:36.071608 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-38604982-b70a-4eb5-8e76-68c3bd282906 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:36.072059 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-38604982-b70a-4eb5-8e76-68c3bd282906 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:36.073362 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-38604982-b70a-4eb5-8e76-68c3bd282906 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:36.073926 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-38604982-b70a-4eb5-8e76-68c3bd282906 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:36.220372 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-38604982-b70a-4eb5-8e76-68c3bd282906 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:36.232382 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-38604982-b70a-4eb5-8e76-68c3bd282906 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.172024 Jun 17 13:22:36.232950 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 954/1937] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:36 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:36.803492 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-9e810e7c-2813-4a53-8021-f9d4455921d3 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:36.804323 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-9e810e7c-2813-4a53-8021-f9d4455921d3 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:36.812293 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9e810e7c-2813-4a53-8021-f9d4455921d3 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:36.812737 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9e810e7c-2813-4a53-8021-f9d4455921d3 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:36.813486 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9e810e7c-2813-4a53-8021-f9d4455921d3 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:36.813914 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9e810e7c-2813-4a53-8021-f9d4455921d3 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:36.954393 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-9e810e7c-2813-4a53-8021-f9d4455921d3 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:36.962452 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-9e810e7c-2813-4a53-8021-f9d4455921d3 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.164181 Jun 17 13:22:36.963025 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 984/1938] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:36 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:37.253758 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-3524f42c-0f8d-4d8a-b27b-0c2ff02f6353 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:37.254728 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-3524f42c-0f8d-4d8a-b27b-0c2ff02f6353 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:37.264112 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3524f42c-0f8d-4d8a-b27b-0c2ff02f6353 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:37.264551 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3524f42c-0f8d-4d8a-b27b-0c2ff02f6353 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:37.265283 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3524f42c-0f8d-4d8a-b27b-0c2ff02f6353 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:37.265736 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3524f42c-0f8d-4d8a-b27b-0c2ff02f6353 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:37.408364 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-3524f42c-0f8d-4d8a-b27b-0c2ff02f6353 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:37.420814 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-3524f42c-0f8d-4d8a-b27b-0c2ff02f6353 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.173267 Jun 17 13:22:37.421521 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 955/1939] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:37 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:37.979063 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-a84476ef-76ae-4668-9c38-c82bede969af tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:37.979681 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-a84476ef-76ae-4668-9c38-c82bede969af tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:37.987509 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a84476ef-76ae-4668-9c38-c82bede969af tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:37.987818 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a84476ef-76ae-4668-9c38-c82bede969af tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:37.988657 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a84476ef-76ae-4668-9c38-c82bede969af tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:37.989091 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a84476ef-76ae-4668-9c38-c82bede969af tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:38.007725 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_cell1:SELECT=100 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:22:38.125488 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-a84476ef-76ae-4668-9c38-c82bede969af tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:38.133871 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-a84476ef-76ae-4668-9c38-c82bede969af tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.158768 Jun 17 13:22:38.135874 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 985/1940] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:37 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:38.446233 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-bab59a2c-0e59-43b6-81a0-280ef563c691 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:38.447249 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-bab59a2c-0e59-43b6-81a0-280ef563c691 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:38.455108 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bab59a2c-0e59-43b6-81a0-280ef563c691 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:38.455552 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bab59a2c-0e59-43b6-81a0-280ef563c691 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:38.456315 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bab59a2c-0e59-43b6-81a0-280ef563c691 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:38.456741 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bab59a2c-0e59-43b6-81a0-280ef563c691 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:38.588790 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-bab59a2c-0e59-43b6-81a0-280ef563c691 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:38.601859 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-bab59a2c-0e59-43b6-81a0-280ef563c691 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.161950 Jun 17 13:22:38.602644 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 956/1941] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:38 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:39.155061 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-c065135d-cf16-4ead-8bbf-f06a891ef3d6 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:39.155931 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-c065135d-cf16-4ead-8bbf-f06a891ef3d6 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:39.165034 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c065135d-cf16-4ead-8bbf-f06a891ef3d6 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:39.165722 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c065135d-cf16-4ead-8bbf-f06a891ef3d6 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:39.166910 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c065135d-cf16-4ead-8bbf-f06a891ef3d6 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:39.167683 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c065135d-cf16-4ead-8bbf-f06a891ef3d6 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:39.303005 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-c065135d-cf16-4ead-8bbf-f06a891ef3d6 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:39.312616 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-c065135d-cf16-4ead-8bbf-f06a891ef3d6 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.163294 Jun 17 13:22:39.313505 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 986/1942] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:39 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:39.623430 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-a7a9c34d-f83d-47e8-bdf7-cb2b89ad05f9 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:39.624101 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-a7a9c34d-f83d-47e8-bdf7-cb2b89ad05f9 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:39.631132 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a7a9c34d-f83d-47e8-bdf7-cb2b89ad05f9 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:39.631613 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a7a9c34d-f83d-47e8-bdf7-cb2b89ad05f9 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:39.632353 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a7a9c34d-f83d-47e8-bdf7-cb2b89ad05f9 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:39.632782 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a7a9c34d-f83d-47e8-bdf7-cb2b89ad05f9 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:39.768409 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-a7a9c34d-f83d-47e8-bdf7-cb2b89ad05f9 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:39.778752 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-a7a9c34d-f83d-47e8-bdf7-cb2b89ad05f9 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.160703 Jun 17 13:22:39.779316 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 957/1943] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:39 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:40.330542 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-7b3190fa-2c39-495c-aa5b-f9aeddd6efdc tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:40.331173 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-7b3190fa-2c39-495c-aa5b-f9aeddd6efdc tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:40.338232 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7b3190fa-2c39-495c-aa5b-f9aeddd6efdc tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:40.338681 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7b3190fa-2c39-495c-aa5b-f9aeddd6efdc tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:40.339452 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7b3190fa-2c39-495c-aa5b-f9aeddd6efdc tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:40.339897 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7b3190fa-2c39-495c-aa5b-f9aeddd6efdc tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:40.485626 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-7b3190fa-2c39-495c-aa5b-f9aeddd6efdc tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:40.497514 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-7b3190fa-2c39-495c-aa5b-f9aeddd6efdc tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.170931 Jun 17 13:22:40.498127 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 987/1944] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:40 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:40.799777 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-1f64cec8-8676-4283-9167-a550ca44b12b tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:40.800703 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-1f64cec8-8676-4283-9167-a550ca44b12b tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:40.804394 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_api:SELECT=52 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:22:40.813428 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1f64cec8-8676-4283-9167-a550ca44b12b tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:40.814166 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1f64cec8-8676-4283-9167-a550ca44b12b tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:40.815443 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1f64cec8-8676-4283-9167-a550ca44b12b tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:40.816147 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1f64cec8-8676-4283-9167-a550ca44b12b tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:40.961392 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-1f64cec8-8676-4283-9167-a550ca44b12b tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:40.973568 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-1f64cec8-8676-4283-9167-a550ca44b12b tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.180056 Jun 17 13:22:40.974395 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 958/1945] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:40 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:41.518448 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-a0967881-0f79-409f-b85b-6002816c39c6 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:41.519059 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-a0967881-0f79-409f-b85b-6002816c39c6 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:41.526221 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a0967881-0f79-409f-b85b-6002816c39c6 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:41.526668 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a0967881-0f79-409f-b85b-6002816c39c6 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:41.527449 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a0967881-0f79-409f-b85b-6002816c39c6 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:41.528438 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a0967881-0f79-409f-b85b-6002816c39c6 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:41.667230 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-a0967881-0f79-409f-b85b-6002816c39c6 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:41.676134 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-a0967881-0f79-409f-b85b-6002816c39c6 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.161744 Jun 17 13:22:41.676718 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 988/1946] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:41 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:41.995421 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-1dc769c7-9eaf-4114-8d83-2639bd024076 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:41.996177 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-1dc769c7-9eaf-4114-8d83-2639bd024076 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:42.003807 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1dc769c7-9eaf-4114-8d83-2639bd024076 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:42.004257 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1dc769c7-9eaf-4114-8d83-2639bd024076 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:42.005021 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1dc769c7-9eaf-4114-8d83-2639bd024076 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:42.005480 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1dc769c7-9eaf-4114-8d83-2639bd024076 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:42.024141 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=100 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:22:42.148352 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-1dc769c7-9eaf-4114-8d83-2639bd024076 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:42.161180 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-1dc769c7-9eaf-4114-8d83-2639bd024076 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.171524 Jun 17 13:22:42.162034 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 959/1947] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:41 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:42.697377 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-bad6655b-c567-4455-a2f5-43ec1a2662ec tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:42.698470 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-bad6655b-c567-4455-a2f5-43ec1a2662ec tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:42.709856 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-bad6655b-c567-4455-a2f5-43ec1a2662ec tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:42.710630 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-bad6655b-c567-4455-a2f5-43ec1a2662ec tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:42.711861 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-bad6655b-c567-4455-a2f5-43ec1a2662ec tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:42.712594 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-bad6655b-c567-4455-a2f5-43ec1a2662ec tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:42.843832 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-bad6655b-c567-4455-a2f5-43ec1a2662ec tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:42.851883 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-bad6655b-c567-4455-a2f5-43ec1a2662ec tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.161058 Jun 17 13:22:42.852460 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 989/1948] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:42 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:43.185679 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-259d276a-c506-4b61-afac-732ffd6cd173 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:43.186687 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-259d276a-c506-4b61-afac-732ffd6cd173 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:43.197980 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-259d276a-c506-4b61-afac-732ffd6cd173 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:43.198787 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-259d276a-c506-4b61-afac-732ffd6cd173 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:43.200046 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-259d276a-c506-4b61-afac-732ffd6cd173 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:43.200819 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-259d276a-c506-4b61-afac-732ffd6cd173 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:43.338632 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-259d276a-c506-4b61-afac-732ffd6cd173 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:43.347041 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-259d276a-c506-4b61-afac-732ffd6cd173 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.167857 Jun 17 13:22:43.347571 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 960/1949] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:43 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:43.873838 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-b7b8e634-9a2b-4042-b6d4-7529d689d54c tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:43.874897 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-b7b8e634-9a2b-4042-b6d4-7529d689d54c tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:43.886004 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b7b8e634-9a2b-4042-b6d4-7529d689d54c tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:43.886758 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b7b8e634-9a2b-4042-b6d4-7529d689d54c tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:43.888101 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b7b8e634-9a2b-4042-b6d4-7529d689d54c tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:43.888550 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b7b8e634-9a2b-4042-b6d4-7529d689d54c tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:44.024114 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-b7b8e634-9a2b-4042-b6d4-7529d689d54c tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:44.033809 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-b7b8e634-9a2b-4042-b6d4-7529d689d54c tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.166664 Jun 17 13:22:44.034405 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 990/1950] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:43 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:44.368000 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-ffe3f904-8e29-4123-9d61-d284bfed6d2e tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:44.368632 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-ffe3f904-8e29-4123-9d61-d284bfed6d2e tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:44.377080 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ffe3f904-8e29-4123-9d61-d284bfed6d2e tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:44.377529 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ffe3f904-8e29-4123-9d61-d284bfed6d2e tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:44.378335 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ffe3f904-8e29-4123-9d61-d284bfed6d2e tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:44.378764 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ffe3f904-8e29-4123-9d61-d284bfed6d2e tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:44.525884 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-ffe3f904-8e29-4123-9d61-d284bfed6d2e tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:44.534898 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-ffe3f904-8e29-4123-9d61-d284bfed6d2e tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.172825 Jun 17 13:22:44.535480 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 961/1951] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:44 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:44.629626 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 13:22:44.629929 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Fri Jun 17 13:22:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 17 13:22:45.051322 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-c0eaa7a2-6fdf-4c9f-bbc7-e59ff649484a tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:45.051953 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-c0eaa7a2-6fdf-4c9f-bbc7-e59ff649484a tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:45.058873 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c0eaa7a2-6fdf-4c9f-bbc7-e59ff649484a tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:45.059315 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c0eaa7a2-6fdf-4c9f-bbc7-e59ff649484a tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:45.060138 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c0eaa7a2-6fdf-4c9f-bbc7-e59ff649484a tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:45.060536 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c0eaa7a2-6fdf-4c9f-bbc7-e59ff649484a tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:45.198080 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-c0eaa7a2-6fdf-4c9f-bbc7-e59ff649484a tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:45.206686 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-c0eaa7a2-6fdf-4c9f-bbc7-e59ff649484a tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.159359 Jun 17 13:22:45.207237 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 991/1952] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:45 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:45.553187 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-8624ea6f-2df3-409b-93d8-378143e59e21 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:45.553799 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-8624ea6f-2df3-409b-93d8-378143e59e21 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:45.561769 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8624ea6f-2df3-409b-93d8-378143e59e21 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:45.562268 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8624ea6f-2df3-409b-93d8-378143e59e21 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:45.563018 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8624ea6f-2df3-409b-93d8-378143e59e21 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:45.563438 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8624ea6f-2df3-409b-93d8-378143e59e21 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:45.694862 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-8624ea6f-2df3-409b-93d8-378143e59e21 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:45.703246 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-8624ea6f-2df3-409b-93d8-378143e59e21 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.154682 Jun 17 13:22:45.703822 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 962/1953] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:45 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:46.233502 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-7b6233ee-8e68-4b0a-ada9-b2002d3a735b tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:46.234228 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-7b6233ee-8e68-4b0a-ada9-b2002d3a735b tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:46.241799 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7b6233ee-8e68-4b0a-ada9-b2002d3a735b tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:46.242343 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7b6233ee-8e68-4b0a-ada9-b2002d3a735b tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:46.243178 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7b6233ee-8e68-4b0a-ada9-b2002d3a735b tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:46.243661 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7b6233ee-8e68-4b0a-ada9-b2002d3a735b tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:46.379553 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-7b6233ee-8e68-4b0a-ada9-b2002d3a735b tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:46.387705 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-7b6233ee-8e68-4b0a-ada9-b2002d3a735b tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.160877 Jun 17 13:22:46.388261 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 992/1954] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:46 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:46.720623 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-de824319-12ea-483f-8815-b035471a4e89 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:46.721241 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-de824319-12ea-483f-8815-b035471a4e89 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:46.728014 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-de824319-12ea-483f-8815-b035471a4e89 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:46.728456 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-de824319-12ea-483f-8815-b035471a4e89 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:46.729217 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-de824319-12ea-483f-8815-b035471a4e89 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:46.729648 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-de824319-12ea-483f-8815-b035471a4e89 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:46.860179 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-de824319-12ea-483f-8815-b035471a4e89 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:46.868471 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-de824319-12ea-483f-8815-b035471a4e89 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.151962 Jun 17 13:22:46.869048 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 963/1955] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:46 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:47.407819 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-a8987f32-6d3a-4364-9e79-a6538bdc8c75 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:47.408555 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-a8987f32-6d3a-4364-9e79-a6538bdc8c75 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:47.411576 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_api:SELECT=52 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:22:47.418960 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a8987f32-6d3a-4364-9e79-a6538bdc8c75 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:47.419559 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a8987f32-6d3a-4364-9e79-a6538bdc8c75 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:47.420534 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a8987f32-6d3a-4364-9e79-a6538bdc8c75 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:47.420972 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a8987f32-6d3a-4364-9e79-a6538bdc8c75 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:47.572509 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-a8987f32-6d3a-4364-9e79-a6538bdc8c75 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:47.581529 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-a8987f32-6d3a-4364-9e79-a6538bdc8c75 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.179079 Jun 17 13:22:47.582073 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 993/1956] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:47 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:47.888964 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-aba69f8e-3c67-4b1a-8973-fec2a10c9497 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:47.891232 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-aba69f8e-3c67-4b1a-8973-fec2a10c9497 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:47.902976 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-aba69f8e-3c67-4b1a-8973-fec2a10c9497 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:47.903718 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-aba69f8e-3c67-4b1a-8973-fec2a10c9497 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:47.904900 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-aba69f8e-3c67-4b1a-8973-fec2a10c9497 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:47.905313 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-aba69f8e-3c67-4b1a-8973-fec2a10c9497 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:48.033972 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-aba69f8e-3c67-4b1a-8973-fec2a10c9497 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:48.042052 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-aba69f8e-3c67-4b1a-8973-fec2a10c9497 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.159608 Jun 17 13:22:48.042646 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 964/1957] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:47 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:48.401289 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 13:22:48.401546 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Fri Jun 17 13:22:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 17 13:22:48.598960 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-30e425ac-3fcb-475a-ad53-3a74e3e3c195 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:48.599585 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-30e425ac-3fcb-475a-ad53-3a74e3e3c195 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:48.607325 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-30e425ac-3fcb-475a-ad53-3a74e3e3c195 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:48.607501 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-30e425ac-3fcb-475a-ad53-3a74e3e3c195 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:48.608271 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-30e425ac-3fcb-475a-ad53-3a74e3e3c195 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:48.608698 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-30e425ac-3fcb-475a-ad53-3a74e3e3c195 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:48.745393 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-30e425ac-3fcb-475a-ad53-3a74e3e3c195 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:48.754582 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-30e425ac-3fcb-475a-ad53-3a74e3e3c195 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.158833 Jun 17 13:22:48.758409 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 994/1958] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:48 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:49.060246 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-81fca583-6d07-432e-9444-c27bd7d06daa tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:49.061074 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-81fca583-6d07-432e-9444-c27bd7d06daa tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:49.068983 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-81fca583-6d07-432e-9444-c27bd7d06daa tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:49.069480 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-81fca583-6d07-432e-9444-c27bd7d06daa tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:49.070385 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-81fca583-6d07-432e-9444-c27bd7d06daa tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:49.070862 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-81fca583-6d07-432e-9444-c27bd7d06daa tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:49.209297 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-81fca583-6d07-432e-9444-c27bd7d06daa tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:49.222241 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-81fca583-6d07-432e-9444-c27bd7d06daa tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.166057 Jun 17 13:22:49.223059 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 965/1959] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:49 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:49.772597 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-d000788e-a7dd-4d78-a092-e7ca314d87be tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:49.773355 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-d000788e-a7dd-4d78-a092-e7ca314d87be tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:49.781010 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d000788e-a7dd-4d78-a092-e7ca314d87be tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:49.781591 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d000788e-a7dd-4d78-a092-e7ca314d87be tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:49.782519 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d000788e-a7dd-4d78-a092-e7ca314d87be tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:49.783099 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d000788e-a7dd-4d78-a092-e7ca314d87be tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:49.917973 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-d000788e-a7dd-4d78-a092-e7ca314d87be tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:49.926859 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-d000788e-a7dd-4d78-a092-e7ca314d87be tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.158773 Jun 17 13:22:49.927432 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 995/1960] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:49 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:50.244621 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-deb34c2e-bc15-4689-9d8b-6fede748e993 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:50.245572 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-deb34c2e-bc15-4689-9d8b-6fede748e993 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:50.253223 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-deb34c2e-bc15-4689-9d8b-6fede748e993 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:50.253663 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-deb34c2e-bc15-4689-9d8b-6fede748e993 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:50.254471 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-deb34c2e-bc15-4689-9d8b-6fede748e993 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:50.254897 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-deb34c2e-bc15-4689-9d8b-6fede748e993 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:50.394836 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-deb34c2e-bc15-4689-9d8b-6fede748e993 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:50.403278 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-deb34c2e-bc15-4689-9d8b-6fede748e993 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.165537 Jun 17 13:22:50.404070 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 966/1961] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:50 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:50.944273 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-c32967b6-9b4d-4656-881c-cf19ecc72660 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:50.944787 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-c32967b6-9b4d-4656-881c-cf19ecc72660 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:50.951607 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c32967b6-9b4d-4656-881c-cf19ecc72660 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:50.952045 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c32967b6-9b4d-4656-881c-cf19ecc72660 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:50.952798 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c32967b6-9b4d-4656-881c-cf19ecc72660 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:50.953229 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c32967b6-9b4d-4656-881c-cf19ecc72660 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:51.092360 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-c32967b6-9b4d-4656-881c-cf19ecc72660 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:51.100512 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-c32967b6-9b4d-4656-881c-cf19ecc72660 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.160131 Jun 17 13:22:51.101077 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 996/1962] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:50 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:51.422852 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-0f6b979b-165a-48f6-99cd-75a48e40a6a5 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:51.423454 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-0f6b979b-165a-48f6-99cd-75a48e40a6a5 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:51.430442 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0f6b979b-165a-48f6-99cd-75a48e40a6a5 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:51.430892 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0f6b979b-165a-48f6-99cd-75a48e40a6a5 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:51.431671 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0f6b979b-165a-48f6-99cd-75a48e40a6a5 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:51.432078 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0f6b979b-165a-48f6-99cd-75a48e40a6a5 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:51.577665 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-0f6b979b-165a-48f6-99cd-75a48e40a6a5 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:51.590350 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-0f6b979b-165a-48f6-99cd-75a48e40a6a5 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.171990 Jun 17 13:22:51.591283 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 967/1963] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:51 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:52.120358 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-5d72fd86-2d78-409c-a5dc-de7007306a0e tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:52.120944 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-5d72fd86-2d78-409c-a5dc-de7007306a0e tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:52.130410 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-5d72fd86-2d78-409c-a5dc-de7007306a0e tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:52.131010 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-5d72fd86-2d78-409c-a5dc-de7007306a0e tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:52.132033 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-5d72fd86-2d78-409c-a5dc-de7007306a0e tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:52.132620 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-5d72fd86-2d78-409c-a5dc-de7007306a0e tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:52.271474 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-5d72fd86-2d78-409c-a5dc-de7007306a0e tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:52.280522 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-5d72fd86-2d78-409c-a5dc-de7007306a0e tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.164978 Jun 17 13:22:52.281096 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 997/1964] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:52 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:52.610880 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-36d9bc74-2776-4e4d-b0e9-960e0e96c0db tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:52.611520 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-36d9bc74-2776-4e4d-b0e9-960e0e96c0db tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:52.618332 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-36d9bc74-2776-4e4d-b0e9-960e0e96c0db tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:52.618779 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-36d9bc74-2776-4e4d-b0e9-960e0e96c0db tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:52.619534 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-36d9bc74-2776-4e4d-b0e9-960e0e96c0db tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:52.619963 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-36d9bc74-2776-4e4d-b0e9-960e0e96c0db tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:52.755834 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-36d9bc74-2776-4e4d-b0e9-960e0e96c0db tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:52.764016 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-36d9bc74-2776-4e4d-b0e9-960e0e96c0db tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.158909 Jun 17 13:22:52.764718 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 968/1965] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:52 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:53.301141 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-33cc20cd-99fb-4a81-a9c5-0195f66765a8 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:53.302040 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-33cc20cd-99fb-4a81-a9c5-0195f66765a8 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:53.312185 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-33cc20cd-99fb-4a81-a9c5-0195f66765a8 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:53.312636 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-33cc20cd-99fb-4a81-a9c5-0195f66765a8 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:53.313396 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-33cc20cd-99fb-4a81-a9c5-0195f66765a8 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:53.313835 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-33cc20cd-99fb-4a81-a9c5-0195f66765a8 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:53.452417 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-33cc20cd-99fb-4a81-a9c5-0195f66765a8 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:53.460976 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-33cc20cd-99fb-4a81-a9c5-0195f66765a8 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.166641 Jun 17 13:22:53.461548 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 998/1966] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:53 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:53.783703 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-6aa2a88e-0ccc-4c79-b02c-b7e0647bf710 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:53.784512 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-6aa2a88e-0ccc-4c79-b02c-b7e0647bf710 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:53.792951 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6aa2a88e-0ccc-4c79-b02c-b7e0647bf710 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:53.793468 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6aa2a88e-0ccc-4c79-b02c-b7e0647bf710 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:53.794390 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6aa2a88e-0ccc-4c79-b02c-b7e0647bf710 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:53.794862 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6aa2a88e-0ccc-4c79-b02c-b7e0647bf710 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:53.933749 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-6aa2a88e-0ccc-4c79-b02c-b7e0647bf710 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:53.942762 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-6aa2a88e-0ccc-4c79-b02c-b7e0647bf710 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.164398 Jun 17 13:22:53.943333 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 969/1967] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:53 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:54.482331 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-42d72d93-36da-4f56-8394-83f67e66c415 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:54.483018 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-42d72d93-36da-4f56-8394-83f67e66c415 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:54.490745 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-42d72d93-36da-4f56-8394-83f67e66c415 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:54.491248 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-42d72d93-36da-4f56-8394-83f67e66c415 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:54.492071 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-42d72d93-36da-4f56-8394-83f67e66c415 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:54.492548 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-42d72d93-36da-4f56-8394-83f67e66c415 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:54.631442 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-42d72d93-36da-4f56-8394-83f67e66c415 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:54.643775 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-42d72d93-36da-4f56-8394-83f67e66c415 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.167575 Jun 17 13:22:54.644520 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 999/1968] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:54 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:54.960223 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-0d367f61-db7c-42da-ac54-ba2cf2c46998 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:54.960839 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-0d367f61-db7c-42da-ac54-ba2cf2c46998 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:54.967687 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0d367f61-db7c-42da-ac54-ba2cf2c46998 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:54.968132 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0d367f61-db7c-42da-ac54-ba2cf2c46998 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:54.968900 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0d367f61-db7c-42da-ac54-ba2cf2c46998 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:54.969351 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0d367f61-db7c-42da-ac54-ba2cf2c46998 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:55.101102 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-0d367f61-db7c-42da-ac54-ba2cf2c46998 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:55.110372 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-0d367f61-db7c-42da-ac54-ba2cf2c46998 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.153843 Jun 17 13:22:55.111148 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 970/1969] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:54 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:55.665922 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-ca05f157-75de-4390-a667-65084f836645 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:55.667066 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-ca05f157-75de-4390-a667-65084f836645 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:55.675114 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ca05f157-75de-4390-a667-65084f836645 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:55.675561 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ca05f157-75de-4390-a667-65084f836645 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:55.676323 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ca05f157-75de-4390-a667-65084f836645 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:55.676752 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ca05f157-75de-4390-a667-65084f836645 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:55.809456 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-ca05f157-75de-4390-a667-65084f836645 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:55.817749 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-ca05f157-75de-4390-a667-65084f836645 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.158444 Jun 17 13:22:55.818335 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1000/1970] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:55 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:56.131867 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-e411cd66-7791-4ef0-bba2-cf9215ff65dd tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:56.132803 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-e411cd66-7791-4ef0-bba2-cf9215ff65dd tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:56.143894 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e411cd66-7791-4ef0-bba2-cf9215ff65dd tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:56.144635 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e411cd66-7791-4ef0-bba2-cf9215ff65dd tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:56.145948 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e411cd66-7791-4ef0-bba2-cf9215ff65dd tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:56.146711 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e411cd66-7791-4ef0-bba2-cf9215ff65dd tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:56.522406 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-e411cd66-7791-4ef0-bba2-cf9215ff65dd tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:56.531279 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-e411cd66-7791-4ef0-bba2-cf9215ff65dd tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.405954 Jun 17 13:22:56.531849 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 971/1971] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:56 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:56.839459 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-958106a7-eb7e-4afb-a088-e84adeb4d578 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:56.840301 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-958106a7-eb7e-4afb-a088-e84adeb4d578 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:56.847886 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-958106a7-eb7e-4afb-a088-e84adeb4d578 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:56.848335 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-958106a7-eb7e-4afb-a088-e84adeb4d578 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:56.849113 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-958106a7-eb7e-4afb-a088-e84adeb4d578 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:56.849522 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-958106a7-eb7e-4afb-a088-e84adeb4d578 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:56.985874 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-958106a7-eb7e-4afb-a088-e84adeb4d578 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:56.994271 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-958106a7-eb7e-4afb-a088-e84adeb4d578 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.161404 Jun 17 13:22:56.994846 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1001/1972] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:56 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:57.552831 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-cc901169-e5d8-4d92-a454-3192d69d0fd7 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:57.553705 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-cc901169-e5d8-4d92-a454-3192d69d0fd7 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:57.563079 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cc901169-e5d8-4d92-a454-3192d69d0fd7 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:57.563519 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cc901169-e5d8-4d92-a454-3192d69d0fd7 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:57.564272 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cc901169-e5d8-4d92-a454-3192d69d0fd7 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:57.564697 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cc901169-e5d8-4d92-a454-3192d69d0fd7 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:57.704801 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-cc901169-e5d8-4d92-a454-3192d69d0fd7 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:57.713396 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-cc901169-e5d8-4d92-a454-3192d69d0fd7 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.167337 Jun 17 13:22:57.713936 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 972/1973] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:57 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:58.014534 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-15d117f4-bfc4-4abb-8b53-929f8c2e9c93 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:58.015156 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-15d117f4-bfc4-4abb-8b53-929f8c2e9c93 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:58.022140 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-15d117f4-bfc4-4abb-8b53-929f8c2e9c93 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:58.022615 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-15d117f4-bfc4-4abb-8b53-929f8c2e9c93 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:58.023382 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-15d117f4-bfc4-4abb-8b53-929f8c2e9c93 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:58.023818 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-15d117f4-bfc4-4abb-8b53-929f8c2e9c93 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:58.027828 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_cell1:SELECT=100 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:22:58.155697 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-15d117f4-bfc4-4abb-8b53-929f8c2e9c93 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:58.163974 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-15d117f4-bfc4-4abb-8b53-929f8c2e9c93 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.155436 Jun 17 13:22:58.164535 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1002/1974] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:58 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:58.733409 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-58539197-5635-4231-afbb-fe59bae74ce9 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:58.734067 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-58539197-5635-4231-afbb-fe59bae74ce9 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:58.741181 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-58539197-5635-4231-afbb-fe59bae74ce9 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:58.741661 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-58539197-5635-4231-afbb-fe59bae74ce9 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:58.742514 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-58539197-5635-4231-afbb-fe59bae74ce9 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:58.742947 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-58539197-5635-4231-afbb-fe59bae74ce9 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:58.878319 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-58539197-5635-4231-afbb-fe59bae74ce9 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:58.886404 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-58539197-5635-4231-afbb-fe59bae74ce9 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.158169 Jun 17 13:22:58.886981 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 973/1975] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:58 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:59.182750 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-4065b7a0-21dd-40d1-b1a3-f682e426c6d8 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:59.183340 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-4065b7a0-21dd-40d1-b1a3-f682e426c6d8 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:59.190410 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4065b7a0-21dd-40d1-b1a3-f682e426c6d8 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:59.190865 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4065b7a0-21dd-40d1-b1a3-f682e426c6d8 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:59.191664 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4065b7a0-21dd-40d1-b1a3-f682e426c6d8 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:59.192097 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4065b7a0-21dd-40d1-b1a3-f682e426c6d8 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:59.327524 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-4065b7a0-21dd-40d1-b1a3-f682e426c6d8 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:22:59.336140 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-4065b7a0-21dd-40d1-b1a3-f682e426c6d8 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.157272 Jun 17 13:22:59.336724 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1003/1976] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:59 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:22:59.906639 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-97cf49c3-41c7-4e80-830f-e9612ed0c001 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:22:59.907730 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-97cf49c3-41c7-4e80-830f-e9612ed0c001 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:22:59.917023 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-97cf49c3-41c7-4e80-830f-e9612ed0c001 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:59.917581 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-97cf49c3-41c7-4e80-830f-e9612ed0c001 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:22:59.918568 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-97cf49c3-41c7-4e80-830f-e9612ed0c001 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:22:59.919095 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-97cf49c3-41c7-4e80-830f-e9612ed0c001 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:00.066593 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-97cf49c3-41c7-4e80-830f-e9612ed0c001 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:00.080173 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-97cf49c3-41c7-4e80-830f-e9612ed0c001 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.179348 Jun 17 13:23:00.081005 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 974/1977] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:22:59 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:00.353821 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-7f0ce3fb-cf2e-4c5e-93f7-bd558678744e tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:00.354396 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-7f0ce3fb-cf2e-4c5e-93f7-bd558678744e tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:00.362034 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7f0ce3fb-cf2e-4c5e-93f7-bd558678744e tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:00.362528 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7f0ce3fb-cf2e-4c5e-93f7-bd558678744e tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:00.363297 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7f0ce3fb-cf2e-4c5e-93f7-bd558678744e tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:00.363732 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7f0ce3fb-cf2e-4c5e-93f7-bd558678744e tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:00.505883 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-7f0ce3fb-cf2e-4c5e-93f7-bd558678744e tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:00.514057 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-7f0ce3fb-cf2e-4c5e-93f7-bd558678744e tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.164214 Jun 17 13:23:00.514636 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1004/1978] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:00 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:01.101818 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-cad56a06-8ef0-4714-a276-ef5552afdb75 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:01.102849 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-cad56a06-8ef0-4714-a276-ef5552afdb75 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:01.112428 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cad56a06-8ef0-4714-a276-ef5552afdb75 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:01.112874 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cad56a06-8ef0-4714-a276-ef5552afdb75 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:01.113637 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cad56a06-8ef0-4714-a276-ef5552afdb75 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:01.114075 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cad56a06-8ef0-4714-a276-ef5552afdb75 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:01.255704 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-cad56a06-8ef0-4714-a276-ef5552afdb75 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:01.263863 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-cad56a06-8ef0-4714-a276-ef5552afdb75 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.168520 Jun 17 13:23:01.264426 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 975/1979] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:01 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:01.531412 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-bc41af7a-f02b-46ff-9ff5-202fde1146ae tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:01.532108 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-bc41af7a-f02b-46ff-9ff5-202fde1146ae tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:01.539090 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-bc41af7a-f02b-46ff-9ff5-202fde1146ae tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:01.539519 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-bc41af7a-f02b-46ff-9ff5-202fde1146ae tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:01.540270 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-bc41af7a-f02b-46ff-9ff5-202fde1146ae tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:01.540692 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-bc41af7a-f02b-46ff-9ff5-202fde1146ae tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:01.677694 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-bc41af7a-f02b-46ff-9ff5-202fde1146ae tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:01.685720 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-bc41af7a-f02b-46ff-9ff5-202fde1146ae tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.158457 Jun 17 13:23:01.686368 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1005/1980] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:01 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:02.285045 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-13e5bdce-8eea-4682-a281-e19eba4f8e77 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:02.286016 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-13e5bdce-8eea-4682-a281-e19eba4f8e77 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:02.297806 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-13e5bdce-8eea-4682-a281-e19eba4f8e77 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:02.298603 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-13e5bdce-8eea-4682-a281-e19eba4f8e77 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:02.300004 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-13e5bdce-8eea-4682-a281-e19eba4f8e77 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:02.300729 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-13e5bdce-8eea-4682-a281-e19eba4f8e77 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:02.307291 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=100 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:23:02.433433 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-13e5bdce-8eea-4682-a281-e19eba4f8e77 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:02.441688 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-13e5bdce-8eea-4682-a281-e19eba4f8e77 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.163509 Jun 17 13:23:02.442341 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 976/1981] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:02 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:02.703329 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-1c71b4a5-56a8-4a0d-851b-2e908c7142be tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:02.703977 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-1c71b4a5-56a8-4a0d-851b-2e908c7142be tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:02.711013 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-1c71b4a5-56a8-4a0d-851b-2e908c7142be tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:02.711463 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-1c71b4a5-56a8-4a0d-851b-2e908c7142be tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:02.712252 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-1c71b4a5-56a8-4a0d-851b-2e908c7142be tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:02.712691 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-1c71b4a5-56a8-4a0d-851b-2e908c7142be tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:02.848251 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-1c71b4a5-56a8-4a0d-851b-2e908c7142be tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:02.857092 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-1c71b4a5-56a8-4a0d-851b-2e908c7142be tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.157626 Jun 17 13:23:02.857663 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1006/1982] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:02 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:03.459461 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-b27fc0e7-d26d-4d00-a69e-ca26722f1ce9 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:03.460082 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-b27fc0e7-d26d-4d00-a69e-ca26722f1ce9 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:03.467025 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b27fc0e7-d26d-4d00-a69e-ca26722f1ce9 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:03.467466 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b27fc0e7-d26d-4d00-a69e-ca26722f1ce9 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:03.468217 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b27fc0e7-d26d-4d00-a69e-ca26722f1ce9 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:03.468646 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b27fc0e7-d26d-4d00-a69e-ca26722f1ce9 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:03.604594 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-b27fc0e7-d26d-4d00-a69e-ca26722f1ce9 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:03.613212 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-b27fc0e7-d26d-4d00-a69e-ca26722f1ce9 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.157727 Jun 17 13:23:03.613879 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 977/1983] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:03 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:03.878159 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-fbe962fc-e31b-45e0-ac6f-2ff24a4a890c tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:03.879160 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-fbe962fc-e31b-45e0-ac6f-2ff24a4a890c tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:03.889426 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-fbe962fc-e31b-45e0-ac6f-2ff24a4a890c tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:03.889873 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-fbe962fc-e31b-45e0-ac6f-2ff24a4a890c tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:03.890670 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-fbe962fc-e31b-45e0-ac6f-2ff24a4a890c tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:03.891098 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-fbe962fc-e31b-45e0-ac6f-2ff24a4a890c tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:04.024764 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-fbe962fc-e31b-45e0-ac6f-2ff24a4a890c tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:04.037150 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-fbe962fc-e31b-45e0-ac6f-2ff24a4a890c tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.165210 Jun 17 13:23:04.037962 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1007/1984] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:03 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:04.632579 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-3ee77d88-6111-4c8a-8300-61e681d54c9d tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:04.633403 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-3ee77d88-6111-4c8a-8300-61e681d54c9d tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:04.642040 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3ee77d88-6111-4c8a-8300-61e681d54c9d tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:04.642523 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3ee77d88-6111-4c8a-8300-61e681d54c9d tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:04.643296 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3ee77d88-6111-4c8a-8300-61e681d54c9d tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:04.643734 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3ee77d88-6111-4c8a-8300-61e681d54c9d tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:04.780693 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-3ee77d88-6111-4c8a-8300-61e681d54c9d tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:04.788851 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-3ee77d88-6111-4c8a-8300-61e681d54c9d tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.161518 Jun 17 13:23:04.789419 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 978/1985] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:04 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:05.057683 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-8259b75d-44d9-4be4-9dfd-df6dba868499 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:05.058280 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-8259b75d-44d9-4be4-9dfd-df6dba868499 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:05.065357 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8259b75d-44d9-4be4-9dfd-df6dba868499 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:05.065821 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8259b75d-44d9-4be4-9dfd-df6dba868499 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:05.066678 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8259b75d-44d9-4be4-9dfd-df6dba868499 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:05.067104 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8259b75d-44d9-4be4-9dfd-df6dba868499 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:05.200006 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-8259b75d-44d9-4be4-9dfd-df6dba868499 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:05.209042 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-8259b75d-44d9-4be4-9dfd-df6dba868499 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.155365 Jun 17 13:23:05.209642 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1008/1986] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:05 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:05.805335 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-00c04a92-64d6-4c5c-a681-9977bf0781c1 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:05.805951 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-00c04a92-64d6-4c5c-a681-9977bf0781c1 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:05.812834 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-00c04a92-64d6-4c5c-a681-9977bf0781c1 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:05.813211 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-00c04a92-64d6-4c5c-a681-9977bf0781c1 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:05.813967 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-00c04a92-64d6-4c5c-a681-9977bf0781c1 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:05.814434 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-00c04a92-64d6-4c5c-a681-9977bf0781c1 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:05.962012 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-00c04a92-64d6-4c5c-a681-9977bf0781c1 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:05.970562 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-00c04a92-64d6-4c5c-a681-9977bf0781c1 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.169270 Jun 17 13:23:05.971132 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 979/1987] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:05 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:06.230923 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-36c29231-ab8d-474f-a990-77a11979d753 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:06.232346 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-36c29231-ab8d-474f-a990-77a11979d753 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:06.239062 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-36c29231-ab8d-474f-a990-77a11979d753 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:06.239495 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-36c29231-ab8d-474f-a990-77a11979d753 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:06.240262 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-36c29231-ab8d-474f-a990-77a11979d753 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:06.240687 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-36c29231-ab8d-474f-a990-77a11979d753 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:06.380846 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-36c29231-ab8d-474f-a990-77a11979d753 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:06.389402 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-36c29231-ab8d-474f-a990-77a11979d753 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.165218 Jun 17 13:23:06.389956 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1009/1988] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:06 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:06.992055 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-fae06e8e-7965-44be-bc0d-c61fdc5b8697 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:06.993077 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-fae06e8e-7965-44be-bc0d-c61fdc5b8697 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:07.004022 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fae06e8e-7965-44be-bc0d-c61fdc5b8697 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:07.004763 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fae06e8e-7965-44be-bc0d-c61fdc5b8697 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:07.006078 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fae06e8e-7965-44be-bc0d-c61fdc5b8697 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:07.006850 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fae06e8e-7965-44be-bc0d-c61fdc5b8697 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:07.148504 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-fae06e8e-7965-44be-bc0d-c61fdc5b8697 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:07.160599 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-fae06e8e-7965-44be-bc0d-c61fdc5b8697 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.174814 Jun 17 13:23:07.161360 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 980/1989] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:06 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:07.408535 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-2788d8b8-8bd6-4faf-9a9e-90bc2305819a tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:07.409155 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-2788d8b8-8bd6-4faf-9a9e-90bc2305819a tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:07.416467 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2788d8b8-8bd6-4faf-9a9e-90bc2305819a tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:07.416914 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2788d8b8-8bd6-4faf-9a9e-90bc2305819a tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:07.417671 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2788d8b8-8bd6-4faf-9a9e-90bc2305819a tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:07.418075 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2788d8b8-8bd6-4faf-9a9e-90bc2305819a tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:07.556130 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-2788d8b8-8bd6-4faf-9a9e-90bc2305819a tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:07.566075 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-2788d8b8-8bd6-4faf-9a9e-90bc2305819a tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.161471 Jun 17 13:23:07.566691 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1010/1990] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:07 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:08.180647 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-917aba24-df81-4cba-8223-49bc52779796 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:08.181280 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-917aba24-df81-4cba-8223-49bc52779796 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:08.189362 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-917aba24-df81-4cba-8223-49bc52779796 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:08.189806 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-917aba24-df81-4cba-8223-49bc52779796 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:08.190591 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-917aba24-df81-4cba-8223-49bc52779796 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:08.191015 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-917aba24-df81-4cba-8223-49bc52779796 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:08.322159 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-917aba24-df81-4cba-8223-49bc52779796 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:08.333587 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-917aba24-df81-4cba-8223-49bc52779796 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.159108 Jun 17 13:23:08.334328 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 981/1991] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:08 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:08.587887 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-20086c6f-6a90-4bb7-8993-f939ae0f7eed tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:08.588740 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-20086c6f-6a90-4bb7-8993-f939ae0f7eed tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:08.600189 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-20086c6f-6a90-4bb7-8993-f939ae0f7eed tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:08.600976 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-20086c6f-6a90-4bb7-8993-f939ae0f7eed tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:08.602231 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-20086c6f-6a90-4bb7-8993-f939ae0f7eed tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:08.602981 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-20086c6f-6a90-4bb7-8993-f939ae0f7eed tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:08.753826 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-20086c6f-6a90-4bb7-8993-f939ae0f7eed tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:08.765252 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-20086c6f-6a90-4bb7-8993-f939ae0f7eed tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.180605 Jun 17 13:23:08.765864 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1011/1992] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:08 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:09.357767 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-fecfa6ce-2290-4298-9399-cc5314216d40 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:09.358411 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-fecfa6ce-2290-4298-9399-cc5314216d40 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:09.365394 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fecfa6ce-2290-4298-9399-cc5314216d40 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:09.365847 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fecfa6ce-2290-4298-9399-cc5314216d40 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:09.366658 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fecfa6ce-2290-4298-9399-cc5314216d40 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:09.367094 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fecfa6ce-2290-4298-9399-cc5314216d40 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:09.508339 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-fecfa6ce-2290-4298-9399-cc5314216d40 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:09.521636 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-fecfa6ce-2290-4298-9399-cc5314216d40 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.170381 Jun 17 13:23:09.522554 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 982/1993] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:09 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:09.782823 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-b594bf3c-0fa5-48b9-9378-56a5705d905e tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:09.783563 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-b594bf3c-0fa5-48b9-9378-56a5705d905e tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:09.790042 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b594bf3c-0fa5-48b9-9378-56a5705d905e tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:09.790495 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b594bf3c-0fa5-48b9-9378-56a5705d905e tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:09.791298 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b594bf3c-0fa5-48b9-9378-56a5705d905e tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:09.791707 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b594bf3c-0fa5-48b9-9378-56a5705d905e tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:09.932809 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-b594bf3c-0fa5-48b9-9378-56a5705d905e tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:09.944656 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-b594bf3c-0fa5-48b9-9378-56a5705d905e tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.165786 Jun 17 13:23:09.945537 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1012/1994] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:09 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:10.544633 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-34f182fd-702c-4558-a1a1-a57eaf00a10d tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:10.545611 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-34f182fd-702c-4558-a1a1-a57eaf00a10d tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:10.556538 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-34f182fd-702c-4558-a1a1-a57eaf00a10d tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:10.557282 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-34f182fd-702c-4558-a1a1-a57eaf00a10d tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:10.558621 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-34f182fd-702c-4558-a1a1-a57eaf00a10d tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:10.559370 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-34f182fd-702c-4558-a1a1-a57eaf00a10d tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:10.699674 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-34f182fd-702c-4558-a1a1-a57eaf00a10d tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:10.708567 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-34f182fd-702c-4558-a1a1-a57eaf00a10d tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.170557 Jun 17 13:23:10.709139 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 983/1995] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:10 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:10.963429 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-0e4459c3-6edc-43b8-9c88-a3aa831cd285 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:10.964291 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-0e4459c3-6edc-43b8-9c88-a3aa831cd285 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:10.973163 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0e4459c3-6edc-43b8-9c88-a3aa831cd285 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:10.973606 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0e4459c3-6edc-43b8-9c88-a3aa831cd285 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:10.974405 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0e4459c3-6edc-43b8-9c88-a3aa831cd285 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:10.974829 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0e4459c3-6edc-43b8-9c88-a3aa831cd285 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:11.131839 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-0e4459c3-6edc-43b8-9c88-a3aa831cd285 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:11.142461 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-0e4459c3-6edc-43b8-9c88-a3aa831cd285 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.183145 Jun 17 13:23:11.143038 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1013/1996] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:10 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:11.731234 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-c7d7d748-15f1-4889-aeaa-3cdc769c1f2f tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:11.732194 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-c7d7d748-15f1-4889-aeaa-3cdc769c1f2f tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:11.734616 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_api:SELECT=52 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:23:11.740378 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c7d7d748-15f1-4889-aeaa-3cdc769c1f2f tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:11.740839 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c7d7d748-15f1-4889-aeaa-3cdc769c1f2f tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:11.741594 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c7d7d748-15f1-4889-aeaa-3cdc769c1f2f tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:11.742020 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c7d7d748-15f1-4889-aeaa-3cdc769c1f2f tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:11.885335 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-c7d7d748-15f1-4889-aeaa-3cdc769c1f2f tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:11.897255 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-c7d7d748-15f1-4889-aeaa-3cdc769c1f2f tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.169871 Jun 17 13:23:11.897255 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 984/1997] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:11 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:12.165573 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-13308264-8650-4b12-9291-955be89ef8a5 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:12.166214 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-13308264-8650-4b12-9291-955be89ef8a5 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:12.173275 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-13308264-8650-4b12-9291-955be89ef8a5 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:12.173731 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-13308264-8650-4b12-9291-955be89ef8a5 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:12.174517 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-13308264-8650-4b12-9291-955be89ef8a5 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:12.174948 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-13308264-8650-4b12-9291-955be89ef8a5 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:12.315347 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-13308264-8650-4b12-9291-955be89ef8a5 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:12.323782 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-13308264-8650-4b12-9291-955be89ef8a5 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.163924 Jun 17 13:23:12.324349 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1014/1998] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:12 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:12.916973 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-146dae13-cb20-45e1-91af-567008a9774c tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:12.917908 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-146dae13-cb20-45e1-91af-567008a9774c tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:12.925710 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-146dae13-cb20-45e1-91af-567008a9774c tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:12.926191 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-146dae13-cb20-45e1-91af-567008a9774c tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:12.926956 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-146dae13-cb20-45e1-91af-567008a9774c tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:12.927383 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-146dae13-cb20-45e1-91af-567008a9774c tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:13.063237 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-146dae13-cb20-45e1-91af-567008a9774c tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:13.071365 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-146dae13-cb20-45e1-91af-567008a9774c tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.160829 Jun 17 13:23:13.071938 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 985/1999] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:12 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:13.341448 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-86f2217b-43f1-44ad-8411-3fa896712f60 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:13.342059 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-86f2217b-43f1-44ad-8411-3fa896712f60 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:13.350775 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-86f2217b-43f1-44ad-8411-3fa896712f60 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:13.351365 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-86f2217b-43f1-44ad-8411-3fa896712f60 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:13.352476 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-86f2217b-43f1-44ad-8411-3fa896712f60 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:13.353082 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-86f2217b-43f1-44ad-8411-3fa896712f60 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:13.493045 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-86f2217b-43f1-44ad-8411-3fa896712f60 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:13.503527 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-86f2217b-43f1-44ad-8411-3fa896712f60 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.166280 Jun 17 13:23:13.504108 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1015/2000] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:13 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:14.089343 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-98e6552f-2af0-407a-9c86-820e6833e71b tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:14.089930 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-98e6552f-2af0-407a-9c86-820e6833e71b tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:14.096663 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-98e6552f-2af0-407a-9c86-820e6833e71b tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:14.097094 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-98e6552f-2af0-407a-9c86-820e6833e71b tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:14.097839 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-98e6552f-2af0-407a-9c86-820e6833e71b tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:14.098299 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-98e6552f-2af0-407a-9c86-820e6833e71b tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:14.243340 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-98e6552f-2af0-407a-9c86-820e6833e71b tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:14.251673 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-98e6552f-2af0-407a-9c86-820e6833e71b tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.166125 Jun 17 13:23:14.252209 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 986/2001] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:14 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:14.521510 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-3257609c-bda5-4e57-afc7-f6722589cd32 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:14.522184 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-3257609c-bda5-4e57-afc7-f6722589cd32 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:14.531254 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-3257609c-bda5-4e57-afc7-f6722589cd32 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:14.531820 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-3257609c-bda5-4e57-afc7-f6722589cd32 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:14.533017 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-3257609c-bda5-4e57-afc7-f6722589cd32 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:14.533716 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-3257609c-bda5-4e57-afc7-f6722589cd32 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:14.676471 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-3257609c-bda5-4e57-afc7-f6722589cd32 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:14.684924 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-3257609c-bda5-4e57-afc7-f6722589cd32 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.167745 Jun 17 13:23:14.685744 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1016/2002] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:14 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:15.269676 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-be12381d-4f5c-484f-acbe-ccbcd89200bd tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:15.270349 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-be12381d-4f5c-484f-acbe-ccbcd89200bd tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:15.277425 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-be12381d-4f5c-484f-acbe-ccbcd89200bd tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:15.277876 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-be12381d-4f5c-484f-acbe-ccbcd89200bd tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:15.278843 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-be12381d-4f5c-484f-acbe-ccbcd89200bd tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:15.279090 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-be12381d-4f5c-484f-acbe-ccbcd89200bd tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:15.412596 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-be12381d-4f5c-484f-acbe-ccbcd89200bd tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:15.421127 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-be12381d-4f5c-484f-acbe-ccbcd89200bd tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.155660 Jun 17 13:23:15.421697 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 987/2003] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:15 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:15.706472 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-e4b6f5b5-4c74-4b3b-9fc4-17d47a1288f4 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:15.707421 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-e4b6f5b5-4c74-4b3b-9fc4-17d47a1288f4 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:15.717892 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e4b6f5b5-4c74-4b3b-9fc4-17d47a1288f4 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:15.718379 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e4b6f5b5-4c74-4b3b-9fc4-17d47a1288f4 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:15.719145 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e4b6f5b5-4c74-4b3b-9fc4-17d47a1288f4 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:15.719585 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e4b6f5b5-4c74-4b3b-9fc4-17d47a1288f4 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:15.862567 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-e4b6f5b5-4c74-4b3b-9fc4-17d47a1288f4 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:15.874969 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-e4b6f5b5-4c74-4b3b-9fc4-17d47a1288f4 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.174803 Jun 17 13:23:15.875828 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1017/2004] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:15 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:16.440732 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-a06b8e2c-2359-483c-8584-3f8582e3f74a tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:16.441698 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-a06b8e2c-2359-483c-8584-3f8582e3f74a tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:16.452256 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a06b8e2c-2359-483c-8584-3f8582e3f74a tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:16.452945 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a06b8e2c-2359-483c-8584-3f8582e3f74a tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:16.454167 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a06b8e2c-2359-483c-8584-3f8582e3f74a tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:16.454828 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a06b8e2c-2359-483c-8584-3f8582e3f74a tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:16.588393 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-a06b8e2c-2359-483c-8584-3f8582e3f74a tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:16.597296 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-a06b8e2c-2359-483c-8584-3f8582e3f74a tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.162724 Jun 17 13:23:16.597887 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 988/2005] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:16 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:16.901099 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-425dcadc-662e-4356-b43b-5217a6460cfb tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:16.902157 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-425dcadc-662e-4356-b43b-5217a6460cfb tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:16.912608 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-425dcadc-662e-4356-b43b-5217a6460cfb tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:16.913376 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-425dcadc-662e-4356-b43b-5217a6460cfb tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:16.914655 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-425dcadc-662e-4356-b43b-5217a6460cfb tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:16.915373 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-425dcadc-662e-4356-b43b-5217a6460cfb tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:17.058652 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-425dcadc-662e-4356-b43b-5217a6460cfb tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:17.062151 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_cell1:SELECT=100 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:23:17.067789 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-425dcadc-662e-4356-b43b-5217a6460cfb tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.173316 Jun 17 13:23:17.068355 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1018/2006] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:16 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:17.619269 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-bc8b2593-ebea-4745-bb3d-d7e554e80609 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:17.620141 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-bc8b2593-ebea-4745-bb3d-d7e554e80609 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:17.631764 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bc8b2593-ebea-4745-bb3d-d7e554e80609 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:17.632515 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bc8b2593-ebea-4745-bb3d-d7e554e80609 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:17.633777 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bc8b2593-ebea-4745-bb3d-d7e554e80609 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:17.634560 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bc8b2593-ebea-4745-bb3d-d7e554e80609 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:17.774771 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-bc8b2593-ebea-4745-bb3d-d7e554e80609 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:17.784348 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-bc8b2593-ebea-4745-bb3d-d7e554e80609 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.171741 Jun 17 13:23:17.784917 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 989/2007] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:17 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:18.089213 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-84c178b4-00d7-4296-9eee-28d6392c402f tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:18.090238 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-84c178b4-00d7-4296-9eee-28d6392c402f tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:18.093316 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_api:SELECT=52 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:23:18.098980 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-84c178b4-00d7-4296-9eee-28d6392c402f tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:18.099423 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-84c178b4-00d7-4296-9eee-28d6392c402f tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:18.100192 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-84c178b4-00d7-4296-9eee-28d6392c402f tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:18.100623 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-84c178b4-00d7-4296-9eee-28d6392c402f tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:18.242174 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-84c178b4-00d7-4296-9eee-28d6392c402f tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:18.250846 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-84c178b4-00d7-4296-9eee-28d6392c402f tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.168060 Jun 17 13:23:18.251433 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1019/2008] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:18 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:18.805549 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-8f6bf136-2921-4d6f-b538-33ce7b14ec2c tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:18.806418 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-8f6bf136-2921-4d6f-b538-33ce7b14ec2c tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:18.814754 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8f6bf136-2921-4d6f-b538-33ce7b14ec2c tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:18.815198 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8f6bf136-2921-4d6f-b538-33ce7b14ec2c tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:18.815959 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8f6bf136-2921-4d6f-b538-33ce7b14ec2c tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:18.816391 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8f6bf136-2921-4d6f-b538-33ce7b14ec2c tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:18.957484 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-8f6bf136-2921-4d6f-b538-33ce7b14ec2c tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:18.970032 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-8f6bf136-2921-4d6f-b538-33ce7b14ec2c tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.170897 Jun 17 13:23:18.970912 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 990/2009] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:18 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:19.268482 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-ae2722d3-40b7-4164-abd7-4422047ff50c tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:19.269108 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-ae2722d3-40b7-4164-abd7-4422047ff50c tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:19.276176 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ae2722d3-40b7-4164-abd7-4422047ff50c tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:19.276630 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ae2722d3-40b7-4164-abd7-4422047ff50c tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:19.277399 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ae2722d3-40b7-4164-abd7-4422047ff50c tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:19.277840 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ae2722d3-40b7-4164-abd7-4422047ff50c tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:19.411692 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-ae2722d3-40b7-4164-abd7-4422047ff50c tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:19.420345 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-ae2722d3-40b7-4164-abd7-4422047ff50c tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.155806 Jun 17 13:23:19.420925 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1020/2010] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:19 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:19.995921 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-cb60266b-c798-4c27-863b-fc368a3d88d0 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:19.997045 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-cb60266b-c798-4c27-863b-fc368a3d88d0 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:20.003843 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cb60266b-c798-4c27-863b-fc368a3d88d0 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:20.004293 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cb60266b-c798-4c27-863b-fc368a3d88d0 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:20.005078 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cb60266b-c798-4c27-863b-fc368a3d88d0 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:20.005521 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cb60266b-c798-4c27-863b-fc368a3d88d0 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:20.147940 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-cb60266b-c798-4c27-863b-fc368a3d88d0 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:20.156916 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-cb60266b-c798-4c27-863b-fc368a3d88d0 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.167768 Jun 17 13:23:20.157462 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 991/2011] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:19 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:20.444185 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-31b402e8-c07e-425b-9c5d-e6e9fa97b406 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:20.445075 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-31b402e8-c07e-425b-9c5d-e6e9fa97b406 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:20.452964 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-31b402e8-c07e-425b-9c5d-e6e9fa97b406 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:20.453408 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-31b402e8-c07e-425b-9c5d-e6e9fa97b406 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:20.454195 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-31b402e8-c07e-425b-9c5d-e6e9fa97b406 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:20.454613 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-31b402e8-c07e-425b-9c5d-e6e9fa97b406 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:20.596735 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-31b402e8-c07e-425b-9c5d-e6e9fa97b406 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:20.605657 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-31b402e8-c07e-425b-9c5d-e6e9fa97b406 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.167962 Jun 17 13:23:20.606479 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1021/2012] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:20 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:21.178158 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-b7835886-19f0-4c3a-90cd-4b903fd0f9b8 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:21.179179 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-b7835886-19f0-4c3a-90cd-4b903fd0f9b8 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:21.190333 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b7835886-19f0-4c3a-90cd-4b903fd0f9b8 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:21.191068 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b7835886-19f0-4c3a-90cd-4b903fd0f9b8 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:21.192312 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b7835886-19f0-4c3a-90cd-4b903fd0f9b8 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:21.193019 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b7835886-19f0-4c3a-90cd-4b903fd0f9b8 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:21.333203 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-b7835886-19f0-4c3a-90cd-4b903fd0f9b8 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:21.336646 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=100 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:23:21.342631 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-b7835886-19f0-4c3a-90cd-4b903fd0f9b8 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.170971 Jun 17 13:23:21.343207 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 992/2013] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:21 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:21.625329 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-79078c58-43cd-4357-b1db-879110ab5e1f tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:21.625946 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-79078c58-43cd-4357-b1db-879110ab5e1f tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:21.633186 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-79078c58-43cd-4357-b1db-879110ab5e1f tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:21.633638 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-79078c58-43cd-4357-b1db-879110ab5e1f tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:21.634418 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-79078c58-43cd-4357-b1db-879110ab5e1f tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:21.635067 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-79078c58-43cd-4357-b1db-879110ab5e1f tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:21.767745 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-79078c58-43cd-4357-b1db-879110ab5e1f tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:21.775897 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-79078c58-43cd-4357-b1db-879110ab5e1f tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.155247 Jun 17 13:23:21.776466 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1022/2014] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:21 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:22.364634 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-eb9102c6-207c-4acb-b91b-64274c7edf4b tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:22.365209 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-eb9102c6-207c-4acb-b91b-64274c7edf4b tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:22.372201 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-eb9102c6-207c-4acb-b91b-64274c7edf4b tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:22.372642 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-eb9102c6-207c-4acb-b91b-64274c7edf4b tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:22.373421 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-eb9102c6-207c-4acb-b91b-64274c7edf4b tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:22.373841 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-eb9102c6-207c-4acb-b91b-64274c7edf4b tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:22.527079 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-eb9102c6-207c-4acb-b91b-64274c7edf4b tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:22.535175 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-eb9102c6-207c-4acb-b91b-64274c7edf4b tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.177248 Jun 17 13:23:22.535751 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 993/2015] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:22 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:22.792811 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-b8daf7cc-6fa1-4da4-a6e7-7208aa17d36a tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:22.793404 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-b8daf7cc-6fa1-4da4-a6e7-7208aa17d36a tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:22.800614 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b8daf7cc-6fa1-4da4-a6e7-7208aa17d36a tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:22.801065 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b8daf7cc-6fa1-4da4-a6e7-7208aa17d36a tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:22.801823 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b8daf7cc-6fa1-4da4-a6e7-7208aa17d36a tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:22.802302 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b8daf7cc-6fa1-4da4-a6e7-7208aa17d36a tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:22.938393 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-b8daf7cc-6fa1-4da4-a6e7-7208aa17d36a tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:22.946511 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-b8daf7cc-6fa1-4da4-a6e7-7208aa17d36a tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.157555 Jun 17 13:23:22.947089 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1023/2016] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:22 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:23.556574 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-b4c404bd-c1c9-45d4-b3b8-a3391fc020bb tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:23.557504 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-b4c404bd-c1c9-45d4-b3b8-a3391fc020bb tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:23.568569 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b4c404bd-c1c9-45d4-b3b8-a3391fc020bb tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:23.569207 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b4c404bd-c1c9-45d4-b3b8-a3391fc020bb tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:23.570765 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b4c404bd-c1c9-45d4-b3b8-a3391fc020bb tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:23.571566 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b4c404bd-c1c9-45d4-b3b8-a3391fc020bb tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:23.710008 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-b4c404bd-c1c9-45d4-b3b8-a3391fc020bb tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:23.721474 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-b4c404bd-c1c9-45d4-b3b8-a3391fc020bb tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.171432 Jun 17 13:23:23.722037 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 994/2017] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:23 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:23.968544 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-b4b28a3a-77da-4bba-befe-279b8ecb5c50 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:23.969396 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-b4b28a3a-77da-4bba-befe-279b8ecb5c50 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:23.978495 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b4b28a3a-77da-4bba-befe-279b8ecb5c50 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:23.979083 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b4b28a3a-77da-4bba-befe-279b8ecb5c50 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:23.980419 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b4b28a3a-77da-4bba-befe-279b8ecb5c50 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:23.980987 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b4b28a3a-77da-4bba-befe-279b8ecb5c50 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:24.125567 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-b4b28a3a-77da-4bba-befe-279b8ecb5c50 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:24.137753 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-b4b28a3a-77da-4bba-befe-279b8ecb5c50 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.175083 Jun 17 13:23:24.138345 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1024/2018] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:23 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:24.738478 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-d16fd153-fee1-402b-9b81-e3215c537abd tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:24.739119 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-d16fd153-fee1-402b-9b81-e3215c537abd tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:24.745906 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d16fd153-fee1-402b-9b81-e3215c537abd tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:24.746378 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d16fd153-fee1-402b-9b81-e3215c537abd tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:24.747175 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d16fd153-fee1-402b-9b81-e3215c537abd tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:24.747624 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d16fd153-fee1-402b-9b81-e3215c537abd tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:24.880135 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-d16fd153-fee1-402b-9b81-e3215c537abd tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:24.888243 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-d16fd153-fee1-402b-9b81-e3215c537abd tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.153771 Jun 17 13:23:24.888801 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 995/2019] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:24 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:25.158752 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-37b2ef70-87e3-40bb-a851-aa5bd89f95c2 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:25.159662 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-37b2ef70-87e3-40bb-a851-aa5bd89f95c2 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:25.170391 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-37b2ef70-87e3-40bb-a851-aa5bd89f95c2 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:25.170846 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-37b2ef70-87e3-40bb-a851-aa5bd89f95c2 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:25.171620 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-37b2ef70-87e3-40bb-a851-aa5bd89f95c2 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:25.172059 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-37b2ef70-87e3-40bb-a851-aa5bd89f95c2 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:25.316524 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-37b2ef70-87e3-40bb-a851-aa5bd89f95c2 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:25.329366 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-37b2ef70-87e3-40bb-a851-aa5bd89f95c2 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.176863 Jun 17 13:23:25.330139 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1025/2020] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:25 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:25.905042 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-61f9e546-500a-4f14-a33a-fb0d2e3649d3 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:25.905669 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-61f9e546-500a-4f14-a33a-fb0d2e3649d3 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:25.912408 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-61f9e546-500a-4f14-a33a-fb0d2e3649d3 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:25.912859 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-61f9e546-500a-4f14-a33a-fb0d2e3649d3 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:25.913641 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-61f9e546-500a-4f14-a33a-fb0d2e3649d3 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:25.914064 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-61f9e546-500a-4f14-a33a-fb0d2e3649d3 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:26.046047 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-61f9e546-500a-4f14-a33a-fb0d2e3649d3 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:26.054174 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-61f9e546-500a-4f14-a33a-fb0d2e3649d3 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.153203 Jun 17 13:23:26.054744 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 996/2021] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:25 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:26.347082 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-d3459a9a-7022-46b1-895a-e300ec5106b1 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:26.347696 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-d3459a9a-7022-46b1-895a-e300ec5106b1 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:26.354641 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d3459a9a-7022-46b1-895a-e300ec5106b1 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:26.355410 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d3459a9a-7022-46b1-895a-e300ec5106b1 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:26.356231 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d3459a9a-7022-46b1-895a-e300ec5106b1 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:26.356670 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d3459a9a-7022-46b1-895a-e300ec5106b1 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:26.527369 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-d3459a9a-7022-46b1-895a-e300ec5106b1 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:26.539909 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-d3459a9a-7022-46b1-895a-e300ec5106b1 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.196600 Jun 17 13:23:26.540936 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1026/2022] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:26 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:27.072143 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-dbdbb5cf-5a00-42eb-9f22-617a9af06b49 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:27.072808 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-dbdbb5cf-5a00-42eb-9f22-617a9af06b49 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:27.079652 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dbdbb5cf-5a00-42eb-9f22-617a9af06b49 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:27.080095 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dbdbb5cf-5a00-42eb-9f22-617a9af06b49 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:27.080854 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dbdbb5cf-5a00-42eb-9f22-617a9af06b49 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:27.081286 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dbdbb5cf-5a00-42eb-9f22-617a9af06b49 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:27.221519 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-dbdbb5cf-5a00-42eb-9f22-617a9af06b49 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:27.230642 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-dbdbb5cf-5a00-42eb-9f22-617a9af06b49 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.162479 Jun 17 13:23:27.231227 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 997/2023] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:27 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 13:23:27.560496 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-bf1e46fd-cfb0-4591-9a82-c2ad15af8378 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:27.561129 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-bf1e46fd-cfb0-4591-9a82-c2ad15af8378 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:27.568825 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-bf1e46fd-cfb0-4591-9a82-c2ad15af8378 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:27.569324 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-bf1e46fd-cfb0-4591-9a82-c2ad15af8378 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:27.570199 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-bf1e46fd-cfb0-4591-9a82-c2ad15af8378 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:27.570684 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-bf1e46fd-cfb0-4591-9a82-c2ad15af8378 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:27.706571 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-bf1e46fd-cfb0-4591-9a82-c2ad15af8378 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:27.714614 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-bf1e46fd-cfb0-4591-9a82-c2ad15af8378 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.160534 Jun 17 13:23:27.715180 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1027/2024] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:27 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:28.249881 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-cc49f2b6-322d-49bc-9f9d-b2caffab727d tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:28.250553 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-cc49f2b6-322d-49bc-9f9d-b2caffab727d tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:28.257482 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cc49f2b6-322d-49bc-9f9d-b2caffab727d tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:28.257927 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cc49f2b6-322d-49bc-9f9d-b2caffab727d tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:28.258722 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cc49f2b6-322d-49bc-9f9d-b2caffab727d tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:28.259169 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cc49f2b6-322d-49bc-9f9d-b2caffab727d tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:28.404819 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-cc49f2b6-322d-49bc-9f9d-b2caffab727d tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:28.413251 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-cc49f2b6-322d-49bc-9f9d-b2caffab727d tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.168129 Jun 17 13:23:28.413823 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 998/2025] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:28 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:28.736156 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-8d889ac6-1821-4ca7-8b1c-a12c8bd6a1ee tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:28.736750 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-8d889ac6-1821-4ca7-8b1c-a12c8bd6a1ee tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:28.746814 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8d889ac6-1821-4ca7-8b1c-a12c8bd6a1ee tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:28.747666 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8d889ac6-1821-4ca7-8b1c-a12c8bd6a1ee tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:28.748706 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8d889ac6-1821-4ca7-8b1c-a12c8bd6a1ee tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:28.749303 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8d889ac6-1821-4ca7-8b1c-a12c8bd6a1ee tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:28.891066 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-8d889ac6-1821-4ca7-8b1c-a12c8bd6a1ee tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:28.899591 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-8d889ac6-1821-4ca7-8b1c-a12c8bd6a1ee tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.170220 Jun 17 13:23:28.900169 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1028/2026] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:28 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:29.432266 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-0242cab8-2a3b-4162-81d0-8757cb5117e2 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:29.433037 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-0242cab8-2a3b-4162-81d0-8757cb5117e2 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:29.442250 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0242cab8-2a3b-4162-81d0-8757cb5117e2 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:29.442810 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0242cab8-2a3b-4162-81d0-8757cb5117e2 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:29.443760 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0242cab8-2a3b-4162-81d0-8757cb5117e2 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:29.444302 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0242cab8-2a3b-4162-81d0-8757cb5117e2 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:29.602029 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-0242cab8-2a3b-4162-81d0-8757cb5117e2 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:29.610949 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-0242cab8-2a3b-4162-81d0-8757cb5117e2 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.183654 Jun 17 13:23:29.611524 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 999/2027] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:29 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:29.917680 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-06223754-308a-40f4-8aa2-39cc04c58da6 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:29.918457 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-06223754-308a-40f4-8aa2-39cc04c58da6 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:29.927474 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-06223754-308a-40f4-8aa2-39cc04c58da6 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:29.928040 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-06223754-308a-40f4-8aa2-39cc04c58da6 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:29.929026 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-06223754-308a-40f4-8aa2-39cc04c58da6 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:29.929576 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-06223754-308a-40f4-8aa2-39cc04c58da6 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:30.076106 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-06223754-308a-40f4-8aa2-39cc04c58da6 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:30.084255 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-06223754-308a-40f4-8aa2-39cc04c58da6 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.171397 Jun 17 13:23:30.084876 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1029/2028] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:29 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:30.628143 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-4e0fc64e-942d-46f2-9669-b7cff578a1af tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:30.628767 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-4e0fc64e-942d-46f2-9669-b7cff578a1af tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:30.635595 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4e0fc64e-942d-46f2-9669-b7cff578a1af tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:30.636263 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4e0fc64e-942d-46f2-9669-b7cff578a1af tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:30.637215 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4e0fc64e-942d-46f2-9669-b7cff578a1af tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:30.637822 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4e0fc64e-942d-46f2-9669-b7cff578a1af tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:30.770233 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-4e0fc64e-942d-46f2-9669-b7cff578a1af tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:30.778850 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-4e0fc64e-942d-46f2-9669-b7cff578a1af tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.154523 Jun 17 13:23:30.779424 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1000/2029] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:30 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:31.106199 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-9f441cfa-3a80-4ef3-838d-4bb50543141c tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:31.106865 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-9f441cfa-3a80-4ef3-838d-4bb50543141c tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:31.114272 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9f441cfa-3a80-4ef3-838d-4bb50543141c tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:31.114737 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9f441cfa-3a80-4ef3-838d-4bb50543141c tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:31.115530 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9f441cfa-3a80-4ef3-838d-4bb50543141c tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:31.115987 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9f441cfa-3a80-4ef3-838d-4bb50543141c tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:31.261954 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-9f441cfa-3a80-4ef3-838d-4bb50543141c tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:31.270409 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-9f441cfa-3a80-4ef3-838d-4bb50543141c tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.171011 Jun 17 13:23:31.270981 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1030/2030] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:31 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:31.800094 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-46808c60-e1f7-43d1-b9f2-a370f0fb2125 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:31.801094 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-46808c60-e1f7-43d1-b9f2-a370f0fb2125 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:31.811932 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-46808c60-e1f7-43d1-b9f2-a370f0fb2125 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:31.812665 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-46808c60-e1f7-43d1-b9f2-a370f0fb2125 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:31.813906 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-46808c60-e1f7-43d1-b9f2-a370f0fb2125 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:31.814699 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-46808c60-e1f7-43d1-b9f2-a370f0fb2125 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:31.959467 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-46808c60-e1f7-43d1-b9f2-a370f0fb2125 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:31.967444 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-46808c60-e1f7-43d1-b9f2-a370f0fb2125 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.174155 Jun 17 13:23:31.967973 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1001/2031] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:31 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:32.287615 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-2e2cac42-568f-4a55-abc7-6dcf3a9140c8 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:32.288237 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-2e2cac42-568f-4a55-abc7-6dcf3a9140c8 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:32.295450 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2e2cac42-568f-4a55-abc7-6dcf3a9140c8 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:32.295905 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2e2cac42-568f-4a55-abc7-6dcf3a9140c8 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:32.296669 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2e2cac42-568f-4a55-abc7-6dcf3a9140c8 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:32.297108 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2e2cac42-568f-4a55-abc7-6dcf3a9140c8 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:32.437778 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-2e2cac42-568f-4a55-abc7-6dcf3a9140c8 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:32.450125 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-2e2cac42-568f-4a55-abc7-6dcf3a9140c8 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.166158 Jun 17 13:23:32.450714 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1031/2032] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:32 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:32.989003 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-47c05e26-a1a1-453b-b028-3738c592e3e3 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:32.989950 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-47c05e26-a1a1-453b-b028-3738c592e3e3 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:32.999412 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-47c05e26-a1a1-453b-b028-3738c592e3e3 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:32.999861 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-47c05e26-a1a1-453b-b028-3738c592e3e3 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:33.000605 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-47c05e26-a1a1-453b-b028-3738c592e3e3 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:33.001026 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-47c05e26-a1a1-453b-b028-3738c592e3e3 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:33.142599 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-47c05e26-a1a1-453b-b028-3738c592e3e3 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:33.150669 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-47c05e26-a1a1-453b-b028-3738c592e3e3 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.168266 Jun 17 13:23:33.151219 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1002/2033] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:32 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:33.471413 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-fe5e7464-cb25-4bb5-84a8-4e3497cd0c72 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:33.472420 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-fe5e7464-cb25-4bb5-84a8-4e3497cd0c72 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:33.482882 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-fe5e7464-cb25-4bb5-84a8-4e3497cd0c72 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:33.483332 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-fe5e7464-cb25-4bb5-84a8-4e3497cd0c72 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:33.484099 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-fe5e7464-cb25-4bb5-84a8-4e3497cd0c72 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:33.484523 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-fe5e7464-cb25-4bb5-84a8-4e3497cd0c72 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:33.626191 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-fe5e7464-cb25-4bb5-84a8-4e3497cd0c72 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:33.636850 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-fe5e7464-cb25-4bb5-84a8-4e3497cd0c72 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.171949 Jun 17 13:23:33.637541 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1032/2034] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:33 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:34.170830 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-33617dda-5fb6-418d-94f2-297b9c0f4d7f tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:34.171438 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-33617dda-5fb6-418d-94f2-297b9c0f4d7f tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:34.178319 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-33617dda-5fb6-418d-94f2-297b9c0f4d7f tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:34.178760 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-33617dda-5fb6-418d-94f2-297b9c0f4d7f tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:34.179513 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-33617dda-5fb6-418d-94f2-297b9c0f4d7f tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:34.179934 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-33617dda-5fb6-418d-94f2-297b9c0f4d7f tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:34.312656 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-33617dda-5fb6-418d-94f2-297b9c0f4d7f tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:34.320857 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-33617dda-5fb6-418d-94f2-297b9c0f4d7f tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.155678 Jun 17 13:23:34.321593 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1003/2035] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:34 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:34.663374 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-48176712-db6e-414c-a825-59b44f5c47d3 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:34.664387 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-48176712-db6e-414c-a825-59b44f5c47d3 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:34.673476 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-48176712-db6e-414c-a825-59b44f5c47d3 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:34.673933 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-48176712-db6e-414c-a825-59b44f5c47d3 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:34.674731 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-48176712-db6e-414c-a825-59b44f5c47d3 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:34.675165 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-48176712-db6e-414c-a825-59b44f5c47d3 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:34.810628 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-48176712-db6e-414c-a825-59b44f5c47d3 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:34.818878 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-48176712-db6e-414c-a825-59b44f5c47d3 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.162097 Jun 17 13:23:34.819450 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1033/2036] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:34 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:35.338000 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-b8d67dbd-d089-4b95-b625-04d0bef61b8e tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:35.338718 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-b8d67dbd-d089-4b95-b625-04d0bef61b8e tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:35.345742 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b8d67dbd-d089-4b95-b625-04d0bef61b8e tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:35.346243 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b8d67dbd-d089-4b95-b625-04d0bef61b8e tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:35.347003 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b8d67dbd-d089-4b95-b625-04d0bef61b8e tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:35.347433 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b8d67dbd-d089-4b95-b625-04d0bef61b8e tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:35.482827 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-b8d67dbd-d089-4b95-b625-04d0bef61b8e tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:35.490744 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-b8d67dbd-d089-4b95-b625-04d0bef61b8e tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.156682 Jun 17 13:23:35.491341 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1004/2037] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:35 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:35.838203 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-a2b60c74-3bc3-44fa-98ff-7255f130d8e1 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:35.838905 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-a2b60c74-3bc3-44fa-98ff-7255f130d8e1 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:35.846007 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a2b60c74-3bc3-44fa-98ff-7255f130d8e1 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:35.846493 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a2b60c74-3bc3-44fa-98ff-7255f130d8e1 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:35.847248 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a2b60c74-3bc3-44fa-98ff-7255f130d8e1 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:35.847738 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a2b60c74-3bc3-44fa-98ff-7255f130d8e1 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:35.984583 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-a2b60c74-3bc3-44fa-98ff-7255f130d8e1 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:35.997303 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-a2b60c74-3bc3-44fa-98ff-7255f130d8e1 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.163565 Jun 17 13:23:35.997878 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1034/2038] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:35 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:36.507282 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-d61c3cc2-5201-402c-9cf6-0dcf220c8175 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:36.507898 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-d61c3cc2-5201-402c-9cf6-0dcf220c8175 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:36.514842 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d61c3cc2-5201-402c-9cf6-0dcf220c8175 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:36.515262 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d61c3cc2-5201-402c-9cf6-0dcf220c8175 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:36.516026 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d61c3cc2-5201-402c-9cf6-0dcf220c8175 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:36.516456 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d61c3cc2-5201-402c-9cf6-0dcf220c8175 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:36.651076 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-d61c3cc2-5201-402c-9cf6-0dcf220c8175 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:36.659509 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-d61c3cc2-5201-402c-9cf6-0dcf220c8175 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.156115 Jun 17 13:23:36.660082 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1005/2039] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:36 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:37.017645 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-03e356e4-37b8-4937-8f71-a73c3268c878 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:37.018477 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-03e356e4-37b8-4937-8f71-a73c3268c878 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:37.027574 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-03e356e4-37b8-4937-8f71-a73c3268c878 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:37.028334 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-03e356e4-37b8-4937-8f71-a73c3268c878 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:37.029332 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-03e356e4-37b8-4937-8f71-a73c3268c878 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:37.029895 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-03e356e4-37b8-4937-8f71-a73c3268c878 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:37.051583 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_cell1:SELECT=100 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:23:37.200913 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-03e356e4-37b8-4937-8f71-a73c3268c878 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:37.209279 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-03e356e4-37b8-4937-8f71-a73c3268c878 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.197783 Jun 17 13:23:37.209856 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1035/2040] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:37 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:37.676353 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-ef77bf32-accb-49bd-b7de-efbef110dc69 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:37.677018 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-ef77bf32-accb-49bd-b7de-efbef110dc69 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:37.684284 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ef77bf32-accb-49bd-b7de-efbef110dc69 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:37.684731 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ef77bf32-accb-49bd-b7de-efbef110dc69 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:37.685516 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ef77bf32-accb-49bd-b7de-efbef110dc69 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:37.685952 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ef77bf32-accb-49bd-b7de-efbef110dc69 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:37.823192 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-ef77bf32-accb-49bd-b7de-efbef110dc69 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:37.835156 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-ef77bf32-accb-49bd-b7de-efbef110dc69 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.162412 Jun 17 13:23:37.835865 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1006/2041] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:37 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:38.226859 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-6928a61b-02ad-41c4-9f1b-0137b85514b2 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:38.227541 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-6928a61b-02ad-41c4-9f1b-0137b85514b2 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:38.235000 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6928a61b-02ad-41c4-9f1b-0137b85514b2 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:38.235495 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6928a61b-02ad-41c4-9f1b-0137b85514b2 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:38.236345 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6928a61b-02ad-41c4-9f1b-0137b85514b2 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:38.236763 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6928a61b-02ad-41c4-9f1b-0137b85514b2 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:38.377177 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-6928a61b-02ad-41c4-9f1b-0137b85514b2 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:38.388079 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-6928a61b-02ad-41c4-9f1b-0137b85514b2 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.165023 Jun 17 13:23:38.388565 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1036/2042] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:38 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:38.861606 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-e884a766-8b74-460d-8412-9a84659fa8f0 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:38.862745 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-e884a766-8b74-460d-8412-9a84659fa8f0 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:38.873206 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e884a766-8b74-460d-8412-9a84659fa8f0 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:38.873645 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e884a766-8b74-460d-8412-9a84659fa8f0 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:38.874444 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e884a766-8b74-460d-8412-9a84659fa8f0 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:38.874872 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e884a766-8b74-460d-8412-9a84659fa8f0 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:39.006825 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-e884a766-8b74-460d-8412-9a84659fa8f0 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:39.020223 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-e884a766-8b74-460d-8412-9a84659fa8f0 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.165432 Jun 17 13:23:39.021004 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1007/2043] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:38 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:39.409445 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-f88e543c-a9b2-405c-b291-6a4f88f0a22b tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:39.410456 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-f88e543c-a9b2-405c-b291-6a4f88f0a22b tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:39.420329 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f88e543c-a9b2-405c-b291-6a4f88f0a22b tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:39.420781 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f88e543c-a9b2-405c-b291-6a4f88f0a22b tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:39.421538 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f88e543c-a9b2-405c-b291-6a4f88f0a22b tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:39.421968 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f88e543c-a9b2-405c-b291-6a4f88f0a22b tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:39.567020 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-f88e543c-a9b2-405c-b291-6a4f88f0a22b tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:39.575018 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-f88e543c-a9b2-405c-b291-6a4f88f0a22b tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.172099 Jun 17 13:23:39.575557 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1037/2044] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:39 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:40.044587 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-5ca7b847-28f4-44a5-81de-b8f0ababe808 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:40.045230 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-5ca7b847-28f4-44a5-81de-b8f0ababe808 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:40.052793 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5ca7b847-28f4-44a5-81de-b8f0ababe808 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:40.053284 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5ca7b847-28f4-44a5-81de-b8f0ababe808 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:40.054137 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5ca7b847-28f4-44a5-81de-b8f0ababe808 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:40.054652 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5ca7b847-28f4-44a5-81de-b8f0ababe808 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:40.204843 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-5ca7b847-28f4-44a5-81de-b8f0ababe808 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:40.217455 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-5ca7b847-28f4-44a5-81de-b8f0ababe808 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.178858 Jun 17 13:23:40.218339 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1008/2045] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:40 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:40.592100 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-dd951304-3ab9-4178-a913-4870b873c67e tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:40.592709 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-dd951304-3ab9-4178-a913-4870b873c67e tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:40.599580 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-dd951304-3ab9-4178-a913-4870b873c67e tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:40.600025 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-dd951304-3ab9-4178-a913-4870b873c67e tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:40.600810 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-dd951304-3ab9-4178-a913-4870b873c67e tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:40.601232 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-dd951304-3ab9-4178-a913-4870b873c67e tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:40.735642 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-dd951304-3ab9-4178-a913-4870b873c67e tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:40.744356 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-dd951304-3ab9-4178-a913-4870b873c67e tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.156116 Jun 17 13:23:40.744943 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1038/2046] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:40 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:41.244397 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-450ce097-1a73-4e58-8a9e-35191ba19768 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:41.245386 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-450ce097-1a73-4e58-8a9e-35191ba19768 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:41.253140 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-450ce097-1a73-4e58-8a9e-35191ba19768 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:41.253589 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-450ce097-1a73-4e58-8a9e-35191ba19768 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:41.254380 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-450ce097-1a73-4e58-8a9e-35191ba19768 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:41.254814 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-450ce097-1a73-4e58-8a9e-35191ba19768 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:41.273130 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=100 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:23:41.391806 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-450ce097-1a73-4e58-8a9e-35191ba19768 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:41.400606 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-450ce097-1a73-4e58-8a9e-35191ba19768 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.162721 Jun 17 13:23:41.401174 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1009/2047] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:41 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:41.760793 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-89515a0f-9366-4619-ba99-381eddfa68da tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:41.762063 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-89515a0f-9366-4619-ba99-381eddfa68da tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:41.768654 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-89515a0f-9366-4619-ba99-381eddfa68da tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:41.769131 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-89515a0f-9366-4619-ba99-381eddfa68da tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:41.769889 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-89515a0f-9366-4619-ba99-381eddfa68da tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:41.770360 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-89515a0f-9366-4619-ba99-381eddfa68da tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:41.903893 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-89515a0f-9366-4619-ba99-381eddfa68da tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:41.912291 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-89515a0f-9366-4619-ba99-381eddfa68da tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.155333 Jun 17 13:23:41.912866 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1039/2048] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:41 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:42.420468 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-83b05f63-da5c-4a88-8df7-a318a6d7e81c tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:42.421040 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-83b05f63-da5c-4a88-8df7-a318a6d7e81c tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:42.423463 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_api:SELECT=52 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:23:42.429147 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-83b05f63-da5c-4a88-8df7-a318a6d7e81c tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:42.429601 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-83b05f63-da5c-4a88-8df7-a318a6d7e81c tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:42.430397 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-83b05f63-da5c-4a88-8df7-a318a6d7e81c tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:42.430828 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-83b05f63-da5c-4a88-8df7-a318a6d7e81c tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:42.567908 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-83b05f63-da5c-4a88-8df7-a318a6d7e81c tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:42.576168 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-83b05f63-da5c-4a88-8df7-a318a6d7e81c tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.161899 Jun 17 13:23:42.576741 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1010/2049] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:42 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:42.931458 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-841201fe-7669-43bf-98fc-525e79672623 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:42.932660 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-841201fe-7669-43bf-98fc-525e79672623 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:42.941241 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-841201fe-7669-43bf-98fc-525e79672623 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:42.941882 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-841201fe-7669-43bf-98fc-525e79672623 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:42.943135 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-841201fe-7669-43bf-98fc-525e79672623 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:42.943751 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-841201fe-7669-43bf-98fc-525e79672623 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:43.073223 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-841201fe-7669-43bf-98fc-525e79672623 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:43.082223 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-841201fe-7669-43bf-98fc-525e79672623 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.155053 Jun 17 13:23:43.082741 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1040/2050] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:42 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:43.597453 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-27225eb6-9473-43e7-a310-ef2f7260a479 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:43.598459 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-27225eb6-9473-43e7-a310-ef2f7260a479 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:43.609001 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-27225eb6-9473-43e7-a310-ef2f7260a479 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:43.609452 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-27225eb6-9473-43e7-a310-ef2f7260a479 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:43.610256 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-27225eb6-9473-43e7-a310-ef2f7260a479 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:43.610693 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-27225eb6-9473-43e7-a310-ef2f7260a479 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:43.766594 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-27225eb6-9473-43e7-a310-ef2f7260a479 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:43.775226 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-27225eb6-9473-43e7-a310-ef2f7260a479 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.185235 Jun 17 13:23:43.775818 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1011/2051] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:43 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:44.104032 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-649e65f1-fc45-4d56-867b-be0d8614f79c tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:44.105445 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-649e65f1-fc45-4d56-867b-be0d8614f79c tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:44.118186 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-649e65f1-fc45-4d56-867b-be0d8614f79c tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:44.119440 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-649e65f1-fc45-4d56-867b-be0d8614f79c tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:44.121777 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-649e65f1-fc45-4d56-867b-be0d8614f79c tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:44.122573 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-649e65f1-fc45-4d56-867b-be0d8614f79c tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:44.263103 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-649e65f1-fc45-4d56-867b-be0d8614f79c tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:44.271777 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-649e65f1-fc45-4d56-867b-be0d8614f79c tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.174376 Jun 17 13:23:44.272356 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1041/2052] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:44 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:44.795354 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-74c5b95a-bb98-4586-9def-032949d25ef4 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:44.796257 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-74c5b95a-bb98-4586-9def-032949d25ef4 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:44.807156 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-74c5b95a-bb98-4586-9def-032949d25ef4 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:44.807900 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-74c5b95a-bb98-4586-9def-032949d25ef4 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:44.809361 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-74c5b95a-bb98-4586-9def-032949d25ef4 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:44.809601 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-74c5b95a-bb98-4586-9def-032949d25ef4 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:44.939001 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-74c5b95a-bb98-4586-9def-032949d25ef4 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:44.947436 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-74c5b95a-bb98-4586-9def-032949d25ef4 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.158795 Jun 17 13:23:44.948036 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1012/2053] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:44 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:45.292790 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-34c1aac0-19ed-4184-ae70-85a1910b7c17 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:45.293805 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-34c1aac0-19ed-4184-ae70-85a1910b7c17 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:45.301481 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-34c1aac0-19ed-4184-ae70-85a1910b7c17 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:45.301985 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-34c1aac0-19ed-4184-ae70-85a1910b7c17 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:45.303300 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-34c1aac0-19ed-4184-ae70-85a1910b7c17 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:45.303442 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-34c1aac0-19ed-4184-ae70-85a1910b7c17 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:45.443909 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-34c1aac0-19ed-4184-ae70-85a1910b7c17 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:45.452316 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-34c1aac0-19ed-4184-ae70-85a1910b7c17 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.165927 Jun 17 13:23:45.452922 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1042/2054] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:45 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:45.969575 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-c53465d5-6a34-451a-8239-1dd38c181c59 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:45.970655 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-c53465d5-6a34-451a-8239-1dd38c181c59 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:45.981778 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c53465d5-6a34-451a-8239-1dd38c181c59 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:45.982265 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c53465d5-6a34-451a-8239-1dd38c181c59 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:45.983026 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c53465d5-6a34-451a-8239-1dd38c181c59 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:45.983453 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c53465d5-6a34-451a-8239-1dd38c181c59 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:46.115676 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-c53465d5-6a34-451a-8239-1dd38c181c59 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:46.127194 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-c53465d5-6a34-451a-8239-1dd38c181c59 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.164012 Jun 17 13:23:46.127870 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1013/2055] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:45 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:46.473816 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-713f315a-930b-4f3c-b046-d273ab4b03b4 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:46.474899 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-713f315a-930b-4f3c-b046-d273ab4b03b4 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:46.486611 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-713f315a-930b-4f3c-b046-d273ab4b03b4 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:46.487370 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-713f315a-930b-4f3c-b046-d273ab4b03b4 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:46.488621 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-713f315a-930b-4f3c-b046-d273ab4b03b4 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:46.489346 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-713f315a-930b-4f3c-b046-d273ab4b03b4 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:46.634490 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-713f315a-930b-4f3c-b046-d273ab4b03b4 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:46.643985 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-713f315a-930b-4f3c-b046-d273ab4b03b4 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.176724 Jun 17 13:23:46.644574 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1043/2056] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:46 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:47.145852 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-6d7cfcba-6d0d-4c8c-bf33-8a17dc5ba9fc tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:47.146807 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-6d7cfcba-6d0d-4c8c-bf33-8a17dc5ba9fc tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:47.155019 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6d7cfcba-6d0d-4c8c-bf33-8a17dc5ba9fc tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:47.155461 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6d7cfcba-6d0d-4c8c-bf33-8a17dc5ba9fc tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:47.156231 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6d7cfcba-6d0d-4c8c-bf33-8a17dc5ba9fc tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:47.156617 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6d7cfcba-6d0d-4c8c-bf33-8a17dc5ba9fc tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:47.292107 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-6d7cfcba-6d0d-4c8c-bf33-8a17dc5ba9fc tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:47.300764 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-6d7cfcba-6d0d-4c8c-bf33-8a17dc5ba9fc tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.159506 Jun 17 13:23:47.301357 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1014/2057] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:47 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:47.669027 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-898d6462-500c-4f27-befb-d0979dde2834 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:47.669632 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-898d6462-500c-4f27-befb-d0979dde2834 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:47.676844 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-898d6462-500c-4f27-befb-d0979dde2834 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:47.677287 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-898d6462-500c-4f27-befb-d0979dde2834 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:47.678033 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-898d6462-500c-4f27-befb-d0979dde2834 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:47.678495 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-898d6462-500c-4f27-befb-d0979dde2834 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:47.812209 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-898d6462-500c-4f27-befb-d0979dde2834 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:47.820237 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-898d6462-500c-4f27-befb-d0979dde2834 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.157557 Jun 17 13:23:47.820796 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1044/2058] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:47 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:48.321969 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-f4ed6d08-d8c9-4d4e-963a-073d325fdaa6 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:48.323001 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-f4ed6d08-d8c9-4d4e-963a-073d325fdaa6 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:48.330724 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f4ed6d08-d8c9-4d4e-963a-073d325fdaa6 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:48.331166 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f4ed6d08-d8c9-4d4e-963a-073d325fdaa6 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:48.331917 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f4ed6d08-d8c9-4d4e-963a-073d325fdaa6 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:48.332342 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f4ed6d08-d8c9-4d4e-963a-073d325fdaa6 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:48.468050 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-f4ed6d08-d8c9-4d4e-963a-073d325fdaa6 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:48.476057 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-f4ed6d08-d8c9-4d4e-963a-073d325fdaa6 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.160399 Jun 17 13:23:48.476617 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1015/2059] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:48 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:48.841069 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-8dcf3ee4-46f8-4f71-99f9-6bd6be08b2d1 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:48.841815 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-8dcf3ee4-46f8-4f71-99f9-6bd6be08b2d1 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:48.844721 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_api:SELECT=52 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:23:48.851537 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8dcf3ee4-46f8-4f71-99f9-6bd6be08b2d1 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:48.852131 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8dcf3ee4-46f8-4f71-99f9-6bd6be08b2d1 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:48.853082 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8dcf3ee4-46f8-4f71-99f9-6bd6be08b2d1 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:48.853626 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8dcf3ee4-46f8-4f71-99f9-6bd6be08b2d1 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:48.995868 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-8dcf3ee4-46f8-4f71-99f9-6bd6be08b2d1 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:49.006979 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-8dcf3ee4-46f8-4f71-99f9-6bd6be08b2d1 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.172368 Jun 17 13:23:49.007753 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1045/2060] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:48 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:49.494315 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-bc921a21-c6c8-4de5-bece-bbf2547fc57e tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:49.494960 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-bc921a21-c6c8-4de5-bece-bbf2547fc57e tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:49.501982 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bc921a21-c6c8-4de5-bece-bbf2547fc57e tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:49.502462 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bc921a21-c6c8-4de5-bece-bbf2547fc57e tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:49.503229 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bc921a21-c6c8-4de5-bece-bbf2547fc57e tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:49.503664 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bc921a21-c6c8-4de5-bece-bbf2547fc57e tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:49.643329 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-bc921a21-c6c8-4de5-bece-bbf2547fc57e tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:49.651867 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-bc921a21-c6c8-4de5-bece-bbf2547fc57e tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.161496 Jun 17 13:23:49.652594 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1016/2061] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:49 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:50.028103 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-8f008fcb-8e1a-4c13-88c9-22b0f4ec514d tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:50.029061 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-8f008fcb-8e1a-4c13-88c9-22b0f4ec514d tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:50.037036 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8f008fcb-8e1a-4c13-88c9-22b0f4ec514d tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:50.037562 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8f008fcb-8e1a-4c13-88c9-22b0f4ec514d tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:50.038493 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8f008fcb-8e1a-4c13-88c9-22b0f4ec514d tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:50.039001 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8f008fcb-8e1a-4c13-88c9-22b0f4ec514d tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:50.177105 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-8f008fcb-8e1a-4c13-88c9-22b0f4ec514d tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:50.185802 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-8f008fcb-8e1a-4c13-88c9-22b0f4ec514d tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.164433 Jun 17 13:23:50.186477 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1046/2062] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:50 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:50.678816 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-7b00f94f-d119-43b8-b925-712fbb01f3c9 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:50.679765 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-7b00f94f-d119-43b8-b925-712fbb01f3c9 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:50.690779 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7b00f94f-d119-43b8-b925-712fbb01f3c9 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:50.691521 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7b00f94f-d119-43b8-b925-712fbb01f3c9 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:50.692777 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7b00f94f-d119-43b8-b925-712fbb01f3c9 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:50.693495 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7b00f94f-d119-43b8-b925-712fbb01f3c9 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:50.836472 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-7b00f94f-d119-43b8-b925-712fbb01f3c9 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:50.844763 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-7b00f94f-d119-43b8-b925-712fbb01f3c9 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.172720 Jun 17 13:23:50.845298 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1017/2063] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:50 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:51.202508 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-2ed85f17-28da-4972-90ef-b206f85420dc tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:51.203222 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-2ed85f17-28da-4972-90ef-b206f85420dc tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:51.209862 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2ed85f17-28da-4972-90ef-b206f85420dc tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:51.210371 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2ed85f17-28da-4972-90ef-b206f85420dc tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:51.211124 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2ed85f17-28da-4972-90ef-b206f85420dc tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:51.211557 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2ed85f17-28da-4972-90ef-b206f85420dc tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:51.345806 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-2ed85f17-28da-4972-90ef-b206f85420dc tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:51.353720 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-2ed85f17-28da-4972-90ef-b206f85420dc tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.155373 Jun 17 13:23:51.354334 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1047/2064] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:51 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:51.866412 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-126f943c-e480-4c13-8bcd-616435764a14 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:51.867410 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-126f943c-e480-4c13-8bcd-616435764a14 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:51.878665 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-126f943c-e480-4c13-8bcd-616435764a14 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:51.879407 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-126f943c-e480-4c13-8bcd-616435764a14 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:51.880655 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-126f943c-e480-4c13-8bcd-616435764a14 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:51.881368 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-126f943c-e480-4c13-8bcd-616435764a14 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:52.011610 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-126f943c-e480-4c13-8bcd-616435764a14 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:52.020029 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-126f943c-e480-4c13-8bcd-616435764a14 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.160280 Jun 17 13:23:52.020599 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1018/2065] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:51 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:52.370738 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-830c7042-0a82-409b-8987-2ee4a2da50fa tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:52.371450 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-830c7042-0a82-409b-8987-2ee4a2da50fa tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:52.378525 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-830c7042-0a82-409b-8987-2ee4a2da50fa tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:52.378975 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-830c7042-0a82-409b-8987-2ee4a2da50fa tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:52.379756 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-830c7042-0a82-409b-8987-2ee4a2da50fa tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:52.380175 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-830c7042-0a82-409b-8987-2ee4a2da50fa tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:52.513109 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-830c7042-0a82-409b-8987-2ee4a2da50fa tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:52.521927 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-830c7042-0a82-409b-8987-2ee4a2da50fa tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.154985 Jun 17 13:23:52.522544 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1048/2066] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:52 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:53.041159 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-a5b762e7-c9b4-4ff6-b686-987d21f5d53e tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:53.042248 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-a5b762e7-c9b4-4ff6-b686-987d21f5d53e tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:53.054168 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a5b762e7-c9b4-4ff6-b686-987d21f5d53e tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:53.055101 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a5b762e7-c9b4-4ff6-b686-987d21f5d53e tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:53.056381 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a5b762e7-c9b4-4ff6-b686-987d21f5d53e tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:53.057110 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a5b762e7-c9b4-4ff6-b686-987d21f5d53e tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:53.195451 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-a5b762e7-c9b4-4ff6-b686-987d21f5d53e tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:53.204264 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-a5b762e7-c9b4-4ff6-b686-987d21f5d53e tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.169614 Jun 17 13:23:53.204837 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1019/2067] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:53 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:53.542242 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-944dae83-db2f-4217-9515-15c32c0c2c7d tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:53.542884 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-944dae83-db2f-4217-9515-15c32c0c2c7d tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:53.549805 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-944dae83-db2f-4217-9515-15c32c0c2c7d tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:53.550227 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-944dae83-db2f-4217-9515-15c32c0c2c7d tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:53.550981 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-944dae83-db2f-4217-9515-15c32c0c2c7d tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:53.551418 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-944dae83-db2f-4217-9515-15c32c0c2c7d tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:53.698753 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-944dae83-db2f-4217-9515-15c32c0c2c7d tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:53.707232 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-944dae83-db2f-4217-9515-15c32c0c2c7d tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.171262 Jun 17 13:23:53.707798 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1049/2068] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:53 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:54.226220 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-91e8cef9-a92d-456c-bba0-55be30f91d20 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:54.228024 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-91e8cef9-a92d-456c-bba0-55be30f91d20 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:54.236420 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-91e8cef9-a92d-456c-bba0-55be30f91d20 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:54.236864 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-91e8cef9-a92d-456c-bba0-55be30f91d20 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:54.237646 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-91e8cef9-a92d-456c-bba0-55be30f91d20 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:54.238072 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-91e8cef9-a92d-456c-bba0-55be30f91d20 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:54.384035 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-91e8cef9-a92d-456c-bba0-55be30f91d20 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:54.392213 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-91e8cef9-a92d-456c-bba0-55be30f91d20 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.172422 Jun 17 13:23:54.392778 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1020/2069] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:54 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:54.728307 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-0c9a49c5-b428-4e1d-8cd1-e3ebf76fbe73 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:54.729298 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-0c9a49c5-b428-4e1d-8cd1-e3ebf76fbe73 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:54.740834 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0c9a49c5-b428-4e1d-8cd1-e3ebf76fbe73 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:54.741576 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0c9a49c5-b428-4e1d-8cd1-e3ebf76fbe73 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:54.742856 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0c9a49c5-b428-4e1d-8cd1-e3ebf76fbe73 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:54.743568 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0c9a49c5-b428-4e1d-8cd1-e3ebf76fbe73 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:54.878425 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-0c9a49c5-b428-4e1d-8cd1-e3ebf76fbe73 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:54.888955 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-0c9a49c5-b428-4e1d-8cd1-e3ebf76fbe73 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.167004 Jun 17 13:23:54.889498 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1050/2070] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:54 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:55.409088 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-eb2c62db-6b0b-4dbf-bb6e-29fa8e2308ce tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:55.409651 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-eb2c62db-6b0b-4dbf-bb6e-29fa8e2308ce tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:55.416529 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-eb2c62db-6b0b-4dbf-bb6e-29fa8e2308ce tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:55.416982 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-eb2c62db-6b0b-4dbf-bb6e-29fa8e2308ce tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:55.418028 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-eb2c62db-6b0b-4dbf-bb6e-29fa8e2308ce tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:55.418241 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-eb2c62db-6b0b-4dbf-bb6e-29fa8e2308ce tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:55.556846 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-eb2c62db-6b0b-4dbf-bb6e-29fa8e2308ce tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:55.565240 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-eb2c62db-6b0b-4dbf-bb6e-29fa8e2308ce tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.160047 Jun 17 13:23:55.565889 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1021/2071] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:55 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:55.907544 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-81696085-d451-45cc-9da5-17878ebfd2b5 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:55.908176 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-81696085-d451-45cc-9da5-17878ebfd2b5 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:55.916319 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-81696085-d451-45cc-9da5-17878ebfd2b5 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:55.916805 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-81696085-d451-45cc-9da5-17878ebfd2b5 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:55.917679 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-81696085-d451-45cc-9da5-17878ebfd2b5 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:55.918249 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-81696085-d451-45cc-9da5-17878ebfd2b5 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:56.052884 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-81696085-d451-45cc-9da5-17878ebfd2b5 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:56.061626 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-81696085-d451-45cc-9da5-17878ebfd2b5 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.158780 Jun 17 13:23:56.062253 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1051/2072] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:55 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:56.586717 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-fabcbc74-b163-43df-9549-b28afaedd920 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:56.587902 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-fabcbc74-b163-43df-9549-b28afaedd920 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:56.598928 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fabcbc74-b163-43df-9549-b28afaedd920 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:56.599674 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fabcbc74-b163-43df-9549-b28afaedd920 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:56.600949 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fabcbc74-b163-43df-9549-b28afaedd920 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:56.601685 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fabcbc74-b163-43df-9549-b28afaedd920 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:56.990246 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-fabcbc74-b163-43df-9549-b28afaedd920 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:57.000207 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-fabcbc74-b163-43df-9549-b28afaedd920 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.420302 Jun 17 13:23:57.000783 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1022/2073] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:56 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:57.082508 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-8f58fb80-3a9e-43b3-967c-f1715383db29 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:57.083507 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-8f58fb80-3a9e-43b3-967c-f1715383db29 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:57.092840 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8f58fb80-3a9e-43b3-967c-f1715383db29 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:57.093290 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8f58fb80-3a9e-43b3-967c-f1715383db29 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:57.094052 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8f58fb80-3a9e-43b3-967c-f1715383db29 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:57.094521 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8f58fb80-3a9e-43b3-967c-f1715383db29 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:57.098564 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_cell1:SELECT=100 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:23:57.227691 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-8f58fb80-3a9e-43b3-967c-f1715383db29 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:57.236767 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-8f58fb80-3a9e-43b3-967c-f1715383db29 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.160675 Jun 17 13:23:57.237276 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1052/2074] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:57 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:58.021035 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-102974f8-8584-4bc9-9b04-a76abed1fb29 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:58.021996 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-102974f8-8584-4bc9-9b04-a76abed1fb29 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:58.033553 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-102974f8-8584-4bc9-9b04-a76abed1fb29 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:58.034364 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-102974f8-8584-4bc9-9b04-a76abed1fb29 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:58.035630 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-102974f8-8584-4bc9-9b04-a76abed1fb29 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:58.036349 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-102974f8-8584-4bc9-9b04-a76abed1fb29 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:58.178566 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-102974f8-8584-4bc9-9b04-a76abed1fb29 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:58.186695 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-102974f8-8584-4bc9-9b04-a76abed1fb29 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.172042 Jun 17 13:23:58.187237 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1023/2075] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:58 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:58.257639 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-21266648-2743-4812-835b-af0284a9e83b tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:58.258545 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-21266648-2743-4812-835b-af0284a9e83b tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:58.269835 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-21266648-2743-4812-835b-af0284a9e83b tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:58.270604 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-21266648-2743-4812-835b-af0284a9e83b tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:58.271845 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-21266648-2743-4812-835b-af0284a9e83b tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:58.272563 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-21266648-2743-4812-835b-af0284a9e83b tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:58.411311 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-21266648-2743-4812-835b-af0284a9e83b tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:58.423806 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-21266648-2743-4812-835b-af0284a9e83b tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.172291 Jun 17 13:23:58.424475 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1053/2076] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:58 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:59.207797 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-f36e5974-6b77-4c3b-85b2-9c66705edea9 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:59.208810 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-f36e5974-6b77-4c3b-85b2-9c66705edea9 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:59.218656 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f36e5974-6b77-4c3b-85b2-9c66705edea9 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:59.219104 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f36e5974-6b77-4c3b-85b2-9c66705edea9 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:59.219893 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f36e5974-6b77-4c3b-85b2-9c66705edea9 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:59.220322 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f36e5974-6b77-4c3b-85b2-9c66705edea9 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:59.359032 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-f36e5974-6b77-4c3b-85b2-9c66705edea9 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:59.371247 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-f36e5974-6b77-4c3b-85b2-9c66705edea9 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.169779 Jun 17 13:23:59.372082 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1024/2077] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:59 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:23:59.443988 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-f04abfb9-c32a-4681-85fd-89441f5f4448 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:23:59.444586 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-f04abfb9-c32a-4681-85fd-89441f5f4448 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:23:59.453379 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f04abfb9-c32a-4681-85fd-89441f5f4448 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:59.453829 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f04abfb9-c32a-4681-85fd-89441f5f4448 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:59.454614 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f04abfb9-c32a-4681-85fd-89441f5f4448 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:23:59.455049 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f04abfb9-c32a-4681-85fd-89441f5f4448 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:23:59.600152 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-f04abfb9-c32a-4681-85fd-89441f5f4448 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:23:59.610529 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-f04abfb9-c32a-4681-85fd-89441f5f4448 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.172940 Jun 17 13:23:59.611105 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1054/2078] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:23:59 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:00.398914 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-683b864d-be44-4378-8aad-00facceb6012 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:00.399912 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-683b864d-be44-4378-8aad-00facceb6012 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:00.411204 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-683b864d-be44-4378-8aad-00facceb6012 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:00.411917 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-683b864d-be44-4378-8aad-00facceb6012 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:00.413154 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-683b864d-be44-4378-8aad-00facceb6012 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:00.413864 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-683b864d-be44-4378-8aad-00facceb6012 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:00.543997 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-683b864d-be44-4378-8aad-00facceb6012 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:00.552087 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-683b864d-be44-4378-8aad-00facceb6012 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.159733 Jun 17 13:24:00.552652 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1025/2079] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:00 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:00.629711 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-bda3f05f-3a12-47f9-ae29-23b0f9babea8 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:00.630353 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-bda3f05f-3a12-47f9-ae29-23b0f9babea8 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:00.638789 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-bda3f05f-3a12-47f9-ae29-23b0f9babea8 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:00.639239 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-bda3f05f-3a12-47f9-ae29-23b0f9babea8 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:00.640437 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-bda3f05f-3a12-47f9-ae29-23b0f9babea8 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:00.641161 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-bda3f05f-3a12-47f9-ae29-23b0f9babea8 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:00.785541 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-bda3f05f-3a12-47f9-ae29-23b0f9babea8 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:00.793657 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-bda3f05f-3a12-47f9-ae29-23b0f9babea8 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.168735 Jun 17 13:24:00.794236 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1055/2080] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:00 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:01.574033 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-d28b2c42-e62e-41ab-ab46-d567e8fb3be2 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:01.575305 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-d28b2c42-e62e-41ab-ab46-d567e8fb3be2 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:01.585959 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d28b2c42-e62e-41ab-ab46-d567e8fb3be2 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:01.586743 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d28b2c42-e62e-41ab-ab46-d567e8fb3be2 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:01.587994 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d28b2c42-e62e-41ab-ab46-d567e8fb3be2 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:01.588658 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d28b2c42-e62e-41ab-ab46-d567e8fb3be2 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:01.593144 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=100 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:24:01.720142 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-d28b2c42-e62e-41ab-ab46-d567e8fb3be2 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:01.728711 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-d28b2c42-e62e-41ab-ab46-d567e8fb3be2 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.161290 Jun 17 13:24:01.729284 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1026/2081] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:01 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:01.817513 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-a749298e-8bc1-4a6f-a6b3-a6ead65cf13f tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:01.817955 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-a749298e-8bc1-4a6f-a6b3-a6ead65cf13f tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:01.825955 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a749298e-8bc1-4a6f-a6b3-a6ead65cf13f tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:01.826363 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a749298e-8bc1-4a6f-a6b3-a6ead65cf13f tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:01.827139 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a749298e-8bc1-4a6f-a6b3-a6ead65cf13f tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:01.827582 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a749298e-8bc1-4a6f-a6b3-a6ead65cf13f tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:01.971190 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-a749298e-8bc1-4a6f-a6b3-a6ead65cf13f tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:01.979271 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-a749298e-8bc1-4a6f-a6b3-a6ead65cf13f tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.166468 Jun 17 13:24:01.980329 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1056/2082] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:01 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:02.748318 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-308b63a6-1449-4ec4-8404-08e3af6d419e tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:02.748952 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-308b63a6-1449-4ec4-8404-08e3af6d419e tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:02.755788 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-308b63a6-1449-4ec4-8404-08e3af6d419e tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:02.756232 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-308b63a6-1449-4ec4-8404-08e3af6d419e tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:02.756986 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-308b63a6-1449-4ec4-8404-08e3af6d419e tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:02.757415 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-308b63a6-1449-4ec4-8404-08e3af6d419e tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:02.895141 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-308b63a6-1449-4ec4-8404-08e3af6d419e tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:02.903643 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-308b63a6-1449-4ec4-8404-08e3af6d419e tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.160442 Jun 17 13:24:02.904196 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1027/2083] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:02 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:02.996801 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-e4729f20-f883-42e3-b457-dbdfecb385ea tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:02.997380 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-e4729f20-f883-42e3-b457-dbdfecb385ea tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:03.004626 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e4729f20-f883-42e3-b457-dbdfecb385ea tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:03.005070 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e4729f20-f883-42e3-b457-dbdfecb385ea tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:03.005923 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e4729f20-f883-42e3-b457-dbdfecb385ea tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:03.006384 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e4729f20-f883-42e3-b457-dbdfecb385ea tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:03.142434 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-e4729f20-f883-42e3-b457-dbdfecb385ea tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:03.150976 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-e4729f20-f883-42e3-b457-dbdfecb385ea tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.158071 Jun 17 13:24:03.151549 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1057/2084] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:02 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:03.921442 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-23aad827-c6b9-4044-83bf-2bfed818fb09 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:03.922054 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-23aad827-c6b9-4044-83bf-2bfed818fb09 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:03.928912 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-23aad827-c6b9-4044-83bf-2bfed818fb09 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:03.929360 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-23aad827-c6b9-4044-83bf-2bfed818fb09 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:03.930146 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-23aad827-c6b9-4044-83bf-2bfed818fb09 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:03.930582 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-23aad827-c6b9-4044-83bf-2bfed818fb09 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:04.079257 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-23aad827-c6b9-4044-83bf-2bfed818fb09 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:04.087266 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-23aad827-c6b9-4044-83bf-2bfed818fb09 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.169834 Jun 17 13:24:04.087831 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1028/2085] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:03 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:04.178124 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-57deea39-88f6-45bf-ba78-c5c14445bbc5 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:04.179195 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-57deea39-88f6-45bf-ba78-c5c14445bbc5 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:04.190805 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-57deea39-88f6-45bf-ba78-c5c14445bbc5 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:04.191558 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-57deea39-88f6-45bf-ba78-c5c14445bbc5 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:04.192826 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-57deea39-88f6-45bf-ba78-c5c14445bbc5 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:04.193567 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-57deea39-88f6-45bf-ba78-c5c14445bbc5 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:04.325823 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-57deea39-88f6-45bf-ba78-c5c14445bbc5 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:04.334252 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-57deea39-88f6-45bf-ba78-c5c14445bbc5 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.162495 Jun 17 13:24:04.334798 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1058/2086] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:04 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:05.104470 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-09ef3bd2-a6a7-463b-baab-f0048f398319 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:05.105882 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-09ef3bd2-a6a7-463b-baab-f0048f398319 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:05.112790 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-09ef3bd2-a6a7-463b-baab-f0048f398319 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:05.113229 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-09ef3bd2-a6a7-463b-baab-f0048f398319 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:05.113992 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-09ef3bd2-a6a7-463b-baab-f0048f398319 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:05.114440 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-09ef3bd2-a6a7-463b-baab-f0048f398319 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:05.251842 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-09ef3bd2-a6a7-463b-baab-f0048f398319 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:05.264500 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-09ef3bd2-a6a7-463b-baab-f0048f398319 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.163629 Jun 17 13:24:05.265270 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1029/2087] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:05 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:05.351841 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-8c1f3eba-6c56-469f-bc2c-da3b3f2b8289 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:05.352461 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-8c1f3eba-6c56-469f-bc2c-da3b3f2b8289 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:05.360516 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8c1f3eba-6c56-469f-bc2c-da3b3f2b8289 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:05.360973 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8c1f3eba-6c56-469f-bc2c-da3b3f2b8289 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:05.361729 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8c1f3eba-6c56-469f-bc2c-da3b3f2b8289 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:05.362188 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8c1f3eba-6c56-469f-bc2c-da3b3f2b8289 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:05.499587 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-8c1f3eba-6c56-469f-bc2c-da3b3f2b8289 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:05.508046 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-8c1f3eba-6c56-469f-bc2c-da3b3f2b8289 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.160224 Jun 17 13:24:05.508621 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1059/2088] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:05 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:06.286795 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-27671683-7bcf-4cf0-a66b-893af9d79f98 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:06.287803 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-27671683-7bcf-4cf0-a66b-893af9d79f98 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:06.296376 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-27671683-7bcf-4cf0-a66b-893af9d79f98 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:06.296821 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-27671683-7bcf-4cf0-a66b-893af9d79f98 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:06.297578 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-27671683-7bcf-4cf0-a66b-893af9d79f98 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:06.298012 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-27671683-7bcf-4cf0-a66b-893af9d79f98 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:06.444826 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-27671683-7bcf-4cf0-a66b-893af9d79f98 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:06.453503 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-27671683-7bcf-4cf0-a66b-893af9d79f98 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.173199 Jun 17 13:24:06.454075 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1030/2089] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:06 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:06.529300 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-0d0d6944-8b53-4d04-87e2-748b91d11eaa tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:06.530137 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-0d0d6944-8b53-4d04-87e2-748b91d11eaa tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:06.539021 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0d0d6944-8b53-4d04-87e2-748b91d11eaa tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:06.539613 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0d0d6944-8b53-4d04-87e2-748b91d11eaa tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:06.540611 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0d0d6944-8b53-4d04-87e2-748b91d11eaa tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:06.541199 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0d0d6944-8b53-4d04-87e2-748b91d11eaa tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:06.679927 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-0d0d6944-8b53-4d04-87e2-748b91d11eaa tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:06.688673 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-0d0d6944-8b53-4d04-87e2-748b91d11eaa tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.165674 Jun 17 13:24:06.689256 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1060/2090] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:06 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:07.474807 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-5db57b31-a190-499c-b3fa-228469d4b2f6 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:07.475772 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-5db57b31-a190-499c-b3fa-228469d4b2f6 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:07.487328 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5db57b31-a190-499c-b3fa-228469d4b2f6 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:07.488078 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5db57b31-a190-499c-b3fa-228469d4b2f6 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:07.489330 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5db57b31-a190-499c-b3fa-228469d4b2f6 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:07.490050 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5db57b31-a190-499c-b3fa-228469d4b2f6 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:07.633724 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-5db57b31-a190-499c-b3fa-228469d4b2f6 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:07.642186 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-5db57b31-a190-499c-b3fa-228469d4b2f6 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.173894 Jun 17 13:24:07.642764 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1031/2091] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:07 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:07.708492 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-379fb75f-a3ba-41cd-bf97-b9973b24368f tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:07.709310 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-379fb75f-a3ba-41cd-bf97-b9973b24368f tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:07.718471 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-379fb75f-a3ba-41cd-bf97-b9973b24368f tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:07.719074 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-379fb75f-a3ba-41cd-bf97-b9973b24368f tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:07.720076 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-379fb75f-a3ba-41cd-bf97-b9973b24368f tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:07.720659 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-379fb75f-a3ba-41cd-bf97-b9973b24368f tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:07.869845 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-379fb75f-a3ba-41cd-bf97-b9973b24368f tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:07.882078 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-379fb75f-a3ba-41cd-bf97-b9973b24368f tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.178443 Jun 17 13:24:07.883233 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1061/2092] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:07 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:08.663525 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-c398c13f-ccbd-4405-8c7c-2f27eb4e8eea tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:08.664458 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-c398c13f-ccbd-4405-8c7c-2f27eb4e8eea tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:08.673530 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c398c13f-ccbd-4405-8c7c-2f27eb4e8eea tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:08.673979 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c398c13f-ccbd-4405-8c7c-2f27eb4e8eea tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:08.674775 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c398c13f-ccbd-4405-8c7c-2f27eb4e8eea tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:08.675207 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c398c13f-ccbd-4405-8c7c-2f27eb4e8eea tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:08.807532 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-c398c13f-ccbd-4405-8c7c-2f27eb4e8eea tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:08.817369 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-c398c13f-ccbd-4405-8c7c-2f27eb4e8eea tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.160153 Jun 17 13:24:08.817941 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1032/2093] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:08 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:08.904640 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-eab0fe89-1fcc-4120-a6e8-8d747d74aa5b tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:08.905415 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-eab0fe89-1fcc-4120-a6e8-8d747d74aa5b tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:08.913187 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-eab0fe89-1fcc-4120-a6e8-8d747d74aa5b tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:08.913736 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-eab0fe89-1fcc-4120-a6e8-8d747d74aa5b tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:08.914674 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-eab0fe89-1fcc-4120-a6e8-8d747d74aa5b tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:08.915189 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-eab0fe89-1fcc-4120-a6e8-8d747d74aa5b tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:09.056759 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-eab0fe89-1fcc-4120-a6e8-8d747d74aa5b tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:09.064929 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-eab0fe89-1fcc-4120-a6e8-8d747d74aa5b tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.166429 Jun 17 13:24:09.065505 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1062/2094] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:08 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:09.610381 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 13:24:09.610713 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Fri Jun 17 13:24:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 17 13:24:09.837990 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-34ee469d-bf12-4e20-b4ad-8571be95c821 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:09.838701 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-34ee469d-bf12-4e20-b4ad-8571be95c821 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:09.845877 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-34ee469d-bf12-4e20-b4ad-8571be95c821 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:09.846348 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-34ee469d-bf12-4e20-b4ad-8571be95c821 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:09.847103 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-34ee469d-bf12-4e20-b4ad-8571be95c821 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:09.847526 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-34ee469d-bf12-4e20-b4ad-8571be95c821 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:09.990402 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-34ee469d-bf12-4e20-b4ad-8571be95c821 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:10.002514 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-34ee469d-bf12-4e20-b4ad-8571be95c821 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.168116 Jun 17 13:24:10.003224 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1033/2095] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:09 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:10.085834 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-fda04424-85c1-4a36-8eea-cd8fa1d4ebac tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:10.086819 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-fda04424-85c1-4a36-8eea-cd8fa1d4ebac tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:10.098130 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-fda04424-85c1-4a36-8eea-cd8fa1d4ebac tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:10.098901 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-fda04424-85c1-4a36-8eea-cd8fa1d4ebac tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:10.100130 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-fda04424-85c1-4a36-8eea-cd8fa1d4ebac tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:10.100839 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-fda04424-85c1-4a36-8eea-cd8fa1d4ebac tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:10.241843 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-fda04424-85c1-4a36-8eea-cd8fa1d4ebac tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:10.249945 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-fda04424-85c1-4a36-8eea-cd8fa1d4ebac tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.170452 Jun 17 13:24:10.250582 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1063/2096] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:10 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:11.263120 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-0db6eef0-4951-4e44-ab11-1e260e25860c tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:11.263680 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-0db6eef0-4951-4e44-ab11-1e260e25860c tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:11.267501 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-2f5d019f-b5ed-4077-9d8a-9eb91b61d9f2 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:11.268103 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-2f5d019f-b5ed-4077-9d8a-9eb91b61d9f2 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:11.270186 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0db6eef0-4951-4e44-ab11-1e260e25860c tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:11.270625 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0db6eef0-4951-4e44-ab11-1e260e25860c tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:11.271398 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0db6eef0-4951-4e44-ab11-1e260e25860c tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:11.271829 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0db6eef0-4951-4e44-ab11-1e260e25860c tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:11.274906 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2f5d019f-b5ed-4077-9d8a-9eb91b61d9f2 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:11.275348 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2f5d019f-b5ed-4077-9d8a-9eb91b61d9f2 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:11.276080 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2f5d019f-b5ed-4077-9d8a-9eb91b61d9f2 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:11.276506 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2f5d019f-b5ed-4077-9d8a-9eb91b61d9f2 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:11.459902 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-2f5d019f-b5ed-4077-9d8a-9eb91b61d9f2 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:11.470190 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-2f5d019f-b5ed-4077-9d8a-9eb91b61d9f2 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.206351 Jun 17 13:24:11.480089 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1064/2097] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:11 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 13:24:11.480435 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-0db6eef0-4951-4e44-ab11-1e260e25860c tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:11.483937 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-0db6eef0-4951-4e44-ab11-1e260e25860c tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.466624 Jun 17 13:24:11.484553 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1034/2098] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:11 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:12.408721 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-fb409850-95c4-4580-986a-7b3885a5e055 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:12.409269 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-fb409850-95c4-4580-986a-7b3885a5e055 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:12.416104 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-fb409850-95c4-4580-986a-7b3885a5e055 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:12.416570 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-fb409850-95c4-4580-986a-7b3885a5e055 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:12.417328 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-fb409850-95c4-4580-986a-7b3885a5e055 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:12.417764 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-fb409850-95c4-4580-986a-7b3885a5e055 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:12.443188 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-fb409850-95c4-4580-986a-7b3885a5e055 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Going to try to terminate instance {{(pid=117659) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 17 13:24:12.535029 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-fb409850-95c4-4580-986a-7b3885a5e055 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "DELETE /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 204 len: 0 microversion: 2.1 time: 0.129834 Jun 17 13:24:12.535783 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1065/2099] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Jun 17 13:24:12 2022] DELETE /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 17 13:24:12.541038 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-5e8e5058-79ac-4a4c-9617-f73be130b4f3 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:12.541738 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-5e8e5058-79ac-4a4c-9617-f73be130b4f3 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:12.547820 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-5e8e5058-79ac-4a4c-9617-f73be130b4f3 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:12.548266 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-5e8e5058-79ac-4a4c-9617-f73be130b4f3 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:12.549046 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-5e8e5058-79ac-4a4c-9617-f73be130b4f3 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:12.549481 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-5e8e5058-79ac-4a4c-9617-f73be130b4f3 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:12.643211 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-7de65c3a-1824-43b3-a122-6ba8c219a5b4 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:12.643928 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-7de65c3a-1824-43b3-a122-6ba8c219a5b4 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:12.646987 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_api:SELECT=50 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:24:12.650805 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7de65c3a-1824-43b3-a122-6ba8c219a5b4 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:12.651254 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7de65c3a-1824-43b3-a122-6ba8c219a5b4 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:12.652171 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7de65c3a-1824-43b3-a122-6ba8c219a5b4 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:12.652637 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7de65c3a-1824-43b3-a122-6ba8c219a5b4 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:12.686266 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-5e8e5058-79ac-4a4c-9617-f73be130b4f3 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:12.696220 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-5e8e5058-79ac-4a4c-9617-f73be130b4f3 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.159073 Jun 17 13:24:12.696699 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1066/2100] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:12 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:12.701434 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-3a452187-1226-4149-9d44-8adfe86098b3 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:12.702032 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-3a452187-1226-4149-9d44-8adfe86098b3 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:12.708717 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-3a452187-1226-4149-9d44-8adfe86098b3 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:12.709163 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-3a452187-1226-4149-9d44-8adfe86098b3 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:12.709919 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-3a452187-1226-4149-9d44-8adfe86098b3 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:12.710369 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-3a452187-1226-4149-9d44-8adfe86098b3 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:12.715993 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:24:12.854341 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-7de65c3a-1824-43b3-a122-6ba8c219a5b4 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:12.863454 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-7de65c3a-1824-43b3-a122-6ba8c219a5b4 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.378445 Jun 17 13:24:12.864405 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1035/2101] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:12 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:12.904265 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-3a452187-1226-4149-9d44-8adfe86098b3 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:12.912942 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-3a452187-1226-4149-9d44-8adfe86098b3 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1718 microversion: 2.1 time: 0.215227 Jun 17 13:24:12.913516 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1067/2102] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:12 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1718 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:13.719715 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-cb0bc778-b7a4-46fd-8f63-6bf56d636803 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:13.720359 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-cb0bc778-b7a4-46fd-8f63-6bf56d636803 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:13.729277 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cb0bc778-b7a4-46fd-8f63-6bf56d636803 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:13.730379 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cb0bc778-b7a4-46fd-8f63-6bf56d636803 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:13.731513 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cb0bc778-b7a4-46fd-8f63-6bf56d636803 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:13.731947 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cb0bc778-b7a4-46fd-8f63-6bf56d636803 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:13.869474 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-cb0bc778-b7a4-46fd-8f63-6bf56d636803 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:13.878668 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-cb0bc778-b7a4-46fd-8f63-6bf56d636803 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.163724 Jun 17 13:24:13.879229 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1036/2103] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:13 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:13.880699 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-a43079ba-0cfe-4535-ab0f-f4bc97091d34 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:13.881316 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-a43079ba-0cfe-4535-ab0f-f4bc97091d34 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:13.888836 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a43079ba-0cfe-4535-ab0f-f4bc97091d34 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:13.889282 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a43079ba-0cfe-4535-ab0f-f4bc97091d34 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:13.890038 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a43079ba-0cfe-4535-ab0f-f4bc97091d34 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:13.890490 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a43079ba-0cfe-4535-ab0f-f4bc97091d34 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:13.931260 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-4ea85cee-0ad2-43eb-ae1f-76f23b861130 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:13.931867 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-4ea85cee-0ad2-43eb-ae1f-76f23b861130 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:13.939012 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4ea85cee-0ad2-43eb-ae1f-76f23b861130 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:13.939450 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4ea85cee-0ad2-43eb-ae1f-76f23b861130 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:13.940207 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4ea85cee-0ad2-43eb-ae1f-76f23b861130 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:13.940630 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4ea85cee-0ad2-43eb-ae1f-76f23b861130 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:14.195434 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-a43079ba-0cfe-4535-ab0f-f4bc97091d34 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:14.204026 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-a43079ba-0cfe-4535-ab0f-f4bc97091d34 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.327087 Jun 17 13:24:14.204698 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1068/2104] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:13 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:14.215200 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-4ea85cee-0ad2-43eb-ae1f-76f23b861130 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:14.225551 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-4ea85cee-0ad2-43eb-ae1f-76f23b861130 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1718 microversion: 2.1 time: 0.298016 Jun 17 13:24:14.226342 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1037/2105] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:13 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1718 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:14.894836 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-c7558ef0-cd51-4d75-b3d5-2f9790ba0f34 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:14.895537 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-c7558ef0-cd51-4d75-b3d5-2f9790ba0f34 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:14.902340 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c7558ef0-cd51-4d75-b3d5-2f9790ba0f34 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:14.902963 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c7558ef0-cd51-4d75-b3d5-2f9790ba0f34 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:14.903993 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c7558ef0-cd51-4d75-b3d5-2f9790ba0f34 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:14.904488 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c7558ef0-cd51-4d75-b3d5-2f9790ba0f34 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:15.117303 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [req-6de43002-eb51-42ff-87c2-a3e937c2769f req-21968b13-969b-4de9-9ba5-a90d4ac4be23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "748a3422-aeab-41c8-b051-df5f7d7ca509", "name": "network-vif-deleted", "tag": "87583636-e590-4c87-87ad-1151137bd889"}]} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:24:15.134485 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-c7558ef0-cd51-4d75-b3d5-2f9790ba0f34 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:15.138908 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-6de43002-eb51-42ff-87c2-a3e937c2769f req-21968b13-969b-4de9-9ba5-a90d4ac4be23 service nova] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:15.139358 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-6de43002-eb51-42ff-87c2-a3e937c2769f req-21968b13-969b-4de9-9ba5-a90d4ac4be23 service nova] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:15.147104 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-c7558ef0-cd51-4d75-b3d5-2f9790ba0f34 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.255852 Jun 17 13:24:15.152232 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.compute.server_external_events [req-6de43002-eb51-42ff-87c2-a3e937c2769f req-21968b13-969b-4de9-9ba5-a90d4ac4be23 service nova] Creating event network-vif-deleted:87583636-e590-4c87-87ad-1151137bd889 for instance 748a3422-aeab-41c8-b051-df5f7d7ca509 on hv-cinder-83754 Jun 17 13:24:15.159136 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1069/2106] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:14 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:15.162184 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [req-6de43002-eb51-42ff-87c2-a3e937c2769f req-21968b13-969b-4de9-9ba5-a90d4ac4be23 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.141503 Jun 17 13:24:15.164901 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1038/2107] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 13:24:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 13:24:15.221129 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-e24e738e-a9ae-42c4-8523-586c4d7049f3 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:15.221746 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-e24e738e-a9ae-42c4-8523-586c4d7049f3 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:15.228234 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e24e738e-a9ae-42c4-8523-586c4d7049f3 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:15.228680 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e24e738e-a9ae-42c4-8523-586c4d7049f3 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:15.230679 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e24e738e-a9ae-42c4-8523-586c4d7049f3 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:15.231186 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e24e738e-a9ae-42c4-8523-586c4d7049f3 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:15.244979 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-32c3a4b8-4223-42fc-a180-70d260df57e4 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:15.245740 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-32c3a4b8-4223-42fc-a180-70d260df57e4 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:15.256974 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-32c3a4b8-4223-42fc-a180-70d260df57e4 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:15.257797 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-32c3a4b8-4223-42fc-a180-70d260df57e4 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:15.259048 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-32c3a4b8-4223-42fc-a180-70d260df57e4 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:15.259716 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-32c3a4b8-4223-42fc-a180-70d260df57e4 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:15.333729 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-32c3a4b8-4223-42fc-a180-70d260df57e4 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:15.342398 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-32c3a4b8-4223-42fc-a180-70d260df57e4 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.102291 Jun 17 13:24:15.343022 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1039/2108] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:15 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:15.390208 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-e24e738e-a9ae-42c4-8523-586c4d7049f3 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:15.398748 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-e24e738e-a9ae-42c4-8523-586c4d7049f3 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.181723 Jun 17 13:24:15.399526 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1070/2109] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:15 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:16.165082 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-c3a18584-b89f-462b-89cf-a35a06fb19b9 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:16.165694 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-c3a18584-b89f-462b-89cf-a35a06fb19b9 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:16.173077 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c3a18584-b89f-462b-89cf-a35a06fb19b9 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:16.173524 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c3a18584-b89f-462b-89cf-a35a06fb19b9 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:16.174341 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c3a18584-b89f-462b-89cf-a35a06fb19b9 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:16.174755 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c3a18584-b89f-462b-89cf-a35a06fb19b9 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:16.360211 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-e2dcb496-8350-4bcc-a180-3844ed61783b tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:16.360918 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-e2dcb496-8350-4bcc-a180-3844ed61783b tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:16.367772 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e2dcb496-8350-4bcc-a180-3844ed61783b tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:16.368225 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e2dcb496-8350-4bcc-a180-3844ed61783b tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:16.368979 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e2dcb496-8350-4bcc-a180-3844ed61783b tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:16.369414 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e2dcb496-8350-4bcc-a180-3844ed61783b tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:16.449558 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-e2dcb496-8350-4bcc-a180-3844ed61783b tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:16.458448 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-e2dcb496-8350-4bcc-a180-3844ed61783b tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.102374 Jun 17 13:24:16.459063 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1071/2110] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:16 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:16.464179 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-859a1dc5-bb0b-421e-b7d0-a92d4a3cabb0 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:16.464792 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-859a1dc5-bb0b-421e-b7d0-a92d4a3cabb0 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:16.470904 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-859a1dc5-bb0b-421e-b7d0-a92d4a3cabb0 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:16.471360 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-859a1dc5-bb0b-421e-b7d0-a92d4a3cabb0 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:16.472119 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-859a1dc5-bb0b-421e-b7d0-a92d4a3cabb0 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:16.472643 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-859a1dc5-bb0b-421e-b7d0-a92d4a3cabb0 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:16.491024 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-c3a18584-b89f-462b-89cf-a35a06fb19b9 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:16.499754 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-c3a18584-b89f-462b-89cf-a35a06fb19b9 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.338575 Jun 17 13:24:16.500314 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1040/2111] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:16 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:16.605160 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-859a1dc5-bb0b-421e-b7d0-a92d4a3cabb0 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:16.613414 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-859a1dc5-bb0b-421e-b7d0-a92d4a3cabb0 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.153399 Jun 17 13:24:16.613959 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1072/2112] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:16 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:17.478826 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-27af3329-c5f9-4388-b00b-d5d097d7772e tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:17.480014 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-27af3329-c5f9-4388-b00b-d5d097d7772e tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:17.487854 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-27af3329-c5f9-4388-b00b-d5d097d7772e tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:17.488297 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-27af3329-c5f9-4388-b00b-d5d097d7772e tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:17.489046 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-27af3329-c5f9-4388-b00b-d5d097d7772e tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:17.489472 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-27af3329-c5f9-4388-b00b-d5d097d7772e tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:17.517017 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-ea23f8f8-b2c6-4cb7-a430-bcc8b04aad74 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:17.517687 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-ea23f8f8-b2c6-4cb7-a430-bcc8b04aad74 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:17.524357 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ea23f8f8-b2c6-4cb7-a430-bcc8b04aad74 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:17.524808 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ea23f8f8-b2c6-4cb7-a430-bcc8b04aad74 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:17.525567 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ea23f8f8-b2c6-4cb7-a430-bcc8b04aad74 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:17.526003 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ea23f8f8-b2c6-4cb7-a430-bcc8b04aad74 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:17.554676 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-27af3329-c5f9-4388-b00b-d5d097d7772e tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:17.563568 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-27af3329-c5f9-4388-b00b-d5d097d7772e tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.091352 Jun 17 13:24:17.564123 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1041/2113] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:17 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:17.636926 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-f7e40400-4c7b-4975-9a79-bad11dd05862 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:17.638220 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-f7e40400-4c7b-4975-9a79-bad11dd05862 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:17.645256 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f7e40400-4c7b-4975-9a79-bad11dd05862 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:17.645714 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f7e40400-4c7b-4975-9a79-bad11dd05862 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:17.646522 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f7e40400-4c7b-4975-9a79-bad11dd05862 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:17.646947 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f7e40400-4c7b-4975-9a79-bad11dd05862 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:17.656227 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-ea23f8f8-b2c6-4cb7-a430-bcc8b04aad74 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:17.665230 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-ea23f8f8-b2c6-4cb7-a430-bcc8b04aad74 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.152119 Jun 17 13:24:17.665809 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1073/2114] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:17 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:17.776898 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-f7e40400-4c7b-4975-9a79-bad11dd05862 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:17.785509 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-f7e40400-4c7b-4975-9a79-bad11dd05862 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.152478 Jun 17 13:24:17.786080 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1042/2115] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:17 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:18.584826 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-9c9fbcd2-880d-4297-8ef9-90c8df7dadbe tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:18.585696 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-9c9fbcd2-880d-4297-8ef9-90c8df7dadbe tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:18.594823 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9c9fbcd2-880d-4297-8ef9-90c8df7dadbe tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:18.595274 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9c9fbcd2-880d-4297-8ef9-90c8df7dadbe tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:18.596035 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9c9fbcd2-880d-4297-8ef9-90c8df7dadbe tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:18.596473 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9c9fbcd2-880d-4297-8ef9-90c8df7dadbe tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:18.662930 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-9c9fbcd2-880d-4297-8ef9-90c8df7dadbe tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:18.671313 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-9c9fbcd2-880d-4297-8ef9-90c8df7dadbe tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.093069 Jun 17 13:24:18.671882 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1074/2116] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:18 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:18.682410 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-86b8f759-942e-4fef-adc8-b305e55367f4 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:18.683030 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-86b8f759-942e-4fef-adc8-b305e55367f4 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:18.690269 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-86b8f759-942e-4fef-adc8-b305e55367f4 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:18.690717 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-86b8f759-942e-4fef-adc8-b305e55367f4 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:18.691486 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-86b8f759-942e-4fef-adc8-b305e55367f4 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:18.691917 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-86b8f759-942e-4fef-adc8-b305e55367f4 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:18.713771 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=100 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:24:18.803043 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-d839b574-1769-46d0-a14e-da0ca02fc35d tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:18.803648 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-d839b574-1769-46d0-a14e-da0ca02fc35d tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:18.810862 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d839b574-1769-46d0-a14e-da0ca02fc35d tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:18.811309 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d839b574-1769-46d0-a14e-da0ca02fc35d tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:18.812084 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d839b574-1769-46d0-a14e-da0ca02fc35d tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:18.812516 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d839b574-1769-46d0-a14e-da0ca02fc35d tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:18.827609 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-86b8f759-942e-4fef-adc8-b305e55367f4 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:18.835734 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-86b8f759-942e-4fef-adc8-b305e55367f4 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.157155 Jun 17 13:24:18.836279 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1043/2117] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:18 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:18.943581 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-d839b574-1769-46d0-a14e-da0ca02fc35d tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:18.952252 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-d839b574-1769-46d0-a14e-da0ca02fc35d tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.153051 Jun 17 13:24:18.952816 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1075/2118] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:18 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:19.690184 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-e52489ff-d447-49c9-91f8-acae77046ad5 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:19.690788 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-e52489ff-d447-49c9-91f8-acae77046ad5 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:19.697175 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e52489ff-d447-49c9-91f8-acae77046ad5 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:19.697616 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e52489ff-d447-49c9-91f8-acae77046ad5 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:19.698432 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e52489ff-d447-49c9-91f8-acae77046ad5 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:19.698857 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e52489ff-d447-49c9-91f8-acae77046ad5 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:19.767080 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-e52489ff-d447-49c9-91f8-acae77046ad5 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:19.775373 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-e52489ff-d447-49c9-91f8-acae77046ad5 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.089343 Jun 17 13:24:19.775944 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1044/2119] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:19 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:19.857450 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-218e737b-252e-4e69-839f-9fcafa49715d tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:19.858114 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-218e737b-252e-4e69-839f-9fcafa49715d tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:19.860567 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:24:19.866479 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-218e737b-252e-4e69-839f-9fcafa49715d tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:19.866942 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-218e737b-252e-4e69-839f-9fcafa49715d tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:19.867709 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-218e737b-252e-4e69-839f-9fcafa49715d tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:19.868166 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-218e737b-252e-4e69-839f-9fcafa49715d tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:19.969622 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-c917d2a4-1142-41f8-89e4-f60d5d7ec845 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:19.970233 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-c917d2a4-1142-41f8-89e4-f60d5d7ec845 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:19.976611 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c917d2a4-1142-41f8-89e4-f60d5d7ec845 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:19.977160 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c917d2a4-1142-41f8-89e4-f60d5d7ec845 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:19.977953 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c917d2a4-1142-41f8-89e4-f60d5d7ec845 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:19.978428 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c917d2a4-1142-41f8-89e4-f60d5d7ec845 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:20.000869 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-218e737b-252e-4e69-839f-9fcafa49715d tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:20.009435 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-218e737b-252e-4e69-839f-9fcafa49715d tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.159177 Jun 17 13:24:20.010022 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1076/2120] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:19 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:20.116922 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-c917d2a4-1142-41f8-89e4-f60d5d7ec845 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:20.125390 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-c917d2a4-1142-41f8-89e4-f60d5d7ec845 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.159853 Jun 17 13:24:20.125923 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1045/2121] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:19 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:20.801247 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-deed1134-9364-4bb6-958d-025eb55f0fae tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:20.802287 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-deed1134-9364-4bb6-958d-025eb55f0fae tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:20.811830 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-deed1134-9364-4bb6-958d-025eb55f0fae tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:20.812279 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-deed1134-9364-4bb6-958d-025eb55f0fae tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:20.813090 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-deed1134-9364-4bb6-958d-025eb55f0fae tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:20.813460 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-deed1134-9364-4bb6-958d-025eb55f0fae tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:20.889369 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-deed1134-9364-4bb6-958d-025eb55f0fae tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:20.897426 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-deed1134-9364-4bb6-958d-025eb55f0fae tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.102854 Jun 17 13:24:20.898010 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1077/2122] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:20 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:21.030449 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-723eca54-3229-42a4-8baa-98e60b1020f7 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:21.031040 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-723eca54-3229-42a4-8baa-98e60b1020f7 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:21.038638 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-723eca54-3229-42a4-8baa-98e60b1020f7 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:21.039119 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-723eca54-3229-42a4-8baa-98e60b1020f7 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:21.039889 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-723eca54-3229-42a4-8baa-98e60b1020f7 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:21.040307 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-723eca54-3229-42a4-8baa-98e60b1020f7 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:21.143435 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-bb5ca2e1-5fbf-492c-965b-d45e8b43cf81 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:21.144078 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-bb5ca2e1-5fbf-492c-965b-d45e8b43cf81 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:21.150359 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-bb5ca2e1-5fbf-492c-965b-d45e8b43cf81 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:21.150815 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-bb5ca2e1-5fbf-492c-965b-d45e8b43cf81 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:21.151573 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-bb5ca2e1-5fbf-492c-965b-d45e8b43cf81 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:21.152013 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-bb5ca2e1-5fbf-492c-965b-d45e8b43cf81 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:21.180066 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-723eca54-3229-42a4-8baa-98e60b1020f7 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:21.188165 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-723eca54-3229-42a4-8baa-98e60b1020f7 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.163922 Jun 17 13:24:21.188738 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1046/2123] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:21 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:21.283045 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-bb5ca2e1-5fbf-492c-965b-d45e8b43cf81 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:21.291751 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-bb5ca2e1-5fbf-492c-965b-d45e8b43cf81 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.152997 Jun 17 13:24:21.292352 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1078/2124] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:21 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:21.918131 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-e253f079-b6fb-4ecd-9bb0-0e0331e9761a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:21.919116 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-e253f079-b6fb-4ecd-9bb0-0e0331e9761a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:21.926148 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e253f079-b6fb-4ecd-9bb0-0e0331e9761a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:21.926619 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e253f079-b6fb-4ecd-9bb0-0e0331e9761a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:21.927371 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e253f079-b6fb-4ecd-9bb0-0e0331e9761a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:21.927792 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e253f079-b6fb-4ecd-9bb0-0e0331e9761a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:22.002960 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-e253f079-b6fb-4ecd-9bb0-0e0331e9761a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:22.014977 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-e253f079-b6fb-4ecd-9bb0-0e0331e9761a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.103384 Jun 17 13:24:22.015504 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1047/2125] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:21 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:22.208386 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-146ab58f-2508-4b52-a0c7-8f11fa7cd1f7 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:22.209025 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-146ab58f-2508-4b52-a0c7-8f11fa7cd1f7 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:22.218507 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-146ab58f-2508-4b52-a0c7-8f11fa7cd1f7 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:22.218947 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-146ab58f-2508-4b52-a0c7-8f11fa7cd1f7 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:22.219747 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-146ab58f-2508-4b52-a0c7-8f11fa7cd1f7 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:22.220174 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-146ab58f-2508-4b52-a0c7-8f11fa7cd1f7 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:22.308789 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-f6afcddc-7df8-4245-a374-7876748595f7 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:22.309442 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-f6afcddc-7df8-4245-a374-7876748595f7 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:22.316347 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f6afcddc-7df8-4245-a374-7876748595f7 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:22.316801 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f6afcddc-7df8-4245-a374-7876748595f7 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:22.317561 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f6afcddc-7df8-4245-a374-7876748595f7 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:22.318009 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f6afcddc-7df8-4245-a374-7876748595f7 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:22.365979 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-146ab58f-2508-4b52-a0c7-8f11fa7cd1f7 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:22.374042 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-146ab58f-2508-4b52-a0c7-8f11fa7cd1f7 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.172453 Jun 17 13:24:22.374633 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1079/2126] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:22 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:22.461978 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-f6afcddc-7df8-4245-a374-7876748595f7 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:22.470812 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-f6afcddc-7df8-4245-a374-7876748595f7 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.165870 Jun 17 13:24:22.471359 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1048/2127] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:22 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:23.041623 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-6065d6b2-b9a9-4105-8170-ac8cf138f199 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:23.042895 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-6065d6b2-b9a9-4105-8170-ac8cf138f199 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:23.053900 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6065d6b2-b9a9-4105-8170-ac8cf138f199 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:23.054677 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6065d6b2-b9a9-4105-8170-ac8cf138f199 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:23.055893 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6065d6b2-b9a9-4105-8170-ac8cf138f199 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:23.056625 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6065d6b2-b9a9-4105-8170-ac8cf138f199 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:23.132914 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-6065d6b2-b9a9-4105-8170-ac8cf138f199 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:23.141257 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-6065d6b2-b9a9-4105-8170-ac8cf138f199 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.106227 Jun 17 13:24:23.141826 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1080/2128] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:23 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:23.392711 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-0e84c0df-1d22-4be9-8200-00bb4727ecf2 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:23.393308 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-0e84c0df-1d22-4be9-8200-00bb4727ecf2 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:23.400762 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0e84c0df-1d22-4be9-8200-00bb4727ecf2 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:23.401234 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0e84c0df-1d22-4be9-8200-00bb4727ecf2 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:23.402029 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0e84c0df-1d22-4be9-8200-00bb4727ecf2 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:23.402521 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0e84c0df-1d22-4be9-8200-00bb4727ecf2 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:23.489185 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-aa7447e1-f11f-4130-aa25-5a952b7d47ad tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:23.490170 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-aa7447e1-f11f-4130-aa25-5a952b7d47ad tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:23.497699 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-aa7447e1-f11f-4130-aa25-5a952b7d47ad tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:23.498161 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-aa7447e1-f11f-4130-aa25-5a952b7d47ad tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:23.498934 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-aa7447e1-f11f-4130-aa25-5a952b7d47ad tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:23.499436 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-aa7447e1-f11f-4130-aa25-5a952b7d47ad tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:23.548981 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-0e84c0df-1d22-4be9-8200-00bb4727ecf2 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:23.557618 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-0e84c0df-1d22-4be9-8200-00bb4727ecf2 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.169594 Jun 17 13:24:23.558254 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1049/2129] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:23 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:23.635305 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-aa7447e1-f11f-4130-aa25-5a952b7d47ad tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:23.643965 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-aa7447e1-f11f-4130-aa25-5a952b7d47ad tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.159398 Jun 17 13:24:23.644535 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1081/2130] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:23 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:24.162439 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-bce3ec3a-3e24-4f58-ab50-41c9e0da883f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:24.163443 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-bce3ec3a-3e24-4f58-ab50-41c9e0da883f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:24.172642 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bce3ec3a-3e24-4f58-ab50-41c9e0da883f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:24.173088 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bce3ec3a-3e24-4f58-ab50-41c9e0da883f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:24.173846 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bce3ec3a-3e24-4f58-ab50-41c9e0da883f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:24.174324 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bce3ec3a-3e24-4f58-ab50-41c9e0da883f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:24.252635 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-bce3ec3a-3e24-4f58-ab50-41c9e0da883f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:24.264847 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-bce3ec3a-3e24-4f58-ab50-41c9e0da883f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.108587 Jun 17 13:24:24.265707 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1050/2131] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:24 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:24.579722 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-feba415a-9a22-437e-addb-294af15afa4c tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:24.580588 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-feba415a-9a22-437e-addb-294af15afa4c tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:24.591628 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-feba415a-9a22-437e-addb-294af15afa4c tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:24.592514 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-feba415a-9a22-437e-addb-294af15afa4c tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:24.593310 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-feba415a-9a22-437e-addb-294af15afa4c tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:24.593746 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-feba415a-9a22-437e-addb-294af15afa4c tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:24.662041 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-4d229e51-b55b-4f24-b203-fb01aa89cc30 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:24.662757 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-4d229e51-b55b-4f24-b203-fb01aa89cc30 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:24.669649 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4d229e51-b55b-4f24-b203-fb01aa89cc30 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:24.670118 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4d229e51-b55b-4f24-b203-fb01aa89cc30 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:24.670904 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4d229e51-b55b-4f24-b203-fb01aa89cc30 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:24.671335 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4d229e51-b55b-4f24-b203-fb01aa89cc30 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:24.772006 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-feba415a-9a22-437e-addb-294af15afa4c tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:24.780655 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-feba415a-9a22-437e-addb-294af15afa4c tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.207932 Jun 17 13:24:24.781479 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1082/2132] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:24 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:24.818065 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-4d229e51-b55b-4f24-b203-fb01aa89cc30 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:24.829102 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-4d229e51-b55b-4f24-b203-fb01aa89cc30 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.171917 Jun 17 13:24:24.829659 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1051/2133] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:24 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:25.285746 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-488f356d-58a5-48da-9a53-661f4d16ed6d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:25.286829 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-488f356d-58a5-48da-9a53-661f4d16ed6d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:25.295349 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-488f356d-58a5-48da-9a53-661f4d16ed6d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:25.295834 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-488f356d-58a5-48da-9a53-661f4d16ed6d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:25.296918 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-488f356d-58a5-48da-9a53-661f4d16ed6d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:25.297511 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-488f356d-58a5-48da-9a53-661f4d16ed6d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:25.369630 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-488f356d-58a5-48da-9a53-661f4d16ed6d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:25.373090 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_cell1:SELECT=100 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:24:25.378809 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-488f356d-58a5-48da-9a53-661f4d16ed6d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.099190 Jun 17 13:24:25.379357 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1083/2134] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:25 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:25.798219 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-aca4204f-f8da-448a-a74b-a548c62f46c5 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:25.798908 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-aca4204f-f8da-448a-a74b-a548c62f46c5 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:25.806927 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-aca4204f-f8da-448a-a74b-a548c62f46c5 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:25.807448 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-aca4204f-f8da-448a-a74b-a548c62f46c5 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:25.808336 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-aca4204f-f8da-448a-a74b-a548c62f46c5 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:25.808839 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-aca4204f-f8da-448a-a74b-a548c62f46c5 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:25.847491 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-7d1bead4-be91-4a24-9d50-eb9048c13b6e tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:25.848121 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-7d1bead4-be91-4a24-9d50-eb9048c13b6e tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:25.855022 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7d1bead4-be91-4a24-9d50-eb9048c13b6e tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:25.855474 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7d1bead4-be91-4a24-9d50-eb9048c13b6e tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:25.856252 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7d1bead4-be91-4a24-9d50-eb9048c13b6e tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:25.856705 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7d1bead4-be91-4a24-9d50-eb9048c13b6e tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:25.996799 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-aca4204f-f8da-448a-a74b-a548c62f46c5 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:26.006227 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-aca4204f-f8da-448a-a74b-a548c62f46c5 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.212416 Jun 17 13:24:26.015800 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1052/2135] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:25 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:26.027065 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-7d1bead4-be91-4a24-9d50-eb9048c13b6e tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:26.036428 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-7d1bead4-be91-4a24-9d50-eb9048c13b6e tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.193645 Jun 17 13:24:26.036995 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1084/2136] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:25 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:26.396712 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-bc3b93b0-788e-4856-9a7b-06ec6cef3215 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:26.397359 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-bc3b93b0-788e-4856-9a7b-06ec6cef3215 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:26.404069 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bc3b93b0-788e-4856-9a7b-06ec6cef3215 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:26.404512 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bc3b93b0-788e-4856-9a7b-06ec6cef3215 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:26.405303 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bc3b93b0-788e-4856-9a7b-06ec6cef3215 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:26.405732 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bc3b93b0-788e-4856-9a7b-06ec6cef3215 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:26.658421 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-bc3b93b0-788e-4856-9a7b-06ec6cef3215 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:26.667025 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-bc3b93b0-788e-4856-9a7b-06ec6cef3215 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.274328 Jun 17 13:24:26.667565 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1053/2137] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:26 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:27.022652 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-0f18e80c-55a8-458a-9861-94ef893589ca tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:27.023413 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-0f18e80c-55a8-458a-9861-94ef893589ca tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:27.030182 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0f18e80c-55a8-458a-9861-94ef893589ca tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:27.030896 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0f18e80c-55a8-458a-9861-94ef893589ca tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:27.031382 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0f18e80c-55a8-458a-9861-94ef893589ca tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:27.031819 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0f18e80c-55a8-458a-9861-94ef893589ca tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:27.053918 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-d6c03ac8-8420-4d64-9ce5-7b3c61d7d3d5 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:27.054553 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-d6c03ac8-8420-4d64-9ce5-7b3c61d7d3d5 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:27.061105 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d6c03ac8-8420-4d64-9ce5-7b3c61d7d3d5 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:27.061811 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d6c03ac8-8420-4d64-9ce5-7b3c61d7d3d5 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:27.062789 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d6c03ac8-8420-4d64-9ce5-7b3c61d7d3d5 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:27.063218 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d6c03ac8-8420-4d64-9ce5-7b3c61d7d3d5 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:27.301607 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-0f18e80c-55a8-458a-9861-94ef893589ca tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:27.310385 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-0f18e80c-55a8-458a-9861-94ef893589ca tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.291557 Jun 17 13:24:27.311051 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1085/2138] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:27 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:27.314584 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-d6c03ac8-8420-4d64-9ce5-7b3c61d7d3d5 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:27.324553 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-d6c03ac8-8420-4d64-9ce5-7b3c61d7d3d5 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.274147 Jun 17 13:24:27.325439 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1054/2139] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:27 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 13:24:27.688330 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-2dcbacff-4c64-4b9c-82ba-04653d8778de tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:27.689136 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-2dcbacff-4c64-4b9c-82ba-04653d8778de tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:27.697650 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2dcbacff-4c64-4b9c-82ba-04653d8778de tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:27.698283 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2dcbacff-4c64-4b9c-82ba-04653d8778de tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:27.699272 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2dcbacff-4c64-4b9c-82ba-04653d8778de tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:27.699838 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2dcbacff-4c64-4b9c-82ba-04653d8778de tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:27.770039 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-2dcbacff-4c64-4b9c-82ba-04653d8778de tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:27.781670 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-2dcbacff-4c64-4b9c-82ba-04653d8778de tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.099568 Jun 17 13:24:27.782544 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1086/2140] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:27 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:28.332559 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-f937aab0-fb2b-49e3-a742-46a3e4ed6166 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:28.333610 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-f937aab0-fb2b-49e3-a742-46a3e4ed6166 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:28.345115 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-3acff35d-be9e-44f1-917f-998ec3cb3c31 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:28.345731 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-3acff35d-be9e-44f1-917f-998ec3cb3c31 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:28.345864 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f937aab0-fb2b-49e3-a742-46a3e4ed6166 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:28.346324 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f937aab0-fb2b-49e3-a742-46a3e4ed6166 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:28.347097 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f937aab0-fb2b-49e3-a742-46a3e4ed6166 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:28.347532 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f937aab0-fb2b-49e3-a742-46a3e4ed6166 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:28.352218 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-3acff35d-be9e-44f1-917f-998ec3cb3c31 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:28.352671 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-3acff35d-be9e-44f1-917f-998ec3cb3c31 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:28.353429 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-3acff35d-be9e-44f1-917f-998ec3cb3c31 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:28.353860 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-3acff35d-be9e-44f1-917f-998ec3cb3c31 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:28.541077 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-f937aab0-fb2b-49e3-a742-46a3e4ed6166 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:28.544017 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-3acff35d-be9e-44f1-917f-998ec3cb3c31 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:28.549450 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-f937aab0-fb2b-49e3-a742-46a3e4ed6166 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.223403 Jun 17 13:24:28.550161 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1055/2141] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:28 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:28.553342 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-3acff35d-be9e-44f1-917f-998ec3cb3c31 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.213290 Jun 17 13:24:28.553881 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1087/2142] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:28 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:28.808057 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-d0f3995a-7406-4f98-b69f-8a35d343c36a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:28.809071 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-d0f3995a-7406-4f98-b69f-8a35d343c36a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:28.819815 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d0f3995a-7406-4f98-b69f-8a35d343c36a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:28.820556 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d0f3995a-7406-4f98-b69f-8a35d343c36a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:28.821799 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d0f3995a-7406-4f98-b69f-8a35d343c36a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:28.822578 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d0f3995a-7406-4f98-b69f-8a35d343c36a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:28.888072 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-d0f3995a-7406-4f98-b69f-8a35d343c36a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:28.896989 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-d0f3995a-7406-4f98-b69f-8a35d343c36a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.095725 Jun 17 13:24:28.897556 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1056/2143] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:28 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:29.571318 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-071be970-bd64-45bf-a70a-17dd71d3a4f7 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:29.572147 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-071be970-bd64-45bf-a70a-17dd71d3a4f7 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:29.574675 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-cb52ba18-5847-43bd-b4d4-6b3e9232d287 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:29.575824 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-cb52ba18-5847-43bd-b4d4-6b3e9232d287 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:29.581110 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-071be970-bd64-45bf-a70a-17dd71d3a4f7 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:29.581555 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-071be970-bd64-45bf-a70a-17dd71d3a4f7 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:29.582334 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-071be970-bd64-45bf-a70a-17dd71d3a4f7 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:29.582758 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-071be970-bd64-45bf-a70a-17dd71d3a4f7 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:29.583287 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cb52ba18-5847-43bd-b4d4-6b3e9232d287 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:29.583733 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cb52ba18-5847-43bd-b4d4-6b3e9232d287 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:29.584502 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cb52ba18-5847-43bd-b4d4-6b3e9232d287 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:29.584935 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cb52ba18-5847-43bd-b4d4-6b3e9232d287 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:29.779308 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-071be970-bd64-45bf-a70a-17dd71d3a4f7 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:29.782856 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-cb52ba18-5847-43bd-b4d4-6b3e9232d287 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:29.787538 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-071be970-bd64-45bf-a70a-17dd71d3a4f7 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.222879 Jun 17 13:24:29.788083 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1088/2144] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:29 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:29.791050 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-cb52ba18-5847-43bd-b4d4-6b3e9232d287 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.222791 Jun 17 13:24:29.791828 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1057/2145] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:29 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:29.918124 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-d2abcb8e-dd53-48ea-9e03-4300043f0a43 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:29.919167 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-d2abcb8e-dd53-48ea-9e03-4300043f0a43 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:29.929518 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d2abcb8e-dd53-48ea-9e03-4300043f0a43 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:29.930316 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d2abcb8e-dd53-48ea-9e03-4300043f0a43 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:29.931562 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d2abcb8e-dd53-48ea-9e03-4300043f0a43 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:29.932296 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d2abcb8e-dd53-48ea-9e03-4300043f0a43 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:29.996461 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-d2abcb8e-dd53-48ea-9e03-4300043f0a43 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:30.004665 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-d2abcb8e-dd53-48ea-9e03-4300043f0a43 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.092863 Jun 17 13:24:30.005226 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1089/2146] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:29 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:30.806197 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-5247c051-f61c-4a6d-adc9-52ab3d04178d tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:30.807034 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-5247c051-f61c-4a6d-adc9-52ab3d04178d tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:30.807683 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-2546549c-fdab-4fd8-98ea-afc409e766e6 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:30.808323 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-2546549c-fdab-4fd8-98ea-afc409e766e6 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:30.818306 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5247c051-f61c-4a6d-adc9-52ab3d04178d tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:30.818741 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5247c051-f61c-4a6d-adc9-52ab3d04178d tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:30.819536 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5247c051-f61c-4a6d-adc9-52ab3d04178d tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:30.819976 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5247c051-f61c-4a6d-adc9-52ab3d04178d tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:30.820163 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2546549c-fdab-4fd8-98ea-afc409e766e6 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:30.820676 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2546549c-fdab-4fd8-98ea-afc409e766e6 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:30.821609 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2546549c-fdab-4fd8-98ea-afc409e766e6 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:30.822126 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2546549c-fdab-4fd8-98ea-afc409e766e6 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:31.036824 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-5247c051-f61c-4a6d-adc9-52ab3d04178d tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:31.044902 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-5247c051-f61c-4a6d-adc9-52ab3d04178d tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.243565 Jun 17 13:24:31.045471 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1058/2147] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:30 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:31.049943 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-2546549c-fdab-4fd8-98ea-afc409e766e6 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:31.056522 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-c9c9cddb-eeaf-42fa-806a-3c9215590213 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:31.057099 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-c9c9cddb-eeaf-42fa-806a-3c9215590213 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:31.058814 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-2546549c-fdab-4fd8-98ea-afc409e766e6 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.255208 Jun 17 13:24:31.059465 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1090/2148] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:30 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:31.063445 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c9c9cddb-eeaf-42fa-806a-3c9215590213 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:31.063900 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c9c9cddb-eeaf-42fa-806a-3c9215590213 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:31.064699 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c9c9cddb-eeaf-42fa-806a-3c9215590213 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:31.065134 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c9c9cddb-eeaf-42fa-806a-3c9215590213 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:31.138005 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-c9c9cddb-eeaf-42fa-806a-3c9215590213 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:31.150410 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-c9c9cddb-eeaf-42fa-806a-3c9215590213 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.099389 Jun 17 13:24:31.151196 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1059/2149] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:31 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:32.064049 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-49e8dd06-f740-4896-85b8-68397c6d9aba tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:32.065198 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-49e8dd06-f740-4896-85b8-68397c6d9aba tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:32.072356 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-49e8dd06-f740-4896-85b8-68397c6d9aba tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:32.072841 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-49e8dd06-f740-4896-85b8-68397c6d9aba tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:32.073601 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-49e8dd06-f740-4896-85b8-68397c6d9aba tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:32.074032 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-49e8dd06-f740-4896-85b8-68397c6d9aba tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:32.076727 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-dd42e361-2a31-4cc5-a862-fbe390cdea04 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:32.077384 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-dd42e361-2a31-4cc5-a862-fbe390cdea04 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:32.084542 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dd42e361-2a31-4cc5-a862-fbe390cdea04 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:32.084919 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dd42e361-2a31-4cc5-a862-fbe390cdea04 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:32.085702 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dd42e361-2a31-4cc5-a862-fbe390cdea04 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:32.086118 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dd42e361-2a31-4cc5-a862-fbe390cdea04 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:32.090219 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=100 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:24:32.280114 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-49e8dd06-f740-4896-85b8-68397c6d9aba tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:32.283311 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-dd42e361-2a31-4cc5-a862-fbe390cdea04 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:32.291393 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-49e8dd06-f740-4896-85b8-68397c6d9aba tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.232239 Jun 17 13:24:32.292401 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1091/2150] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:32 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:32.293489 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-dd42e361-2a31-4cc5-a862-fbe390cdea04 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.220796 Jun 17 13:24:32.298872 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1060/2151] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:32 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:32.299083 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-1b319ba5-96c4-42f5-9f47-81207f45c541 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:32.299083 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-1b319ba5-96c4-42f5-9f47-81207f45c541 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:32.303915 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-1b319ba5-96c4-42f5-9f47-81207f45c541 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:32.304365 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-1b319ba5-96c4-42f5-9f47-81207f45c541 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:32.305133 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-1b319ba5-96c4-42f5-9f47-81207f45c541 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:32.305573 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-1b319ba5-96c4-42f5-9f47-81207f45c541 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:32.373403 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-1b319ba5-96c4-42f5-9f47-81207f45c541 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:32.383525 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-1b319ba5-96c4-42f5-9f47-81207f45c541 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.090348 Jun 17 13:24:32.384107 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1092/2152] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:32 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:33.313367 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-392b096f-ec88-408e-a15c-281e8a077dd2 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:33.314656 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-392b096f-ec88-408e-a15c-281e8a077dd2 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:33.314846 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-bf2e6fbc-68ad-417e-be96-f28cf3a8005d tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:33.315484 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-bf2e6fbc-68ad-417e-be96-f28cf3a8005d tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:33.322467 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-392b096f-ec88-408e-a15c-281e8a077dd2 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:33.322902 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-392b096f-ec88-408e-a15c-281e8a077dd2 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:33.323141 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-bf2e6fbc-68ad-417e-be96-f28cf3a8005d tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:33.323588 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-bf2e6fbc-68ad-417e-be96-f28cf3a8005d tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:33.323702 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-392b096f-ec88-408e-a15c-281e8a077dd2 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:33.324092 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-392b096f-ec88-408e-a15c-281e8a077dd2 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:33.324334 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-bf2e6fbc-68ad-417e-be96-f28cf3a8005d tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:33.324759 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-bf2e6fbc-68ad-417e-be96-f28cf3a8005d tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:33.522826 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-bf2e6fbc-68ad-417e-be96-f28cf3a8005d tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:33.528068 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-392b096f-ec88-408e-a15c-281e8a077dd2 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:33.533189 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-bf2e6fbc-68ad-417e-be96-f28cf3a8005d tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.225463 Jun 17 13:24:33.533889 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1093/2153] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:33 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:33.537543 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-392b096f-ec88-408e-a15c-281e8a077dd2 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.230970 Jun 17 13:24:33.538305 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1061/2154] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:33 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:33.539038 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-d0f556c6-7697-4f6b-95a6-546627eafb5f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:33.539650 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-d0f556c6-7697-4f6b-95a6-546627eafb5f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:33.545949 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d0f556c6-7697-4f6b-95a6-546627eafb5f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:33.546433 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d0f556c6-7697-4f6b-95a6-546627eafb5f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:33.547204 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d0f556c6-7697-4f6b-95a6-546627eafb5f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:33.547636 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d0f556c6-7697-4f6b-95a6-546627eafb5f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:33.611312 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-d0f556c6-7697-4f6b-95a6-546627eafb5f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:33.620278 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-d0f556c6-7697-4f6b-95a6-546627eafb5f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.085389 Jun 17 13:24:33.620871 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1094/2155] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:33 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:34.554591 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-3bdac68a-4b4e-4e98-a7d9-f25fa53bebac tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:34.572564 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-3bdac68a-4b4e-4e98-a7d9-f25fa53bebac tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:34.572764 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-dd38665c-91cd-4842-9503-63f5934a2ad9 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:34.572764 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-dd38665c-91cd-4842-9503-63f5934a2ad9 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:34.573344 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3bdac68a-4b4e-4e98-a7d9-f25fa53bebac tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:34.573344 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3bdac68a-4b4e-4e98-a7d9-f25fa53bebac tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:34.573344 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3bdac68a-4b4e-4e98-a7d9-f25fa53bebac tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:34.573344 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3bdac68a-4b4e-4e98-a7d9-f25fa53bebac tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:34.573796 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-dd38665c-91cd-4842-9503-63f5934a2ad9 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:34.574306 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-dd38665c-91cd-4842-9503-63f5934a2ad9 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:34.575026 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-dd38665c-91cd-4842-9503-63f5934a2ad9 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:34.575456 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-dd38665c-91cd-4842-9503-63f5934a2ad9 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:34.781265 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-3bdac68a-4b4e-4e98-a7d9-f25fa53bebac tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:34.785492 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-dd38665c-91cd-4842-9503-63f5934a2ad9 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:34.790418 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-3bdac68a-4b4e-4e98-a7d9-f25fa53bebac tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.241383 Jun 17 13:24:34.791018 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1062/2156] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:34 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:34.795806 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-6b9ec0ea-3ddb-4ecc-ab62-e6e47c4b93df tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:34.796430 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-6b9ec0ea-3ddb-4ecc-ab62-e6e47c4b93df tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:34.801322 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-dd38665c-91cd-4842-9503-63f5934a2ad9 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.249677 Jun 17 13:24:34.802130 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1095/2157] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:34 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:34.802758 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6b9ec0ea-3ddb-4ecc-ab62-e6e47c4b93df tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:34.803214 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6b9ec0ea-3ddb-4ecc-ab62-e6e47c4b93df tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:34.803986 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6b9ec0ea-3ddb-4ecc-ab62-e6e47c4b93df tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:34.804428 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6b9ec0ea-3ddb-4ecc-ab62-e6e47c4b93df tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:34.870063 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-6b9ec0ea-3ddb-4ecc-ab62-e6e47c4b93df tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:34.882005 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-6b9ec0ea-3ddb-4ecc-ab62-e6e47c4b93df tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.089906 Jun 17 13:24:34.882941 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1063/2158] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:34 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:35.808601 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-8ef67527-8527-490d-a7bd-90b9b0580597 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:35.809248 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-8ef67527-8527-490d-a7bd-90b9b0580597 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:35.817400 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8ef67527-8527-490d-a7bd-90b9b0580597 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:35.817861 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8ef67527-8527-490d-a7bd-90b9b0580597 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:35.818710 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8ef67527-8527-490d-a7bd-90b9b0580597 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:35.819049 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-3c315713-ea69-4c7f-91c1-0991f7cc7486 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:35.819532 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8ef67527-8527-490d-a7bd-90b9b0580597 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:35.819650 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-3c315713-ea69-4c7f-91c1-0991f7cc7486 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:35.827048 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3c315713-ea69-4c7f-91c1-0991f7cc7486 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:35.827494 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3c315713-ea69-4c7f-91c1-0991f7cc7486 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:35.828277 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3c315713-ea69-4c7f-91c1-0991f7cc7486 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:35.828714 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3c315713-ea69-4c7f-91c1-0991f7cc7486 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:36.021895 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-8ef67527-8527-490d-a7bd-90b9b0580597 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:36.026237 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-3c315713-ea69-4c7f-91c1-0991f7cc7486 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:36.030626 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-8ef67527-8527-490d-a7bd-90b9b0580597 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.226255 Jun 17 13:24:36.031245 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1096/2159] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:35 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:36.034760 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-3c315713-ea69-4c7f-91c1-0991f7cc7486 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.219740 Jun 17 13:24:36.035519 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1064/2160] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:35 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:36.035678 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-18e785f5-486c-4b08-86c6-aebf59ab8ce3 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:36.036212 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-18e785f5-486c-4b08-86c6-aebf59ab8ce3 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:36.042250 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-18e785f5-486c-4b08-86c6-aebf59ab8ce3 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:36.042694 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-18e785f5-486c-4b08-86c6-aebf59ab8ce3 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:36.043438 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-18e785f5-486c-4b08-86c6-aebf59ab8ce3 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:36.043865 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-18e785f5-486c-4b08-86c6-aebf59ab8ce3 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:36.108781 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-18e785f5-486c-4b08-86c6-aebf59ab8ce3 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:36.121581 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-18e785f5-486c-4b08-86c6-aebf59ab8ce3 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.089123 Jun 17 13:24:36.122435 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1097/2161] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:36 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:37.048455 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-7f466e25-a33f-4d56-906b-6972aadf4493 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:37.049038 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-7f466e25-a33f-4d56-906b-6972aadf4493 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:37.051997 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-0072836b-fe2f-4fb5-9143-91c7278a2722 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:37.052600 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-0072836b-fe2f-4fb5-9143-91c7278a2722 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:37.055965 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7f466e25-a33f-4d56-906b-6972aadf4493 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:37.056410 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7f466e25-a33f-4d56-906b-6972aadf4493 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:37.057163 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7f466e25-a33f-4d56-906b-6972aadf4493 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:37.057591 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7f466e25-a33f-4d56-906b-6972aadf4493 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:37.059988 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0072836b-fe2f-4fb5-9143-91c7278a2722 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:37.060439 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0072836b-fe2f-4fb5-9143-91c7278a2722 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:37.061170 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0072836b-fe2f-4fb5-9143-91c7278a2722 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:37.061624 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0072836b-fe2f-4fb5-9143-91c7278a2722 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:37.258170 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-7f466e25-a33f-4d56-906b-6972aadf4493 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:37.263297 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-0072836b-fe2f-4fb5-9143-91c7278a2722 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:37.271078 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-7f466e25-a33f-4d56-906b-6972aadf4493 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.226451 Jun 17 13:24:37.274159 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1065/2162] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:37 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:37.276289 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-0072836b-fe2f-4fb5-9143-91c7278a2722 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.228035 Jun 17 13:24:37.277127 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-bf42ff4b-cb1a-4df6-9912-bf30a4bb341d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:37.277290 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1098/2163] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:37 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:37.277802 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-bf42ff4b-cb1a-4df6-9912-bf30a4bb341d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:37.284482 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bf42ff4b-cb1a-4df6-9912-bf30a4bb341d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:37.284915 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bf42ff4b-cb1a-4df6-9912-bf30a4bb341d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:37.285750 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bf42ff4b-cb1a-4df6-9912-bf30a4bb341d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:37.286221 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bf42ff4b-cb1a-4df6-9912-bf30a4bb341d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:37.358448 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-bf42ff4b-cb1a-4df6-9912-bf30a4bb341d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:37.366793 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-bf42ff4b-cb1a-4df6-9912-bf30a4bb341d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.093929 Jun 17 13:24:37.367342 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1066/2164] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:37 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:38.289163 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-689aa304-c1af-41fb-bd69-8e5e602d6907 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:38.289790 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-689aa304-c1af-41fb-bd69-8e5e602d6907 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:38.294004 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-3f3add6b-acc9-426c-95a1-0c8a7f2962b5 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:38.295334 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-3f3add6b-acc9-426c-95a1-0c8a7f2962b5 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:38.297155 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-689aa304-c1af-41fb-bd69-8e5e602d6907 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:38.297598 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-689aa304-c1af-41fb-bd69-8e5e602d6907 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:38.298404 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-689aa304-c1af-41fb-bd69-8e5e602d6907 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:38.298818 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-689aa304-c1af-41fb-bd69-8e5e602d6907 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:38.302261 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3f3add6b-acc9-426c-95a1-0c8a7f2962b5 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:38.302709 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3f3add6b-acc9-426c-95a1-0c8a7f2962b5 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:38.303474 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3f3add6b-acc9-426c-95a1-0c8a7f2962b5 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:38.303936 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3f3add6b-acc9-426c-95a1-0c8a7f2962b5 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:38.502203 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-689aa304-c1af-41fb-bd69-8e5e602d6907 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:38.506309 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-3f3add6b-acc9-426c-95a1-0c8a7f2962b5 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:38.510960 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-689aa304-c1af-41fb-bd69-8e5e602d6907 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.225635 Jun 17 13:24:38.511529 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1099/2165] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:38 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:38.516896 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-d1b1f961-6bb7-4b70-8e39-79b7763f6f46 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:38.517508 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-d1b1f961-6bb7-4b70-8e39-79b7763f6f46 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:38.523250 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-3f3add6b-acc9-426c-95a1-0c8a7f2962b5 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.233100 Jun 17 13:24:38.523632 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d1b1f961-6bb7-4b70-8e39-79b7763f6f46 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:38.527682 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1067/2166] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:38 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:38.527856 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d1b1f961-6bb7-4b70-8e39-79b7763f6f46 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:38.527856 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d1b1f961-6bb7-4b70-8e39-79b7763f6f46 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:38.527856 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d1b1f961-6bb7-4b70-8e39-79b7763f6f46 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:38.543519 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_cell1:SELECT=100 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:24:38.598134 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-d1b1f961-6bb7-4b70-8e39-79b7763f6f46 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:38.607313 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-d1b1f961-6bb7-4b70-8e39-79b7763f6f46 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.094814 Jun 17 13:24:38.607894 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1100/2167] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:38 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:39.528873 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-44454f0f-fa5b-425d-ba5d-9266e0c92a72 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:39.529891 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-44454f0f-fa5b-425d-ba5d-9266e0c92a72 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:39.537077 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-44454f0f-fa5b-425d-ba5d-9266e0c92a72 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:39.537553 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-44454f0f-fa5b-425d-ba5d-9266e0c92a72 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:39.538371 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-44454f0f-fa5b-425d-ba5d-9266e0c92a72 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:39.538781 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-44454f0f-fa5b-425d-ba5d-9266e0c92a72 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:39.540816 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-770b6547-8be6-4e5f-b5bf-3ef6ece6b539 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:39.541427 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-770b6547-8be6-4e5f-b5bf-3ef6ece6b539 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:39.548420 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-770b6547-8be6-4e5f-b5bf-3ef6ece6b539 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:39.548870 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-770b6547-8be6-4e5f-b5bf-3ef6ece6b539 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:39.549625 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-770b6547-8be6-4e5f-b5bf-3ef6ece6b539 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:39.550060 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-770b6547-8be6-4e5f-b5bf-3ef6ece6b539 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:39.738632 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-44454f0f-fa5b-425d-ba5d-9266e0c92a72 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:39.741636 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-770b6547-8be6-4e5f-b5bf-3ef6ece6b539 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:39.747077 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-44454f0f-fa5b-425d-ba5d-9266e0c92a72 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.222405 Jun 17 13:24:39.747707 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1068/2168] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:39 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:39.750237 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-770b6547-8be6-4e5f-b5bf-3ef6ece6b539 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.213145 Jun 17 13:24:39.752873 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-4eb48e95-69d5-4f57-8dc3-42fa4137e417 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:39.753482 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-4eb48e95-69d5-4f57-8dc3-42fa4137e417 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:39.759560 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4eb48e95-69d5-4f57-8dc3-42fa4137e417 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:39.759866 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1101/2169] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:39 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:39.760029 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4eb48e95-69d5-4f57-8dc3-42fa4137e417 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:39.760769 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4eb48e95-69d5-4f57-8dc3-42fa4137e417 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:39.761202 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4eb48e95-69d5-4f57-8dc3-42fa4137e417 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:39.824189 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-4eb48e95-69d5-4f57-8dc3-42fa4137e417 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:39.835012 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-4eb48e95-69d5-4f57-8dc3-42fa4137e417 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.086059 Jun 17 13:24:39.835807 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1069/2170] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:39 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:40.766291 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-9b7178c0-ec0b-47b8-909f-9bceb3566662 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:40.766902 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-9b7178c0-ec0b-47b8-909f-9bceb3566662 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:40.767740 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-170dc49e-f12b-47fb-b439-a9100f140d24 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:40.768364 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-170dc49e-f12b-47fb-b439-a9100f140d24 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:40.773869 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9b7178c0-ec0b-47b8-909f-9bceb3566662 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:40.774357 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9b7178c0-ec0b-47b8-909f-9bceb3566662 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:40.775135 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9b7178c0-ec0b-47b8-909f-9bceb3566662 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:40.775312 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-170dc49e-f12b-47fb-b439-a9100f140d24 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:40.775590 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9b7178c0-ec0b-47b8-909f-9bceb3566662 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:40.775758 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-170dc49e-f12b-47fb-b439-a9100f140d24 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:40.776387 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-170dc49e-f12b-47fb-b439-a9100f140d24 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:40.776828 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-170dc49e-f12b-47fb-b439-a9100f140d24 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:40.978564 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-170dc49e-f12b-47fb-b439-a9100f140d24 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:40.983465 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-9b7178c0-ec0b-47b8-909f-9bceb3566662 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:40.991643 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-170dc49e-f12b-47fb-b439-a9100f140d24 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.228109 Jun 17 13:24:40.992596 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1070/2171] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:40 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:40.996965 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-9b7178c0-ec0b-47b8-909f-9bceb3566662 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.234996 Jun 17 13:24:40.997448 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-3a4c8fee-19d1-43b2-b5fd-b8b9b642166c tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:41.003549 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1102/2172] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:40 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:41.003690 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-3a4c8fee-19d1-43b2-b5fd-b8b9b642166c tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:41.005255 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3a4c8fee-19d1-43b2-b5fd-b8b9b642166c tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:41.005703 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3a4c8fee-19d1-43b2-b5fd-b8b9b642166c tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:41.006494 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3a4c8fee-19d1-43b2-b5fd-b8b9b642166c tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:41.006936 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3a4c8fee-19d1-43b2-b5fd-b8b9b642166c tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:41.074704 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-3a4c8fee-19d1-43b2-b5fd-b8b9b642166c tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:41.087864 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-3a4c8fee-19d1-43b2-b5fd-b8b9b642166c tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.094012 Jun 17 13:24:41.088646 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1071/2173] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:40 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:42.012217 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-0fba6fee-853d-48c3-9f14-0d76987a13c7 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:42.012807 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-0fba6fee-853d-48c3-9f14-0d76987a13c7 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:42.014957 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-0e8b203f-8c6b-4b0f-ac9a-0d93229a58dd tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:42.016302 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-0e8b203f-8c6b-4b0f-ac9a-0d93229a58dd tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:42.019885 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0fba6fee-853d-48c3-9f14-0d76987a13c7 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:42.020341 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0fba6fee-853d-48c3-9f14-0d76987a13c7 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:42.021093 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0fba6fee-853d-48c3-9f14-0d76987a13c7 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:42.021547 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0fba6fee-853d-48c3-9f14-0d76987a13c7 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:42.023097 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0e8b203f-8c6b-4b0f-ac9a-0d93229a58dd tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:42.023549 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0e8b203f-8c6b-4b0f-ac9a-0d93229a58dd tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:42.024311 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0e8b203f-8c6b-4b0f-ac9a-0d93229a58dd tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:42.024750 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0e8b203f-8c6b-4b0f-ac9a-0d93229a58dd tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:42.218894 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-0fba6fee-853d-48c3-9f14-0d76987a13c7 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:42.223203 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-0e8b203f-8c6b-4b0f-ac9a-0d93229a58dd tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:42.231263 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-0fba6fee-853d-48c3-9f14-0d76987a13c7 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.223309 Jun 17 13:24:42.231824 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1103/2174] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:42 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:42.235146 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-0e8b203f-8c6b-4b0f-ac9a-0d93229a58dd tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.223237 Jun 17 13:24:42.235728 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1072/2175] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:42 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:42.236604 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-0b383274-f88e-4214-9083-f17a90891dfe tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:42.237424 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-0b383274-f88e-4214-9083-f17a90891dfe tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:42.243965 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0b383274-f88e-4214-9083-f17a90891dfe tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:42.244443 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0b383274-f88e-4214-9083-f17a90891dfe tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:42.245203 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0b383274-f88e-4214-9083-f17a90891dfe tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:42.245639 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0b383274-f88e-4214-9083-f17a90891dfe tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:42.307669 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-0b383274-f88e-4214-9083-f17a90891dfe tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:42.318329 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-0b383274-f88e-4214-9083-f17a90891dfe tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.085143 Jun 17 13:24:42.319118 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1104/2176] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:42 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:43.252909 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-83c7d525-93ff-4f07-9f93-5eeef8fa6820 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:43.253541 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-83c7d525-93ff-4f07-9f93-5eeef8fa6820 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:43.254122 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-6e3ace6a-6c9b-44a6-bd55-762369d1d3d0 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:43.254770 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-6e3ace6a-6c9b-44a6-bd55-762369d1d3d0 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:43.257165 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_api:SELECT=76 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:24:43.261317 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-83c7d525-93ff-4f07-9f93-5eeef8fa6820 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:43.261529 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6e3ace6a-6c9b-44a6-bd55-762369d1d3d0 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:43.261824 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-83c7d525-93ff-4f07-9f93-5eeef8fa6820 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:43.262005 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6e3ace6a-6c9b-44a6-bd55-762369d1d3d0 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:43.262614 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-83c7d525-93ff-4f07-9f93-5eeef8fa6820 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:43.262770 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6e3ace6a-6c9b-44a6-bd55-762369d1d3d0 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:43.263019 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-83c7d525-93ff-4f07-9f93-5eeef8fa6820 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:43.263185 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6e3ace6a-6c9b-44a6-bd55-762369d1d3d0 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:43.465369 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-6e3ace6a-6c9b-44a6-bd55-762369d1d3d0 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:43.467980 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-83c7d525-93ff-4f07-9f93-5eeef8fa6820 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:43.473855 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-6e3ace6a-6c9b-44a6-bd55-762369d1d3d0 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.224090 Jun 17 13:24:43.474490 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1105/2177] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:43 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:43.479216 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-22e1c1f0-9276-4e9d-a75b-f43f25381654 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:43.480305 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-22e1c1f0-9276-4e9d-a75b-f43f25381654 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:43.481241 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-83c7d525-93ff-4f07-9f93-5eeef8fa6820 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.234245 Jun 17 13:24:43.482057 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1073/2178] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:43 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:43.487519 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-22e1c1f0-9276-4e9d-a75b-f43f25381654 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:43.487974 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-22e1c1f0-9276-4e9d-a75b-f43f25381654 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:43.488760 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-22e1c1f0-9276-4e9d-a75b-f43f25381654 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:43.489196 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-22e1c1f0-9276-4e9d-a75b-f43f25381654 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:43.562814 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-22e1c1f0-9276-4e9d-a75b-f43f25381654 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:43.575576 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-22e1c1f0-9276-4e9d-a75b-f43f25381654 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.099788 Jun 17 13:24:43.576307 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1106/2179] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:43 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:44.496945 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-621cb143-9aaf-499a-8807-0b226d0a839d tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:44.497650 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-621cb143-9aaf-499a-8807-0b226d0a839d tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:44.498291 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-53670b9a-be15-470a-a9b8-fd6b8b0036a6 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:44.498929 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-53670b9a-be15-470a-a9b8-fd6b8b0036a6 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:44.504976 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-621cb143-9aaf-499a-8807-0b226d0a839d tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:44.505449 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-621cb143-9aaf-499a-8807-0b226d0a839d tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:44.506292 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-621cb143-9aaf-499a-8807-0b226d0a839d tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:44.506736 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-53670b9a-be15-470a-a9b8-fd6b8b0036a6 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:44.506882 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-621cb143-9aaf-499a-8807-0b226d0a839d tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:44.507189 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-53670b9a-be15-470a-a9b8-fd6b8b0036a6 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:44.507957 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-53670b9a-be15-470a-a9b8-fd6b8b0036a6 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:44.508399 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-53670b9a-be15-470a-a9b8-fd6b8b0036a6 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:44.709153 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-621cb143-9aaf-499a-8807-0b226d0a839d tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:44.712113 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-53670b9a-be15-470a-a9b8-fd6b8b0036a6 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:44.718234 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-621cb143-9aaf-499a-8807-0b226d0a839d tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.225773 Jun 17 13:24:44.718831 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1074/2180] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:44 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:44.720440 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-53670b9a-be15-470a-a9b8-fd6b8b0036a6 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.226064 Jun 17 13:24:44.721334 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1107/2181] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:44 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:44.723785 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-99bf709a-cd3c-44be-ad62-eda162a6260a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:44.724493 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-99bf709a-cd3c-44be-ad62-eda162a6260a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:44.731306 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-99bf709a-cd3c-44be-ad62-eda162a6260a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:44.731785 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-99bf709a-cd3c-44be-ad62-eda162a6260a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:44.732561 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-99bf709a-cd3c-44be-ad62-eda162a6260a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:44.733025 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-99bf709a-cd3c-44be-ad62-eda162a6260a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:44.801602 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-99bf709a-cd3c-44be-ad62-eda162a6260a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:44.814495 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-99bf709a-cd3c-44be-ad62-eda162a6260a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.094316 Jun 17 13:24:44.815305 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1075/2182] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:44 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:45.735925 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-d9cb387f-d700-43fa-9233-efdc9f374095 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:45.736528 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-d9cb387f-d700-43fa-9233-efdc9f374095 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:45.737788 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-2dd7e0fd-a2a3-4f9a-b2ce-d311316b20e9 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:45.738949 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-2dd7e0fd-a2a3-4f9a-b2ce-d311316b20e9 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:45.743977 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d9cb387f-d700-43fa-9233-efdc9f374095 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:45.744445 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d9cb387f-d700-43fa-9233-efdc9f374095 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:45.745229 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d9cb387f-d700-43fa-9233-efdc9f374095 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:45.745668 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d9cb387f-d700-43fa-9233-efdc9f374095 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:45.745937 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2dd7e0fd-a2a3-4f9a-b2ce-d311316b20e9 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:45.746443 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2dd7e0fd-a2a3-4f9a-b2ce-d311316b20e9 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:45.747250 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2dd7e0fd-a2a3-4f9a-b2ce-d311316b20e9 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:45.747717 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2dd7e0fd-a2a3-4f9a-b2ce-d311316b20e9 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:45.946608 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-d9cb387f-d700-43fa-9233-efdc9f374095 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:45.951286 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-2dd7e0fd-a2a3-4f9a-b2ce-d311316b20e9 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:45.956768 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=100 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:24:45.960017 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-d9cb387f-d700-43fa-9233-efdc9f374095 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.227882 Jun 17 13:24:45.960637 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1108/2183] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:45 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:45.962441 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-2dd7e0fd-a2a3-4f9a-b2ce-d311316b20e9 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.228659 Jun 17 13:24:45.963170 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1076/2184] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:45 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 13:24:45.965283 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-76f0abc3-dc62-489a-85cd-ced5872e74d4 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:45.965919 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-76f0abc3-dc62-489a-85cd-ced5872e74d4 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:45.972365 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-76f0abc3-dc62-489a-85cd-ced5872e74d4 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:45.972835 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-76f0abc3-dc62-489a-85cd-ced5872e74d4 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:45.973647 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-76f0abc3-dc62-489a-85cd-ced5872e74d4 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:45.974122 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-76f0abc3-dc62-489a-85cd-ced5872e74d4 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:46.049436 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-76f0abc3-dc62-489a-85cd-ced5872e74d4 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:46.058760 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-76f0abc3-dc62-489a-85cd-ced5872e74d4 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.097104 Jun 17 13:24:46.059363 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1109/2185] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:45 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:46.982128 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-ce948efb-567d-4ebc-83ab-15c2ac3c2723 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:46.982751 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-ce948efb-567d-4ebc-83ab-15c2ac3c2723 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:46.983635 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-92fc7f3f-da43-46ba-b177-cc0942738c1a tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:46.984406 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-92fc7f3f-da43-46ba-b177-cc0942738c1a tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:46.992024 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ce948efb-567d-4ebc-83ab-15c2ac3c2723 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:46.992475 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ce948efb-567d-4ebc-83ab-15c2ac3c2723 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:46.993256 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ce948efb-567d-4ebc-83ab-15c2ac3c2723 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:46.993411 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-92fc7f3f-da43-46ba-b177-cc0942738c1a tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:46.993688 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ce948efb-567d-4ebc-83ab-15c2ac3c2723 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:46.993853 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-92fc7f3f-da43-46ba-b177-cc0942738c1a tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:46.994654 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-92fc7f3f-da43-46ba-b177-cc0942738c1a tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:46.995149 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-92fc7f3f-da43-46ba-b177-cc0942738c1a tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:47.208272 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-ce948efb-567d-4ebc-83ab-15c2ac3c2723 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:47.212805 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-92fc7f3f-da43-46ba-b177-cc0942738c1a tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:47.222515 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-ce948efb-567d-4ebc-83ab-15c2ac3c2723 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.247224 Jun 17 13:24:47.223345 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1077/2186] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:46 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 13:24:47.225493 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-92fc7f3f-da43-46ba-b177-cc0942738c1a tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.248605 Jun 17 13:24:47.226293 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1110/2187] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:46 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 13:24:47.229051 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-361a5c6f-921d-4d07-909c-9fbf8a909925 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:47.230046 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-361a5c6f-921d-4d07-909c-9fbf8a909925 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:47.236662 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-361a5c6f-921d-4d07-909c-9fbf8a909925 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:47.237079 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-361a5c6f-921d-4d07-909c-9fbf8a909925 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:47.237868 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-361a5c6f-921d-4d07-909c-9fbf8a909925 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:47.238341 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-361a5c6f-921d-4d07-909c-9fbf8a909925 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:47.303367 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-361a5c6f-921d-4d07-909c-9fbf8a909925 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:47.311728 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-361a5c6f-921d-4d07-909c-9fbf8a909925 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.087102 Jun 17 13:24:47.312208 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1078/2188] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:47 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:48.242787 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-dee9273f-7a84-4277-a7ba-075e377c6f96 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:48.243413 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-dee9273f-7a84-4277-a7ba-075e377c6f96 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:48.243768 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-b1c4280b-e9b2-4da1-8e3a-d2c34db9f5b4 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:48.244358 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-b1c4280b-e9b2-4da1-8e3a-d2c34db9f5b4 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:48.250138 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-dee9273f-7a84-4277-a7ba-075e377c6f96 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:48.250607 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-dee9273f-7a84-4277-a7ba-075e377c6f96 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:48.250933 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b1c4280b-e9b2-4da1-8e3a-d2c34db9f5b4 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:48.251379 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b1c4280b-e9b2-4da1-8e3a-d2c34db9f5b4 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:48.251505 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-dee9273f-7a84-4277-a7ba-075e377c6f96 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:48.251823 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-dee9273f-7a84-4277-a7ba-075e377c6f96 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:48.252133 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b1c4280b-e9b2-4da1-8e3a-d2c34db9f5b4 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:48.252564 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b1c4280b-e9b2-4da1-8e3a-d2c34db9f5b4 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:48.447895 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-b1c4280b-e9b2-4da1-8e3a-d2c34db9f5b4 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:48.451102 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-dee9273f-7a84-4277-a7ba-075e377c6f96 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:48.456418 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-b1c4280b-e9b2-4da1-8e3a-d2c34db9f5b4 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.217059 Jun 17 13:24:48.457110 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1079/2189] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:48 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 13:24:48.459580 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-dee9273f-7a84-4277-a7ba-075e377c6f96 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.221463 Jun 17 13:24:48.460316 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1111/2190] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:48 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:48.462040 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-7c2e8e54-332a-47e4-8688-8e04947d30f4 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:48.462747 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-7c2e8e54-332a-47e4-8688-8e04947d30f4 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:48.468821 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7c2e8e54-332a-47e4-8688-8e04947d30f4 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:48.469274 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7c2e8e54-332a-47e4-8688-8e04947d30f4 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:48.470039 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7c2e8e54-332a-47e4-8688-8e04947d30f4 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:48.470507 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7c2e8e54-332a-47e4-8688-8e04947d30f4 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:48.535786 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-7c2e8e54-332a-47e4-8688-8e04947d30f4 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:48.549416 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-7c2e8e54-332a-47e4-8688-8e04947d30f4 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.091020 Jun 17 13:24:48.550191 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1080/2191] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:48 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:49.475129 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-ca2752d2-5150-4ff2-a762-1f181200d4fd tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:49.475791 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-ca2752d2-5150-4ff2-a762-1f181200d4fd tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:49.476945 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-9121a42f-e80e-457a-b9ff-74b65ae6c31a tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:49.477585 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-9121a42f-e80e-457a-b9ff-74b65ae6c31a tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:49.483609 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ca2752d2-5150-4ff2-a762-1f181200d4fd tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:49.484055 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ca2752d2-5150-4ff2-a762-1f181200d4fd tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:49.484458 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9121a42f-e80e-457a-b9ff-74b65ae6c31a tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:49.484824 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ca2752d2-5150-4ff2-a762-1f181200d4fd tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:49.484942 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9121a42f-e80e-457a-b9ff-74b65ae6c31a tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:49.485257 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ca2752d2-5150-4ff2-a762-1f181200d4fd tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:49.485687 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9121a42f-e80e-457a-b9ff-74b65ae6c31a tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:49.486162 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9121a42f-e80e-457a-b9ff-74b65ae6c31a tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:49.681555 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-ca2752d2-5150-4ff2-a762-1f181200d4fd tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:49.685766 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-9121a42f-e80e-457a-b9ff-74b65ae6c31a tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:49.690045 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-ca2752d2-5150-4ff2-a762-1f181200d4fd tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.219004 Jun 17 13:24:49.690664 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1112/2192] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:49 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:49.694153 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-9121a42f-e80e-457a-b9ff-74b65ae6c31a tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.221241 Jun 17 13:24:49.694934 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1081/2193] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:49 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:49.695591 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-5b5ee10f-59d7-42b2-8f48-ed3beabe57f4 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:49.696242 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-5b5ee10f-59d7-42b2-8f48-ed3beabe57f4 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:49.702351 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-5b5ee10f-59d7-42b2-8f48-ed3beabe57f4 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:49.702797 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-5b5ee10f-59d7-42b2-8f48-ed3beabe57f4 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:49.703547 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-5b5ee10f-59d7-42b2-8f48-ed3beabe57f4 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:49.703975 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-5b5ee10f-59d7-42b2-8f48-ed3beabe57f4 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:49.775937 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-5b5ee10f-59d7-42b2-8f48-ed3beabe57f4 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:49.784935 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-5b5ee10f-59d7-42b2-8f48-ed3beabe57f4 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.093310 Jun 17 13:24:49.785539 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1113/2194] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:49 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:50.712670 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-3fa2fffd-92e8-4598-a05d-91259ddc38e3 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:50.713340 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-3fa2fffd-92e8-4598-a05d-91259ddc38e3 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:50.716372 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-474b6dc6-0a87-4f73-b95c-b93ea9bfb662 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:50.716985 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-474b6dc6-0a87-4f73-b95c-b93ea9bfb662 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:50.719383 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_api:SELECT=76 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:24:50.720974 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3fa2fffd-92e8-4598-a05d-91259ddc38e3 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:50.721430 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3fa2fffd-92e8-4598-a05d-91259ddc38e3 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:50.722238 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3fa2fffd-92e8-4598-a05d-91259ddc38e3 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:50.722673 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3fa2fffd-92e8-4598-a05d-91259ddc38e3 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:50.724664 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-474b6dc6-0a87-4f73-b95c-b93ea9bfb662 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:50.725112 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-474b6dc6-0a87-4f73-b95c-b93ea9bfb662 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:50.725870 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-474b6dc6-0a87-4f73-b95c-b93ea9bfb662 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:50.726344 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-474b6dc6-0a87-4f73-b95c-b93ea9bfb662 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:50.921270 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-3fa2fffd-92e8-4598-a05d-91259ddc38e3 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:50.925292 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-474b6dc6-0a87-4f73-b95c-b93ea9bfb662 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:50.932819 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-3fa2fffd-92e8-4598-a05d-91259ddc38e3 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.223892 Jun 17 13:24:50.933701 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1082/2195] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:50 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:50.935655 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-474b6dc6-0a87-4f73-b95c-b93ea9bfb662 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.223396 Jun 17 13:24:50.936388 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1114/2196] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:50 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:50.938219 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-ba1c8c9c-5abd-4659-93b1-a6185e4470cc tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:50.938825 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-ba1c8c9c-5abd-4659-93b1-a6185e4470cc tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:50.945673 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ba1c8c9c-5abd-4659-93b1-a6185e4470cc tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:50.946126 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ba1c8c9c-5abd-4659-93b1-a6185e4470cc tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:50.946897 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ba1c8c9c-5abd-4659-93b1-a6185e4470cc tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:50.947328 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ba1c8c9c-5abd-4659-93b1-a6185e4470cc tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:51.020602 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-ba1c8c9c-5abd-4659-93b1-a6185e4470cc tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:51.030288 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-ba1c8c9c-5abd-4659-93b1-a6185e4470cc tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.095334 Jun 17 13:24:51.031192 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1083/2197] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:50 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:51.953949 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-8a18702a-9ac1-4fc8-93dd-de9e54c0a031 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:51.954927 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-8a18702a-9ac1-4fc8-93dd-de9e54c0a031 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:51.956145 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-d819cf1a-49a4-4d8a-b62c-e22db8785c87 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:51.957160 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-d819cf1a-49a4-4d8a-b62c-e22db8785c87 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:51.964744 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8a18702a-9ac1-4fc8-93dd-de9e54c0a031 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:51.965473 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8a18702a-9ac1-4fc8-93dd-de9e54c0a031 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:51.966052 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8a18702a-9ac1-4fc8-93dd-de9e54c0a031 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:51.966350 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d819cf1a-49a4-4d8a-b62c-e22db8785c87 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:51.966539 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8a18702a-9ac1-4fc8-93dd-de9e54c0a031 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:51.966801 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d819cf1a-49a4-4d8a-b62c-e22db8785c87 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:51.967562 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d819cf1a-49a4-4d8a-b62c-e22db8785c87 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:51.967992 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d819cf1a-49a4-4d8a-b62c-e22db8785c87 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:52.176507 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-8a18702a-9ac1-4fc8-93dd-de9e54c0a031 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:52.180596 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-d819cf1a-49a4-4d8a-b62c-e22db8785c87 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:52.186382 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-8a18702a-9ac1-4fc8-93dd-de9e54c0a031 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.239158 Jun 17 13:24:52.187313 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1115/2198] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:51 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:52.191868 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-e777afaa-4d56-4492-bf2c-f9bfbeab3b0a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:52.192474 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-e777afaa-4d56-4492-bf2c-f9bfbeab3b0a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:52.197971 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-d819cf1a-49a4-4d8a-b62c-e22db8785c87 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.247864 Jun 17 13:24:52.198604 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1084/2199] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:51 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:52.198850 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e777afaa-4d56-4492-bf2c-f9bfbeab3b0a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:52.199314 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e777afaa-4d56-4492-bf2c-f9bfbeab3b0a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:52.200186 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e777afaa-4d56-4492-bf2c-f9bfbeab3b0a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:52.200620 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e777afaa-4d56-4492-bf2c-f9bfbeab3b0a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:52.277476 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-e777afaa-4d56-4492-bf2c-f9bfbeab3b0a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:52.286371 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-e777afaa-4d56-4492-bf2c-f9bfbeab3b0a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.097985 Jun 17 13:24:52.286974 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1116/2200] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:52 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:53.206274 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-5a35d78b-7c6a-4163-bd4e-cabca5bb5a2a tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:53.206887 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-5a35d78b-7c6a-4163-bd4e-cabca5bb5a2a tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:53.214127 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5a35d78b-7c6a-4163-bd4e-cabca5bb5a2a tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:53.214633 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5a35d78b-7c6a-4163-bd4e-cabca5bb5a2a tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:53.215442 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5a35d78b-7c6a-4163-bd4e-cabca5bb5a2a tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:53.215595 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-0e85cd4c-dfd0-48db-9f28-eba2d9d925ea tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:53.216026 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5a35d78b-7c6a-4163-bd4e-cabca5bb5a2a tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:53.216149 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-0e85cd4c-dfd0-48db-9f28-eba2d9d925ea tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:53.223143 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0e85cd4c-dfd0-48db-9f28-eba2d9d925ea tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:53.223597 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0e85cd4c-dfd0-48db-9f28-eba2d9d925ea tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:53.224362 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0e85cd4c-dfd0-48db-9f28-eba2d9d925ea tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:53.224798 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0e85cd4c-dfd0-48db-9f28-eba2d9d925ea tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:53.228920 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_cell1:SELECT=100 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:24:53.412571 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-5a35d78b-7c6a-4163-bd4e-cabca5bb5a2a tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:53.415666 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-0e85cd4c-dfd0-48db-9f28-eba2d9d925ea tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:53.420723 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-5a35d78b-7c6a-4163-bd4e-cabca5bb5a2a tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.219670 Jun 17 13:24:53.421317 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1085/2201] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:53 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:53.424193 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-0e85cd4c-dfd0-48db-9f28-eba2d9d925ea tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.212488 Jun 17 13:24:53.424928 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1117/2202] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:53 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:53.426812 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-e20582a0-8010-4bad-aea2-e493f69f41fb tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:53.427419 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-e20582a0-8010-4bad-aea2-e493f69f41fb tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:53.433391 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e20582a0-8010-4bad-aea2-e493f69f41fb tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:53.433837 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e20582a0-8010-4bad-aea2-e493f69f41fb tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:53.434655 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e20582a0-8010-4bad-aea2-e493f69f41fb tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:53.435082 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e20582a0-8010-4bad-aea2-e493f69f41fb tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:53.497406 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-e20582a0-8010-4bad-aea2-e493f69f41fb tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:53.506061 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-e20582a0-8010-4bad-aea2-e493f69f41fb tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.083751 Jun 17 13:24:53.506666 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1086/2203] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:53 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:54.438407 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-9e023f82-26ff-4700-abaa-ad4a87f77d08 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:54.439107 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-9e023f82-26ff-4700-abaa-ad4a87f77d08 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:54.441406 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-759aafa6-006d-4a2d-95c6-907c9b91a340 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:54.442049 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-759aafa6-006d-4a2d-95c6-907c9b91a340 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:54.446585 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9e023f82-26ff-4700-abaa-ad4a87f77d08 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:54.447043 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9e023f82-26ff-4700-abaa-ad4a87f77d08 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:54.447815 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9e023f82-26ff-4700-abaa-ad4a87f77d08 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:54.448252 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9e023f82-26ff-4700-abaa-ad4a87f77d08 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:54.448910 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-759aafa6-006d-4a2d-95c6-907c9b91a340 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:54.449378 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-759aafa6-006d-4a2d-95c6-907c9b91a340 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:54.450187 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-759aafa6-006d-4a2d-95c6-907c9b91a340 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:54.450623 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-759aafa6-006d-4a2d-95c6-907c9b91a340 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:54.659990 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-9e023f82-26ff-4700-abaa-ad4a87f77d08 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:54.663345 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-759aafa6-006d-4a2d-95c6-907c9b91a340 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:54.670041 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-9e023f82-26ff-4700-abaa-ad4a87f77d08 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.235688 Jun 17 13:24:54.670937 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1118/2204] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:54 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:54.675236 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-759aafa6-006d-4a2d-95c6-907c9b91a340 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.237773 Jun 17 13:24:54.675873 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-7f348d05-9045-4ab0-a34c-5b5feb88a7c6 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:54.676484 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-7f348d05-9045-4ab0-a34c-5b5feb88a7c6 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:54.677023 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1087/2205] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:54 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:54.683019 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7f348d05-9045-4ab0-a34c-5b5feb88a7c6 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:54.683495 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7f348d05-9045-4ab0-a34c-5b5feb88a7c6 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:54.684263 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7f348d05-9045-4ab0-a34c-5b5feb88a7c6 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:54.684694 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7f348d05-9045-4ab0-a34c-5b5feb88a7c6 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:54.757906 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-7f348d05-9045-4ab0-a34c-5b5feb88a7c6 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:54.766404 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-7f348d05-9045-4ab0-a34c-5b5feb88a7c6 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.094455 Jun 17 13:24:54.766969 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1119/2206] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:54 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:55.690888 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-cbb7c16d-6ea7-4ec7-a4b8-ed3868913932 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:55.691535 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-cbb7c16d-6ea7-4ec7-a4b8-ed3868913932 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:55.694681 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-7b091e5e-15b5-4133-8c38-880fc2aa252d tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:55.695288 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-7b091e5e-15b5-4133-8c38-880fc2aa252d tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:55.698727 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cbb7c16d-6ea7-4ec7-a4b8-ed3868913932 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:55.698910 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cbb7c16d-6ea7-4ec7-a4b8-ed3868913932 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:55.699677 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cbb7c16d-6ea7-4ec7-a4b8-ed3868913932 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:55.700109 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cbb7c16d-6ea7-4ec7-a4b8-ed3868913932 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:55.702964 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7b091e5e-15b5-4133-8c38-880fc2aa252d tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:55.703411 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7b091e5e-15b5-4133-8c38-880fc2aa252d tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:55.704177 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7b091e5e-15b5-4133-8c38-880fc2aa252d tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:55.704610 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7b091e5e-15b5-4133-8c38-880fc2aa252d tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:56.141622 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-cbb7c16d-6ea7-4ec7-a4b8-ed3868913932 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:56.150652 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-cbb7c16d-6ea7-4ec7-a4b8-ed3868913932 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.466186 Jun 17 13:24:56.151209 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1088/2207] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:55 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:56.153333 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-7b091e5e-15b5-4133-8c38-880fc2aa252d tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:56.155622 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-55121583-55da-465d-8862-7f8020f3361c tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:56.156218 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-55121583-55da-465d-8862-7f8020f3361c tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:56.162876 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-55121583-55da-465d-8862-7f8020f3361c tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:56.163063 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-7b091e5e-15b5-4133-8c38-880fc2aa252d tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.472276 Jun 17 13:24:56.163321 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-55121583-55da-465d-8862-7f8020f3361c tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:56.163692 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1120/2208] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:55 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:56.164089 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-55121583-55da-465d-8862-7f8020f3361c tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:56.164590 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-55121583-55da-465d-8862-7f8020f3361c tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:56.235869 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-55121583-55da-465d-8862-7f8020f3361c tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:56.244371 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-55121583-55da-465d-8862-7f8020f3361c tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.092204 Jun 17 13:24:56.244928 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1089/2209] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:56 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:57.169321 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-bf9de92f-569f-4297-adb2-3b0abd8de484 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:57.170262 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-bf9de92f-569f-4297-adb2-3b0abd8de484 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:57.178753 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-bf9de92f-569f-4297-adb2-3b0abd8de484 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:57.179310 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-bf9de92f-569f-4297-adb2-3b0abd8de484 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:57.180248 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-bf9de92f-569f-4297-adb2-3b0abd8de484 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:57.180787 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-bf9de92f-569f-4297-adb2-3b0abd8de484 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:57.181487 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-e8db059d-941a-4063-b899-5d529fe3c887 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:57.182293 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-e8db059d-941a-4063-b899-5d529fe3c887 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:57.190636 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e8db059d-941a-4063-b899-5d529fe3c887 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:57.191194 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e8db059d-941a-4063-b899-5d529fe3c887 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:57.192164 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e8db059d-941a-4063-b899-5d529fe3c887 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:57.192762 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e8db059d-941a-4063-b899-5d529fe3c887 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:57.380115 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-bf9de92f-569f-4297-adb2-3b0abd8de484 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:57.385158 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-e8db059d-941a-4063-b899-5d529fe3c887 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:57.391538 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-bf9de92f-569f-4297-adb2-3b0abd8de484 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.226775 Jun 17 13:24:57.392261 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1121/2210] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:57 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:57.397436 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-b8f790ff-4680-424a-9428-4c1d84b6c17d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:57.398041 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-b8f790ff-4680-424a-9428-4c1d84b6c17d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:57.398218 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-e8db059d-941a-4063-b899-5d529fe3c887 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.221469 Jun 17 13:24:57.398875 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1090/2211] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:57 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:57.404365 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b8f790ff-4680-424a-9428-4c1d84b6c17d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:57.404842 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b8f790ff-4680-424a-9428-4c1d84b6c17d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:57.405605 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b8f790ff-4680-424a-9428-4c1d84b6c17d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:57.406039 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b8f790ff-4680-424a-9428-4c1d84b6c17d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:57.467278 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-b8f790ff-4680-424a-9428-4c1d84b6c17d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:57.475926 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-b8f790ff-4680-424a-9428-4c1d84b6c17d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.082692 Jun 17 13:24:57.476493 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1122/2212] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:57 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:58.410031 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-31212fbd-f016-49e5-bb64-844839103731 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:58.410612 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-31212fbd-f016-49e5-bb64-844839103731 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:58.415741 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-efad8773-cddb-4c5b-9120-a8aef3d8f416 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:58.416746 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-efad8773-cddb-4c5b-9120-a8aef3d8f416 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:58.419995 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-31212fbd-f016-49e5-bb64-844839103731 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:58.420772 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-31212fbd-f016-49e5-bb64-844839103731 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:58.422001 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-31212fbd-f016-49e5-bb64-844839103731 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:58.422791 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-31212fbd-f016-49e5-bb64-844839103731 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:58.426955 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-efad8773-cddb-4c5b-9120-a8aef3d8f416 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:58.427681 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-efad8773-cddb-4c5b-9120-a8aef3d8f416 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:58.428891 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-efad8773-cddb-4c5b-9120-a8aef3d8f416 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:58.429491 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-efad8773-cddb-4c5b-9120-a8aef3d8f416 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:58.622226 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-31212fbd-f016-49e5-bb64-844839103731 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:58.625717 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-efad8773-cddb-4c5b-9120-a8aef3d8f416 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:58.630989 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-31212fbd-f016-49e5-bb64-844839103731 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.225166 Jun 17 13:24:58.631642 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1091/2213] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:58 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:58.634067 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-efad8773-cddb-4c5b-9120-a8aef3d8f416 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.223285 Jun 17 13:24:58.634872 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1123/2214] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:58 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:58.636310 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-cbe04f9a-cf45-4734-9888-3d740f1b8677 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:58.636986 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-cbe04f9a-cf45-4734-9888-3d740f1b8677 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:58.643222 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cbe04f9a-cf45-4734-9888-3d740f1b8677 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:58.643744 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cbe04f9a-cf45-4734-9888-3d740f1b8677 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:58.644506 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cbe04f9a-cf45-4734-9888-3d740f1b8677 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:58.644937 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cbe04f9a-cf45-4734-9888-3d740f1b8677 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:58.707098 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-cbe04f9a-cf45-4734-9888-3d740f1b8677 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:58.715864 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-cbe04f9a-cf45-4734-9888-3d740f1b8677 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.083216 Jun 17 13:24:58.716436 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1092/2215] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:58 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:59.652947 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-f3a51d4f-60fd-438f-a9eb-84cbbaba1698 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:59.653707 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-f3a51d4f-60fd-438f-a9eb-84cbbaba1698 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:59.658425 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-68829cb3-d801-4d39-ba0d-1134119cc8e7 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:59.659188 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-68829cb3-d801-4d39-ba0d-1134119cc8e7 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:59.661764 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f3a51d4f-60fd-438f-a9eb-84cbbaba1698 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:59.662296 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f3a51d4f-60fd-438f-a9eb-84cbbaba1698 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:59.663210 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f3a51d4f-60fd-438f-a9eb-84cbbaba1698 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:59.663690 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f3a51d4f-60fd-438f-a9eb-84cbbaba1698 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:59.666844 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-68829cb3-d801-4d39-ba0d-1134119cc8e7 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:59.667331 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-68829cb3-d801-4d39-ba0d-1134119cc8e7 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:59.668227 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-68829cb3-d801-4d39-ba0d-1134119cc8e7 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:59.668888 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-68829cb3-d801-4d39-ba0d-1134119cc8e7 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:59.688441 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=100 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:24:59.861763 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-f3a51d4f-60fd-438f-a9eb-84cbbaba1698 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:59.864993 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-68829cb3-d801-4d39-ba0d-1134119cc8e7 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:59.870139 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-f3a51d4f-60fd-438f-a9eb-84cbbaba1698 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.221735 Jun 17 13:24:59.870706 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1124/2216] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:59 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:59.874615 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-68829cb3-d801-4d39-ba0d-1134119cc8e7 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.221821 Jun 17 13:24:59.875294 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1093/2217] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:59 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:24:59.875789 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-62c986af-5d62-4a1b-9816-aa40bedf687d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:24:59.876408 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-62c986af-5d62-4a1b-9816-aa40bedf687d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:24:59.882910 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-62c986af-5d62-4a1b-9816-aa40bedf687d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:59.883438 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-62c986af-5d62-4a1b-9816-aa40bedf687d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:59.884197 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-62c986af-5d62-4a1b-9816-aa40bedf687d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:24:59.884624 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-62c986af-5d62-4a1b-9816-aa40bedf687d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:24:59.951324 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-62c986af-5d62-4a1b-9816-aa40bedf687d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:24:59.963580 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-62c986af-5d62-4a1b-9816-aa40bedf687d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.091627 Jun 17 13:24:59.964374 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1125/2218] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:24:59 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:00.892777 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-ac9f2bf6-77d3-43bf-8434-e611b7a812a8 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:00.893705 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-ac9f2bf6-77d3-43bf-8434-e611b7a812a8 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:00.896705 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-56fdfe05-faf7-4443-a1cd-1543c78f9c69 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:00.897737 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-56fdfe05-faf7-4443-a1cd-1543c78f9c69 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:00.903843 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ac9f2bf6-77d3-43bf-8434-e611b7a812a8 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:00.904286 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ac9f2bf6-77d3-43bf-8434-e611b7a812a8 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:00.905092 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ac9f2bf6-77d3-43bf-8434-e611b7a812a8 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:00.905515 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ac9f2bf6-77d3-43bf-8434-e611b7a812a8 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:00.906134 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-56fdfe05-faf7-4443-a1cd-1543c78f9c69 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:00.906604 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-56fdfe05-faf7-4443-a1cd-1543c78f9c69 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:00.907353 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-56fdfe05-faf7-4443-a1cd-1543c78f9c69 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:00.907858 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-56fdfe05-faf7-4443-a1cd-1543c78f9c69 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:01.099153 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-ac9f2bf6-77d3-43bf-8434-e611b7a812a8 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:01.102482 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-56fdfe05-faf7-4443-a1cd-1543c78f9c69 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:01.108309 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-ac9f2bf6-77d3-43bf-8434-e611b7a812a8 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.222584 Jun 17 13:25:01.109015 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1094/2219] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:00 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 13:25:01.112477 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-56fdfe05-faf7-4443-a1cd-1543c78f9c69 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.222330 Jun 17 13:25:01.113279 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1126/2220] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:00 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:01.113907 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-709ae412-352d-4fdb-9e3d-5a620cd5cd44 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:01.114578 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-709ae412-352d-4fdb-9e3d-5a620cd5cd44 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:01.122136 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-709ae412-352d-4fdb-9e3d-5a620cd5cd44 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:01.122745 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-709ae412-352d-4fdb-9e3d-5a620cd5cd44 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:01.123522 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-709ae412-352d-4fdb-9e3d-5a620cd5cd44 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:01.124016 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-709ae412-352d-4fdb-9e3d-5a620cd5cd44 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:01.188606 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-709ae412-352d-4fdb-9e3d-5a620cd5cd44 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:01.201054 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-709ae412-352d-4fdb-9e3d-5a620cd5cd44 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.090794 Jun 17 13:25:01.201856 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1095/2221] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:01 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:02.130264 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-7d924222-aa08-4f55-b1a3-bb09f0b7f843 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:02.131820 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-7d924222-aa08-4f55-b1a3-bb09f0b7f843 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:02.134632 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-a28295bc-81e0-4da3-a95e-d86c9226da9f tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:02.135112 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-a28295bc-81e0-4da3-a95e-d86c9226da9f tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:02.139560 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7d924222-aa08-4f55-b1a3-bb09f0b7f843 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:02.140008 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7d924222-aa08-4f55-b1a3-bb09f0b7f843 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:02.140767 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7d924222-aa08-4f55-b1a3-bb09f0b7f843 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:02.141198 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7d924222-aa08-4f55-b1a3-bb09f0b7f843 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:02.141835 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a28295bc-81e0-4da3-a95e-d86c9226da9f tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:02.142308 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a28295bc-81e0-4da3-a95e-d86c9226da9f tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:02.143067 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a28295bc-81e0-4da3-a95e-d86c9226da9f tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:02.143494 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a28295bc-81e0-4da3-a95e-d86c9226da9f tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:02.347620 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-a28295bc-81e0-4da3-a95e-d86c9226da9f tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:02.350530 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-7d924222-aa08-4f55-b1a3-bb09f0b7f843 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:02.356346 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-a28295bc-81e0-4da3-a95e-d86c9226da9f tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.228872 Jun 17 13:25:02.357118 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1096/2222] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:02 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:02.361304 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-f9773e28-dc7b-4bb4-a2e9-3eab1b7ac78a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:02.361905 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-f9773e28-dc7b-4bb4-a2e9-3eab1b7ac78a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:02.363446 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-7d924222-aa08-4f55-b1a3-bb09f0b7f843 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.239589 Jun 17 13:25:02.364229 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1127/2223] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:02 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:02.368320 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f9773e28-dc7b-4bb4-a2e9-3eab1b7ac78a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:02.368504 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f9773e28-dc7b-4bb4-a2e9-3eab1b7ac78a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:02.369231 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f9773e28-dc7b-4bb4-a2e9-3eab1b7ac78a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:02.369664 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f9773e28-dc7b-4bb4-a2e9-3eab1b7ac78a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:02.443793 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-f9773e28-dc7b-4bb4-a2e9-3eab1b7ac78a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:02.452230 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-f9773e28-dc7b-4bb4-a2e9-3eab1b7ac78a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.094329 Jun 17 13:25:02.452816 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1097/2224] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:02 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:03.373152 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-2f5994e0-efec-4bca-be4b-8d25f8afdd8b tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:03.373806 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-2f5994e0-efec-4bca-be4b-8d25f8afdd8b tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:03.380020 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-b88b4e76-96ea-433c-88b8-ac7743fa59f5 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:03.381000 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2f5994e0-efec-4bca-be4b-8d25f8afdd8b tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:03.381233 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-b88b4e76-96ea-433c-88b8-ac7743fa59f5 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:03.381447 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2f5994e0-efec-4bca-be4b-8d25f8afdd8b tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:03.382237 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2f5994e0-efec-4bca-be4b-8d25f8afdd8b tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:03.382667 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2f5994e0-efec-4bca-be4b-8d25f8afdd8b tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:03.390158 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b88b4e76-96ea-433c-88b8-ac7743fa59f5 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:03.390673 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b88b4e76-96ea-433c-88b8-ac7743fa59f5 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:03.391452 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b88b4e76-96ea-433c-88b8-ac7743fa59f5 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:03.391886 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b88b4e76-96ea-433c-88b8-ac7743fa59f5 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:03.591271 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-2f5994e0-efec-4bca-be4b-8d25f8afdd8b tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:03.598375 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-b88b4e76-96ea-433c-88b8-ac7743fa59f5 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:03.600784 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-2f5994e0-efec-4bca-be4b-8d25f8afdd8b tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.231327 Jun 17 13:25:03.601374 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1128/2225] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:03 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:03.606674 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-978484ae-74d1-429f-9f27-ce4395088d4b tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:03.607268 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-978484ae-74d1-429f-9f27-ce4395088d4b tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:03.608138 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-b88b4e76-96ea-433c-88b8-ac7743fa59f5 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.232605 Jun 17 13:25:03.608781 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1098/2226] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:03 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 13:25:03.613697 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-978484ae-74d1-429f-9f27-ce4395088d4b tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:03.614147 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-978484ae-74d1-429f-9f27-ce4395088d4b tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:03.614907 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-978484ae-74d1-429f-9f27-ce4395088d4b tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:03.615333 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-978484ae-74d1-429f-9f27-ce4395088d4b tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:03.676967 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-978484ae-74d1-429f-9f27-ce4395088d4b tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:03.685562 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-978484ae-74d1-429f-9f27-ce4395088d4b tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.083188 Jun 17 13:25:03.686157 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1129/2227] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:03 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:04.623973 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-2061e4ae-037d-4f88-852e-66d6d24c59dc tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:04.624964 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-2061e4ae-037d-4f88-852e-66d6d24c59dc tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:04.632719 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-c0e8da84-db57-46a9-8ffc-53939473bfef tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:04.634131 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-c0e8da84-db57-46a9-8ffc-53939473bfef tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:04.635390 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2061e4ae-037d-4f88-852e-66d6d24c59dc tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:04.635807 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2061e4ae-037d-4f88-852e-66d6d24c59dc tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:04.636559 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2061e4ae-037d-4f88-852e-66d6d24c59dc tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:04.636983 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2061e4ae-037d-4f88-852e-66d6d24c59dc tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:04.640722 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c0e8da84-db57-46a9-8ffc-53939473bfef tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:04.641215 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c0e8da84-db57-46a9-8ffc-53939473bfef tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:04.642051 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c0e8da84-db57-46a9-8ffc-53939473bfef tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:04.642510 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c0e8da84-db57-46a9-8ffc-53939473bfef tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:04.833508 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-c0e8da84-db57-46a9-8ffc-53939473bfef tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:04.838372 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-2061e4ae-037d-4f88-852e-66d6d24c59dc tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:04.842654 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-c0e8da84-db57-46a9-8ffc-53939473bfef tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.216231 Jun 17 13:25:04.843240 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1130/2228] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:04 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 13:25:04.846706 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-2061e4ae-037d-4f88-852e-66d6d24c59dc tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.229961 Jun 17 13:25:04.847269 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1099/2229] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:04 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:04.848153 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-e2588462-043e-4bf5-bc7a-c70505f338db tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:04.848747 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-e2588462-043e-4bf5-bc7a-c70505f338db tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:04.855411 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e2588462-043e-4bf5-bc7a-c70505f338db tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:04.855922 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e2588462-043e-4bf5-bc7a-c70505f338db tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:04.856742 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e2588462-043e-4bf5-bc7a-c70505f338db tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:04.857174 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e2588462-043e-4bf5-bc7a-c70505f338db tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:04.921385 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-e2588462-043e-4bf5-bc7a-c70505f338db tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:04.929522 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-e2588462-043e-4bf5-bc7a-c70505f338db tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.085349 Jun 17 13:25:04.930107 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1131/2230] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:04 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:05.862477 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-048f6d3f-76c1-4edc-b74b-f427c75f52d7 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:05.863075 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-048f6d3f-76c1-4edc-b74b-f427c75f52d7 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:05.863830 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-b9395a6d-a018-4c4d-a9f5-e606163ddbb8 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:05.864449 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-b9395a6d-a018-4c4d-a9f5-e606163ddbb8 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:05.869751 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-048f6d3f-76c1-4edc-b74b-f427c75f52d7 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:05.870430 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-048f6d3f-76c1-4edc-b74b-f427c75f52d7 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:05.871199 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-048f6d3f-76c1-4edc-b74b-f427c75f52d7 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:05.871612 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-048f6d3f-76c1-4edc-b74b-f427c75f52d7 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:05.871740 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b9395a6d-a018-4c4d-a9f5-e606163ddbb8 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:05.872146 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b9395a6d-a018-4c4d-a9f5-e606163ddbb8 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:05.872903 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b9395a6d-a018-4c4d-a9f5-e606163ddbb8 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:05.873454 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b9395a6d-a018-4c4d-a9f5-e606163ddbb8 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:06.063788 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-048f6d3f-76c1-4edc-b74b-f427c75f52d7 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:06.067051 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-b9395a6d-a018-4c4d-a9f5-e606163ddbb8 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:06.072848 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-048f6d3f-76c1-4edc-b74b-f427c75f52d7 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.215503 Jun 17 13:25:06.073497 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1100/2231] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:05 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:06.076245 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-b9395a6d-a018-4c4d-a9f5-e606163ddbb8 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.215789 Jun 17 13:25:06.079831 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-d6722c6c-6803-4400-ae5d-2b451d37b638 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:06.080439 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-d6722c6c-6803-4400-ae5d-2b451d37b638 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:06.085185 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1132/2232] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:05 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:06.086656 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d6722c6c-6803-4400-ae5d-2b451d37b638 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:06.087109 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d6722c6c-6803-4400-ae5d-2b451d37b638 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:06.087874 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d6722c6c-6803-4400-ae5d-2b451d37b638 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:06.088340 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d6722c6c-6803-4400-ae5d-2b451d37b638 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:06.158550 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-d6722c6c-6803-4400-ae5d-2b451d37b638 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:06.170592 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-d6722c6c-6803-4400-ae5d-2b451d37b638 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.095763 Jun 17 13:25:06.171240 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1101/2233] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:06 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:07.090460 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-f24a6bc4-401a-4f93-aca2-3c3edbf4b8f9 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:07.091306 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-f24a6bc4-401a-4f93-aca2-3c3edbf4b8f9 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:07.092867 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-63a3b659-02e1-45b6-8b64-b80bd4c6d4ce tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:07.093454 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-63a3b659-02e1-45b6-8b64-b80bd4c6d4ce tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:07.099134 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f24a6bc4-401a-4f93-aca2-3c3edbf4b8f9 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:07.099747 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f24a6bc4-401a-4f93-aca2-3c3edbf4b8f9 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:07.100264 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-63a3b659-02e1-45b6-8b64-b80bd4c6d4ce tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:07.100829 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f24a6bc4-401a-4f93-aca2-3c3edbf4b8f9 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:07.100972 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-63a3b659-02e1-45b6-8b64-b80bd4c6d4ce tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:07.101364 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f24a6bc4-401a-4f93-aca2-3c3edbf4b8f9 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:07.101576 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-63a3b659-02e1-45b6-8b64-b80bd4c6d4ce tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:07.102001 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-63a3b659-02e1-45b6-8b64-b80bd4c6d4ce tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:07.312853 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-f24a6bc4-401a-4f93-aca2-3c3edbf4b8f9 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:07.315279 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-63a3b659-02e1-45b6-8b64-b80bd4c6d4ce tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:07.315989 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_cell1:SELECT=100 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:25:07.321453 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-f24a6bc4-401a-4f93-aca2-3c3edbf4b8f9 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.235126 Jun 17 13:25:07.322025 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1133/2234] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:07 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:07.324307 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-63a3b659-02e1-45b6-8b64-b80bd4c6d4ce tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.235370 Jun 17 13:25:07.324854 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1102/2235] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:07 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:07.326701 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-e7e6f1c3-43b4-4e8d-b160-061d96f79202 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:07.327297 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-e7e6f1c3-43b4-4e8d-b160-061d96f79202 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:07.333682 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e7e6f1c3-43b4-4e8d-b160-061d96f79202 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:07.334125 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e7e6f1c3-43b4-4e8d-b160-061d96f79202 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:07.334898 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e7e6f1c3-43b4-4e8d-b160-061d96f79202 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:07.335331 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e7e6f1c3-43b4-4e8d-b160-061d96f79202 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:07.397261 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-e7e6f1c3-43b4-4e8d-b160-061d96f79202 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:07.405795 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-e7e6f1c3-43b4-4e8d-b160-061d96f79202 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.082627 Jun 17 13:25:07.406403 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1134/2236] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:07 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:08.339688 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-af65ac71-291a-4ed3-ba74-192d63532c6c tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:08.340337 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-af65ac71-291a-4ed3-ba74-192d63532c6c tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:08.340991 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-5be25099-806d-4237-908b-6393d29a0c2c tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:08.341641 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-5be25099-806d-4237-908b-6393d29a0c2c tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:08.347332 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-af65ac71-291a-4ed3-ba74-192d63532c6c tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:08.347743 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-af65ac71-291a-4ed3-ba74-192d63532c6c tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:08.348552 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-af65ac71-291a-4ed3-ba74-192d63532c6c tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:08.348714 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-5be25099-806d-4237-908b-6393d29a0c2c tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:08.348982 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-af65ac71-291a-4ed3-ba74-192d63532c6c tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:08.349152 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-5be25099-806d-4237-908b-6393d29a0c2c tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:08.349947 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-5be25099-806d-4237-908b-6393d29a0c2c tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:08.350441 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-5be25099-806d-4237-908b-6393d29a0c2c tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:08.547329 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-af65ac71-291a-4ed3-ba74-192d63532c6c tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:08.550422 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-5be25099-806d-4237-908b-6393d29a0c2c tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:08.555677 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-af65ac71-291a-4ed3-ba74-192d63532c6c tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.220368 Jun 17 13:25:08.556254 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1103/2237] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:08 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:08.558952 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-5be25099-806d-4237-908b-6393d29a0c2c tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.221968 Jun 17 13:25:08.559526 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1135/2238] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:08 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:08.561476 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-6eb09120-8b81-425e-84de-cc790680d07b tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:08.562390 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-6eb09120-8b81-425e-84de-cc790680d07b tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:08.568625 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6eb09120-8b81-425e-84de-cc790680d07b tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:08.569076 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6eb09120-8b81-425e-84de-cc790680d07b tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:08.569839 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6eb09120-8b81-425e-84de-cc790680d07b tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:08.570308 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6eb09120-8b81-425e-84de-cc790680d07b tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:08.633982 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-6eb09120-8b81-425e-84de-cc790680d07b tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:08.642841 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-6eb09120-8b81-425e-84de-cc790680d07b tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.084950 Jun 17 13:25:08.643411 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1104/2239] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:08 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:09.576268 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-f42aa479-8193-481b-94d2-1acbc3be70e7 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:09.577010 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-f42aa479-8193-481b-94d2-1acbc3be70e7 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:09.578744 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-707ca504-de7f-4662-9e6e-cb1e7ffdedda tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:09.579463 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-707ca504-de7f-4662-9e6e-cb1e7ffdedda tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:09.584898 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f42aa479-8193-481b-94d2-1acbc3be70e7 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:09.585432 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f42aa479-8193-481b-94d2-1acbc3be70e7 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:09.586388 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f42aa479-8193-481b-94d2-1acbc3be70e7 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:09.586896 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f42aa479-8193-481b-94d2-1acbc3be70e7 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:09.587482 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-707ca504-de7f-4662-9e6e-cb1e7ffdedda tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:09.588337 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-707ca504-de7f-4662-9e6e-cb1e7ffdedda tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:09.589390 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-707ca504-de7f-4662-9e6e-cb1e7ffdedda tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:09.589894 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-707ca504-de7f-4662-9e6e-cb1e7ffdedda tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:09.791680 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-f42aa479-8193-481b-94d2-1acbc3be70e7 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:09.794983 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-707ca504-de7f-4662-9e6e-cb1e7ffdedda tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:09.800685 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-f42aa479-8193-481b-94d2-1acbc3be70e7 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.230011 Jun 17 13:25:09.801592 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1136/2240] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:09 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:09.803043 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-707ca504-de7f-4662-9e6e-cb1e7ffdedda tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.229107 Jun 17 13:25:09.803921 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1105/2241] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:09 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:09.808705 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-39f8a82c-1322-48a2-af54-5d465c66f84e tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:09.809609 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-39f8a82c-1322-48a2-af54-5d465c66f84e tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:09.818399 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-39f8a82c-1322-48a2-af54-5d465c66f84e tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:09.819068 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-39f8a82c-1322-48a2-af54-5d465c66f84e tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:09.820225 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-39f8a82c-1322-48a2-af54-5d465c66f84e tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:09.820897 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-39f8a82c-1322-48a2-af54-5d465c66f84e tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:09.894448 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-39f8a82c-1322-48a2-af54-5d465c66f84e tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:09.902526 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-39f8a82c-1322-48a2-af54-5d465c66f84e tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.099616 Jun 17 13:25:09.903110 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1137/2242] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:09 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:10.819089 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-ea5139fd-ced3-4570-b55e-94843dc4fe89 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:10.819780 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-ea5139fd-ced3-4570-b55e-94843dc4fe89 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:10.821171 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-21f2f45d-bcd9-40e0-a9fb-cae761abc676 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:10.822175 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-21f2f45d-bcd9-40e0-a9fb-cae761abc676 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:10.830142 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ea5139fd-ced3-4570-b55e-94843dc4fe89 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:10.830772 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ea5139fd-ced3-4570-b55e-94843dc4fe89 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:10.831595 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-21f2f45d-bcd9-40e0-a9fb-cae761abc676 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:10.831821 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ea5139fd-ced3-4570-b55e-94843dc4fe89 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:10.832179 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-21f2f45d-bcd9-40e0-a9fb-cae761abc676 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:10.832381 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ea5139fd-ced3-4570-b55e-94843dc4fe89 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:10.832904 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-21f2f45d-bcd9-40e0-a9fb-cae761abc676 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:10.833552 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-21f2f45d-bcd9-40e0-a9fb-cae761abc676 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:11.041661 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-ea5139fd-ced3-4570-b55e-94843dc4fe89 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:11.045122 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-21f2f45d-bcd9-40e0-a9fb-cae761abc676 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:11.050904 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-ea5139fd-ced3-4570-b55e-94843dc4fe89 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.236140 Jun 17 13:25:11.051561 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1106/2243] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:10 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:11.054881 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-21f2f45d-bcd9-40e0-a9fb-cae761abc676 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.238239 Jun 17 13:25:11.055656 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1138/2244] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:10 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:11.056128 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-3c87c26f-ee78-4185-8b8f-cbfe5c15ad2c tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:11.056815 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-3c87c26f-ee78-4185-8b8f-cbfe5c15ad2c tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:11.063142 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3c87c26f-ee78-4185-8b8f-cbfe5c15ad2c tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:11.063602 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3c87c26f-ee78-4185-8b8f-cbfe5c15ad2c tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:11.064374 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3c87c26f-ee78-4185-8b8f-cbfe5c15ad2c tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:11.064806 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3c87c26f-ee78-4185-8b8f-cbfe5c15ad2c tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:11.129805 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-3c87c26f-ee78-4185-8b8f-cbfe5c15ad2c tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:11.138181 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-3c87c26f-ee78-4185-8b8f-cbfe5c15ad2c tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.085619 Jun 17 13:25:11.138743 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1107/2245] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:11 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:12.072668 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-9086445f-db41-4d61-a4b7-62056edd3cb9 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:12.073269 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-9086445f-db41-4d61-a4b7-62056edd3cb9 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:12.074542 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-a2fdb244-8ca8-4892-8465-36c9f7978f1f tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:12.075137 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-a2fdb244-8ca8-4892-8465-36c9f7978f1f tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:12.080375 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9086445f-db41-4d61-a4b7-62056edd3cb9 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:12.080824 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9086445f-db41-4d61-a4b7-62056edd3cb9 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:12.081576 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9086445f-db41-4d61-a4b7-62056edd3cb9 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:12.081993 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a2fdb244-8ca8-4892-8465-36c9f7978f1f tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:12.082186 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9086445f-db41-4d61-a4b7-62056edd3cb9 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:12.082457 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a2fdb244-8ca8-4892-8465-36c9f7978f1f tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:12.083204 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a2fdb244-8ca8-4892-8465-36c9f7978f1f tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:12.083627 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a2fdb244-8ca8-4892-8465-36c9f7978f1f tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:12.281959 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-9086445f-db41-4d61-a4b7-62056edd3cb9 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:12.284997 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-a2fdb244-8ca8-4892-8465-36c9f7978f1f tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:12.290048 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-9086445f-db41-4d61-a4b7-62056edd3cb9 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.223702 Jun 17 13:25:12.290754 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1139/2246] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:12 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:12.293566 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-a2fdb244-8ca8-4892-8465-36c9f7978f1f tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.224141 Jun 17 13:25:12.294298 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1108/2247] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:12 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:12.418403 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-b7127e51-9d4a-4b38-a91b-dcb2164a7eee tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:12.419017 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-b7127e51-9d4a-4b38-a91b-dcb2164a7eee tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:12.425575 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b7127e51-9d4a-4b38-a91b-dcb2164a7eee tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:12.426015 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b7127e51-9d4a-4b38-a91b-dcb2164a7eee tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:12.426802 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b7127e51-9d4a-4b38-a91b-dcb2164a7eee tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:12.427235 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b7127e51-9d4a-4b38-a91b-dcb2164a7eee tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:12.493970 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-b7127e51-9d4a-4b38-a91b-dcb2164a7eee tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:12.502920 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-b7127e51-9d4a-4b38-a91b-dcb2164a7eee tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.211236 Jun 17 13:25:12.503516 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1140/2248] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:12 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:13.312726 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-6c809940-9f75-41a0-aa3e-a1057e4c9cd7 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:13.313755 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-6c809940-9f75-41a0-aa3e-a1057e4c9cd7 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:13.314829 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-f7bcc34d-8b26-44de-bdd7-21c0ea39cc3f tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:13.316564 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-f7bcc34d-8b26-44de-bdd7-21c0ea39cc3f tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:13.317640 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_api:SELECT=72 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:25:13.325483 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f7bcc34d-8b26-44de-bdd7-21c0ea39cc3f tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:13.325686 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6c809940-9f75-41a0-aa3e-a1057e4c9cd7 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:13.325923 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f7bcc34d-8b26-44de-bdd7-21c0ea39cc3f tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:13.326116 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6c809940-9f75-41a0-aa3e-a1057e4c9cd7 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:13.326713 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f7bcc34d-8b26-44de-bdd7-21c0ea39cc3f tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:13.326870 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6c809940-9f75-41a0-aa3e-a1057e4c9cd7 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:13.327134 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f7bcc34d-8b26-44de-bdd7-21c0ea39cc3f tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:13.327307 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6c809940-9f75-41a0-aa3e-a1057e4c9cd7 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:13.520115 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-f7bcc34d-8b26-44de-bdd7-21c0ea39cc3f tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:13.522841 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-6c809940-9f75-41a0-aa3e-a1057e4c9cd7 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:13.528895 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-f7bcc34d-8b26-44de-bdd7-21c0ea39cc3f tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.220943 Jun 17 13:25:13.529682 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1141/2249] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:13 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:13.531232 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-6c809940-9f75-41a0-aa3e-a1057e4c9cd7 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.225193 Jun 17 13:25:13.532018 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1109/2250] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:13 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:13.534742 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-9be83706-b074-4ccd-ad27-ed144bc92178 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:13.535416 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-9be83706-b074-4ccd-ad27-ed144bc92178 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:13.542289 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9be83706-b074-4ccd-ad27-ed144bc92178 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:13.542731 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9be83706-b074-4ccd-ad27-ed144bc92178 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:13.543477 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9be83706-b074-4ccd-ad27-ed144bc92178 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:13.543904 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9be83706-b074-4ccd-ad27-ed144bc92178 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:13.611525 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-9be83706-b074-4ccd-ad27-ed144bc92178 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:13.622275 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-9be83706-b074-4ccd-ad27-ed144bc92178 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.091769 Jun 17 13:25:13.622839 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1142/2251] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:13 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:14.548653 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-b37fca5d-92da-4079-98f9-9620952e1551 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:14.549473 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-b37fca5d-92da-4079-98f9-9620952e1551 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:14.549943 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-ce9a02af-8fb0-4641-a1d2-faca8b3e38fc tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:14.550821 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-ce9a02af-8fb0-4641-a1d2-faca8b3e38fc tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:14.558653 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b37fca5d-92da-4079-98f9-9620952e1551 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:14.559107 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b37fca5d-92da-4079-98f9-9620952e1551 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:14.559877 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b37fca5d-92da-4079-98f9-9620952e1551 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:14.560032 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ce9a02af-8fb0-4641-a1d2-faca8b3e38fc tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:14.560320 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b37fca5d-92da-4079-98f9-9620952e1551 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:14.560631 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ce9a02af-8fb0-4641-a1d2-faca8b3e38fc tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:14.561454 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ce9a02af-8fb0-4641-a1d2-faca8b3e38fc tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:14.562125 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ce9a02af-8fb0-4641-a1d2-faca8b3e38fc tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:14.564551 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=100 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:25:14.770401 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-ce9a02af-8fb0-4641-a1d2-faca8b3e38fc tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:14.779558 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-ce9a02af-8fb0-4641-a1d2-faca8b3e38fc tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.234792 Jun 17 13:25:14.780249 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1143/2252] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:14 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:14.785017 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-6bfeb1ff-6ba5-4cf9-bf48-214e3fb719ac tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:14.785726 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-6bfeb1ff-6ba5-4cf9-bf48-214e3fb719ac tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:14.792520 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6bfeb1ff-6ba5-4cf9-bf48-214e3fb719ac tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:14.793071 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6bfeb1ff-6ba5-4cf9-bf48-214e3fb719ac tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:14.793813 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6bfeb1ff-6ba5-4cf9-bf48-214e3fb719ac tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:14.794317 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6bfeb1ff-6ba5-4cf9-bf48-214e3fb719ac tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:14.813199 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-b37fca5d-92da-4079-98f9-9620952e1551 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:14.825589 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-b37fca5d-92da-4079-98f9-9620952e1551 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.282251 Jun 17 13:25:14.826220 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1110/2253] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:14 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:14.867871 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-6bfeb1ff-6ba5-4cf9-bf48-214e3fb719ac tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:14.877033 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-6bfeb1ff-6ba5-4cf9-bf48-214e3fb719ac tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.095748 Jun 17 13:25:14.877619 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1144/2254] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:14 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:15.797886 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-1c8b41b3-2f30-40e3-9014-7bf057c5400d tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:15.798614 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-1c8b41b3-2f30-40e3-9014-7bf057c5400d tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:15.805575 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1c8b41b3-2f30-40e3-9014-7bf057c5400d tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:15.806025 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1c8b41b3-2f30-40e3-9014-7bf057c5400d tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:15.806806 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1c8b41b3-2f30-40e3-9014-7bf057c5400d tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:15.807237 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1c8b41b3-2f30-40e3-9014-7bf057c5400d tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:15.843736 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-06bd7221-f7f8-4aec-ae52-efd723729cb9 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:15.844350 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-06bd7221-f7f8-4aec-ae52-efd723729cb9 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:15.851588 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-06bd7221-f7f8-4aec-ae52-efd723729cb9 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:15.852031 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-06bd7221-f7f8-4aec-ae52-efd723729cb9 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:15.852835 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-06bd7221-f7f8-4aec-ae52-efd723729cb9 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:15.853271 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-06bd7221-f7f8-4aec-ae52-efd723729cb9 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:15.958830 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-1c8b41b3-2f30-40e3-9014-7bf057c5400d tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:15.967367 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-1c8b41b3-2f30-40e3-9014-7bf057c5400d tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.173441 Jun 17 13:25:15.967953 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1111/2255] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:15 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:15.972628 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-cbaf3ef3-9fde-40d3-aaf4-b1073cbc47fd tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:15.973227 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-cbaf3ef3-9fde-40d3-aaf4-b1073cbc47fd tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:15.979842 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cbaf3ef3-9fde-40d3-aaf4-b1073cbc47fd tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:15.980417 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cbaf3ef3-9fde-40d3-aaf4-b1073cbc47fd tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:15.981173 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cbaf3ef3-9fde-40d3-aaf4-b1073cbc47fd tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:15.981597 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cbaf3ef3-9fde-40d3-aaf4-b1073cbc47fd tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:16.051724 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-cbaf3ef3-9fde-40d3-aaf4-b1073cbc47fd tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:16.060174 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-cbaf3ef3-9fde-40d3-aaf4-b1073cbc47fd tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.091220 Jun 17 13:25:16.060745 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1112/2256] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:15 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:16.085531 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-06bd7221-f7f8-4aec-ae52-efd723729cb9 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:16.095300 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-06bd7221-f7f8-4aec-ae52-efd723729cb9 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.255540 Jun 17 13:25:16.095896 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1145/2257] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:15 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:16.989461 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-b6a5ef29-c306-46b5-a4e2-7ec1c050c7f0 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:16.990472 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-b6a5ef29-c306-46b5-a4e2-7ec1c050c7f0 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:17.002440 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b6a5ef29-c306-46b5-a4e2-7ec1c050c7f0 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:17.003184 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b6a5ef29-c306-46b5-a4e2-7ec1c050c7f0 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:17.004462 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b6a5ef29-c306-46b5-a4e2-7ec1c050c7f0 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:17.005160 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b6a5ef29-c306-46b5-a4e2-7ec1c050c7f0 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:17.078013 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-c39a5466-f2bc-4c11-bf5e-d80e64a49d70 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:17.078647 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-c39a5466-f2bc-4c11-bf5e-d80e64a49d70 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:17.085487 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c39a5466-f2bc-4c11-bf5e-d80e64a49d70 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:17.085942 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c39a5466-f2bc-4c11-bf5e-d80e64a49d70 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:17.086732 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c39a5466-f2bc-4c11-bf5e-d80e64a49d70 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:17.087162 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c39a5466-f2bc-4c11-bf5e-d80e64a49d70 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:17.162440 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-c39a5466-f2bc-4c11-bf5e-d80e64a49d70 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:17.169541 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-b6a5ef29-c306-46b5-a4e2-7ec1c050c7f0 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:17.171140 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-c39a5466-f2bc-4c11-bf5e-d80e64a49d70 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.097304 Jun 17 13:25:17.171791 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1146/2258] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:17 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 13:25:17.176634 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-35177bb1-de3c-4912-aab0-016aed74adb8 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:17.177275 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-35177bb1-de3c-4912-aab0-016aed74adb8 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:17.183519 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-35177bb1-de3c-4912-aab0-016aed74adb8 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:17.183969 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-35177bb1-de3c-4912-aab0-016aed74adb8 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:17.185360 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-35177bb1-de3c-4912-aab0-016aed74adb8 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:17.185825 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-35177bb1-de3c-4912-aab0-016aed74adb8 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:17.186126 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-b6a5ef29-c306-46b5-a4e2-7ec1c050c7f0 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.203048 Jun 17 13:25:17.186800 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1113/2259] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:16 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:17.341838 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-35177bb1-de3c-4912-aab0-016aed74adb8 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:17.355052 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-35177bb1-de3c-4912-aab0-016aed74adb8 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.181727 Jun 17 13:25:17.355954 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1147/2260] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:17 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:18.189142 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-72defa28-324a-4c75-a18d-15b1d20131e5 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:18.189757 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-72defa28-324a-4c75-a18d-15b1d20131e5 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:18.197004 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-72defa28-324a-4c75-a18d-15b1d20131e5 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:18.197457 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-72defa28-324a-4c75-a18d-15b1d20131e5 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:18.198251 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-72defa28-324a-4c75-a18d-15b1d20131e5 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:18.198717 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-72defa28-324a-4c75-a18d-15b1d20131e5 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:18.207880 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-985eac72-fb70-452c-bd37-3f44aa6877e1 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:18.208483 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-985eac72-fb70-452c-bd37-3f44aa6877e1 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:18.215379 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-985eac72-fb70-452c-bd37-3f44aa6877e1 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:18.215870 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-985eac72-fb70-452c-bd37-3f44aa6877e1 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:18.216637 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-985eac72-fb70-452c-bd37-3f44aa6877e1 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:18.217074 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-985eac72-fb70-452c-bd37-3f44aa6877e1 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:18.265133 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-72defa28-324a-4c75-a18d-15b1d20131e5 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:18.273548 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-72defa28-324a-4c75-a18d-15b1d20131e5 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.088649 Jun 17 13:25:18.274130 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1114/2261] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:18 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:18.366167 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-985eac72-fb70-452c-bd37-3f44aa6877e1 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:18.373397 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-1a97e267-6df3-45da-8409-01f091edbd67 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:18.374021 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-1a97e267-6df3-45da-8409-01f091edbd67 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:18.374717 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-985eac72-fb70-452c-bd37-3f44aa6877e1 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.171191 Jun 17 13:25:18.375577 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1148/2262] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:18 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:18.380417 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1a97e267-6df3-45da-8409-01f091edbd67 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:18.380886 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1a97e267-6df3-45da-8409-01f091edbd67 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:18.381649 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1a97e267-6df3-45da-8409-01f091edbd67 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:18.382079 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1a97e267-6df3-45da-8409-01f091edbd67 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:18.530161 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-1a97e267-6df3-45da-8409-01f091edbd67 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:18.542351 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-1a97e267-6df3-45da-8409-01f091edbd67 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.173118 Jun 17 13:25:18.543068 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1115/2263] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:18 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 13:25:19.291498 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-2e545e87-c0c4-44f5-8f88-b282ba7e4854 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:19.292190 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-2e545e87-c0c4-44f5-8f88-b282ba7e4854 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:19.299444 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2e545e87-c0c4-44f5-8f88-b282ba7e4854 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:19.299888 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2e545e87-c0c4-44f5-8f88-b282ba7e4854 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:19.300643 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2e545e87-c0c4-44f5-8f88-b282ba7e4854 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:19.301078 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2e545e87-c0c4-44f5-8f88-b282ba7e4854 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:19.366691 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-2e545e87-c0c4-44f5-8f88-b282ba7e4854 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:19.374871 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-2e545e87-c0c4-44f5-8f88-b282ba7e4854 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.087471 Jun 17 13:25:19.375928 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1149/2264] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:19 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:19.393130 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-7a63d703-4dd3-4666-b0aa-8cfede5db5e1 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:19.393716 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-7a63d703-4dd3-4666-b0aa-8cfede5db5e1 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:19.401561 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7a63d703-4dd3-4666-b0aa-8cfede5db5e1 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:19.402191 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7a63d703-4dd3-4666-b0aa-8cfede5db5e1 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:19.402953 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7a63d703-4dd3-4666-b0aa-8cfede5db5e1 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:19.403423 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7a63d703-4dd3-4666-b0aa-8cfede5db5e1 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:19.545264 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-7a63d703-4dd3-4666-b0aa-8cfede5db5e1 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:19.554493 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-7a63d703-4dd3-4666-b0aa-8cfede5db5e1 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.165932 Jun 17 13:25:19.555098 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1116/2265] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:19 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:19.560401 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-bbefcc13-4fcc-492b-99e9-f1d43087f529 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:19.561086 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-bbefcc13-4fcc-492b-99e9-f1d43087f529 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:19.567900 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-bbefcc13-4fcc-492b-99e9-f1d43087f529 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:19.568344 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-bbefcc13-4fcc-492b-99e9-f1d43087f529 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:19.569085 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-bbefcc13-4fcc-492b-99e9-f1d43087f529 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:19.569512 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-bbefcc13-4fcc-492b-99e9-f1d43087f529 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:19.587741 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_cell1:SELECT=100 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:25:19.703778 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-bbefcc13-4fcc-492b-99e9-f1d43087f529 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:19.711818 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-bbefcc13-4fcc-492b-99e9-f1d43087f529 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.155445 Jun 17 13:25:19.712384 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1150/2266] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:19 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:20.399455 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-4bb907f6-0db0-4a06-82f4-5db6a62a183b tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:20.400622 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-4bb907f6-0db0-4a06-82f4-5db6a62a183b tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:20.410250 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4bb907f6-0db0-4a06-82f4-5db6a62a183b tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:20.410702 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4bb907f6-0db0-4a06-82f4-5db6a62a183b tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:20.411462 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4bb907f6-0db0-4a06-82f4-5db6a62a183b tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:20.411896 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4bb907f6-0db0-4a06-82f4-5db6a62a183b tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:20.474485 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-4bb907f6-0db0-4a06-82f4-5db6a62a183b tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:20.483280 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-4bb907f6-0db0-4a06-82f4-5db6a62a183b tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.090476 Jun 17 13:25:20.483857 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1117/2267] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:20 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:20.576239 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-7a531bb8-0eb0-4630-b7d7-e9c2d19cffb1 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:20.576973 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-7a531bb8-0eb0-4630-b7d7-e9c2d19cffb1 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:20.584896 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7a531bb8-0eb0-4630-b7d7-e9c2d19cffb1 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:20.585345 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7a531bb8-0eb0-4630-b7d7-e9c2d19cffb1 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:20.586079 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7a531bb8-0eb0-4630-b7d7-e9c2d19cffb1 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:20.586583 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7a531bb8-0eb0-4630-b7d7-e9c2d19cffb1 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:20.729306 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-de22ad92-ebeb-41a1-9ac2-cbaa9cfd6336 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:20.730311 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-de22ad92-ebeb-41a1-9ac2-cbaa9cfd6336 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:20.733321 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-7a531bb8-0eb0-4630-b7d7-e9c2d19cffb1 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:20.737210 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-de22ad92-ebeb-41a1-9ac2-cbaa9cfd6336 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:20.737683 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-de22ad92-ebeb-41a1-9ac2-cbaa9cfd6336 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:20.738494 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-de22ad92-ebeb-41a1-9ac2-cbaa9cfd6336 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:20.738929 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-de22ad92-ebeb-41a1-9ac2-cbaa9cfd6336 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:20.743149 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-7a531bb8-0eb0-4630-b7d7-e9c2d19cffb1 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.173974 Jun 17 13:25:20.743750 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1151/2268] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:20 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:20.872988 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-de22ad92-ebeb-41a1-9ac2-cbaa9cfd6336 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:20.885782 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-de22ad92-ebeb-41a1-9ac2-cbaa9cfd6336 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.160433 Jun 17 13:25:20.886732 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1118/2269] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:20 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:21.504882 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-c13a1b4d-9811-481c-aa63-afbf094c8381 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:21.505886 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-c13a1b4d-9811-481c-aa63-afbf094c8381 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:21.508849 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_api:SELECT=76 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:25:21.518233 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c13a1b4d-9811-481c-aa63-afbf094c8381 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:21.518719 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c13a1b4d-9811-481c-aa63-afbf094c8381 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:21.519490 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c13a1b4d-9811-481c-aa63-afbf094c8381 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:21.519927 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c13a1b4d-9811-481c-aa63-afbf094c8381 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:21.586690 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-c13a1b4d-9811-481c-aa63-afbf094c8381 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:21.595265 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-c13a1b4d-9811-481c-aa63-afbf094c8381 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.097142 Jun 17 13:25:21.595850 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1152/2270] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:21 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:21.764893 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-e0c2ae95-f8e1-441b-844b-7293d780304c tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:21.765872 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-e0c2ae95-f8e1-441b-844b-7293d780304c tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:21.776843 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e0c2ae95-f8e1-441b-844b-7293d780304c tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:21.777587 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e0c2ae95-f8e1-441b-844b-7293d780304c tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:21.778893 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e0c2ae95-f8e1-441b-844b-7293d780304c tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:21.779612 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e0c2ae95-f8e1-441b-844b-7293d780304c tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:21.906233 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-025655fa-a75e-4589-87d3-80ee260e8c78 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:21.907123 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-025655fa-a75e-4589-87d3-80ee260e8c78 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:21.913865 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-025655fa-a75e-4589-87d3-80ee260e8c78 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:21.914050 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-e0c2ae95-f8e1-441b-844b-7293d780304c tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:21.914346 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-025655fa-a75e-4589-87d3-80ee260e8c78 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:21.915083 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-025655fa-a75e-4589-87d3-80ee260e8c78 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:21.915538 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-025655fa-a75e-4589-87d3-80ee260e8c78 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:21.922491 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-e0c2ae95-f8e1-441b-844b-7293d780304c tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.164069 Jun 17 13:25:21.923074 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1119/2271] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:21 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:22.047352 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-025655fa-a75e-4589-87d3-80ee260e8c78 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:22.056322 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-025655fa-a75e-4589-87d3-80ee260e8c78 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.154042 Jun 17 13:25:22.056892 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1153/2272] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:21 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:22.615241 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-1df8b211-d1b1-4d36-ac08-746a32e3de89 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:22.616119 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-1df8b211-d1b1-4d36-ac08-746a32e3de89 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:22.625369 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1df8b211-d1b1-4d36-ac08-746a32e3de89 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:22.626003 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1df8b211-d1b1-4d36-ac08-746a32e3de89 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:22.627167 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1df8b211-d1b1-4d36-ac08-746a32e3de89 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:22.627587 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1df8b211-d1b1-4d36-ac08-746a32e3de89 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:22.688067 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-1df8b211-d1b1-4d36-ac08-746a32e3de89 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:22.696997 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-1df8b211-d1b1-4d36-ac08-746a32e3de89 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.087648 Jun 17 13:25:22.697564 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1120/2273] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:22 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:22.943851 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-4a8dca3a-9e07-4863-80d3-1004bc02fbe7 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:22.944811 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-4a8dca3a-9e07-4863-80d3-1004bc02fbe7 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:22.955715 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4a8dca3a-9e07-4863-80d3-1004bc02fbe7 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:22.956248 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4a8dca3a-9e07-4863-80d3-1004bc02fbe7 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:22.957001 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4a8dca3a-9e07-4863-80d3-1004bc02fbe7 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:22.957433 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4a8dca3a-9e07-4863-80d3-1004bc02fbe7 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:23.073209 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-14de8231-6217-4ff2-87b2-c52c811c6803 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:23.073834 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-14de8231-6217-4ff2-87b2-c52c811c6803 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:23.080891 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-14de8231-6217-4ff2-87b2-c52c811c6803 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:23.081346 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-14de8231-6217-4ff2-87b2-c52c811c6803 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:23.082281 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-14de8231-6217-4ff2-87b2-c52c811c6803 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:23.082717 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-14de8231-6217-4ff2-87b2-c52c811c6803 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:23.097883 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-4a8dca3a-9e07-4863-80d3-1004bc02fbe7 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:23.106485 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-4a8dca3a-9e07-4863-80d3-1004bc02fbe7 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.169090 Jun 17 13:25:23.107081 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1154/2274] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:22 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:23.217962 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-14de8231-6217-4ff2-87b2-c52c811c6803 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:23.226517 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-14de8231-6217-4ff2-87b2-c52c811c6803 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.157295 Jun 17 13:25:23.227068 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1121/2275] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:23 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:23.722794 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-a8bd5b79-fb4d-4e6a-83ed-24d355417b4d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:23.723802 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-a8bd5b79-fb4d-4e6a-83ed-24d355417b4d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:23.734707 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a8bd5b79-fb4d-4e6a-83ed-24d355417b4d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:23.735458 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a8bd5b79-fb4d-4e6a-83ed-24d355417b4d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:23.736705 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a8bd5b79-fb4d-4e6a-83ed-24d355417b4d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:23.737415 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a8bd5b79-fb4d-4e6a-83ed-24d355417b4d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:23.807241 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-a8bd5b79-fb4d-4e6a-83ed-24d355417b4d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:23.815855 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-a8bd5b79-fb4d-4e6a-83ed-24d355417b4d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.099800 Jun 17 13:25:23.816439 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1155/2276] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:23 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:24.126597 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-087ef8bb-782a-49ef-b9e7-2950ab862755 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:24.127276 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-087ef8bb-782a-49ef-b9e7-2950ab862755 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:24.135121 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-087ef8bb-782a-49ef-b9e7-2950ab862755 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:24.135570 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-087ef8bb-782a-49ef-b9e7-2950ab862755 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:24.136326 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-087ef8bb-782a-49ef-b9e7-2950ab862755 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:24.136757 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-087ef8bb-782a-49ef-b9e7-2950ab862755 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:24.244567 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-8f9ba590-39f7-49c4-bdad-4532fe36e4d2 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:24.245186 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-8f9ba590-39f7-49c4-bdad-4532fe36e4d2 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:24.251854 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8f9ba590-39f7-49c4-bdad-4532fe36e4d2 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:24.252309 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8f9ba590-39f7-49c4-bdad-4532fe36e4d2 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:24.253124 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8f9ba590-39f7-49c4-bdad-4532fe36e4d2 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:24.253553 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8f9ba590-39f7-49c4-bdad-4532fe36e4d2 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:24.271773 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-087ef8bb-782a-49ef-b9e7-2950ab862755 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:24.279992 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-087ef8bb-782a-49ef-b9e7-2950ab862755 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.159703 Jun 17 13:25:24.280679 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1122/2277] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:24 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:24.394721 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-8f9ba590-39f7-49c4-bdad-4532fe36e4d2 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:24.404458 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-8f9ba590-39f7-49c4-bdad-4532fe36e4d2 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.163892 Jun 17 13:25:24.405014 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1156/2278] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:24 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:24.837243 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-96bc105e-75f8-466d-9064-7acf9bede55f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:24.838280 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-96bc105e-75f8-466d-9064-7acf9bede55f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:24.848812 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-96bc105e-75f8-466d-9064-7acf9bede55f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:24.849518 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-96bc105e-75f8-466d-9064-7acf9bede55f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:24.850320 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-96bc105e-75f8-466d-9064-7acf9bede55f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:24.850749 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-96bc105e-75f8-466d-9064-7acf9bede55f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:24.918985 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-96bc105e-75f8-466d-9064-7acf9bede55f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:24.930941 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-96bc105e-75f8-466d-9064-7acf9bede55f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.100267 Jun 17 13:25:24.931642 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1123/2279] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:24 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:25.297147 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-36c77207-7dc0-4fe1-9f0a-3c21d61754e0 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:25.297707 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-36c77207-7dc0-4fe1-9f0a-3c21d61754e0 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:25.305486 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-36c77207-7dc0-4fe1-9f0a-3c21d61754e0 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:25.305938 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-36c77207-7dc0-4fe1-9f0a-3c21d61754e0 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:25.306765 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-36c77207-7dc0-4fe1-9f0a-3c21d61754e0 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:25.307197 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-36c77207-7dc0-4fe1-9f0a-3c21d61754e0 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:25.421392 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-1a50f42c-4c02-4ca1-bfdc-f763e274e855 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:25.422011 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-1a50f42c-4c02-4ca1-bfdc-f763e274e855 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:25.428806 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1a50f42c-4c02-4ca1-bfdc-f763e274e855 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:25.429252 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1a50f42c-4c02-4ca1-bfdc-f763e274e855 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:25.430013 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1a50f42c-4c02-4ca1-bfdc-f763e274e855 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:25.430477 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1a50f42c-4c02-4ca1-bfdc-f763e274e855 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:25.443952 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-36c77207-7dc0-4fe1-9f0a-3c21d61754e0 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:25.452489 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-36c77207-7dc0-4fe1-9f0a-3c21d61754e0 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.159455 Jun 17 13:25:25.453141 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1157/2280] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:25 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:25.574474 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-1a50f42c-4c02-4ca1-bfdc-f763e274e855 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:25.583045 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-1a50f42c-4c02-4ca1-bfdc-f763e274e855 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.165628 Jun 17 13:25:25.584095 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1124/2281] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:25 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:25.951131 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-eedecb6d-2d7d-45df-a5f9-5e2fb569f22b tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:25.952071 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-eedecb6d-2d7d-45df-a5f9-5e2fb569f22b tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:25.960439 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-eedecb6d-2d7d-45df-a5f9-5e2fb569f22b tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:25.960885 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-eedecb6d-2d7d-45df-a5f9-5e2fb569f22b tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:25.961636 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-eedecb6d-2d7d-45df-a5f9-5e2fb569f22b tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:25.962063 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-eedecb6d-2d7d-45df-a5f9-5e2fb569f22b tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:26.031732 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-eedecb6d-2d7d-45df-a5f9-5e2fb569f22b tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:26.040106 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-eedecb6d-2d7d-45df-a5f9-5e2fb569f22b tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.094712 Jun 17 13:25:26.040652 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1158/2282] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:25 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:26.473907 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-143b369a-a949-4ae3-bc9f-0e36ee20492d tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:26.475609 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-143b369a-a949-4ae3-bc9f-0e36ee20492d tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:26.486684 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-143b369a-a949-4ae3-bc9f-0e36ee20492d tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:26.487424 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-143b369a-a949-4ae3-bc9f-0e36ee20492d tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:26.488666 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-143b369a-a949-4ae3-bc9f-0e36ee20492d tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:26.489386 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-143b369a-a949-4ae3-bc9f-0e36ee20492d tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:26.601849 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-998f0f77-d5e2-4c8e-acb0-66b17552cde1 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:26.602578 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-998f0f77-d5e2-4c8e-acb0-66b17552cde1 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:26.609908 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-998f0f77-d5e2-4c8e-acb0-66b17552cde1 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:26.610442 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-998f0f77-d5e2-4c8e-acb0-66b17552cde1 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:26.611196 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-998f0f77-d5e2-4c8e-acb0-66b17552cde1 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:26.611611 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-998f0f77-d5e2-4c8e-acb0-66b17552cde1 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:26.618227 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-143b369a-a949-4ae3-bc9f-0e36ee20492d tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:26.626847 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-143b369a-a949-4ae3-bc9f-0e36ee20492d tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.159209 Jun 17 13:25:26.627407 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1125/2283] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:26 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:26.758746 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-998f0f77-d5e2-4c8e-acb0-66b17552cde1 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:26.770713 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-998f0f77-d5e2-4c8e-acb0-66b17552cde1 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.173563 Jun 17 13:25:26.771744 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1159/2284] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:26 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:27.063040 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-8ef09f81-a08e-49b4-aa05-2fbb514ec71b tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:27.064047 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-8ef09f81-a08e-49b4-aa05-2fbb514ec71b tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:27.074821 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8ef09f81-a08e-49b4-aa05-2fbb514ec71b tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:27.075347 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8ef09f81-a08e-49b4-aa05-2fbb514ec71b tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:27.076450 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8ef09f81-a08e-49b4-aa05-2fbb514ec71b tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:27.077124 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8ef09f81-a08e-49b4-aa05-2fbb514ec71b tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:27.150275 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-8ef09f81-a08e-49b4-aa05-2fbb514ec71b tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:27.153676 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=100 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:25:27.159548 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-8ef09f81-a08e-49b4-aa05-2fbb514ec71b tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.103198 Jun 17 13:25:27.160112 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1126/2285] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:27 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:27.648149 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-03e47d5d-14cc-45d6-8460-f6c79cef8c5b tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:27.649127 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-03e47d5d-14cc-45d6-8460-f6c79cef8c5b tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:27.659990 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-03e47d5d-14cc-45d6-8460-f6c79cef8c5b tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:27.660720 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-03e47d5d-14cc-45d6-8460-f6c79cef8c5b tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:27.661903 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-03e47d5d-14cc-45d6-8460-f6c79cef8c5b tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:27.662362 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-03e47d5d-14cc-45d6-8460-f6c79cef8c5b tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:27.789431 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-6f5ac63d-8816-4124-b37f-be12467cb14b tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:27.790062 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-6f5ac63d-8816-4124-b37f-be12467cb14b tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:27.795038 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-03e47d5d-14cc-45d6-8460-f6c79cef8c5b tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:27.797233 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6f5ac63d-8816-4124-b37f-be12467cb14b tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:27.797668 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6f5ac63d-8816-4124-b37f-be12467cb14b tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:27.798452 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6f5ac63d-8816-4124-b37f-be12467cb14b tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:27.798873 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6f5ac63d-8816-4124-b37f-be12467cb14b tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:27.804182 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-03e47d5d-14cc-45d6-8460-f6c79cef8c5b tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.162398 Jun 17 13:25:27.804775 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1160/2286] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:27 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:27.936893 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-6f5ac63d-8816-4124-b37f-be12467cb14b tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:27.945755 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-6f5ac63d-8816-4124-b37f-be12467cb14b tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.160648 Jun 17 13:25:27.946470 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1127/2287] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:27 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 13:25:28.177291 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-f5a23a71-0e68-46dc-9424-c5471724ffcd tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:28.177902 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-f5a23a71-0e68-46dc-9424-c5471724ffcd tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:28.184498 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f5a23a71-0e68-46dc-9424-c5471724ffcd tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:28.184884 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f5a23a71-0e68-46dc-9424-c5471724ffcd tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:28.185636 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f5a23a71-0e68-46dc-9424-c5471724ffcd tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:28.186072 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f5a23a71-0e68-46dc-9424-c5471724ffcd tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:28.252415 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-f5a23a71-0e68-46dc-9424-c5471724ffcd tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:28.260890 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-f5a23a71-0e68-46dc-9424-c5471724ffcd tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.087652 Jun 17 13:25:28.261485 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1161/2288] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:28 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:28.821320 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-6a9feae4-046a-40aa-8619-38b58e51bc2d tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:28.821901 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-6a9feae4-046a-40aa-8619-38b58e51bc2d tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:28.828754 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6a9feae4-046a-40aa-8619-38b58e51bc2d tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:28.829197 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6a9feae4-046a-40aa-8619-38b58e51bc2d tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:28.829938 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6a9feae4-046a-40aa-8619-38b58e51bc2d tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:28.830386 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6a9feae4-046a-40aa-8619-38b58e51bc2d tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:28.963752 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-f15e7ef0-143a-409b-b5a3-5d82e7659db5 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:28.964373 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-f15e7ef0-143a-409b-b5a3-5d82e7659db5 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:28.971255 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f15e7ef0-143a-409b-b5a3-5d82e7659db5 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:28.971709 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f15e7ef0-143a-409b-b5a3-5d82e7659db5 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:28.972469 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f15e7ef0-143a-409b-b5a3-5d82e7659db5 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:28.972907 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f15e7ef0-143a-409b-b5a3-5d82e7659db5 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:29.025294 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-6a9feae4-046a-40aa-8619-38b58e51bc2d tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:29.033811 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-6a9feae4-046a-40aa-8619-38b58e51bc2d tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.216484 Jun 17 13:25:29.034456 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1128/2289] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:28 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:29.111426 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-f15e7ef0-143a-409b-b5a3-5d82e7659db5 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:29.120884 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-f15e7ef0-143a-409b-b5a3-5d82e7659db5 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.161031 Jun 17 13:25:29.121476 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1162/2290] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:28 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:29.282646 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-e1a8aadd-6909-43ac-9ae8-4d6d24bcfd5a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:29.283524 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-e1a8aadd-6909-43ac-9ae8-4d6d24bcfd5a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:29.291314 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e1a8aadd-6909-43ac-9ae8-4d6d24bcfd5a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:29.291752 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e1a8aadd-6909-43ac-9ae8-4d6d24bcfd5a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:29.292501 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e1a8aadd-6909-43ac-9ae8-4d6d24bcfd5a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:29.292955 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e1a8aadd-6909-43ac-9ae8-4d6d24bcfd5a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:29.355843 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-e1a8aadd-6909-43ac-9ae8-4d6d24bcfd5a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:29.363873 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-e1a8aadd-6909-43ac-9ae8-4d6d24bcfd5a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.087833 Jun 17 13:25:29.364409 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1129/2291] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:29 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:30.055433 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-51ec029a-3664-4112-ae63-5622a176484c tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:30.056416 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-51ec029a-3664-4112-ae63-5622a176484c tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:30.067537 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-51ec029a-3664-4112-ae63-5622a176484c tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:30.068387 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-51ec029a-3664-4112-ae63-5622a176484c tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:30.069136 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-51ec029a-3664-4112-ae63-5622a176484c tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:30.069563 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-51ec029a-3664-4112-ae63-5622a176484c tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:30.138559 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-7412f2ae-93cb-4af9-a4ac-a6aee4f24439 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:30.139166 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-7412f2ae-93cb-4af9-a4ac-a6aee4f24439 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:30.145663 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7412f2ae-93cb-4af9-a4ac-a6aee4f24439 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:30.146305 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7412f2ae-93cb-4af9-a4ac-a6aee4f24439 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:30.147088 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7412f2ae-93cb-4af9-a4ac-a6aee4f24439 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:30.147597 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7412f2ae-93cb-4af9-a4ac-a6aee4f24439 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:30.498235 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-51ec029a-3664-4112-ae63-5622a176484c tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:30.507570 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-51ec029a-3664-4112-ae63-5622a176484c tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.458793 Jun 17 13:25:30.508165 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1163/2292] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:30 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:30.512796 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-fa6e4704-a745-4d81-818c-ef5d9852e422 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:30.513527 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-fa6e4704-a745-4d81-818c-ef5d9852e422 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:30.519711 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-fa6e4704-a745-4d81-818c-ef5d9852e422 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:30.520183 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-fa6e4704-a745-4d81-818c-ef5d9852e422 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:30.521133 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-fa6e4704-a745-4d81-818c-ef5d9852e422 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:30.521572 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-fa6e4704-a745-4d81-818c-ef5d9852e422 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:30.544152 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-7412f2ae-93cb-4af9-a4ac-a6aee4f24439 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:30.552439 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-7412f2ae-93cb-4af9-a4ac-a6aee4f24439 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.417622 Jun 17 13:25:30.553134 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1130/2293] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:30 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 13:25:30.583123 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-fa6e4704-a745-4d81-818c-ef5d9852e422 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:30.591126 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-fa6e4704-a745-4d81-818c-ef5d9852e422 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.081994 Jun 17 13:25:30.591697 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1164/2294] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:30 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:31.529312 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-114b6114-bdbf-43fc-834b-65ce82d38c88 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:31.530471 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-114b6114-bdbf-43fc-834b-65ce82d38c88 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:31.539722 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-114b6114-bdbf-43fc-834b-65ce82d38c88 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:31.540175 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-114b6114-bdbf-43fc-834b-65ce82d38c88 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:31.540929 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-114b6114-bdbf-43fc-834b-65ce82d38c88 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:31.541372 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-114b6114-bdbf-43fc-834b-65ce82d38c88 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:31.569041 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-30e80ded-d424-49e2-ac85-4597aea80a16 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:31.569595 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-30e80ded-d424-49e2-ac85-4597aea80a16 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:31.576617 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-30e80ded-d424-49e2-ac85-4597aea80a16 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:31.577059 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-30e80ded-d424-49e2-ac85-4597aea80a16 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:31.577808 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-30e80ded-d424-49e2-ac85-4597aea80a16 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:31.578270 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-30e80ded-d424-49e2-ac85-4597aea80a16 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:31.735335 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-114b6114-bdbf-43fc-834b-65ce82d38c88 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:31.743908 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-114b6114-bdbf-43fc-834b-65ce82d38c88 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.220972 Jun 17 13:25:31.744495 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1131/2295] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:31 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:31.749106 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-ee896ec9-0869-41b4-8fbe-d2cd1dd10c45 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:31.749698 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-ee896ec9-0869-41b4-8fbe-d2cd1dd10c45 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:31.755939 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ee896ec9-0869-41b4-8fbe-d2cd1dd10c45 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:31.756389 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ee896ec9-0869-41b4-8fbe-d2cd1dd10c45 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:31.757123 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-30e80ded-d424-49e2-ac85-4597aea80a16 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:31.757280 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ee896ec9-0869-41b4-8fbe-d2cd1dd10c45 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:31.757586 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ee896ec9-0869-41b4-8fbe-d2cd1dd10c45 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:31.765340 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-30e80ded-d424-49e2-ac85-4597aea80a16 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.200428 Jun 17 13:25:31.765924 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1165/2296] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:31 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:31.820402 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-ee896ec9-0869-41b4-8fbe-d2cd1dd10c45 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:31.828367 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-ee896ec9-0869-41b4-8fbe-d2cd1dd10c45 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.082916 Jun 17 13:25:31.828930 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1132/2297] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:31 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:32.761396 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-0b554da2-0dd7-417a-99f9-9a28278977c8 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:32.762011 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-0b554da2-0dd7-417a-99f9-9a28278977c8 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:32.769082 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0b554da2-0dd7-417a-99f9-9a28278977c8 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:32.769526 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0b554da2-0dd7-417a-99f9-9a28278977c8 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:32.770317 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0b554da2-0dd7-417a-99f9-9a28278977c8 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:32.770855 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0b554da2-0dd7-417a-99f9-9a28278977c8 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:32.782915 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-22dd894f-bcd4-466c-9a43-c2f79ca7d181 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:32.783622 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-22dd894f-bcd4-466c-9a43-c2f79ca7d181 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:32.790716 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-22dd894f-bcd4-466c-9a43-c2f79ca7d181 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:32.791159 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-22dd894f-bcd4-466c-9a43-c2f79ca7d181 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:32.791923 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-22dd894f-bcd4-466c-9a43-c2f79ca7d181 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:32.792353 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-22dd894f-bcd4-466c-9a43-c2f79ca7d181 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:32.964139 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-0b554da2-0dd7-417a-99f9-9a28278977c8 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:32.972639 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-0b554da2-0dd7-417a-99f9-9a28278977c8 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.215125 Jun 17 13:25:32.973305 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1166/2298] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:32 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:32.977933 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-b19bb11b-8b41-475c-9974-2cc977d32d07 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:32.978561 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-b19bb11b-8b41-475c-9974-2cc977d32d07 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:32.984819 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b19bb11b-8b41-475c-9974-2cc977d32d07 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:32.985269 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b19bb11b-8b41-475c-9974-2cc977d32d07 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:32.986032 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b19bb11b-8b41-475c-9974-2cc977d32d07 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:32.986432 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-22dd894f-bcd4-466c-9a43-c2f79ca7d181 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:32.986567 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b19bb11b-8b41-475c-9974-2cc977d32d07 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:32.990785 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_cell1:SELECT=100 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:25:32.995314 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-22dd894f-bcd4-466c-9a43-c2f79ca7d181 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.216286 Jun 17 13:25:32.996267 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1133/2299] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:32 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:33.050826 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-b19bb11b-8b41-475c-9974-2cc977d32d07 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:33.063539 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-b19bb11b-8b41-475c-9974-2cc977d32d07 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.088944 Jun 17 13:25:33.064371 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1167/2300] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:32 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:33.994723 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-d16c0653-2c68-41ff-ab4c-c4353f25a79d tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:33.995764 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-d16c0653-2c68-41ff-ab4c-c4353f25a79d tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:34.007072 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d16c0653-2c68-41ff-ab4c-c4353f25a79d tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:34.007825 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d16c0653-2c68-41ff-ab4c-c4353f25a79d tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:34.009079 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d16c0653-2c68-41ff-ab4c-c4353f25a79d tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:34.010033 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d16c0653-2c68-41ff-ab4c-c4353f25a79d tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:34.017387 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-e14bd201-bd03-405f-938a-911f526b1f3e tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:34.018441 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-e14bd201-bd03-405f-938a-911f526b1f3e tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:34.027229 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e14bd201-bd03-405f-938a-911f526b1f3e tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:34.027670 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e14bd201-bd03-405f-938a-911f526b1f3e tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:34.028419 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e14bd201-bd03-405f-938a-911f526b1f3e tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:34.028850 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e14bd201-bd03-405f-938a-911f526b1f3e tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:34.212848 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-d16c0653-2c68-41ff-ab4c-c4353f25a79d tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:34.221328 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-d16c0653-2c68-41ff-ab4c-c4353f25a79d tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.233157 Jun 17 13:25:34.222252 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1134/2301] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:33 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:34.224713 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-e14bd201-bd03-405f-938a-911f526b1f3e tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:34.227031 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-c4d35f9f-064b-4b0f-b1b4-4a4b7736a7b1 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:34.227775 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-c4d35f9f-064b-4b0f-b1b4-4a4b7736a7b1 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:34.233371 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-e14bd201-bd03-405f-938a-911f526b1f3e tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.222680 Jun 17 13:25:34.233975 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1168/2302] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:34 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:34.234191 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c4d35f9f-064b-4b0f-b1b4-4a4b7736a7b1 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:34.234752 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c4d35f9f-064b-4b0f-b1b4-4a4b7736a7b1 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:34.235583 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c4d35f9f-064b-4b0f-b1b4-4a4b7736a7b1 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:34.236040 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c4d35f9f-064b-4b0f-b1b4-4a4b7736a7b1 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:34.298534 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-c4d35f9f-064b-4b0f-b1b4-4a4b7736a7b1 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:34.307220 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-c4d35f9f-064b-4b0f-b1b4-4a4b7736a7b1 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.084053 Jun 17 13:25:34.307799 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1135/2303] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:34 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:35.239283 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-a168af3b-182f-4851-a0fb-55f4c2636e24 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:35.239897 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-a168af3b-182f-4851-a0fb-55f4c2636e24 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:35.247078 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a168af3b-182f-4851-a0fb-55f4c2636e24 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:35.247522 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a168af3b-182f-4851-a0fb-55f4c2636e24 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:35.248256 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a168af3b-182f-4851-a0fb-55f4c2636e24 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:35.248692 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a168af3b-182f-4851-a0fb-55f4c2636e24 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:35.250771 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-d168eb8d-3a14-4bd2-9787-1a9079abe267 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:35.251378 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-d168eb8d-3a14-4bd2-9787-1a9079abe267 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:35.258551 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d168eb8d-3a14-4bd2-9787-1a9079abe267 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:35.258979 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d168eb8d-3a14-4bd2-9787-1a9079abe267 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:35.259731 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d168eb8d-3a14-4bd2-9787-1a9079abe267 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:35.260158 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d168eb8d-3a14-4bd2-9787-1a9079abe267 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:35.450296 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-a168af3b-182f-4851-a0fb-55f4c2636e24 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:35.454935 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-d168eb8d-3a14-4bd2-9787-1a9079abe267 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:35.461859 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-a168af3b-182f-4851-a0fb-55f4c2636e24 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.226590 Jun 17 13:25:35.462499 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1169/2304] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:35 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:35.464364 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-d168eb8d-3a14-4bd2-9787-1a9079abe267 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.217267 Jun 17 13:25:35.465148 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1136/2305] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:35 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:35.467111 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-8da55c81-536e-4dd5-96b6-1f28f139074d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:35.467756 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-8da55c81-536e-4dd5-96b6-1f28f139074d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:35.473730 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8da55c81-536e-4dd5-96b6-1f28f139074d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:35.474186 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8da55c81-536e-4dd5-96b6-1f28f139074d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:35.475004 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8da55c81-536e-4dd5-96b6-1f28f139074d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:35.475773 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8da55c81-536e-4dd5-96b6-1f28f139074d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:35.542053 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-8da55c81-536e-4dd5-96b6-1f28f139074d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:35.550754 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-8da55c81-536e-4dd5-96b6-1f28f139074d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.087288 Jun 17 13:25:35.551347 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1170/2306] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:35 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:36.483936 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-626cac13-b14d-46a7-b04a-55ee00741b59 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:36.484868 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-c5201eb8-f7e9-4f8c-893b-7b522e4e1941 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:36.485463 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-626cac13-b14d-46a7-b04a-55ee00741b59 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:36.485655 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-c5201eb8-f7e9-4f8c-893b-7b522e4e1941 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:36.495843 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-626cac13-b14d-46a7-b04a-55ee00741b59 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:36.496743 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-626cac13-b14d-46a7-b04a-55ee00741b59 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:36.497033 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c5201eb8-f7e9-4f8c-893b-7b522e4e1941 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:36.497503 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c5201eb8-f7e9-4f8c-893b-7b522e4e1941 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:36.498062 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-626cac13-b14d-46a7-b04a-55ee00741b59 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:36.498807 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c5201eb8-f7e9-4f8c-893b-7b522e4e1941 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:36.499064 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-626cac13-b14d-46a7-b04a-55ee00741b59 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:36.499537 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c5201eb8-f7e9-4f8c-893b-7b522e4e1941 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:36.695307 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-626cac13-b14d-46a7-b04a-55ee00741b59 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:36.699052 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-c5201eb8-f7e9-4f8c-893b-7b522e4e1941 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:36.703930 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-626cac13-b14d-46a7-b04a-55ee00741b59 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.226859 Jun 17 13:25:36.704532 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1137/2307] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:36 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:36.708080 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-c5201eb8-f7e9-4f8c-893b-7b522e4e1941 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.230047 Jun 17 13:25:36.708868 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1171/2308] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:36 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:36.709249 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-cf32688c-2c68-4547-8d91-6444020dfbf5 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:36.709862 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-cf32688c-2c68-4547-8d91-6444020dfbf5 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:36.716254 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cf32688c-2c68-4547-8d91-6444020dfbf5 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:36.716696 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cf32688c-2c68-4547-8d91-6444020dfbf5 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:36.717451 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cf32688c-2c68-4547-8d91-6444020dfbf5 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:36.717875 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cf32688c-2c68-4547-8d91-6444020dfbf5 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:36.782261 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-cf32688c-2c68-4547-8d91-6444020dfbf5 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:36.795098 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-cf32688c-2c68-4547-8d91-6444020dfbf5 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.089221 Jun 17 13:25:36.795822 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1138/2309] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:36 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:37.725802 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-2d1d1a7d-1081-4ce9-b26c-079c72508d46 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:37.726434 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-2d1d1a7d-1081-4ce9-b26c-079c72508d46 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:37.727859 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-90b64df6-6b7d-43d1-b24b-5f19ee44f318 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:37.728545 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-90b64df6-6b7d-43d1-b24b-5f19ee44f318 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:37.735053 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2d1d1a7d-1081-4ce9-b26c-079c72508d46 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:37.735502 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2d1d1a7d-1081-4ce9-b26c-079c72508d46 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:37.735746 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-90b64df6-6b7d-43d1-b24b-5f19ee44f318 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:37.736204 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-90b64df6-6b7d-43d1-b24b-5f19ee44f318 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:37.736377 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2d1d1a7d-1081-4ce9-b26c-079c72508d46 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:37.736720 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2d1d1a7d-1081-4ce9-b26c-079c72508d46 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:37.736949 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-90b64df6-6b7d-43d1-b24b-5f19ee44f318 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:37.737407 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-90b64df6-6b7d-43d1-b24b-5f19ee44f318 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:37.944303 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-2d1d1a7d-1081-4ce9-b26c-079c72508d46 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:37.947827 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-90b64df6-6b7d-43d1-b24b-5f19ee44f318 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:37.952872 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-2d1d1a7d-1081-4ce9-b26c-079c72508d46 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.233081 Jun 17 13:25:37.953516 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1172/2310] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:37 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:37.955617 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-90b64df6-6b7d-43d1-b24b-5f19ee44f318 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.233202 Jun 17 13:25:37.956329 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1139/2311] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:37 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:37.958416 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-85877934-19ae-4a91-9bf5-bc776abe8eaf tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:37.959090 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-85877934-19ae-4a91-9bf5-bc776abe8eaf tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:37.965290 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-85877934-19ae-4a91-9bf5-bc776abe8eaf tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:37.965744 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-85877934-19ae-4a91-9bf5-bc776abe8eaf tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:37.966528 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-85877934-19ae-4a91-9bf5-bc776abe8eaf tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:37.966998 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-85877934-19ae-4a91-9bf5-bc776abe8eaf tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:38.041457 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-85877934-19ae-4a91-9bf5-bc776abe8eaf tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:38.049841 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-85877934-19ae-4a91-9bf5-bc776abe8eaf tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.095281 Jun 17 13:25:38.050447 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1173/2312] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:37 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:38.864705 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 13:25:38.865690 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Fri Jun 17 13:25:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 17 13:25:38.975638 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-f8c1ef79-41c5-42de-898f-9c9b824b8223 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:38.976529 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-6ae3a61f-bcc6-40ee-bf1d-15956de7c672 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:38.977383 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-f8c1ef79-41c5-42de-898f-9c9b824b8223 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:38.977577 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-6ae3a61f-bcc6-40ee-bf1d-15956de7c672 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:38.988108 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6ae3a61f-bcc6-40ee-bf1d-15956de7c672 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:38.988441 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f8c1ef79-41c5-42de-898f-9c9b824b8223 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:38.988801 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6ae3a61f-bcc6-40ee-bf1d-15956de7c672 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:38.989021 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f8c1ef79-41c5-42de-898f-9c9b824b8223 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:38.990072 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6ae3a61f-bcc6-40ee-bf1d-15956de7c672 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:38.990355 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f8c1ef79-41c5-42de-898f-9c9b824b8223 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:38.990837 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6ae3a61f-bcc6-40ee-bf1d-15956de7c672 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:38.991098 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f8c1ef79-41c5-42de-898f-9c9b824b8223 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:39.185838 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-f8c1ef79-41c5-42de-898f-9c9b824b8223 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:39.189079 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-6ae3a61f-bcc6-40ee-bf1d-15956de7c672 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:39.194580 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-f8c1ef79-41c5-42de-898f-9c9b824b8223 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.225674 Jun 17 13:25:39.195202 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1140/2313] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:38 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:39.199604 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-6ae3a61f-bcc6-40ee-bf1d-15956de7c672 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.229686 Jun 17 13:25:39.200533 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-83bc06f9-e73d-4ff0-be59-038ae4ed6372 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:39.200714 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1174/2314] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:38 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:39.200942 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-83bc06f9-e73d-4ff0-be59-038ae4ed6372 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:39.207696 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-83bc06f9-e73d-4ff0-be59-038ae4ed6372 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:39.208147 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-83bc06f9-e73d-4ff0-be59-038ae4ed6372 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:39.208926 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-83bc06f9-e73d-4ff0-be59-038ae4ed6372 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:39.209355 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-83bc06f9-e73d-4ff0-be59-038ae4ed6372 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:39.272347 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-83bc06f9-e73d-4ff0-be59-038ae4ed6372 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:39.280805 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-83bc06f9-e73d-4ff0-be59-038ae4ed6372 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.084565 Jun 17 13:25:39.281373 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1141/2315] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:39 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:40.217165 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-1edf79cf-d5b4-4a2f-84df-9aec9559e939 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:40.218045 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-1edf79cf-d5b4-4a2f-84df-9aec9559e939 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:40.220560 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-aa63f1e2-d757-4652-8ca3-0d2a4501dc37 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:40.221556 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-aa63f1e2-d757-4652-8ca3-0d2a4501dc37 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:40.229254 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-1edf79cf-d5b4-4a2f-84df-9aec9559e939 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:40.230009 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-1edf79cf-d5b4-4a2f-84df-9aec9559e939 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:40.230846 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-1edf79cf-d5b4-4a2f-84df-9aec9559e939 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:40.231292 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-1edf79cf-d5b4-4a2f-84df-9aec9559e939 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:40.231481 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-aa63f1e2-d757-4652-8ca3-0d2a4501dc37 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:40.231950 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-aa63f1e2-d757-4652-8ca3-0d2a4501dc37 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:40.232733 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-aa63f1e2-d757-4652-8ca3-0d2a4501dc37 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:40.233160 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-aa63f1e2-d757-4652-8ca3-0d2a4501dc37 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:40.433497 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-aa63f1e2-d757-4652-8ca3-0d2a4501dc37 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:40.436315 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-1edf79cf-d5b4-4a2f-84df-9aec9559e939 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:40.441664 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-aa63f1e2-d757-4652-8ca3-0d2a4501dc37 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.227435 Jun 17 13:25:40.442265 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1142/2316] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:40 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:40.444597 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-1edf79cf-d5b4-4a2f-84df-9aec9559e939 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.234919 Jun 17 13:25:40.445389 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1175/2317] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:40 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:40.446687 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-b00c8a3b-b117-4696-8dae-c94258a03a4f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:40.447986 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-b00c8a3b-b117-4696-8dae-c94258a03a4f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:40.454256 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b00c8a3b-b117-4696-8dae-c94258a03a4f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:40.454709 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b00c8a3b-b117-4696-8dae-c94258a03a4f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:40.455505 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b00c8a3b-b117-4696-8dae-c94258a03a4f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:40.455917 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b00c8a3b-b117-4696-8dae-c94258a03a4f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:40.474218 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=100 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:25:40.522676 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-b00c8a3b-b117-4696-8dae-c94258a03a4f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:40.532047 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-b00c8a3b-b117-4696-8dae-c94258a03a4f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.088833 Jun 17 13:25:40.532590 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1143/2318] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:40 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:41.251961 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 13:25:41.252611 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Fri Jun 17 13:25:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 17 13:25:41.463381 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-a4117cbb-fa3c-48e7-8149-513c8a919ff7 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:41.464600 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-a4117cbb-fa3c-48e7-8149-513c8a919ff7 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:41.465667 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-658f8f69-0c61-43c8-b2fa-edd411031929 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:41.466687 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-658f8f69-0c61-43c8-b2fa-edd411031929 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:41.475117 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a4117cbb-fa3c-48e7-8149-513c8a919ff7 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:41.475878 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a4117cbb-fa3c-48e7-8149-513c8a919ff7 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:41.477143 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a4117cbb-fa3c-48e7-8149-513c8a919ff7 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:41.477400 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-658f8f69-0c61-43c8-b2fa-edd411031929 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:41.477869 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a4117cbb-fa3c-48e7-8149-513c8a919ff7 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:41.478498 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-658f8f69-0c61-43c8-b2fa-edd411031929 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:41.478952 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-658f8f69-0c61-43c8-b2fa-edd411031929 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:41.479268 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-658f8f69-0c61-43c8-b2fa-edd411031929 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:41.670305 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-658f8f69-0c61-43c8-b2fa-edd411031929 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:41.675332 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-a4117cbb-fa3c-48e7-8149-513c8a919ff7 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:41.679547 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-658f8f69-0c61-43c8-b2fa-edd411031929 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.220396 Jun 17 13:25:41.680151 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1144/2319] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:41 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:41.684432 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-a4117cbb-fa3c-48e7-8149-513c8a919ff7 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.227796 Jun 17 13:25:41.685267 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1176/2320] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:41 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:41.685682 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-2a8092f0-ea7c-4c94-9b58-d07760d61362 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:41.686360 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-2a8092f0-ea7c-4c94-9b58-d07760d61362 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:41.692926 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2a8092f0-ea7c-4c94-9b58-d07760d61362 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:41.693378 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2a8092f0-ea7c-4c94-9b58-d07760d61362 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:41.694217 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2a8092f0-ea7c-4c94-9b58-d07760d61362 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:41.694848 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2a8092f0-ea7c-4c94-9b58-d07760d61362 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:41.766463 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-2a8092f0-ea7c-4c94-9b58-d07760d61362 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:41.777685 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-2a8092f0-ea7c-4c94-9b58-d07760d61362 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.096565 Jun 17 13:25:41.778291 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1145/2321] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:41 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:42.697419 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-6f198f40-f5e7-423e-8e9f-0aa3143a6711 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:42.698040 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-6f198f40-f5e7-423e-8e9f-0aa3143a6711 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:42.700916 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-35d8d11f-50be-4f1c-8a72-aa7d3ccaa1ba tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:42.701565 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-35d8d11f-50be-4f1c-8a72-aa7d3ccaa1ba tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:42.705050 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6f198f40-f5e7-423e-8e9f-0aa3143a6711 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:42.705498 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6f198f40-f5e7-423e-8e9f-0aa3143a6711 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:42.706284 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6f198f40-f5e7-423e-8e9f-0aa3143a6711 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:42.706697 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6f198f40-f5e7-423e-8e9f-0aa3143a6711 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:42.708441 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-35d8d11f-50be-4f1c-8a72-aa7d3ccaa1ba tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:42.709009 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-35d8d11f-50be-4f1c-8a72-aa7d3ccaa1ba tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:42.709706 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-35d8d11f-50be-4f1c-8a72-aa7d3ccaa1ba tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:42.710175 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-35d8d11f-50be-4f1c-8a72-aa7d3ccaa1ba tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:42.903322 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-6f198f40-f5e7-423e-8e9f-0aa3143a6711 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:42.908276 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-35d8d11f-50be-4f1c-8a72-aa7d3ccaa1ba tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:42.911635 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-6f198f40-f5e7-423e-8e9f-0aa3143a6711 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.218127 Jun 17 13:25:42.912465 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1177/2322] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:42 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:42.917535 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-fdf879b2-02a4-43d6-8c3c-c689a9fd9fb4 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:42.918050 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-fdf879b2-02a4-43d6-8c3c-c689a9fd9fb4 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:42.919163 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-35d8d11f-50be-4f1c-8a72-aa7d3ccaa1ba tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.222238 Jun 17 13:25:42.921571 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1146/2323] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:42 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:42.924309 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-fdf879b2-02a4-43d6-8c3c-c689a9fd9fb4 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:42.924751 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-fdf879b2-02a4-43d6-8c3c-c689a9fd9fb4 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:42.925503 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-fdf879b2-02a4-43d6-8c3c-c689a9fd9fb4 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:42.925932 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-fdf879b2-02a4-43d6-8c3c-c689a9fd9fb4 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:42.989196 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-fdf879b2-02a4-43d6-8c3c-c689a9fd9fb4 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:42.997043 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-fdf879b2-02a4-43d6-8c3c-c689a9fd9fb4 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.083642 Jun 17 13:25:42.997602 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1178/2324] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:42 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:43.933780 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-97a57295-0d57-466f-afb0-964c261882fc tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:43.934872 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-97a57295-0d57-466f-afb0-964c261882fc tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:43.938574 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_api:SELECT=76 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:25:43.941252 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-25526acf-5145-4aaf-acb7-7b6686aa0725 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:43.942354 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-25526acf-5145-4aaf-acb7-7b6686aa0725 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:43.947657 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-97a57295-0d57-466f-afb0-964c261882fc tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:43.948456 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-97a57295-0d57-466f-afb0-964c261882fc tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:43.949373 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-97a57295-0d57-466f-afb0-964c261882fc tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:43.949807 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-97a57295-0d57-466f-afb0-964c261882fc tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:43.951249 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-25526acf-5145-4aaf-acb7-7b6686aa0725 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:43.951708 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-25526acf-5145-4aaf-acb7-7b6686aa0725 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:43.952486 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-25526acf-5145-4aaf-acb7-7b6686aa0725 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:43.952924 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-25526acf-5145-4aaf-acb7-7b6686aa0725 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:44.143695 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-97a57295-0d57-466f-afb0-964c261882fc tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:44.146669 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-25526acf-5145-4aaf-acb7-7b6686aa0725 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:44.152338 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-97a57295-0d57-466f-afb0-964c261882fc tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.225473 Jun 17 13:25:44.152968 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1147/2325] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:43 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:44.154841 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-25526acf-5145-4aaf-acb7-7b6686aa0725 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.220897 Jun 17 13:25:44.155404 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1179/2326] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:43 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:44.157596 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-22a7c2ec-c5e0-4368-a84a-457c660a741a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:44.158290 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-22a7c2ec-c5e0-4368-a84a-457c660a741a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:44.164517 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-22a7c2ec-c5e0-4368-a84a-457c660a741a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:44.164964 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-22a7c2ec-c5e0-4368-a84a-457c660a741a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:44.165706 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-22a7c2ec-c5e0-4368-a84a-457c660a741a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:44.166133 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-22a7c2ec-c5e0-4368-a84a-457c660a741a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:44.234144 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-22a7c2ec-c5e0-4368-a84a-457c660a741a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:44.242650 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-22a7c2ec-c5e0-4368-a84a-457c660a741a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.088643 Jun 17 13:25:44.243211 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1148/2327] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:44 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:45.169903 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-6c0d882a-1f8c-4740-93f6-9f0454d3ebe5 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:45.170536 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-6c0d882a-1f8c-4740-93f6-9f0454d3ebe5 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:45.171963 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-a82bed4b-c147-49e4-a130-5f862e94e3bb tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:45.172586 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-a82bed4b-c147-49e4-a130-5f862e94e3bb tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:45.177606 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6c0d882a-1f8c-4740-93f6-9f0454d3ebe5 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:45.178074 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6c0d882a-1f8c-4740-93f6-9f0454d3ebe5 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:45.178993 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6c0d882a-1f8c-4740-93f6-9f0454d3ebe5 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:45.179424 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6c0d882a-1f8c-4740-93f6-9f0454d3ebe5 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:45.179939 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a82bed4b-c147-49e4-a130-5f862e94e3bb tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:45.180394 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a82bed4b-c147-49e4-a130-5f862e94e3bb tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:45.181160 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a82bed4b-c147-49e4-a130-5f862e94e3bb tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:45.181609 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a82bed4b-c147-49e4-a130-5f862e94e3bb tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:45.376727 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-6c0d882a-1f8c-4740-93f6-9f0454d3ebe5 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:45.380690 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-a82bed4b-c147-49e4-a130-5f862e94e3bb tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:45.386714 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-6c0d882a-1f8c-4740-93f6-9f0454d3ebe5 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.220632 Jun 17 13:25:45.387586 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1180/2328] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:45 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:45.389140 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-a82bed4b-c147-49e4-a130-5f862e94e3bb tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.220957 Jun 17 13:25:45.389827 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1149/2329] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:45 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:45.392245 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-de2d1697-eee2-42e2-b473-4002b5162885 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:45.392926 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-de2d1697-eee2-42e2-b473-4002b5162885 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:45.399331 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-de2d1697-eee2-42e2-b473-4002b5162885 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:45.399783 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-de2d1697-eee2-42e2-b473-4002b5162885 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:45.400571 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-de2d1697-eee2-42e2-b473-4002b5162885 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:45.401006 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-de2d1697-eee2-42e2-b473-4002b5162885 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:45.461678 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-de2d1697-eee2-42e2-b473-4002b5162885 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:45.469972 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-de2d1697-eee2-42e2-b473-4002b5162885 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.081418 Jun 17 13:25:45.470591 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1181/2330] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:45 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:46.405496 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-f9e9253b-b1b6-41ec-b6b1-bb0a9c5b9eec tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:46.406081 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-f9e9253b-b1b6-41ec-b6b1-bb0a9c5b9eec tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:46.406889 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-9467ac8d-a1a0-4378-97a3-0db0ad71c20e tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:46.407504 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-9467ac8d-a1a0-4378-97a3-0db0ad71c20e tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:46.413031 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f9e9253b-b1b6-41ec-b6b1-bb0a9c5b9eec tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:46.413474 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f9e9253b-b1b6-41ec-b6b1-bb0a9c5b9eec tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:46.414166 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9467ac8d-a1a0-4378-97a3-0db0ad71c20e tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:46.414345 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f9e9253b-b1b6-41ec-b6b1-bb0a9c5b9eec tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:46.414652 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9467ac8d-a1a0-4378-97a3-0db0ad71c20e tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:46.414785 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f9e9253b-b1b6-41ec-b6b1-bb0a9c5b9eec tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:46.415407 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9467ac8d-a1a0-4378-97a3-0db0ad71c20e tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:46.415850 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9467ac8d-a1a0-4378-97a3-0db0ad71c20e tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:46.609603 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-9467ac8d-a1a0-4378-97a3-0db0ad71c20e tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:46.612522 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-f9e9253b-b1b6-41ec-b6b1-bb0a9c5b9eec tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:46.617829 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-9467ac8d-a1a0-4378-97a3-0db0ad71c20e tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.214791 Jun 17 13:25:46.618452 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1182/2331] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:46 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:46.621045 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-f9e9253b-b1b6-41ec-b6b1-bb0a9c5b9eec tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.219438 Jun 17 13:25:46.621769 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1150/2332] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:46 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:46.623742 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-c77e4ebc-39e9-4ffb-a33c-3551f180d374 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:46.624347 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-c77e4ebc-39e9-4ffb-a33c-3551f180d374 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:46.630545 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c77e4ebc-39e9-4ffb-a33c-3551f180d374 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:46.631301 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c77e4ebc-39e9-4ffb-a33c-3551f180d374 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:46.632452 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c77e4ebc-39e9-4ffb-a33c-3551f180d374 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:46.633166 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c77e4ebc-39e9-4ffb-a33c-3551f180d374 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:46.696850 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-c77e4ebc-39e9-4ffb-a33c-3551f180d374 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:46.700539 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_cell1:SELECT=100 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:25:46.705763 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-c77e4ebc-39e9-4ffb-a33c-3551f180d374 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.086380 Jun 17 13:25:46.706394 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1183/2333] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:46 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:47.638011 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-f6fb0424-e79a-4cc5-8e10-cb7323e5f4b5 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:47.638677 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-f6fb0424-e79a-4cc5-8e10-cb7323e5f4b5 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:47.639414 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-7f6edd7f-1e0c-4f98-a0c7-3ed1470bf130 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:47.640049 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-7f6edd7f-1e0c-4f98-a0c7-3ed1470bf130 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:47.646045 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f6fb0424-e79a-4cc5-8e10-cb7323e5f4b5 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:47.646569 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f6fb0424-e79a-4cc5-8e10-cb7323e5f4b5 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:47.647362 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f6fb0424-e79a-4cc5-8e10-cb7323e5f4b5 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:47.647536 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7f6edd7f-1e0c-4f98-a0c7-3ed1470bf130 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:47.647813 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f6fb0424-e79a-4cc5-8e10-cb7323e5f4b5 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:47.648025 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7f6edd7f-1e0c-4f98-a0c7-3ed1470bf130 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:47.648843 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7f6edd7f-1e0c-4f98-a0c7-3ed1470bf130 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:47.649310 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7f6edd7f-1e0c-4f98-a0c7-3ed1470bf130 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:47.844114 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-f6fb0424-e79a-4cc5-8e10-cb7323e5f4b5 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:47.847331 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-7f6edd7f-1e0c-4f98-a0c7-3ed1470bf130 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:47.852584 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-f6fb0424-e79a-4cc5-8e10-cb7323e5f4b5 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.219771 Jun 17 13:25:47.853611 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 13:25:47.853762 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Fri Jun 17 13:25:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 (ip 10.222.0.48) !!! Jun 17 13:25:47.854828 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1151/2334] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:47 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:47.857393 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-7f6edd7f-1e0c-4f98-a0c7-3ed1470bf130 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.222204 Jun 17 13:25:47.859393 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1184/2335] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:47 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:47.860363 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-6e167a90-bbdd-4e6d-bd8e-b1af1b94c009 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:47.860978 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-6e167a90-bbdd-4e6d-bd8e-b1af1b94c009 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:47.867150 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6e167a90-bbdd-4e6d-bd8e-b1af1b94c009 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:47.867594 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6e167a90-bbdd-4e6d-bd8e-b1af1b94c009 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:47.868356 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6e167a90-bbdd-4e6d-bd8e-b1af1b94c009 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:47.868785 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6e167a90-bbdd-4e6d-bd8e-b1af1b94c009 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:47.944493 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-6e167a90-bbdd-4e6d-bd8e-b1af1b94c009 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:47.956452 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-6e167a90-bbdd-4e6d-bd8e-b1af1b94c009 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.099891 Jun 17 13:25:47.957195 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1152/2336] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:47 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:48.883447 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-5aea77de-5434-427c-a15f-1378f9fac10c tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:48.884464 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-5aea77de-5434-427c-a15f-1378f9fac10c tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:48.884763 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-eddef198-808e-4f5f-9ee3-ecaf4e0323d9 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:48.885806 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-eddef198-808e-4f5f-9ee3-ecaf4e0323d9 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:48.892153 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-5aea77de-5434-427c-a15f-1378f9fac10c tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:48.892611 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-5aea77de-5434-427c-a15f-1378f9fac10c tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:48.893090 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-eddef198-808e-4f5f-9ee3-ecaf4e0323d9 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:48.893376 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-5aea77de-5434-427c-a15f-1378f9fac10c tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:48.893547 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-eddef198-808e-4f5f-9ee3-ecaf4e0323d9 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:48.893807 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-5aea77de-5434-427c-a15f-1378f9fac10c tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:48.894351 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-eddef198-808e-4f5f-9ee3-ecaf4e0323d9 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:48.894786 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-eddef198-808e-4f5f-9ee3-ecaf4e0323d9 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:49.099836 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-5aea77de-5434-427c-a15f-1378f9fac10c tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:49.103163 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-eddef198-808e-4f5f-9ee3-ecaf4e0323d9 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:49.108600 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-5aea77de-5434-427c-a15f-1378f9fac10c tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.231979 Jun 17 13:25:49.109178 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1185/2337] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:48 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:49.113556 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-5aa88cb2-2b3c-4dd3-b3ae-bd6c464ccac7 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:49.114182 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-5aa88cb2-2b3c-4dd3-b3ae-bd6c464ccac7 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:49.117542 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-eddef198-808e-4f5f-9ee3-ecaf4e0323d9 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.239455 Jun 17 13:25:49.118247 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1153/2338] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:48 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:49.120021 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-5aa88cb2-2b3c-4dd3-b3ae-bd6c464ccac7 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:49.120470 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-5aa88cb2-2b3c-4dd3-b3ae-bd6c464ccac7 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:49.121225 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-5aa88cb2-2b3c-4dd3-b3ae-bd6c464ccac7 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:49.121660 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-5aa88cb2-2b3c-4dd3-b3ae-bd6c464ccac7 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:49.190113 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-5aa88cb2-2b3c-4dd3-b3ae-bd6c464ccac7 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:49.199092 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-5aa88cb2-2b3c-4dd3-b3ae-bd6c464ccac7 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.088939 Jun 17 13:25:49.199674 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1186/2339] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:49 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:50.130492 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-2060d841-96aa-41d6-9c38-9b81fe5ae4ed tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:50.131509 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-2060d841-96aa-41d6-9c38-9b81fe5ae4ed tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:50.138691 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-f432141a-bdc8-4b50-8b3e-8c4f268b7014 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:50.140656 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-f432141a-bdc8-4b50-8b3e-8c4f268b7014 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:50.141769 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2060d841-96aa-41d6-9c38-9b81fe5ae4ed tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:50.142580 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2060d841-96aa-41d6-9c38-9b81fe5ae4ed tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:50.143836 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2060d841-96aa-41d6-9c38-9b81fe5ae4ed tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:50.144567 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2060d841-96aa-41d6-9c38-9b81fe5ae4ed tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:50.151582 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f432141a-bdc8-4b50-8b3e-8c4f268b7014 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:50.152049 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f432141a-bdc8-4b50-8b3e-8c4f268b7014 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:50.152780 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f432141a-bdc8-4b50-8b3e-8c4f268b7014 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:50.153239 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f432141a-bdc8-4b50-8b3e-8c4f268b7014 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:50.340181 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-2060d841-96aa-41d6-9c38-9b81fe5ae4ed tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:50.343069 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-f432141a-bdc8-4b50-8b3e-8c4f268b7014 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:50.348360 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-2060d841-96aa-41d6-9c38-9b81fe5ae4ed tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.224768 Jun 17 13:25:50.353556 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1154/2340] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:50 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:50.353729 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-f432141a-bdc8-4b50-8b3e-8c4f268b7014 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.218922 Jun 17 13:25:50.353729 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1187/2341] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:50 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:50.354623 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-c0db12d7-ce86-4e3c-b9b2-167a5a7a62fd tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:50.354852 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-c0db12d7-ce86-4e3c-b9b2-167a5a7a62fd tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:50.360746 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c0db12d7-ce86-4e3c-b9b2-167a5a7a62fd tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:50.361191 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c0db12d7-ce86-4e3c-b9b2-167a5a7a62fd tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:50.361947 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c0db12d7-ce86-4e3c-b9b2-167a5a7a62fd tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:50.362406 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c0db12d7-ce86-4e3c-b9b2-167a5a7a62fd tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:50.428836 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-c0db12d7-ce86-4e3c-b9b2-167a5a7a62fd tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:50.437165 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-c0db12d7-ce86-4e3c-b9b2-167a5a7a62fd tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.086898 Jun 17 13:25:50.437784 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1155/2342] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:50 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:51.370510 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-67f26415-036b-48c1-9908-0b58bb674473 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:51.371563 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-67f26415-036b-48c1-9908-0b58bb674473 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:51.372381 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-276b73cb-68dc-43a3-b946-34523ddbcf66 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:51.373378 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-276b73cb-68dc-43a3-b946-34523ddbcf66 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:51.383023 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-67f26415-036b-48c1-9908-0b58bb674473 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:51.383773 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-67f26415-036b-48c1-9908-0b58bb674473 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:51.384343 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-276b73cb-68dc-43a3-b946-34523ddbcf66 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:51.385069 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-276b73cb-68dc-43a3-b946-34523ddbcf66 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:51.386072 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-276b73cb-68dc-43a3-b946-34523ddbcf66 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:51.386528 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-276b73cb-68dc-43a3-b946-34523ddbcf66 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:51.389928 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-67f26415-036b-48c1-9908-0b58bb674473 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:51.391916 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-67f26415-036b-48c1-9908-0b58bb674473 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:51.584337 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-276b73cb-68dc-43a3-b946-34523ddbcf66 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:51.587291 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-67f26415-036b-48c1-9908-0b58bb674473 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:51.592706 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-276b73cb-68dc-43a3-b946-34523ddbcf66 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.226818 Jun 17 13:25:51.593365 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1156/2343] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:51 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:51.597806 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-f2169fee-fef2-43bb-8e27-59275b4a5f0d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:51.598401 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-f2169fee-fef2-43bb-8e27-59275b4a5f0d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:51.601289 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-67f26415-036b-48c1-9908-0b58bb674473 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.237278 Jun 17 13:25:51.602123 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1188/2344] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:51 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:51.604933 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f2169fee-fef2-43bb-8e27-59275b4a5f0d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:51.605467 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f2169fee-fef2-43bb-8e27-59275b4a5f0d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:51.606255 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f2169fee-fef2-43bb-8e27-59275b4a5f0d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:51.606684 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f2169fee-fef2-43bb-8e27-59275b4a5f0d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:51.670544 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-f2169fee-fef2-43bb-8e27-59275b4a5f0d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:51.678591 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-f2169fee-fef2-43bb-8e27-59275b4a5f0d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.084245 Jun 17 13:25:51.679146 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1157/2345] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:51 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:52.614577 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-dd181141-5cff-45dc-86d3-a4ac17b05adf tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:52.616009 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-dd181141-5cff-45dc-86d3-a4ac17b05adf tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:52.619560 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_api:SELECT=74 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:25:52.623235 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-c2014805-b340-4b47-9923-56439c2a35fc tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:52.624172 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-c2014805-b340-4b47-9923-56439c2a35fc tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:52.628238 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-dd181141-5cff-45dc-86d3-a4ac17b05adf tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:52.628917 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-dd181141-5cff-45dc-86d3-a4ac17b05adf tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:52.630077 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-dd181141-5cff-45dc-86d3-a4ac17b05adf tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:52.630771 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-dd181141-5cff-45dc-86d3-a4ac17b05adf tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:52.633855 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c2014805-b340-4b47-9923-56439c2a35fc tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:52.634592 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c2014805-b340-4b47-9923-56439c2a35fc tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:52.636229 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c2014805-b340-4b47-9923-56439c2a35fc tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:52.636671 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c2014805-b340-4b47-9923-56439c2a35fc tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:52.828021 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-dd181141-5cff-45dc-86d3-a4ac17b05adf tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:52.830874 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-c2014805-b340-4b47-9923-56439c2a35fc tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:52.836455 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-dd181141-5cff-45dc-86d3-a4ac17b05adf tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.228449 Jun 17 13:25:52.837070 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1189/2346] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:52 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:52.840223 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-c2014805-b340-4b47-9923-56439c2a35fc tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.223938 Jun 17 13:25:52.840998 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1158/2347] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:52 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:52.841976 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-9c8789ce-4441-4755-929f-0610ed47f046 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:52.842604 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-9c8789ce-4441-4755-929f-0610ed47f046 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:52.848574 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9c8789ce-4441-4755-929f-0610ed47f046 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:52.848996 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9c8789ce-4441-4755-929f-0610ed47f046 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:52.849735 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9c8789ce-4441-4755-929f-0610ed47f046 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:52.850185 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9c8789ce-4441-4755-929f-0610ed47f046 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:52.913009 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-9c8789ce-4441-4755-929f-0610ed47f046 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:52.921488 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-9c8789ce-4441-4755-929f-0610ed47f046 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.083433 Jun 17 13:25:52.922056 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1190/2348] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:52 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:53.857284 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-eb76881a-a6e8-4d5d-840f-8fd19b74d408 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:53.858316 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-eb76881a-a6e8-4d5d-840f-8fd19b74d408 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:53.860973 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-7b802e9c-ad8c-4547-9a92-5e74483db7d3 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:53.862016 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-7b802e9c-ad8c-4547-9a92-5e74483db7d3 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:53.870014 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-eb76881a-a6e8-4d5d-840f-8fd19b74d408 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:53.870501 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-eb76881a-a6e8-4d5d-840f-8fd19b74d408 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:53.871267 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-eb76881a-a6e8-4d5d-840f-8fd19b74d408 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:53.871697 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-eb76881a-a6e8-4d5d-840f-8fd19b74d408 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:53.871851 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7b802e9c-ad8c-4547-9a92-5e74483db7d3 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:53.872152 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7b802e9c-ad8c-4547-9a92-5e74483db7d3 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:53.872898 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7b802e9c-ad8c-4547-9a92-5e74483db7d3 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:53.873331 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7b802e9c-ad8c-4547-9a92-5e74483db7d3 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:54.064943 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-eb76881a-a6e8-4d5d-840f-8fd19b74d408 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:54.069946 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-7b802e9c-ad8c-4547-9a92-5e74483db7d3 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:54.076216 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-eb76881a-a6e8-4d5d-840f-8fd19b74d408 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.225457 Jun 17 13:25:54.076960 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1159/2349] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:53 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:54.080157 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-7b802e9c-ad8c-4547-9a92-5e74483db7d3 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.226005 Jun 17 13:25:54.080882 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1191/2350] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:53 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:54.081589 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-8483ff79-54d2-4949-92fc-ef98f787daab tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:54.082236 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-8483ff79-54d2-4949-92fc-ef98f787daab tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:54.089144 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8483ff79-54d2-4949-92fc-ef98f787daab tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:54.089586 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8483ff79-54d2-4949-92fc-ef98f787daab tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:54.090364 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8483ff79-54d2-4949-92fc-ef98f787daab tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:54.090795 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8483ff79-54d2-4949-92fc-ef98f787daab tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:54.094857 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=100 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:25:54.157972 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-8483ff79-54d2-4949-92fc-ef98f787daab tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:54.166107 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-8483ff79-54d2-4949-92fc-ef98f787daab tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.088176 Jun 17 13:25:54.166724 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1160/2351] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:54 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:55.097729 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-33abe23c-185e-4619-b0f7-8d596e6a3e37 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:55.098798 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-33abe23c-185e-4619-b0f7-8d596e6a3e37 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:55.101729 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-cd57a714-5cc4-4a6f-9a86-9bf34adadaf2 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:55.102951 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-cd57a714-5cc4-4a6f-9a86-9bf34adadaf2 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:55.108487 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-33abe23c-185e-4619-b0f7-8d596e6a3e37 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:55.108944 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-33abe23c-185e-4619-b0f7-8d596e6a3e37 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:55.109746 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-33abe23c-185e-4619-b0f7-8d596e6a3e37 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:55.110227 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-33abe23c-185e-4619-b0f7-8d596e6a3e37 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:55.111242 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cd57a714-5cc4-4a6f-9a86-9bf34adadaf2 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:55.111739 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cd57a714-5cc4-4a6f-9a86-9bf34adadaf2 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:55.112760 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cd57a714-5cc4-4a6f-9a86-9bf34adadaf2 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:55.113359 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cd57a714-5cc4-4a6f-9a86-9bf34adadaf2 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:55.307192 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-33abe23c-185e-4619-b0f7-8d596e6a3e37 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:55.312502 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-cd57a714-5cc4-4a6f-9a86-9bf34adadaf2 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:55.316739 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-33abe23c-185e-4619-b0f7-8d596e6a3e37 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.225392 Jun 17 13:25:55.317315 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1192/2352] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:55 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:55.320586 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-cd57a714-5cc4-4a6f-9a86-9bf34adadaf2 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.225045 Jun 17 13:25:55.321233 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1161/2353] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:55 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:55.321836 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-06722ee8-df1f-4687-b5c6-cd17deb45165 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:55.322660 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-06722ee8-df1f-4687-b5c6-cd17deb45165 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:55.328850 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-06722ee8-df1f-4687-b5c6-cd17deb45165 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:55.329288 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-06722ee8-df1f-4687-b5c6-cd17deb45165 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:55.330038 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-06722ee8-df1f-4687-b5c6-cd17deb45165 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:55.330586 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-06722ee8-df1f-4687-b5c6-cd17deb45165 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:55.395155 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-06722ee8-df1f-4687-b5c6-cd17deb45165 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:55.404332 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-06722ee8-df1f-4687-b5c6-cd17deb45165 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.086079 Jun 17 13:25:55.404872 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1193/2354] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:55 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:56.338288 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-b8ef10da-87fa-4052-a3e0-24a3b4ccc344 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:56.339320 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-b8ef10da-87fa-4052-a3e0-24a3b4ccc344 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:56.340072 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-28a52524-77b6-4c60-8018-59b3cba2be57 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:56.340716 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-28a52524-77b6-4c60-8018-59b3cba2be57 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:56.346304 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b8ef10da-87fa-4052-a3e0-24a3b4ccc344 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:56.346750 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b8ef10da-87fa-4052-a3e0-24a3b4ccc344 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:56.347467 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-28a52524-77b6-4c60-8018-59b3cba2be57 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:56.347641 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b8ef10da-87fa-4052-a3e0-24a3b4ccc344 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:56.347915 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b8ef10da-87fa-4052-a3e0-24a3b4ccc344 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:56.348090 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-28a52524-77b6-4c60-8018-59b3cba2be57 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:56.348672 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-28a52524-77b6-4c60-8018-59b3cba2be57 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:56.349106 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-28a52524-77b6-4c60-8018-59b3cba2be57 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:56.542065 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-b8ef10da-87fa-4052-a3e0-24a3b4ccc344 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:56.545233 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-28a52524-77b6-4c60-8018-59b3cba2be57 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:56.550661 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-b8ef10da-87fa-4052-a3e0-24a3b4ccc344 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.218909 Jun 17 13:25:56.551258 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1162/2355] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:56 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:56.553258 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-28a52524-77b6-4c60-8018-59b3cba2be57 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.219089 Jun 17 13:25:56.554132 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1194/2356] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:56 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:56.555769 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-726a44bd-f055-4748-a1d0-4b04e863b8fc tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:56.556521 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-726a44bd-f055-4748-a1d0-4b04e863b8fc tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:56.562718 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-726a44bd-f055-4748-a1d0-4b04e863b8fc tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:56.563145 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-726a44bd-f055-4748-a1d0-4b04e863b8fc tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:56.563977 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-726a44bd-f055-4748-a1d0-4b04e863b8fc tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:56.564411 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-726a44bd-f055-4748-a1d0-4b04e863b8fc tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:56.627773 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-726a44bd-f055-4748-a1d0-4b04e863b8fc tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:56.636758 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-726a44bd-f055-4748-a1d0-4b04e863b8fc tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.084518 Jun 17 13:25:56.637328 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1163/2357] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:56 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:57.573214 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-9b1d94ad-2193-496e-a139-667582682ed1 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:57.574061 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-9b1d94ad-2193-496e-a139-667582682ed1 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:57.575315 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-6579cc7f-2719-4fae-a05c-d99e22629ad5 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:57.576278 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-6579cc7f-2719-4fae-a05c-d99e22629ad5 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:57.585135 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9b1d94ad-2193-496e-a139-667582682ed1 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:57.585907 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9b1d94ad-2193-496e-a139-667582682ed1 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:57.587220 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9b1d94ad-2193-496e-a139-667582682ed1 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:57.587472 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6579cc7f-2719-4fae-a05c-d99e22629ad5 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:57.587955 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9b1d94ad-2193-496e-a139-667582682ed1 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:57.588199 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6579cc7f-2719-4fae-a05c-d99e22629ad5 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:57.589426 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6579cc7f-2719-4fae-a05c-d99e22629ad5 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:57.589967 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6579cc7f-2719-4fae-a05c-d99e22629ad5 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:57.791823 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-9b1d94ad-2193-496e-a139-667582682ed1 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:57.796048 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-6579cc7f-2719-4fae-a05c-d99e22629ad5 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:57.803683 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-9b1d94ad-2193-496e-a139-667582682ed1 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.237179 Jun 17 13:25:57.804681 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1195/2358] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:57 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:57.808199 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-6579cc7f-2719-4fae-a05c-d99e22629ad5 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.239611 Jun 17 13:25:57.808966 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1164/2359] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:57 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:57.810226 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-20eb8bc2-d0c2-4a5c-be65-c0b5aea5ef1b tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:57.810827 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-20eb8bc2-d0c2-4a5c-be65-c0b5aea5ef1b tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:57.816981 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-20eb8bc2-d0c2-4a5c-be65-c0b5aea5ef1b tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:57.817428 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-20eb8bc2-d0c2-4a5c-be65-c0b5aea5ef1b tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:57.818209 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-20eb8bc2-d0c2-4a5c-be65-c0b5aea5ef1b tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:57.818640 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-20eb8bc2-d0c2-4a5c-be65-c0b5aea5ef1b tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:57.882076 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-20eb8bc2-d0c2-4a5c-be65-c0b5aea5ef1b tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:57.890894 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-20eb8bc2-d0c2-4a5c-be65-c0b5aea5ef1b tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.085055 Jun 17 13:25:57.891472 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1196/2360] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:57 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:58.824224 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-23d7b8ca-b782-4cd9-8c82-ad977375f9c8 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:58.824820 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-23d7b8ca-b782-4cd9-8c82-ad977375f9c8 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:58.826907 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-b2d6c12f-617d-4320-a00c-6385afa03963 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:58.827526 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-b2d6c12f-617d-4320-a00c-6385afa03963 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:58.831678 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-23d7b8ca-b782-4cd9-8c82-ad977375f9c8 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:58.832130 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-23d7b8ca-b782-4cd9-8c82-ad977375f9c8 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:58.832951 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-23d7b8ca-b782-4cd9-8c82-ad977375f9c8 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:58.833391 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-23d7b8ca-b782-4cd9-8c82-ad977375f9c8 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:58.834118 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b2d6c12f-617d-4320-a00c-6385afa03963 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:58.834622 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b2d6c12f-617d-4320-a00c-6385afa03963 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:58.835416 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b2d6c12f-617d-4320-a00c-6385afa03963 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:58.835865 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b2d6c12f-617d-4320-a00c-6385afa03963 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:59.027428 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-23d7b8ca-b782-4cd9-8c82-ad977375f9c8 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:59.030751 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-b2d6c12f-617d-4320-a00c-6385afa03963 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:59.035845 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-23d7b8ca-b782-4cd9-8c82-ad977375f9c8 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.216597 Jun 17 13:25:59.036426 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1165/2361] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:58 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:59.039699 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-b2d6c12f-617d-4320-a00c-6385afa03963 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.217742 Jun 17 13:25:59.040447 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1197/2362] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:58 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:25:59.041052 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-b5d852dd-10bd-4596-b411-fdffe1581643 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:25:59.041869 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-b5d852dd-10bd-4596-b411-fdffe1581643 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:25:59.048063 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b5d852dd-10bd-4596-b411-fdffe1581643 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:59.048545 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b5d852dd-10bd-4596-b411-fdffe1581643 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:59.049337 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b5d852dd-10bd-4596-b411-fdffe1581643 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:25:59.049765 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b5d852dd-10bd-4596-b411-fdffe1581643 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:25:59.130901 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-b5d852dd-10bd-4596-b411-fdffe1581643 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:25:59.139362 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-b5d852dd-10bd-4596-b411-fdffe1581643 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.101764 Jun 17 13:25:59.139937 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1166/2363] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:25:59 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:00.057908 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-0decba28-996f-4d3f-8bc8-cfc2e3a3907d tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:00.058542 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-0decba28-996f-4d3f-8bc8-cfc2e3a3907d tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:00.060587 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-a1390631-cfd0-4758-9761-9a464837b0ea tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:00.061205 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-a1390631-cfd0-4758-9761-9a464837b0ea tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:00.065388 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0decba28-996f-4d3f-8bc8-cfc2e3a3907d tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:00.065831 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0decba28-996f-4d3f-8bc8-cfc2e3a3907d tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:00.066604 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0decba28-996f-4d3f-8bc8-cfc2e3a3907d tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:00.067029 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0decba28-996f-4d3f-8bc8-cfc2e3a3907d tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:00.067951 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a1390631-cfd0-4758-9761-9a464837b0ea tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:00.068414 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a1390631-cfd0-4758-9761-9a464837b0ea tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:00.069179 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a1390631-cfd0-4758-9761-9a464837b0ea tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:00.069615 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a1390631-cfd0-4758-9761-9a464837b0ea tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:00.263764 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-0decba28-996f-4d3f-8bc8-cfc2e3a3907d tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:00.268317 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-a1390631-cfd0-4758-9761-9a464837b0ea tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:00.275648 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-0decba28-996f-4d3f-8bc8-cfc2e3a3907d tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.224137 Jun 17 13:26:00.285955 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1198/2364] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:00 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:00.286199 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-a1390631-cfd0-4758-9761-9a464837b0ea tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.224257 Jun 17 13:26:00.286199 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1167/2365] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:00 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:00.286417 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-343267f5-6511-43ba-bb41-472edba916f3 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:00.286417 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-343267f5-6511-43ba-bb41-472edba916f3 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:00.288223 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-343267f5-6511-43ba-bb41-472edba916f3 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:00.288802 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-343267f5-6511-43ba-bb41-472edba916f3 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:00.289926 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-343267f5-6511-43ba-bb41-472edba916f3 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:00.290595 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-343267f5-6511-43ba-bb41-472edba916f3 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:00.354751 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-343267f5-6511-43ba-bb41-472edba916f3 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:00.363475 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-343267f5-6511-43ba-bb41-472edba916f3 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.085745 Jun 17 13:26:00.364059 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1199/2366] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:00 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:01.297509 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-3c44c363-cb38-46ac-a225-000af1a98799 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:01.298604 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-3c44c363-cb38-46ac-a225-000af1a98799 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:01.301518 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-52230c47-b7f1-4c62-adb9-018c62f303c3 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:01.302567 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-52230c47-b7f1-4c62-adb9-018c62f303c3 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:01.309413 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3c44c363-cb38-46ac-a225-000af1a98799 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:01.309854 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3c44c363-cb38-46ac-a225-000af1a98799 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:01.310642 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3c44c363-cb38-46ac-a225-000af1a98799 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:01.311107 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3c44c363-cb38-46ac-a225-000af1a98799 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:01.311454 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-52230c47-b7f1-4c62-adb9-018c62f303c3 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:01.311877 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-52230c47-b7f1-4c62-adb9-018c62f303c3 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:01.312620 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-52230c47-b7f1-4c62-adb9-018c62f303c3 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:01.313040 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-52230c47-b7f1-4c62-adb9-018c62f303c3 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:01.331100 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_cell1:SELECT=100 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:26:01.510591 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-3c44c363-cb38-46ac-a225-000af1a98799 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:01.514382 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-52230c47-b7f1-4c62-adb9-018c62f303c3 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:01.519215 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-3c44c363-cb38-46ac-a225-000af1a98799 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.228038 Jun 17 13:26:01.519794 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1168/2367] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:01 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:01.522901 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-52230c47-b7f1-4c62-adb9-018c62f303c3 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.227899 Jun 17 13:26:01.523746 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1200/2368] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:01 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:01.524245 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-82f6a320-5089-4c13-a07d-4c6a7d5ce330 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:01.524850 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-82f6a320-5089-4c13-a07d-4c6a7d5ce330 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:01.531731 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-82f6a320-5089-4c13-a07d-4c6a7d5ce330 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:01.532179 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-82f6a320-5089-4c13-a07d-4c6a7d5ce330 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:01.532945 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-82f6a320-5089-4c13-a07d-4c6a7d5ce330 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:01.533376 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-82f6a320-5089-4c13-a07d-4c6a7d5ce330 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:01.598003 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-82f6a320-5089-4c13-a07d-4c6a7d5ce330 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:01.607710 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-82f6a320-5089-4c13-a07d-4c6a7d5ce330 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.086926 Jun 17 13:26:01.608281 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1169/2369] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:01 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:02.540300 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-ff0c821d-1e5b-414f-9da3-8ae3f38e58dd tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:02.541322 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-ff0c821d-1e5b-414f-9da3-8ae3f38e58dd tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:02.544678 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-9c2cd307-b8e1-4c94-99f1-1bd2b3eaa0bd tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:02.545307 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-9c2cd307-b8e1-4c94-99f1-1bd2b3eaa0bd tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:02.548881 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ff0c821d-1e5b-414f-9da3-8ae3f38e58dd tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:02.549334 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ff0c821d-1e5b-414f-9da3-8ae3f38e58dd tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:02.550231 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ff0c821d-1e5b-414f-9da3-8ae3f38e58dd tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:02.550717 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ff0c821d-1e5b-414f-9da3-8ae3f38e58dd tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:02.552176 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9c2cd307-b8e1-4c94-99f1-1bd2b3eaa0bd tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:02.552615 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9c2cd307-b8e1-4c94-99f1-1bd2b3eaa0bd tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:02.553523 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9c2cd307-b8e1-4c94-99f1-1bd2b3eaa0bd tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:02.554047 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9c2cd307-b8e1-4c94-99f1-1bd2b3eaa0bd tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:02.743731 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-ff0c821d-1e5b-414f-9da3-8ae3f38e58dd tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:02.747868 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-9c2cd307-b8e1-4c94-99f1-1bd2b3eaa0bd tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:02.752029 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-ff0c821d-1e5b-414f-9da3-8ae3f38e58dd tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.218331 Jun 17 13:26:02.752613 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1201/2370] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:02 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:02.756447 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-9c2cd307-b8e1-4c94-99f1-1bd2b3eaa0bd tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.218328 Jun 17 13:26:02.757173 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-89d26d2b-03bc-4b9b-9af1-3ba778057aed tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:02.757336 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1170/2371] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:02 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:02.757554 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-89d26d2b-03bc-4b9b-9af1-3ba778057aed tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:02.764098 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-89d26d2b-03bc-4b9b-9af1-3ba778057aed tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:02.764542 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-89d26d2b-03bc-4b9b-9af1-3ba778057aed tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:02.765296 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-89d26d2b-03bc-4b9b-9af1-3ba778057aed tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:02.765725 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-89d26d2b-03bc-4b9b-9af1-3ba778057aed tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:02.830834 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-89d26d2b-03bc-4b9b-9af1-3ba778057aed tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:02.838938 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-89d26d2b-03bc-4b9b-9af1-3ba778057aed tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.085385 Jun 17 13:26:02.839501 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1202/2372] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:02 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:03.769865 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-5fd93ccc-a122-422a-a95f-e5df762d7f7e tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:03.770544 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-5fd93ccc-a122-422a-a95f-e5df762d7f7e tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:03.773249 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-2c8e3859-0b0f-4ade-87cb-a5cff8839cac tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:03.773872 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-2c8e3859-0b0f-4ade-87cb-a5cff8839cac tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:03.777604 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5fd93ccc-a122-422a-a95f-e5df762d7f7e tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:03.778236 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5fd93ccc-a122-422a-a95f-e5df762d7f7e tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:03.778847 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5fd93ccc-a122-422a-a95f-e5df762d7f7e tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:03.779275 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5fd93ccc-a122-422a-a95f-e5df762d7f7e tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:03.781270 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2c8e3859-0b0f-4ade-87cb-a5cff8839cac tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:03.781723 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2c8e3859-0b0f-4ade-87cb-a5cff8839cac tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:03.782515 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2c8e3859-0b0f-4ade-87cb-a5cff8839cac tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:03.782946 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2c8e3859-0b0f-4ade-87cb-a5cff8839cac tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:03.970776 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-5fd93ccc-a122-422a-a95f-e5df762d7f7e tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:03.976028 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-2c8e3859-0b0f-4ade-87cb-a5cff8839cac tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:03.982066 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-5fd93ccc-a122-422a-a95f-e5df762d7f7e tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.216078 Jun 17 13:26:03.982884 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1171/2373] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:03 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:03.986344 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-2c8e3859-0b0f-4ade-87cb-a5cff8839cac tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.216796 Jun 17 13:26:03.993503 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1203/2374] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:03 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 13:26:03.993686 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-195bb414-c560-4a6c-ab06-2346eaad9c85 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:03.993686 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-195bb414-c560-4a6c-ab06-2346eaad9c85 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:03.994935 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-195bb414-c560-4a6c-ab06-2346eaad9c85 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:03.995390 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-195bb414-c560-4a6c-ab06-2346eaad9c85 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:03.996519 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-195bb414-c560-4a6c-ab06-2346eaad9c85 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:03.996958 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-195bb414-c560-4a6c-ab06-2346eaad9c85 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:04.318635 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-195bb414-c560-4a6c-ab06-2346eaad9c85 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:04.329358 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-195bb414-c560-4a6c-ab06-2346eaad9c85 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.344885 Jun 17 13:26:04.329924 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1172/2375] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:03 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:05.000324 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-29ee05b4-77ba-43c3-b26d-121145f46bf2 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:05.000966 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-29ee05b4-77ba-43c3-b26d-121145f46bf2 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:05.003933 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-152e3698-d6b1-4d53-8275-2db523457b4f tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:05.004569 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-152e3698-d6b1-4d53-8275-2db523457b4f tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:05.007923 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-29ee05b4-77ba-43c3-b26d-121145f46bf2 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:05.008386 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-29ee05b4-77ba-43c3-b26d-121145f46bf2 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:05.009141 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-29ee05b4-77ba-43c3-b26d-121145f46bf2 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:05.009573 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-29ee05b4-77ba-43c3-b26d-121145f46bf2 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:05.011506 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-152e3698-d6b1-4d53-8275-2db523457b4f tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:05.012548 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-152e3698-d6b1-4d53-8275-2db523457b4f tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:05.014881 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-152e3698-d6b1-4d53-8275-2db523457b4f tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:05.014881 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-152e3698-d6b1-4d53-8275-2db523457b4f tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:05.207961 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-29ee05b4-77ba-43c3-b26d-121145f46bf2 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:05.212547 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-152e3698-d6b1-4d53-8275-2db523457b4f tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:05.216431 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-29ee05b4-77ba-43c3-b26d-121145f46bf2 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.220948 Jun 17 13:26:05.216982 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1204/2376] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:04 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:05.221471 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-152e3698-d6b1-4d53-8275-2db523457b4f tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.222244 Jun 17 13:26:05.222123 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1173/2377] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:04 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:05.347627 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-46921c4b-9f88-4bcf-bdbe-2d37ca2b2535 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:05.348267 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-46921c4b-9f88-4bcf-bdbe-2d37ca2b2535 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:05.355206 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-46921c4b-9f88-4bcf-bdbe-2d37ca2b2535 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:05.355991 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-46921c4b-9f88-4bcf-bdbe-2d37ca2b2535 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:05.356572 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-46921c4b-9f88-4bcf-bdbe-2d37ca2b2535 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:05.357002 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-46921c4b-9f88-4bcf-bdbe-2d37ca2b2535 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:05.420363 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-46921c4b-9f88-4bcf-bdbe-2d37ca2b2535 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:05.432329 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-46921c4b-9f88-4bcf-bdbe-2d37ca2b2535 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.088258 Jun 17 13:26:05.432954 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1205/2378] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:05 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:06.239279 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-a69c1b2e-d033-47db-925c-aae1da20a4e2 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:06.240176 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-a69c1b2e-d033-47db-925c-aae1da20a4e2 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:06.242292 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-534c84b7-4e5f-4cec-8a9f-f4002bcc7967 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:06.243306 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-534c84b7-4e5f-4cec-8a9f-f4002bcc7967 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:06.251636 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a69c1b2e-d033-47db-925c-aae1da20a4e2 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:06.252434 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a69c1b2e-d033-47db-925c-aae1da20a4e2 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:06.253713 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a69c1b2e-d033-47db-925c-aae1da20a4e2 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:06.254516 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a69c1b2e-d033-47db-925c-aae1da20a4e2 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:06.254757 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-534c84b7-4e5f-4cec-8a9f-f4002bcc7967 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:06.255261 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-534c84b7-4e5f-4cec-8a9f-f4002bcc7967 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:06.256499 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-534c84b7-4e5f-4cec-8a9f-f4002bcc7967 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:06.257219 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-534c84b7-4e5f-4cec-8a9f-f4002bcc7967 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:06.451688 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-a69c1b2e-d033-47db-925c-aae1da20a4e2 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:06.454895 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-534c84b7-4e5f-4cec-8a9f-f4002bcc7967 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:06.460171 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-a69c1b2e-d033-47db-925c-aae1da20a4e2 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.227499 Jun 17 13:26:06.460779 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1174/2379] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:06 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:06.463641 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-534c84b7-4e5f-4cec-8a9f-f4002bcc7967 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.228019 Jun 17 13:26:06.464335 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1206/2380] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:06 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 13:26:06.465940 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-4f93dde2-a692-4a6f-aeab-94ca44b32e56 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:06.465940 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-4f93dde2-a692-4a6f-aeab-94ca44b32e56 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:06.471813 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4f93dde2-a692-4a6f-aeab-94ca44b32e56 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:06.472256 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4f93dde2-a692-4a6f-aeab-94ca44b32e56 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:06.473000 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4f93dde2-a692-4a6f-aeab-94ca44b32e56 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:06.473412 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4f93dde2-a692-4a6f-aeab-94ca44b32e56 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:06.536994 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-4f93dde2-a692-4a6f-aeab-94ca44b32e56 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:06.545240 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-4f93dde2-a692-4a6f-aeab-94ca44b32e56 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.083518 Jun 17 13:26:06.545817 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1175/2381] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:06 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:07.482618 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-efdcb957-098e-433e-abd4-29355f265d16 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:07.483626 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-efdcb957-098e-433e-abd4-29355f265d16 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:07.485019 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-6c5e80c8-b4c1-4372-b7bb-4c1a9d8551e5 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:07.485984 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-6c5e80c8-b4c1-4372-b7bb-4c1a9d8551e5 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:07.493668 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-efdcb957-098e-433e-abd4-29355f265d16 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:07.494471 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-efdcb957-098e-433e-abd4-29355f265d16 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:07.495716 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-efdcb957-098e-433e-abd4-29355f265d16 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:07.496764 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-efdcb957-098e-433e-abd4-29355f265d16 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:07.496926 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6c5e80c8-b4c1-4372-b7bb-4c1a9d8551e5 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:07.497214 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6c5e80c8-b4c1-4372-b7bb-4c1a9d8551e5 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:07.497961 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6c5e80c8-b4c1-4372-b7bb-4c1a9d8551e5 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:07.498647 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6c5e80c8-b4c1-4372-b7bb-4c1a9d8551e5 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:07.698456 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-efdcb957-098e-433e-abd4-29355f265d16 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:07.702798 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-6c5e80c8-b4c1-4372-b7bb-4c1a9d8551e5 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:07.706327 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=100 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:26:07.707205 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-efdcb957-098e-433e-abd4-29355f265d16 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.231986 Jun 17 13:26:07.707887 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1207/2382] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:07 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:07.711681 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-6c5e80c8-b4c1-4372-b7bb-4c1a9d8551e5 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.233586 Jun 17 13:26:07.712395 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1176/2383] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:07 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:07.712527 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-745f0b04-3667-409d-a4eb-85fcc24cdd7b tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:07.713077 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-745f0b04-3667-409d-a4eb-85fcc24cdd7b tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:07.719531 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-745f0b04-3667-409d-a4eb-85fcc24cdd7b tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:07.719969 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-745f0b04-3667-409d-a4eb-85fcc24cdd7b tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:07.720721 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-745f0b04-3667-409d-a4eb-85fcc24cdd7b tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:07.721154 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-745f0b04-3667-409d-a4eb-85fcc24cdd7b tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:07.783008 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-745f0b04-3667-409d-a4eb-85fcc24cdd7b tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:07.791341 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-745f0b04-3667-409d-a4eb-85fcc24cdd7b tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.082436 Jun 17 13:26:07.791914 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1208/2384] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:07 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:08.729630 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-84cc12bb-2fd5-4718-841f-14fb11ce68a0 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:08.730737 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-84cc12bb-2fd5-4718-841f-14fb11ce68a0 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:08.733301 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-9e6b0d6f-badb-4ef7-867c-2842c027d3c7 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:08.734549 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-9e6b0d6f-badb-4ef7-867c-2842c027d3c7 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:08.741998 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-84cc12bb-2fd5-4718-841f-14fb11ce68a0 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:08.742783 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-84cc12bb-2fd5-4718-841f-14fb11ce68a0 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:08.744022 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-84cc12bb-2fd5-4718-841f-14fb11ce68a0 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:08.744532 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9e6b0d6f-badb-4ef7-867c-2842c027d3c7 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:08.744813 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-84cc12bb-2fd5-4718-841f-14fb11ce68a0 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:08.745310 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9e6b0d6f-badb-4ef7-867c-2842c027d3c7 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:08.746864 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9e6b0d6f-badb-4ef7-867c-2842c027d3c7 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:08.747444 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9e6b0d6f-badb-4ef7-867c-2842c027d3c7 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:08.943477 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-84cc12bb-2fd5-4718-841f-14fb11ce68a0 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:08.947748 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-9e6b0d6f-badb-4ef7-867c-2842c027d3c7 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:08.956043 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-84cc12bb-2fd5-4718-841f-14fb11ce68a0 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.233425 Jun 17 13:26:08.956894 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1177/2385] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:08 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:08.959237 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-9e6b0d6f-badb-4ef7-867c-2842c027d3c7 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.233095 Jun 17 13:26:08.959966 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1209/2386] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:08 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:08.961492 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-8a7394c5-5a24-4f6e-8545-4257f2408e58 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:08.962158 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-8a7394c5-5a24-4f6e-8545-4257f2408e58 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:08.968338 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8a7394c5-5a24-4f6e-8545-4257f2408e58 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:08.968779 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8a7394c5-5a24-4f6e-8545-4257f2408e58 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:08.969527 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8a7394c5-5a24-4f6e-8545-4257f2408e58 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:08.969954 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8a7394c5-5a24-4f6e-8545-4257f2408e58 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:09.045270 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-8a7394c5-5a24-4f6e-8545-4257f2408e58 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:09.053677 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-8a7394c5-5a24-4f6e-8545-4257f2408e58 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.095774 Jun 17 13:26:09.054272 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1178/2387] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:08 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:09.975852 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-b5287539-a728-4340-b749-4ee117becd37 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:09.976625 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-b5287539-a728-4340-b749-4ee117becd37 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:09.979575 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-c1fd0503-8d56-486f-95d4-9f3defa2ef01 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:09.980694 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-c1fd0503-8d56-486f-95d4-9f3defa2ef01 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:09.985307 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b5287539-a728-4340-b749-4ee117becd37 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:09.985759 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b5287539-a728-4340-b749-4ee117becd37 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:09.986548 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b5287539-a728-4340-b749-4ee117becd37 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:09.986979 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b5287539-a728-4340-b749-4ee117becd37 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:09.987382 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c1fd0503-8d56-486f-95d4-9f3defa2ef01 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:09.987826 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c1fd0503-8d56-486f-95d4-9f3defa2ef01 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:09.988588 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c1fd0503-8d56-486f-95d4-9f3defa2ef01 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:09.989020 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c1fd0503-8d56-486f-95d4-9f3defa2ef01 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:10.179334 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-b5287539-a728-4340-b749-4ee117becd37 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:10.182044 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-c1fd0503-8d56-486f-95d4-9f3defa2ef01 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:10.188394 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-b5287539-a728-4340-b749-4ee117becd37 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.217438 Jun 17 13:26:10.189010 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1210/2388] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:09 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:10.191204 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-c1fd0503-8d56-486f-95d4-9f3defa2ef01 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.218007 Jun 17 13:26:10.191911 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1179/2389] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:09 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:10.193623 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-edf44ac6-cde9-428d-8dc5-5bb3caaa2d4a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:10.194275 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-edf44ac6-cde9-428d-8dc5-5bb3caaa2d4a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:10.200307 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-edf44ac6-cde9-428d-8dc5-5bb3caaa2d4a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:10.200779 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-edf44ac6-cde9-428d-8dc5-5bb3caaa2d4a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:10.201539 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-edf44ac6-cde9-428d-8dc5-5bb3caaa2d4a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:10.201978 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-edf44ac6-cde9-428d-8dc5-5bb3caaa2d4a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:10.262687 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-edf44ac6-cde9-428d-8dc5-5bb3caaa2d4a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:10.270886 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-edf44ac6-cde9-428d-8dc5-5bb3caaa2d4a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.080939 Jun 17 13:26:10.271422 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1211/2390] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:10 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:11.211027 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-79bf4548-8074-4ba2-97c3-f4c403644514 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:11.212137 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-79bf4548-8074-4ba2-97c3-f4c403644514 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:11.212460 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-ff3b4dc7-882d-414d-87d0-f98b040c3bb9 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:11.213528 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-ff3b4dc7-882d-414d-87d0-f98b040c3bb9 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:11.221069 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-79bf4548-8074-4ba2-97c3-f4c403644514 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:11.221292 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ff3b4dc7-882d-414d-87d0-f98b040c3bb9 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:11.221525 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-79bf4548-8074-4ba2-97c3-f4c403644514 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:11.221656 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ff3b4dc7-882d-414d-87d0-f98b040c3bb9 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:11.222319 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ff3b4dc7-882d-414d-87d0-f98b040c3bb9 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:11.222481 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-79bf4548-8074-4ba2-97c3-f4c403644514 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:11.222743 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ff3b4dc7-882d-414d-87d0-f98b040c3bb9 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:11.222930 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-79bf4548-8074-4ba2-97c3-f4c403644514 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:11.423351 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-ff3b4dc7-882d-414d-87d0-f98b040c3bb9 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:11.426174 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-79bf4548-8074-4ba2-97c3-f4c403644514 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:11.431493 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-ff3b4dc7-882d-414d-87d0-f98b040c3bb9 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.225419 Jun 17 13:26:11.432047 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1212/2391] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:11 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:11.434780 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-79bf4548-8074-4ba2-97c3-f4c403644514 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.231562 Jun 17 13:26:11.435608 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1180/2392] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:11 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:11.436492 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-f286e0ab-7158-4a5d-8bbd-077124678c67 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:11.437102 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-f286e0ab-7158-4a5d-8bbd-077124678c67 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:11.443502 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f286e0ab-7158-4a5d-8bbd-077124678c67 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:11.443948 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f286e0ab-7158-4a5d-8bbd-077124678c67 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:11.444701 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f286e0ab-7158-4a5d-8bbd-077124678c67 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:11.445154 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f286e0ab-7158-4a5d-8bbd-077124678c67 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:11.506290 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-f286e0ab-7158-4a5d-8bbd-077124678c67 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:11.514954 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-f286e0ab-7158-4a5d-8bbd-077124678c67 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.081923 Jun 17 13:26:11.515545 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1213/2393] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:11 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:12.453453 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-765dbfa6-63f3-4051-95b2-12f76f8e0efa tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:12.454520 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-765dbfa6-63f3-4051-95b2-12f76f8e0efa tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:12.456960 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-a07cd81e-adf4-4601-9e30-d313741fc8c5 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:12.457987 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-a07cd81e-adf4-4601-9e30-d313741fc8c5 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:12.466359 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-765dbfa6-63f3-4051-95b2-12f76f8e0efa tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:12.466809 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-765dbfa6-63f3-4051-95b2-12f76f8e0efa tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:12.467537 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-765dbfa6-63f3-4051-95b2-12f76f8e0efa tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:12.467994 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-765dbfa6-63f3-4051-95b2-12f76f8e0efa tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:12.468172 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a07cd81e-adf4-4601-9e30-d313741fc8c5 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:12.468644 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a07cd81e-adf4-4601-9e30-d313741fc8c5 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:12.469497 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a07cd81e-adf4-4601-9e30-d313741fc8c5 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:12.470309 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a07cd81e-adf4-4601-9e30-d313741fc8c5 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:12.659743 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-a07cd81e-adf4-4601-9e30-d313741fc8c5 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:12.668206 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-a07cd81e-adf4-4601-9e30-d313741fc8c5 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.218451 Jun 17 13:26:12.668924 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1214/2394] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:12 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:12.678236 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-765dbfa6-63f3-4051-95b2-12f76f8e0efa tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:12.678397 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-002abb42-39f0-474a-93a8-f3b0b9ece495 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:12.678397 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-002abb42-39f0-474a-93a8-f3b0b9ece495 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:12.679540 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-765dbfa6-63f3-4051-95b2-12f76f8e0efa tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.233206 Jun 17 13:26:12.680004 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-002abb42-39f0-474a-93a8-f3b0b9ece495 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:12.680453 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-002abb42-39f0-474a-93a8-f3b0b9ece495 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:12.681208 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-002abb42-39f0-474a-93a8-f3b0b9ece495 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:12.681642 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-002abb42-39f0-474a-93a8-f3b0b9ece495 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:12.689275 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1181/2395] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:12 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:12.743538 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-002abb42-39f0-474a-93a8-f3b0b9ece495 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:12.752247 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-002abb42-39f0-474a-93a8-f3b0b9ece495 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.082403 Jun 17 13:26:12.752818 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1215/2396] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:12 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:13.318043 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-8dd786be-e5ce-4a16-9d69-27c9d8e3b962 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:13.318569 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-8dd786be-e5ce-4a16-9d69-27c9d8e3b962 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:13.325051 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8dd786be-e5ce-4a16-9d69-27c9d8e3b962 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:13.325497 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8dd786be-e5ce-4a16-9d69-27c9d8e3b962 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:13.326284 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8dd786be-e5ce-4a16-9d69-27c9d8e3b962 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:13.326715 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8dd786be-e5ce-4a16-9d69-27c9d8e3b962 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:13.354982 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-8dd786be-e5ce-4a16-9d69-27c9d8e3b962 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Going to try to terminate instance {{(pid=117660) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 17 13:26:13.445790 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-8dd786be-e5ce-4a16-9d69-27c9d8e3b962 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "DELETE /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 204 len: 0 microversion: 2.20 time: 0.131309 Jun 17 13:26:13.446318 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1182/2397] 10.222.0.48 () {60 vars in 1279 bytes} [Fri Jun 17 13:26:13 2022] DELETE /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 17 13:26:13.455059 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-64f16df9-5ace-4a68-9af0-a1a9c9c9ed45 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:13.455707 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-64f16df9-5ace-4a68-9af0-a1a9c9c9ed45 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:13.463293 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-64f16df9-5ace-4a68-9af0-a1a9c9c9ed45 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:13.463879 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-64f16df9-5ace-4a68-9af0-a1a9c9c9ed45 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:13.464481 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-64f16df9-5ace-4a68-9af0-a1a9c9c9ed45 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:13.465008 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-64f16df9-5ace-4a68-9af0-a1a9c9c9ed45 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:13.601051 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-64f16df9-5ace-4a68-9af0-a1a9c9c9ed45 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:13.610411 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-64f16df9-5ace-4a68-9af0-a1a9c9c9ed45 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:13.611893 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-64f16df9-5ace-4a68-9af0-a1a9c9c9ed45 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:13.613099 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-64f16df9-5ace-4a68-9af0-a1a9c9c9ed45 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1802 microversion: 2.20 time: 0.162376 Jun 17 13:26:13.613658 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1216/2398] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:26:13 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1802 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 13:26:13.690494 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-8819d560-e75d-43a6-9fbb-44a8fff62013 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:13.691667 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-8819d560-e75d-43a6-9fbb-44a8fff62013 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:13.700357 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-15b2fcbb-a936-4f6f-b845-e84190cd923d tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:13.700884 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-15b2fcbb-a936-4f6f-b845-e84190cd923d tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:13.701367 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8819d560-e75d-43a6-9fbb-44a8fff62013 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:13.701809 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8819d560-e75d-43a6-9fbb-44a8fff62013 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:13.702608 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8819d560-e75d-43a6-9fbb-44a8fff62013 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:13.703036 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8819d560-e75d-43a6-9fbb-44a8fff62013 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:13.707111 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-15b2fcbb-a936-4f6f-b845-e84190cd923d tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:13.707556 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-15b2fcbb-a936-4f6f-b845-e84190cd923d tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:13.708278 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-15b2fcbb-a936-4f6f-b845-e84190cd923d tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:13.708769 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-15b2fcbb-a936-4f6f-b845-e84190cd923d tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:13.712861 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_cell1:SELECT=100 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:26:13.898844 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-8819d560-e75d-43a6-9fbb-44a8fff62013 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:13.901896 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-15b2fcbb-a936-4f6f-b845-e84190cd923d tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:13.907235 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-8819d560-e75d-43a6-9fbb-44a8fff62013 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.223703 Jun 17 13:26:13.907807 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1183/2399] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:13 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:13.912661 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-15b2fcbb-a936-4f6f-b845-e84190cd923d tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.218369 Jun 17 13:26:13.913519 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1217/2400] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:13 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:13.914669 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-6fda2aa2-0a64-40fc-813c-be7e482754a5 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:13.915345 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-6fda2aa2-0a64-40fc-813c-be7e482754a5 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:13.922031 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6fda2aa2-0a64-40fc-813c-be7e482754a5 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:13.922508 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6fda2aa2-0a64-40fc-813c-be7e482754a5 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:13.923273 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6fda2aa2-0a64-40fc-813c-be7e482754a5 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:13.923705 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6fda2aa2-0a64-40fc-813c-be7e482754a5 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:13.995669 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-6fda2aa2-0a64-40fc-813c-be7e482754a5 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:14.004023 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-6fda2aa2-0a64-40fc-813c-be7e482754a5 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.093740 Jun 17 13:26:14.004558 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1184/2401] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:13 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:14.637852 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-f5a72334-739c-4741-9990-2258032a9431 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:14.638496 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-f5a72334-739c-4741-9990-2258032a9431 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:14.645708 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f5a72334-739c-4741-9990-2258032a9431 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:14.646613 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f5a72334-739c-4741-9990-2258032a9431 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:14.646935 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f5a72334-739c-4741-9990-2258032a9431 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:14.647368 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f5a72334-739c-4741-9990-2258032a9431 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:14.873263 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-f5a72334-739c-4741-9990-2258032a9431 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:14.882255 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-f5a72334-739c-4741-9990-2258032a9431 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:14.883841 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-f5a72334-739c-4741-9990-2258032a9431 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:14.885093 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-f5a72334-739c-4741-9990-2258032a9431 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1802 microversion: 2.20 time: 0.251687 Jun 17 13:26:14.885668 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1218/2402] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:26:14 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1802 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:26:14.924628 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-fe86b3bb-4990-46e5-aaf5-b690c0bf3efc tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:14.925388 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-fe86b3bb-4990-46e5-aaf5-b690c0bf3efc tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] [instance: 8a408151-81c8-4490-9190-5e4fa2d98e8a] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:14.927906 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=1 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:26:14.930559 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-cda4e643-f1a8-4bf4-a7cf-62e60696cc13 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:14.931804 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-cda4e643-f1a8-4bf4-a7cf-62e60696cc13 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:14.934902 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fe86b3bb-4990-46e5-aaf5-b690c0bf3efc tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:14.935354 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fe86b3bb-4990-46e5-aaf5-b690c0bf3efc tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:14.936132 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fe86b3bb-4990-46e5-aaf5-b690c0bf3efc tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:14.936567 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fe86b3bb-4990-46e5-aaf5-b690c0bf3efc tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:14.938043 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-cda4e643-f1a8-4bf4-a7cf-62e60696cc13 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:14.938524 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-cda4e643-f1a8-4bf4-a7cf-62e60696cc13 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:14.939346 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-cda4e643-f1a8-4bf4-a7cf-62e60696cc13 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:14.939705 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-cda4e643-f1a8-4bf4-a7cf-62e60696cc13 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:15.261561 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-cda4e643-f1a8-4bf4-a7cf-62e60696cc13 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:15.268564 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-fe86b3bb-4990-46e5-aaf5-b690c0bf3efc tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a99ccc238943a098833d03c6233413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1686ea199c5442958f97102a61ce41aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:15.280789 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-cda4e643-f1a8-4bf4-a7cf-62e60696cc13 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6" status: 200 len: 1560 microversion: 2.1 time: 0.353866 Jun 17 13:26:15.282018 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1219/2403] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:14 2022] GET /compute/v2.1/servers/0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 => generated 1560 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:15.290857 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-6d78687e-5b43-428b-9730-46efaf318d4b tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:15.292294 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-6d78687e-5b43-428b-9730-46efaf318d4b tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:15.295160 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-fe86b3bb-4990-46e5-aaf5-b690c0bf3efc tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a" status: 200 len: 1602 microversion: 2.1 time: 0.374416 Jun 17 13:26:15.295934 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1185/2404] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:14 2022] GET /compute/v2.1/servers/8a408151-81c8-4490-9190-5e4fa2d98e8a => generated 1602 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:15.312812 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6d78687e-5b43-428b-9730-46efaf318d4b tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:15.313520 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6d78687e-5b43-428b-9730-46efaf318d4b tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:15.319204 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6d78687e-5b43-428b-9730-46efaf318d4b tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:15.319841 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6d78687e-5b43-428b-9730-46efaf318d4b tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:15.325548 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-35582182-b2cc-49bb-a49c-c9c335f805a1 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] Calling method '.version_select at 0x7f0183fa7820>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:15.374292 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-35582182-b2cc-49bb-a49c-c9c335f805a1 tempest-TestMinimumBasicScenario-1188150813 tempest-TestMinimumBasicScenario-1188150813-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1523504503" status: 202 len: 0 microversion: 2.1 time: 0.057384 Jun 17 13:26:15.375498 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1186/2405] 10.222.0.48 () {58 vars in 1271 bytes} [Fri Jun 17 13:26:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1523504503 => generated 0 bytes in 59 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 13:26:15.388278 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-40c070ba-4cc7-4658-a7ae-5b5b14b14a84 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:15.388278 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-40c070ba-4cc7-4658-a7ae-5b5b14b14a84 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:15.395903 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-40c070ba-4cc7-4658-a7ae-5b5b14b14a84 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:15.396351 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-40c070ba-4cc7-4658-a7ae-5b5b14b14a84 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:15.397127 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-40c070ba-4cc7-4658-a7ae-5b5b14b14a84 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:15.397560 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-40c070ba-4cc7-4658-a7ae-5b5b14b14a84 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:15.399601 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-6d78687e-5b43-428b-9730-46efaf318d4b tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:15.425373 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-6d78687e-5b43-428b-9730-46efaf318d4b tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.136241 Jun 17 13:26:15.432352 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1220/2406] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:15 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:15.449783 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-40c070ba-4cc7-4658-a7ae-5b5b14b14a84 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Going to try to terminate instance {{(pid=117660) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 17 13:26:15.584670 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-40c070ba-4cc7-4658-a7ae-5b5b14b14a84 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "DELETE /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 204 len: 0 microversion: 2.1 time: 0.207174 Jun 17 13:26:15.585743 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1187/2407] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Jun 17 13:26:15 2022] DELETE /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 17 13:26:15.593833 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-9aba154e-4ab2-4ae9-8a9b-7c348f261067 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:15.594676 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-9aba154e-4ab2-4ae9-8a9b-7c348f261067 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:15.601237 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9aba154e-4ab2-4ae9-8a9b-7c348f261067 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:15.601923 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9aba154e-4ab2-4ae9-8a9b-7c348f261067 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:15.602708 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9aba154e-4ab2-4ae9-8a9b-7c348f261067 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:15.603136 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9aba154e-4ab2-4ae9-8a9b-7c348f261067 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:15.820283 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-9aba154e-4ab2-4ae9-8a9b-7c348f261067 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:15.851625 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-9aba154e-4ab2-4ae9-8a9b-7c348f261067 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.261710 Jun 17 13:26:15.854132 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1221/2408] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:15 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:15.906385 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-839a7869-0147-4c88-8524-c5cb3277c220 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:15.908122 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-839a7869-0147-4c88-8524-c5cb3277c220 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:15.930134 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [req-f0f81f86-8984-4b1a-848c-64f468590556 req-875eef06-140d-4be1-a898-8ead3375c386 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8fdea98-917f-4c4d-aaba-d4f5df4622d6", "name": "network-vif-deleted", "tag": "936c48d1-9e45-4b7e-9fa7-86ea87893b56"}]} {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:26:15.941342 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [req-f0f81f86-8984-4b1a-848c-64f468590556 req-875eef06-140d-4be1-a898-8ead3375c386 service nova] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:15.942068 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [req-f0f81f86-8984-4b1a-848c-64f468590556 req-875eef06-140d-4be1-a898-8ead3375c386 service nova] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:15.956756 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-839a7869-0147-4c88-8524-c5cb3277c220 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:15.957304 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-839a7869-0147-4c88-8524-c5cb3277c220 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:15.958003 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-839a7869-0147-4c88-8524-c5cb3277c220 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:15.965348 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-839a7869-0147-4c88-8524-c5cb3277c220 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:15.970153 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.compute.server_external_events [req-f0f81f86-8984-4b1a-848c-64f468590556 req-875eef06-140d-4be1-a898-8ead3375c386 service nova] Creating event network-vif-deleted:936c48d1-9e45-4b7e-9fa7-86ea87893b56 for instance c8fdea98-917f-4c4d-aaba-d4f5df4622d6 on hv-cinder-83754 Jun 17 13:26:15.978695 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [req-f0f81f86-8984-4b1a-848c-64f468590556 req-875eef06-140d-4be1-a898-8ead3375c386 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053456 Jun 17 13:26:15.986240 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1222/2409] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 13:26:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 13:26:16.091473 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-839a7869-0147-4c88-8524-c5cb3277c220 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:16.105000 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-839a7869-0147-4c88-8524-c5cb3277c220 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:16.107526 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-839a7869-0147-4c88-8524-c5cb3277c220 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:16.109055 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-839a7869-0147-4c88-8524-c5cb3277c220 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.208702 Jun 17 13:26:16.114597 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1188/2410] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:26:15 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:26:16.454010 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-f026dfec-e0dc-4dd7-81d4-06d44d12ed04 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:16.455054 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-f026dfec-e0dc-4dd7-81d4-06d44d12ed04 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:16.463185 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f026dfec-e0dc-4dd7-81d4-06d44d12ed04 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:16.471629 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f026dfec-e0dc-4dd7-81d4-06d44d12ed04 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:16.472724 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f026dfec-e0dc-4dd7-81d4-06d44d12ed04 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:16.473771 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f026dfec-e0dc-4dd7-81d4-06d44d12ed04 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:16.558006 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-f026dfec-e0dc-4dd7-81d4-06d44d12ed04 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:16.567643 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-f026dfec-e0dc-4dd7-81d4-06d44d12ed04 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.122258 Jun 17 13:26:16.568230 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1223/2411] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:16 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:16.873437 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-763ba5c1-8676-4101-a866-7a5b2f0d6cc4 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:16.874540 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-763ba5c1-8676-4101-a866-7a5b2f0d6cc4 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:16.881304 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-763ba5c1-8676-4101-a866-7a5b2f0d6cc4 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:16.882144 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-763ba5c1-8676-4101-a866-7a5b2f0d6cc4 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:16.883311 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-763ba5c1-8676-4101-a866-7a5b2f0d6cc4 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:16.883918 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-763ba5c1-8676-4101-a866-7a5b2f0d6cc4 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:17.122986 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-763ba5c1-8676-4101-a866-7a5b2f0d6cc4 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:17.129063 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-f51fb8ac-5779-4cc8-be23-c28ca7685aa7 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:17.133870 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-f51fb8ac-5779-4cc8-be23-c28ca7685aa7 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:17.142506 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-763ba5c1-8676-4101-a866-7a5b2f0d6cc4 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.272924 Jun 17 13:26:17.143030 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1189/2412] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:16 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:17.146869 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f51fb8ac-5779-4cc8-be23-c28ca7685aa7 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:17.147557 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f51fb8ac-5779-4cc8-be23-c28ca7685aa7 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:17.148337 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f51fb8ac-5779-4cc8-be23-c28ca7685aa7 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:17.148774 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f51fb8ac-5779-4cc8-be23-c28ca7685aa7 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:17.226469 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-f51fb8ac-5779-4cc8-be23-c28ca7685aa7 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:17.236340 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-f51fb8ac-5779-4cc8-be23-c28ca7685aa7 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:17.237895 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-f51fb8ac-5779-4cc8-be23-c28ca7685aa7 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:17.239042 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-f51fb8ac-5779-4cc8-be23-c28ca7685aa7 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.114286 Jun 17 13:26:17.239600 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1224/2413] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:26:17 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:26:17.584957 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-5eb38b7f-3ffb-4fec-b0ce-10c1bd058ec5 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:17.585571 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-5eb38b7f-3ffb-4fec-b0ce-10c1bd058ec5 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:17.593751 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5eb38b7f-3ffb-4fec-b0ce-10c1bd058ec5 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:17.594310 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5eb38b7f-3ffb-4fec-b0ce-10c1bd058ec5 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:17.595090 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5eb38b7f-3ffb-4fec-b0ce-10c1bd058ec5 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:17.595511 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5eb38b7f-3ffb-4fec-b0ce-10c1bd058ec5 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:17.676973 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-5eb38b7f-3ffb-4fec-b0ce-10c1bd058ec5 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:17.685844 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-5eb38b7f-3ffb-4fec-b0ce-10c1bd058ec5 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.104744 Jun 17 13:26:17.686608 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1190/2414] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:17 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:18.160036 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-2e006b81-56d4-4b43-b7ae-0bd6854b53d7 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:18.160654 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-2e006b81-56d4-4b43-b7ae-0bd6854b53d7 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:18.167566 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2e006b81-56d4-4b43-b7ae-0bd6854b53d7 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:18.168807 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2e006b81-56d4-4b43-b7ae-0bd6854b53d7 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:18.168807 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2e006b81-56d4-4b43-b7ae-0bd6854b53d7 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:18.169277 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2e006b81-56d4-4b43-b7ae-0bd6854b53d7 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:18.258408 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-7e156c9b-62c4-44ad-85cd-0f1671996635 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:18.259051 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-7e156c9b-62c4-44ad-85cd-0f1671996635 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:18.265987 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7e156c9b-62c4-44ad-85cd-0f1671996635 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:18.266468 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7e156c9b-62c4-44ad-85cd-0f1671996635 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:18.267235 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7e156c9b-62c4-44ad-85cd-0f1671996635 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:18.267672 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7e156c9b-62c4-44ad-85cd-0f1671996635 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:18.271854 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:26:18.349019 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-7e156c9b-62c4-44ad-85cd-0f1671996635 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:18.358062 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-7e156c9b-62c4-44ad-85cd-0f1671996635 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:18.359627 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-7e156c9b-62c4-44ad-85cd-0f1671996635 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:18.360778 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-7e156c9b-62c4-44ad-85cd-0f1671996635 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.106410 Jun 17 13:26:18.361307 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1191/2415] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:26:18 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:26:18.387526 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-2e006b81-56d4-4b43-b7ae-0bd6854b53d7 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:18.395931 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-2e006b81-56d4-4b43-b7ae-0bd6854b53d7 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.239783 Jun 17 13:26:18.396534 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1225/2416] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:18 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:18.703335 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-45c115e7-46ea-4407-8b35-c2ba67f76cae tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:18.704320 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-45c115e7-46ea-4407-8b35-c2ba67f76cae tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:18.710466 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-45c115e7-46ea-4407-8b35-c2ba67f76cae tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:18.711177 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-45c115e7-46ea-4407-8b35-c2ba67f76cae tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:18.712038 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-45c115e7-46ea-4407-8b35-c2ba67f76cae tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:18.712609 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-45c115e7-46ea-4407-8b35-c2ba67f76cae tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:18.812974 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-45c115e7-46ea-4407-8b35-c2ba67f76cae tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:18.822560 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-45c115e7-46ea-4407-8b35-c2ba67f76cae tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.123462 Jun 17 13:26:18.823549 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1192/2417] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:18 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:19.379681 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-923a5ab9-8dad-48bf-b985-a3723d0e7767 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:19.380187 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-923a5ab9-8dad-48bf-b985-a3723d0e7767 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:19.388520 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-923a5ab9-8dad-48bf-b985-a3723d0e7767 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:19.389256 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-923a5ab9-8dad-48bf-b985-a3723d0e7767 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:19.390233 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-923a5ab9-8dad-48bf-b985-a3723d0e7767 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:19.390821 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-923a5ab9-8dad-48bf-b985-a3723d0e7767 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:19.412761 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-71782f70-0b3b-4d40-874d-e0bb08da9c5e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:19.413355 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-71782f70-0b3b-4d40-874d-e0bb08da9c5e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:19.428435 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-71782f70-0b3b-4d40-874d-e0bb08da9c5e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:19.429016 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-71782f70-0b3b-4d40-874d-e0bb08da9c5e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:19.429660 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-71782f70-0b3b-4d40-874d-e0bb08da9c5e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:19.430053 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-71782f70-0b3b-4d40-874d-e0bb08da9c5e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:19.500934 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-923a5ab9-8dad-48bf-b985-a3723d0e7767 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:19.512102 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-923a5ab9-8dad-48bf-b985-a3723d0e7767 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:19.514274 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-923a5ab9-8dad-48bf-b985-a3723d0e7767 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:19.515877 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-923a5ab9-8dad-48bf-b985-a3723d0e7767 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.140726 Jun 17 13:26:19.516577 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1226/2418] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:26:19 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:26:19.601909 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-71782f70-0b3b-4d40-874d-e0bb08da9c5e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:19.611390 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-71782f70-0b3b-4d40-874d-e0bb08da9c5e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.202260 Jun 17 13:26:19.612235 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1193/2419] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:19 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:19.839247 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-ff0eeeb4-7498-483c-a670-3065a90e244f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:19.840394 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-ff0eeeb4-7498-483c-a670-3065a90e244f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:19.846857 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ff0eeeb4-7498-483c-a670-3065a90e244f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:19.847299 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ff0eeeb4-7498-483c-a670-3065a90e244f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:19.848068 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ff0eeeb4-7498-483c-a670-3065a90e244f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:19.848500 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ff0eeeb4-7498-483c-a670-3065a90e244f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:19.914853 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-ff0eeeb4-7498-483c-a670-3065a90e244f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:19.923841 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-ff0eeeb4-7498-483c-a670-3065a90e244f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.088426 Jun 17 13:26:19.924654 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1227/2420] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:19 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:20.539213 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-b4049a20-736c-4b64-b4dc-d4db3db3702b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:20.540496 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-b4049a20-736c-4b64-b4dc-d4db3db3702b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:20.548948 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b4049a20-736c-4b64-b4dc-d4db3db3702b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:20.549395 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b4049a20-736c-4b64-b4dc-d4db3db3702b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:20.550183 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b4049a20-736c-4b64-b4dc-d4db3db3702b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:20.550629 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b4049a20-736c-4b64-b4dc-d4db3db3702b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:20.621898 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-b4049a20-736c-4b64-b4dc-d4db3db3702b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:20.628834 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-83f15990-9450-434c-8353-c24e8ae534b5 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:20.629450 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-83f15990-9450-434c-8353-c24e8ae534b5 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:20.630980 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-b4049a20-736c-4b64-b4dc-d4db3db3702b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:20.632480 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-b4049a20-736c-4b64-b4dc-d4db3db3702b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:20.633631 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-b4049a20-736c-4b64-b4dc-d4db3db3702b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.100990 Jun 17 13:26:20.634182 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1194/2421] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:26:20 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:26:20.636467 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-83f15990-9450-434c-8353-c24e8ae534b5 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:20.637143 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-83f15990-9450-434c-8353-c24e8ae534b5 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:20.638411 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-83f15990-9450-434c-8353-c24e8ae534b5 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:20.638850 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-83f15990-9450-434c-8353-c24e8ae534b5 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:20.779277 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-83f15990-9450-434c-8353-c24e8ae534b5 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:20.787348 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-83f15990-9450-434c-8353-c24e8ae534b5 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.162361 Jun 17 13:26:20.787928 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1228/2422] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:20 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:20.945085 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-8674b205-b91b-4852-a8d4-8dd9eb8545e0 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:20.946159 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-8674b205-b91b-4852-a8d4-8dd9eb8545e0 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:20.956333 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8674b205-b91b-4852-a8d4-8dd9eb8545e0 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:20.957074 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8674b205-b91b-4852-a8d4-8dd9eb8545e0 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:20.958349 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8674b205-b91b-4852-a8d4-8dd9eb8545e0 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:20.959096 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8674b205-b91b-4852-a8d4-8dd9eb8545e0 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:21.027445 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-8674b205-b91b-4852-a8d4-8dd9eb8545e0 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:21.035788 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-8674b205-b91b-4852-a8d4-8dd9eb8545e0 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.097091 Jun 17 13:26:21.036388 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1195/2423] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:20 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:21.656449 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-3d7ed10a-6810-44aa-b6e6-b73e87c04781 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:21.657264 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-3d7ed10a-6810-44aa-b6e6-b73e87c04781 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:21.666424 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-3d7ed10a-6810-44aa-b6e6-b73e87c04781 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:21.667021 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-3d7ed10a-6810-44aa-b6e6-b73e87c04781 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:21.668031 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-3d7ed10a-6810-44aa-b6e6-b73e87c04781 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:21.668892 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-3d7ed10a-6810-44aa-b6e6-b73e87c04781 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:21.740867 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-3d7ed10a-6810-44aa-b6e6-b73e87c04781 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:21.749651 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-3d7ed10a-6810-44aa-b6e6-b73e87c04781 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:21.751171 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-3d7ed10a-6810-44aa-b6e6-b73e87c04781 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:21.752320 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-3d7ed10a-6810-44aa-b6e6-b73e87c04781 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.102356 Jun 17 13:26:21.752885 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1229/2424] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:26:21 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:26:21.808852 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-d4a9266d-b23a-4112-8ea5-131fb97b7251 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:21.810156 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-d4a9266d-b23a-4112-8ea5-131fb97b7251 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:21.821360 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d4a9266d-b23a-4112-8ea5-131fb97b7251 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:21.822139 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d4a9266d-b23a-4112-8ea5-131fb97b7251 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:21.823382 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d4a9266d-b23a-4112-8ea5-131fb97b7251 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:21.824097 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d4a9266d-b23a-4112-8ea5-131fb97b7251 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:21.970205 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-d4a9266d-b23a-4112-8ea5-131fb97b7251 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:21.980134 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-d4a9266d-b23a-4112-8ea5-131fb97b7251 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.177907 Jun 17 13:26:21.980746 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1196/2425] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:21 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:22.054141 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-fe973e6c-fd79-40d5-9d08-1cf07d16591d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:22.054807 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-fe973e6c-fd79-40d5-9d08-1cf07d16591d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:22.061848 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-fe973e6c-fd79-40d5-9d08-1cf07d16591d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:22.062372 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-fe973e6c-fd79-40d5-9d08-1cf07d16591d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:22.063199 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-fe973e6c-fd79-40d5-9d08-1cf07d16591d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:22.063674 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-fe973e6c-fd79-40d5-9d08-1cf07d16591d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:22.127341 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-fe973e6c-fd79-40d5-9d08-1cf07d16591d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:22.135663 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-fe973e6c-fd79-40d5-9d08-1cf07d16591d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.085967 Jun 17 13:26:22.136225 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1230/2426] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:22 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:22.774732 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-41eea6c2-40f1-448a-b835-5a05660f6862 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:22.775683 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-41eea6c2-40f1-448a-b835-5a05660f6862 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:22.786143 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-41eea6c2-40f1-448a-b835-5a05660f6862 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:22.786759 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-41eea6c2-40f1-448a-b835-5a05660f6862 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:22.788033 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-41eea6c2-40f1-448a-b835-5a05660f6862 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:22.788752 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-41eea6c2-40f1-448a-b835-5a05660f6862 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:22.855383 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-41eea6c2-40f1-448a-b835-5a05660f6862 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:22.864717 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-41eea6c2-40f1-448a-b835-5a05660f6862 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:22.866208 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-41eea6c2-40f1-448a-b835-5a05660f6862 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:22.867344 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-41eea6c2-40f1-448a-b835-5a05660f6862 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.099319 Jun 17 13:26:22.867907 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1197/2427] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:26:22 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:26:23.001216 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-53cab13d-ef98-4566-a29f-48352598f9ef tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:23.002282 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-53cab13d-ef98-4566-a29f-48352598f9ef tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:23.008033 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_api:SELECT=84 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:26:23.015033 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-53cab13d-ef98-4566-a29f-48352598f9ef tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:23.015779 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-53cab13d-ef98-4566-a29f-48352598f9ef tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:23.016987 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-53cab13d-ef98-4566-a29f-48352598f9ef tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:23.017739 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-53cab13d-ef98-4566-a29f-48352598f9ef tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:23.153060 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-50fd6aa3-d45d-4cb8-96ca-caa8b4ecaa52 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:23.153782 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-50fd6aa3-d45d-4cb8-96ca-caa8b4ecaa52 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:23.160574 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-50fd6aa3-d45d-4cb8-96ca-caa8b4ecaa52 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:23.161028 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-50fd6aa3-d45d-4cb8-96ca-caa8b4ecaa52 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:23.161785 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-50fd6aa3-d45d-4cb8-96ca-caa8b4ecaa52 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:23.162250 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-50fd6aa3-d45d-4cb8-96ca-caa8b4ecaa52 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:23.171334 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-53cab13d-ef98-4566-a29f-48352598f9ef tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:23.179458 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-53cab13d-ef98-4566-a29f-48352598f9ef tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.185296 Jun 17 13:26:23.180011 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1231/2428] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:22 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:23.225152 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-50fd6aa3-d45d-4cb8-96ca-caa8b4ecaa52 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:23.233689 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-50fd6aa3-d45d-4cb8-96ca-caa8b4ecaa52 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.084662 Jun 17 13:26:23.234277 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1198/2429] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:23 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:23.889445 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-15bd4a62-1a21-4ff6-8609-bcd2962b2e23 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:23.890510 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-15bd4a62-1a21-4ff6-8609-bcd2962b2e23 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:23.901021 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-15bd4a62-1a21-4ff6-8609-bcd2962b2e23 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:23.901773 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-15bd4a62-1a21-4ff6-8609-bcd2962b2e23 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:23.903091 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-15bd4a62-1a21-4ff6-8609-bcd2962b2e23 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:23.904129 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-15bd4a62-1a21-4ff6-8609-bcd2962b2e23 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:23.976136 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-15bd4a62-1a21-4ff6-8609-bcd2962b2e23 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:23.985435 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-15bd4a62-1a21-4ff6-8609-bcd2962b2e23 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:23.986983 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-15bd4a62-1a21-4ff6-8609-bcd2962b2e23 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:23.988129 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-15bd4a62-1a21-4ff6-8609-bcd2962b2e23 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.105794 Jun 17 13:26:23.988704 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1232/2430] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:26:23 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:26:24.201423 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-093eb01e-8ab4-4fc0-9bf5-3142b74beb9c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:24.202725 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-093eb01e-8ab4-4fc0-9bf5-3142b74beb9c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:24.209482 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-093eb01e-8ab4-4fc0-9bf5-3142b74beb9c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:24.209925 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-093eb01e-8ab4-4fc0-9bf5-3142b74beb9c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:24.210706 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-093eb01e-8ab4-4fc0-9bf5-3142b74beb9c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:24.211103 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-093eb01e-8ab4-4fc0-9bf5-3142b74beb9c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:24.250696 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-8b71ea8e-a424-447d-aac5-fcb3a0b13f3e tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:24.251285 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-8b71ea8e-a424-447d-aac5-fcb3a0b13f3e tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:24.258189 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8b71ea8e-a424-447d-aac5-fcb3a0b13f3e tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:24.258625 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8b71ea8e-a424-447d-aac5-fcb3a0b13f3e tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:24.259411 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8b71ea8e-a424-447d-aac5-fcb3a0b13f3e tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:24.259833 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8b71ea8e-a424-447d-aac5-fcb3a0b13f3e tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:24.339421 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-8b71ea8e-a424-447d-aac5-fcb3a0b13f3e tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:24.347840 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-8b71ea8e-a424-447d-aac5-fcb3a0b13f3e tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.100984 Jun 17 13:26:24.348400 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1233/2431] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:24 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:24.370847 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-093eb01e-8ab4-4fc0-9bf5-3142b74beb9c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:24.379513 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-093eb01e-8ab4-4fc0-9bf5-3142b74beb9c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.184817 Jun 17 13:26:24.380079 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1199/2432] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:24 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:25.011138 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-246b5e43-9630-4538-99d0-4388c9759588 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:25.012143 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-246b5e43-9630-4538-99d0-4388c9759588 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:25.020257 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-246b5e43-9630-4538-99d0-4388c9759588 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:25.020715 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-246b5e43-9630-4538-99d0-4388c9759588 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:25.021473 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-246b5e43-9630-4538-99d0-4388c9759588 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:25.021910 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-246b5e43-9630-4538-99d0-4388c9759588 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:25.040063 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_cell1:SELECT=100 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:26:25.086419 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-246b5e43-9630-4538-99d0-4388c9759588 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:25.095414 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-246b5e43-9630-4538-99d0-4388c9759588 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:25.096923 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-246b5e43-9630-4538-99d0-4388c9759588 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:25.098729 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-246b5e43-9630-4538-99d0-4388c9759588 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.093883 Jun 17 13:26:25.099529 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1234/2433] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:26:25 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:26:25.365719 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-9f41eb44-d89e-4a71-801e-248b7e5b922b tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:25.366381 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-9f41eb44-d89e-4a71-801e-248b7e5b922b tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:25.373804 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9f41eb44-d89e-4a71-801e-248b7e5b922b tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:25.374373 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9f41eb44-d89e-4a71-801e-248b7e5b922b tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:25.375129 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9f41eb44-d89e-4a71-801e-248b7e5b922b tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:25.375557 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9f41eb44-d89e-4a71-801e-248b7e5b922b tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:25.395994 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-f0e068c3-67d2-450d-9b30-5d848adb1b49 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:25.396573 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-f0e068c3-67d2-450d-9b30-5d848adb1b49 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:25.403408 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f0e068c3-67d2-450d-9b30-5d848adb1b49 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:25.403888 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f0e068c3-67d2-450d-9b30-5d848adb1b49 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:25.404645 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f0e068c3-67d2-450d-9b30-5d848adb1b49 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:25.405086 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f0e068c3-67d2-450d-9b30-5d848adb1b49 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:25.439797 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-9f41eb44-d89e-4a71-801e-248b7e5b922b tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:25.448357 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-9f41eb44-d89e-4a71-801e-248b7e5b922b tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.086983 Jun 17 13:26:25.448914 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1200/2434] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:25 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:25.543351 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-f0e068c3-67d2-450d-9b30-5d848adb1b49 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:25.552323 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-f0e068c3-67d2-450d-9b30-5d848adb1b49 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.160177 Jun 17 13:26:25.552891 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1235/2435] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:25 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:26.126223 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-a532d221-0ac7-4a3e-ad44-3a8af840b5f8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:26.126865 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-a532d221-0ac7-4a3e-ad44-3a8af840b5f8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:26.133639 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a532d221-0ac7-4a3e-ad44-3a8af840b5f8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:26.134149 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a532d221-0ac7-4a3e-ad44-3a8af840b5f8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:26.134978 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a532d221-0ac7-4a3e-ad44-3a8af840b5f8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:26.135442 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a532d221-0ac7-4a3e-ad44-3a8af840b5f8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:26.198580 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-a532d221-0ac7-4a3e-ad44-3a8af840b5f8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:26.207209 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-a532d221-0ac7-4a3e-ad44-3a8af840b5f8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:26.208701 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-a532d221-0ac7-4a3e-ad44-3a8af840b5f8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:26.209850 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-a532d221-0ac7-4a3e-ad44-3a8af840b5f8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.090186 Jun 17 13:26:26.210438 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1201/2436] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:26:26 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:26:26.469367 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-97ab951e-b532-4c71-906d-2bc52d8203ce tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:26.470371 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-97ab951e-b532-4c71-906d-2bc52d8203ce tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:26.481460 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-97ab951e-b532-4c71-906d-2bc52d8203ce tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:26.482296 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-97ab951e-b532-4c71-906d-2bc52d8203ce tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:26.483620 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-97ab951e-b532-4c71-906d-2bc52d8203ce tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:26.484067 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-97ab951e-b532-4c71-906d-2bc52d8203ce tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:26.555983 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-97ab951e-b532-4c71-906d-2bc52d8203ce tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:26.564656 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-97ab951e-b532-4c71-906d-2bc52d8203ce tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.101904 Jun 17 13:26:26.565299 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1236/2437] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:26 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:26.568962 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-b89bd493-946b-4d4f-8dbc-f1e5afb0180c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:26.569579 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-b89bd493-946b-4d4f-8dbc-f1e5afb0180c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:26.577346 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b89bd493-946b-4d4f-8dbc-f1e5afb0180c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:26.577950 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b89bd493-946b-4d4f-8dbc-f1e5afb0180c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:26.578868 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b89bd493-946b-4d4f-8dbc-f1e5afb0180c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:26.579308 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b89bd493-946b-4d4f-8dbc-f1e5afb0180c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:26.726232 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-b89bd493-946b-4d4f-8dbc-f1e5afb0180c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:26.734937 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-b89bd493-946b-4d4f-8dbc-f1e5afb0180c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.169907 Jun 17 13:26:26.735660 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1202/2438] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:26 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:27.228485 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-bee273ab-bc62-444e-b2b2-a0d3915f2964 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:27.229089 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-bee273ab-bc62-444e-b2b2-a0d3915f2964 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:27.236165 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-bee273ab-bc62-444e-b2b2-a0d3915f2964 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:27.236634 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-bee273ab-bc62-444e-b2b2-a0d3915f2964 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:27.237376 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-bee273ab-bc62-444e-b2b2-a0d3915f2964 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:27.237808 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-bee273ab-bc62-444e-b2b2-a0d3915f2964 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:27.310795 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-bee273ab-bc62-444e-b2b2-a0d3915f2964 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:27.319566 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-bee273ab-bc62-444e-b2b2-a0d3915f2964 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:27.321072 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-bee273ab-bc62-444e-b2b2-a0d3915f2964 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:27.322253 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-bee273ab-bc62-444e-b2b2-a0d3915f2964 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.097783 Jun 17 13:26:27.322824 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1237/2439] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:26:27 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:26:27.586002 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-47c2ec6c-b4f8-4783-af91-2c529b9490a1 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:27.586875 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-47c2ec6c-b4f8-4783-af91-2c529b9490a1 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:27.596702 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-47c2ec6c-b4f8-4783-af91-2c529b9490a1 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:27.597145 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-47c2ec6c-b4f8-4783-af91-2c529b9490a1 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:27.597898 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-47c2ec6c-b4f8-4783-af91-2c529b9490a1 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:27.598359 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-47c2ec6c-b4f8-4783-af91-2c529b9490a1 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:27.663516 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-47c2ec6c-b4f8-4783-af91-2c529b9490a1 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:27.672049 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-47c2ec6c-b4f8-4783-af91-2c529b9490a1 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.092673 Jun 17 13:26:27.672625 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1203/2440] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:27 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:27.761353 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-38306f14-32c2-4e24-9c3f-5470608a9125 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:27.761949 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-38306f14-32c2-4e24-9c3f-5470608a9125 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:27.770123 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-38306f14-32c2-4e24-9c3f-5470608a9125 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:27.770610 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-38306f14-32c2-4e24-9c3f-5470608a9125 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:27.771373 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-38306f14-32c2-4e24-9c3f-5470608a9125 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:27.771817 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-38306f14-32c2-4e24-9c3f-5470608a9125 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:27.921306 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-38306f14-32c2-4e24-9c3f-5470608a9125 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:27.930124 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-38306f14-32c2-4e24-9c3f-5470608a9125 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.174927 Jun 17 13:26:27.930910 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1238/2441] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:27 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:28.344892 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-19c949f6-b240-4572-8498-289425874c0d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:28.345778 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-19c949f6-b240-4572-8498-289425874c0d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:28.355321 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-19c949f6-b240-4572-8498-289425874c0d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:28.355928 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-19c949f6-b240-4572-8498-289425874c0d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:28.357068 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-19c949f6-b240-4572-8498-289425874c0d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:28.357694 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-19c949f6-b240-4572-8498-289425874c0d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:28.431322 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-19c949f6-b240-4572-8498-289425874c0d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:28.440510 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-19c949f6-b240-4572-8498-289425874c0d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:28.442139 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-19c949f6-b240-4572-8498-289425874c0d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:28.443285 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-19c949f6-b240-4572-8498-289425874c0d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.104345 Jun 17 13:26:28.443850 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1204/2442] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:26:28 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:26:28.699301 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-1c188eaf-806a-4970-9f94-cbcddbdd385e tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:28.700315 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-1c188eaf-806a-4970-9f94-cbcddbdd385e tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:28.707991 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-1c188eaf-806a-4970-9f94-cbcddbdd385e tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:28.708448 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-1c188eaf-806a-4970-9f94-cbcddbdd385e tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:28.709194 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-1c188eaf-806a-4970-9f94-cbcddbdd385e tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:28.709628 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-1c188eaf-806a-4970-9f94-cbcddbdd385e tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:28.784126 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-1c188eaf-806a-4970-9f94-cbcddbdd385e tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:28.792790 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-1c188eaf-806a-4970-9f94-cbcddbdd385e tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.100188 Jun 17 13:26:28.793364 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1239/2443] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:28 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:28.957100 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-790ffe87-676f-4b91-abd1-82270efb0472 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:28.957996 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-790ffe87-676f-4b91-abd1-82270efb0472 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:28.968619 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-790ffe87-676f-4b91-abd1-82270efb0472 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:28.969074 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-790ffe87-676f-4b91-abd1-82270efb0472 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:28.969816 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-790ffe87-676f-4b91-abd1-82270efb0472 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:28.970366 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-790ffe87-676f-4b91-abd1-82270efb0472 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:29.108478 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-790ffe87-676f-4b91-abd1-82270efb0472 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:29.120312 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-790ffe87-676f-4b91-abd1-82270efb0472 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.169747 Jun 17 13:26:29.121102 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1205/2444] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:28 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:29.467248 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-463f014d-6b25-4137-a9ef-27f836ecbc07 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:29.468294 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-463f014d-6b25-4137-a9ef-27f836ecbc07 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:29.479913 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-463f014d-6b25-4137-a9ef-27f836ecbc07 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:29.480685 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-463f014d-6b25-4137-a9ef-27f836ecbc07 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:29.481978 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-463f014d-6b25-4137-a9ef-27f836ecbc07 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:29.482756 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-463f014d-6b25-4137-a9ef-27f836ecbc07 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:29.545530 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-463f014d-6b25-4137-a9ef-27f836ecbc07 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:29.554919 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-463f014d-6b25-4137-a9ef-27f836ecbc07 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:29.556425 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-463f014d-6b25-4137-a9ef-27f836ecbc07 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:29.557607 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-463f014d-6b25-4137-a9ef-27f836ecbc07 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.097610 Jun 17 13:26:29.558197 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1240/2445] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:26:29 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:26:29.809984 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-f68b48a7-66d9-41b1-91e8-461beca94392 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:29.810614 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-f68b48a7-66d9-41b1-91e8-461beca94392 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:29.818048 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f68b48a7-66d9-41b1-91e8-461beca94392 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:29.818607 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f68b48a7-66d9-41b1-91e8-461beca94392 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:29.819342 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f68b48a7-66d9-41b1-91e8-461beca94392 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:29.819957 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f68b48a7-66d9-41b1-91e8-461beca94392 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:29.882730 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-f68b48a7-66d9-41b1-91e8-461beca94392 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:29.891410 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-f68b48a7-66d9-41b1-91e8-461beca94392 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.085248 Jun 17 13:26:29.891983 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1206/2446] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:29 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:30.142845 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-aa0f885c-4dd0-46a8-8b1f-f2be78713c7f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:30.143795 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-aa0f885c-4dd0-46a8-8b1f-f2be78713c7f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:30.153652 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-aa0f885c-4dd0-46a8-8b1f-f2be78713c7f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:30.154367 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-aa0f885c-4dd0-46a8-8b1f-f2be78713c7f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:30.155574 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-aa0f885c-4dd0-46a8-8b1f-f2be78713c7f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:30.156260 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-aa0f885c-4dd0-46a8-8b1f-f2be78713c7f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:30.300765 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-aa0f885c-4dd0-46a8-8b1f-f2be78713c7f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:30.309299 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-aa0f885c-4dd0-46a8-8b1f-f2be78713c7f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.173033 Jun 17 13:26:30.310123 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1241/2447] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:30 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:30.580533 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-e18e6633-3a49-46bf-a3e7-eece9d98072c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:30.581408 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-e18e6633-3a49-46bf-a3e7-eece9d98072c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:30.592385 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e18e6633-3a49-46bf-a3e7-eece9d98072c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:30.593128 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e18e6633-3a49-46bf-a3e7-eece9d98072c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:30.594346 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e18e6633-3a49-46bf-a3e7-eece9d98072c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:30.594799 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e18e6633-3a49-46bf-a3e7-eece9d98072c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:30.663671 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-e18e6633-3a49-46bf-a3e7-eece9d98072c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:30.668384 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=100 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:26:30.676760 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-e18e6633-3a49-46bf-a3e7-eece9d98072c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:30.678987 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-e18e6633-3a49-46bf-a3e7-eece9d98072c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:30.680630 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-e18e6633-3a49-46bf-a3e7-eece9d98072c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.106772 Jun 17 13:26:30.681316 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1207/2448] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:26:30 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:26:30.912550 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-c3929e14-b372-4f0c-946f-401c439be98f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:30.913541 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-c3929e14-b372-4f0c-946f-401c439be98f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:30.923387 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c3929e14-b372-4f0c-946f-401c439be98f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:30.923835 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c3929e14-b372-4f0c-946f-401c439be98f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:30.924592 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c3929e14-b372-4f0c-946f-401c439be98f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:30.925023 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c3929e14-b372-4f0c-946f-401c439be98f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:30.989324 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-c3929e14-b372-4f0c-946f-401c439be98f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:31.002660 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-c3929e14-b372-4f0c-946f-401c439be98f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.096146 Jun 17 13:26:31.003411 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1242/2449] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:30 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:31.328979 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-75b89d1e-e0b9-4c05-8720-ba02287e9153 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:31.329762 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-75b89d1e-e0b9-4c05-8720-ba02287e9153 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:31.338478 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-75b89d1e-e0b9-4c05-8720-ba02287e9153 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:31.339043 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-75b89d1e-e0b9-4c05-8720-ba02287e9153 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:31.340069 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-75b89d1e-e0b9-4c05-8720-ba02287e9153 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:31.340606 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-75b89d1e-e0b9-4c05-8720-ba02287e9153 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:31.477462 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-75b89d1e-e0b9-4c05-8720-ba02287e9153 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:31.486073 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-75b89d1e-e0b9-4c05-8720-ba02287e9153 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.162290 Jun 17 13:26:31.486728 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1208/2450] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:31 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:31.703394 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-3fe16a11-0d86-4676-8388-7afd878b3b47 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:31.704721 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-3fe16a11-0d86-4676-8388-7afd878b3b47 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:31.711472 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-3fe16a11-0d86-4676-8388-7afd878b3b47 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:31.711941 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-3fe16a11-0d86-4676-8388-7afd878b3b47 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:31.712741 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-3fe16a11-0d86-4676-8388-7afd878b3b47 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:31.713196 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-3fe16a11-0d86-4676-8388-7afd878b3b47 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:31.778965 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-3fe16a11-0d86-4676-8388-7afd878b3b47 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:31.792629 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-3fe16a11-0d86-4676-8388-7afd878b3b47 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:31.794988 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-3fe16a11-0d86-4676-8388-7afd878b3b47 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:31.796789 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-3fe16a11-0d86-4676-8388-7afd878b3b47 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.099847 Jun 17 13:26:31.797735 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1243/2451] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:26:31 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:26:32.028553 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-29b2f838-6461-4ba4-90f5-9f3f21332ed6 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:32.029404 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-29b2f838-6461-4ba4-90f5-9f3f21332ed6 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:32.037337 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-29b2f838-6461-4ba4-90f5-9f3f21332ed6 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:32.037784 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-29b2f838-6461-4ba4-90f5-9f3f21332ed6 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:32.038577 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-29b2f838-6461-4ba4-90f5-9f3f21332ed6 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:32.039006 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-29b2f838-6461-4ba4-90f5-9f3f21332ed6 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:32.106107 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-29b2f838-6461-4ba4-90f5-9f3f21332ed6 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:32.114525 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-29b2f838-6461-4ba4-90f5-9f3f21332ed6 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.092475 Jun 17 13:26:32.115106 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1209/2452] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:32 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:32.509941 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-571e514b-38a6-40ea-b38a-15e646a857af tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:32.511005 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-571e514b-38a6-40ea-b38a-15e646a857af tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:32.519847 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-571e514b-38a6-40ea-b38a-15e646a857af tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:32.520368 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-571e514b-38a6-40ea-b38a-15e646a857af tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:32.521199 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-571e514b-38a6-40ea-b38a-15e646a857af tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:32.521707 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-571e514b-38a6-40ea-b38a-15e646a857af tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:32.656039 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-571e514b-38a6-40ea-b38a-15e646a857af tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:32.665278 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-571e514b-38a6-40ea-b38a-15e646a857af tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.161757 Jun 17 13:26:32.665828 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1244/2453] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:32 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:32.822614 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-05641d03-0144-4d01-908d-be38e291c18a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:32.823645 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-05641d03-0144-4d01-908d-be38e291c18a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:32.835112 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-05641d03-0144-4d01-908d-be38e291c18a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:32.835863 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-05641d03-0144-4d01-908d-be38e291c18a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:32.837740 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-05641d03-0144-4d01-908d-be38e291c18a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:32.838575 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-05641d03-0144-4d01-908d-be38e291c18a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:32.903848 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-05641d03-0144-4d01-908d-be38e291c18a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:32.912509 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-05641d03-0144-4d01-908d-be38e291c18a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:32.914007 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-05641d03-0144-4d01-908d-be38e291c18a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:32.915223 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-05641d03-0144-4d01-908d-be38e291c18a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.102391 Jun 17 13:26:32.915779 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1210/2454] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:26:32 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:26:33.135365 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-a967e076-777e-4dbc-bcbf-d5f013e727fd tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:33.136016 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-a967e076-777e-4dbc-bcbf-d5f013e727fd tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:33.143243 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a967e076-777e-4dbc-bcbf-d5f013e727fd tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:33.143687 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a967e076-777e-4dbc-bcbf-d5f013e727fd tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:33.144479 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a967e076-777e-4dbc-bcbf-d5f013e727fd tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:33.144904 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a967e076-777e-4dbc-bcbf-d5f013e727fd tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:33.220523 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-a967e076-777e-4dbc-bcbf-d5f013e727fd tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:33.228803 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-a967e076-777e-4dbc-bcbf-d5f013e727fd tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.097484 Jun 17 13:26:33.229695 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1245/2455] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:33 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:33.687956 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-a1925eae-5c23-442a-bb1c-4655950efea3 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:33.688692 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-a1925eae-5c23-442a-bb1c-4655950efea3 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:33.695815 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a1925eae-5c23-442a-bb1c-4655950efea3 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:33.696257 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a1925eae-5c23-442a-bb1c-4655950efea3 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:33.697003 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a1925eae-5c23-442a-bb1c-4655950efea3 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:33.697430 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a1925eae-5c23-442a-bb1c-4655950efea3 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:33.835776 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-a1925eae-5c23-442a-bb1c-4655950efea3 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:33.844692 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-a1925eae-5c23-442a-bb1c-4655950efea3 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.160608 Jun 17 13:26:33.845346 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1211/2456] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:33 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:33.933889 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-8a61f81f-3088-4e2f-95e2-45fced1b7137 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:33.934525 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-8a61f81f-3088-4e2f-95e2-45fced1b7137 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:33.941255 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8a61f81f-3088-4e2f-95e2-45fced1b7137 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:33.941705 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8a61f81f-3088-4e2f-95e2-45fced1b7137 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:33.942499 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8a61f81f-3088-4e2f-95e2-45fced1b7137 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:33.942933 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8a61f81f-3088-4e2f-95e2-45fced1b7137 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:34.008715 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-8a61f81f-3088-4e2f-95e2-45fced1b7137 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:34.017239 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-8a61f81f-3088-4e2f-95e2-45fced1b7137 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:34.018765 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-8a61f81f-3088-4e2f-95e2-45fced1b7137 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:34.019900 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-8a61f81f-3088-4e2f-95e2-45fced1b7137 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.090090 Jun 17 13:26:34.020458 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1246/2457] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:26:33 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:26:34.251424 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-3c32a07e-19ba-460f-816e-8e9d211f654f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:34.252160 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-3c32a07e-19ba-460f-816e-8e9d211f654f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:34.258906 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3c32a07e-19ba-460f-816e-8e9d211f654f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:34.259355 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3c32a07e-19ba-460f-816e-8e9d211f654f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:34.260112 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3c32a07e-19ba-460f-816e-8e9d211f654f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:34.260538 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3c32a07e-19ba-460f-816e-8e9d211f654f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:34.324972 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-3c32a07e-19ba-460f-816e-8e9d211f654f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:34.337609 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-3c32a07e-19ba-460f-816e-8e9d211f654f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.092411 Jun 17 13:26:34.338499 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1212/2458] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:34 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:34.862718 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-005b18a1-0201-43c1-b5f1-43f9cabc8257 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:34.863467 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-005b18a1-0201-43c1-b5f1-43f9cabc8257 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:34.871676 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-005b18a1-0201-43c1-b5f1-43f9cabc8257 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:34.872194 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-005b18a1-0201-43c1-b5f1-43f9cabc8257 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:34.873091 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-005b18a1-0201-43c1-b5f1-43f9cabc8257 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:34.873598 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-005b18a1-0201-43c1-b5f1-43f9cabc8257 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:35.009696 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-005b18a1-0201-43c1-b5f1-43f9cabc8257 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:35.019436 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-005b18a1-0201-43c1-b5f1-43f9cabc8257 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.161547 Jun 17 13:26:35.020052 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1247/2459] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:34 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:35.038325 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-d6013be7-b5bb-4c21-a2e3-2d9ccdbdd874 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:35.038889 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-d6013be7-b5bb-4c21-a2e3-2d9ccdbdd874 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:35.045494 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d6013be7-b5bb-4c21-a2e3-2d9ccdbdd874 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:35.045933 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d6013be7-b5bb-4c21-a2e3-2d9ccdbdd874 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:35.046710 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d6013be7-b5bb-4c21-a2e3-2d9ccdbdd874 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:35.047139 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d6013be7-b5bb-4c21-a2e3-2d9ccdbdd874 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:35.115697 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-d6013be7-b5bb-4c21-a2e3-2d9ccdbdd874 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:35.124685 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-d6013be7-b5bb-4c21-a2e3-2d9ccdbdd874 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:35.126258 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-d6013be7-b5bb-4c21-a2e3-2d9ccdbdd874 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:35.127401 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-d6013be7-b5bb-4c21-a2e3-2d9ccdbdd874 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.093049 Jun 17 13:26:35.127959 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1213/2460] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:26:35 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:26:35.358803 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-16d9c850-85ca-4ccd-94c9-8e379111d892 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:35.359409 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-16d9c850-85ca-4ccd-94c9-8e379111d892 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:35.365918 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-16d9c850-85ca-4ccd-94c9-8e379111d892 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:35.366329 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-16d9c850-85ca-4ccd-94c9-8e379111d892 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:35.367069 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-16d9c850-85ca-4ccd-94c9-8e379111d892 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:35.367490 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-16d9c850-85ca-4ccd-94c9-8e379111d892 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:35.430594 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-16d9c850-85ca-4ccd-94c9-8e379111d892 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:35.439706 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-16d9c850-85ca-4ccd-94c9-8e379111d892 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.085059 Jun 17 13:26:35.440318 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1248/2461] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:35 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:36.040045 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-c14ca80f-c708-44cc-818d-f32ee0ab4d6e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:36.041008 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-c14ca80f-c708-44cc-818d-f32ee0ab4d6e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:36.051093 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c14ca80f-c708-44cc-818d-f32ee0ab4d6e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:36.051538 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c14ca80f-c708-44cc-818d-f32ee0ab4d6e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:36.052285 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c14ca80f-c708-44cc-818d-f32ee0ab4d6e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:36.052710 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c14ca80f-c708-44cc-818d-f32ee0ab4d6e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:36.145690 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-5aeaca5f-2669-40b8-847a-3b5c34810a0c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:36.146338 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-5aeaca5f-2669-40b8-847a-3b5c34810a0c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:36.153375 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-5aeaca5f-2669-40b8-847a-3b5c34810a0c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:36.153746 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-5aeaca5f-2669-40b8-847a-3b5c34810a0c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:36.154532 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-5aeaca5f-2669-40b8-847a-3b5c34810a0c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:36.154973 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-5aeaca5f-2669-40b8-847a-3b5c34810a0c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:36.205558 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-c14ca80f-c708-44cc-818d-f32ee0ab4d6e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:36.215267 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-c14ca80f-c708-44cc-818d-f32ee0ab4d6e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.181859 Jun 17 13:26:36.215820 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1214/2462] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:36 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:36.223130 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-5aeaca5f-2669-40b8-847a-3b5c34810a0c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:36.232037 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-5aeaca5f-2669-40b8-847a-3b5c34810a0c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:36.233520 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-5aeaca5f-2669-40b8-847a-3b5c34810a0c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:36.234706 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-5aeaca5f-2669-40b8-847a-3b5c34810a0c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.093587 Jun 17 13:26:36.235268 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1249/2463] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:26:36 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 13:26:36.462275 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-db3c4a90-821e-4e11-b69d-e06a556bbc1d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:36.463159 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-db3c4a90-821e-4e11-b69d-e06a556bbc1d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:36.472400 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-db3c4a90-821e-4e11-b69d-e06a556bbc1d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:36.472852 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-db3c4a90-821e-4e11-b69d-e06a556bbc1d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:36.473613 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-db3c4a90-821e-4e11-b69d-e06a556bbc1d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:36.474039 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-db3c4a90-821e-4e11-b69d-e06a556bbc1d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:36.548044 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-db3c4a90-821e-4e11-b69d-e06a556bbc1d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:36.560809 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-db3c4a90-821e-4e11-b69d-e06a556bbc1d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.106214 Jun 17 13:26:36.561643 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1215/2464] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:36 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:37.236281 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-1f0e6322-209b-4267-a27b-1e2f8a79da33 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:37.237640 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-1f0e6322-209b-4267-a27b-1e2f8a79da33 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:37.248326 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-1f0e6322-209b-4267-a27b-1e2f8a79da33 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:37.248900 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-1f0e6322-209b-4267-a27b-1e2f8a79da33 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:37.250081 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-1f0e6322-209b-4267-a27b-1e2f8a79da33 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:37.250789 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-1f0e6322-209b-4267-a27b-1e2f8a79da33 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:37.254946 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-7fa26f06-bdf1-4552-be64-ea2bde16e52a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:37.255623 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-7fa26f06-bdf1-4552-be64-ea2bde16e52a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:37.262521 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7fa26f06-bdf1-4552-be64-ea2bde16e52a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:37.262976 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7fa26f06-bdf1-4552-be64-ea2bde16e52a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:37.263748 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7fa26f06-bdf1-4552-be64-ea2bde16e52a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:37.264186 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7fa26f06-bdf1-4552-be64-ea2bde16e52a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:37.344021 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-7fa26f06-bdf1-4552-be64-ea2bde16e52a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:37.353039 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-7fa26f06-bdf1-4552-be64-ea2bde16e52a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:37.356620 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-7fa26f06-bdf1-4552-be64-ea2bde16e52a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:37.357757 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-7fa26f06-bdf1-4552-be64-ea2bde16e52a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.107620 Jun 17 13:26:37.358496 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1216/2465] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:26:37 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:26:37.409368 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-1f0e6322-209b-4267-a27b-1e2f8a79da33 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:37.418020 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-1f0e6322-209b-4267-a27b-1e2f8a79da33 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.187876 Jun 17 13:26:37.418632 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1250/2466] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:37 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:37.583355 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-dcba0571-8679-43d1-b17d-909602381e20 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:37.584132 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-dcba0571-8679-43d1-b17d-909602381e20 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:37.594020 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dcba0571-8679-43d1-b17d-909602381e20 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:37.594733 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dcba0571-8679-43d1-b17d-909602381e20 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:37.596057 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dcba0571-8679-43d1-b17d-909602381e20 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:37.596423 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dcba0571-8679-43d1-b17d-909602381e20 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:37.664685 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-dcba0571-8679-43d1-b17d-909602381e20 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:37.672985 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-dcba0571-8679-43d1-b17d-909602381e20 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.096327 Jun 17 13:26:37.673593 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1217/2467] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:37 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:38.381076 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-3dadf729-9864-4aa3-ad6d-39f65ab496ca tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:38.382129 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-3dadf729-9864-4aa3-ad6d-39f65ab496ca tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:38.393128 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-3dadf729-9864-4aa3-ad6d-39f65ab496ca tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:38.393589 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-3dadf729-9864-4aa3-ad6d-39f65ab496ca tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:38.394432 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-3dadf729-9864-4aa3-ad6d-39f65ab496ca tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:38.394869 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-3dadf729-9864-4aa3-ad6d-39f65ab496ca tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:38.399030 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_cell1:SELECT=100 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:26:38.435446 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-02792dbd-5bcf-4a20-8402-78be9803ec4a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:38.436080 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-02792dbd-5bcf-4a20-8402-78be9803ec4a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:38.442717 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-02792dbd-5bcf-4a20-8402-78be9803ec4a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:38.443172 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-02792dbd-5bcf-4a20-8402-78be9803ec4a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:38.443934 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-02792dbd-5bcf-4a20-8402-78be9803ec4a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:38.444360 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-02792dbd-5bcf-4a20-8402-78be9803ec4a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:38.457023 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-3dadf729-9864-4aa3-ad6d-39f65ab496ca tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:38.465667 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-3dadf729-9864-4aa3-ad6d-39f65ab496ca tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:38.467107 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-3dadf729-9864-4aa3-ad6d-39f65ab496ca tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:38.468240 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-3dadf729-9864-4aa3-ad6d-39f65ab496ca tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.093862 Jun 17 13:26:38.468809 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1251/2468] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:26:38 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:26:38.577592 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-02792dbd-5bcf-4a20-8402-78be9803ec4a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:38.589401 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-02792dbd-5bcf-4a20-8402-78be9803ec4a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.157723 Jun 17 13:26:38.590289 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1218/2469] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:38 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:38.699058 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-99fc62b6-7bcb-4c7e-980d-a58c8f620cc8 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:38.700066 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-99fc62b6-7bcb-4c7e-980d-a58c8f620cc8 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:38.710877 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-99fc62b6-7bcb-4c7e-980d-a58c8f620cc8 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:38.711629 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-99fc62b6-7bcb-4c7e-980d-a58c8f620cc8 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:38.712897 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-99fc62b6-7bcb-4c7e-980d-a58c8f620cc8 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:38.713626 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-99fc62b6-7bcb-4c7e-980d-a58c8f620cc8 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:38.780100 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-99fc62b6-7bcb-4c7e-980d-a58c8f620cc8 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:38.788986 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-99fc62b6-7bcb-4c7e-980d-a58c8f620cc8 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.096518 Jun 17 13:26:38.789569 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1252/2470] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:38 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:39.491182 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-8761d1c4-338b-4894-b20b-a0d66284eebe tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:39.492203 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-8761d1c4-338b-4894-b20b-a0d66284eebe tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:39.502808 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8761d1c4-338b-4894-b20b-a0d66284eebe tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:39.503260 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8761d1c4-338b-4894-b20b-a0d66284eebe tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:39.504019 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8761d1c4-338b-4894-b20b-a0d66284eebe tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:39.504448 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8761d1c4-338b-4894-b20b-a0d66284eebe tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:39.576907 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-8761d1c4-338b-4894-b20b-a0d66284eebe tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:39.585778 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-8761d1c4-338b-4894-b20b-a0d66284eebe tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:39.587317 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-8761d1c4-338b-4894-b20b-a0d66284eebe tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:39.588477 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-8761d1c4-338b-4894-b20b-a0d66284eebe tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.104037 Jun 17 13:26:39.589041 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1219/2471] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:26:39 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:26:39.609377 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-d6804d49-573b-41cd-b82f-f238f0d7b956 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:39.609957 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-d6804d49-573b-41cd-b82f-f238f0d7b956 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:39.617094 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d6804d49-573b-41cd-b82f-f238f0d7b956 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:39.617544 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d6804d49-573b-41cd-b82f-f238f0d7b956 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:39.618330 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d6804d49-573b-41cd-b82f-f238f0d7b956 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:39.618774 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d6804d49-573b-41cd-b82f-f238f0d7b956 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:39.776756 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-d6804d49-573b-41cd-b82f-f238f0d7b956 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:39.785510 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-d6804d49-573b-41cd-b82f-f238f0d7b956 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.180049 Jun 17 13:26:39.786194 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1253/2472] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:39 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 13:26:39.806865 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-06ca661c-45ac-4065-9a24-47e5baebe58f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:39.807477 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-06ca661c-45ac-4065-9a24-47e5baebe58f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:39.813980 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-06ca661c-45ac-4065-9a24-47e5baebe58f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:39.814468 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-06ca661c-45ac-4065-9a24-47e5baebe58f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:39.815270 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-06ca661c-45ac-4065-9a24-47e5baebe58f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:39.815703 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-06ca661c-45ac-4065-9a24-47e5baebe58f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:39.881979 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-06ca661c-45ac-4065-9a24-47e5baebe58f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:39.890148 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-06ca661c-45ac-4065-9a24-47e5baebe58f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.087237 Jun 17 13:26:39.890731 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1220/2473] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:39 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:40.611653 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-f8903566-ed6b-49a2-b726-93f20a66cc5c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:40.612237 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-f8903566-ed6b-49a2-b726-93f20a66cc5c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:40.619188 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f8903566-ed6b-49a2-b726-93f20a66cc5c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:40.619661 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f8903566-ed6b-49a2-b726-93f20a66cc5c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:40.620410 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f8903566-ed6b-49a2-b726-93f20a66cc5c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:40.620834 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f8903566-ed6b-49a2-b726-93f20a66cc5c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:40.683860 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-f8903566-ed6b-49a2-b726-93f20a66cc5c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:40.692932 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-f8903566-ed6b-49a2-b726-93f20a66cc5c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:40.694444 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-f8903566-ed6b-49a2-b726-93f20a66cc5c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:40.695613 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-f8903566-ed6b-49a2-b726-93f20a66cc5c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.090513 Jun 17 13:26:40.696167 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1254/2474] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:26:40 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:26:40.807036 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-ed5f3b5f-8433-4757-b6f7-c187dcd5e4ee tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:40.807959 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-ed5f3b5f-8433-4757-b6f7-c187dcd5e4ee tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:40.817467 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ed5f3b5f-8433-4757-b6f7-c187dcd5e4ee tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:40.817913 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ed5f3b5f-8433-4757-b6f7-c187dcd5e4ee tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:40.818689 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ed5f3b5f-8433-4757-b6f7-c187dcd5e4ee tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:40.819115 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ed5f3b5f-8433-4757-b6f7-c187dcd5e4ee tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:40.906427 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-2ee24bd4-1aa0-4bd9-9605-82aeba79f8e4 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:40.907038 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-2ee24bd4-1aa0-4bd9-9605-82aeba79f8e4 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:40.913577 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2ee24bd4-1aa0-4bd9-9605-82aeba79f8e4 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:40.914015 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2ee24bd4-1aa0-4bd9-9605-82aeba79f8e4 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:40.914805 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2ee24bd4-1aa0-4bd9-9605-82aeba79f8e4 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:40.915235 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2ee24bd4-1aa0-4bd9-9605-82aeba79f8e4 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:40.967913 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-ed5f3b5f-8433-4757-b6f7-c187dcd5e4ee tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:40.976274 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-ed5f3b5f-8433-4757-b6f7-c187dcd5e4ee tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.175704 Jun 17 13:26:40.976919 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1221/2475] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:40 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:40.984311 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-2ee24bd4-1aa0-4bd9-9605-82aeba79f8e4 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:40.992385 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-2ee24bd4-1aa0-4bd9-9605-82aeba79f8e4 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.090037 Jun 17 13:26:40.992949 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1255/2476] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:40 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 13:26:41.718019 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-0400a2ce-9d33-4da2-b03f-a7929b9d9363 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:41.719067 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-0400a2ce-9d33-4da2-b03f-a7929b9d9363 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:41.727078 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0400a2ce-9d33-4da2-b03f-a7929b9d9363 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:41.727602 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0400a2ce-9d33-4da2-b03f-a7929b9d9363 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:41.728487 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0400a2ce-9d33-4da2-b03f-a7929b9d9363 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:41.728994 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0400a2ce-9d33-4da2-b03f-a7929b9d9363 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:41.794783 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-0400a2ce-9d33-4da2-b03f-a7929b9d9363 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:41.803655 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-0400a2ce-9d33-4da2-b03f-a7929b9d9363 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:41.805140 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-0400a2ce-9d33-4da2-b03f-a7929b9d9363 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:41.806307 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-0400a2ce-9d33-4da2-b03f-a7929b9d9363 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.094927 Jun 17 13:26:41.806868 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1222/2477] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:26:41 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:26:41.998206 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-1f6870e9-7fbf-430b-bd92-b4a5db2d478c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:41.999145 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-1f6870e9-7fbf-430b-bd92-b4a5db2d478c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:42.010298 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-1f6870e9-7fbf-430b-bd92-b4a5db2d478c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:42.011044 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-1f6870e9-7fbf-430b-bd92-b4a5db2d478c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:42.012291 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-1f6870e9-7fbf-430b-bd92-b4a5db2d478c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:42.012804 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-311fa845-5d7d-4836-aff1-7f2d93be3d33 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:42.013550 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-1f6870e9-7fbf-430b-bd92-b4a5db2d478c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:42.013871 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-311fa845-5d7d-4836-aff1-7f2d93be3d33 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:42.022580 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-311fa845-5d7d-4836-aff1-7f2d93be3d33 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:42.023032 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-311fa845-5d7d-4836-aff1-7f2d93be3d33 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:42.023806 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-311fa845-5d7d-4836-aff1-7f2d93be3d33 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:42.024243 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-311fa845-5d7d-4836-aff1-7f2d93be3d33 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:42.102974 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-311fa845-5d7d-4836-aff1-7f2d93be3d33 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:42.112128 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-311fa845-5d7d-4836-aff1-7f2d93be3d33 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.105254 Jun 17 13:26:42.112709 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1223/2478] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:42 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:42.172972 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-1f6870e9-7fbf-430b-bd92-b4a5db2d478c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:42.181587 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-1f6870e9-7fbf-430b-bd92-b4a5db2d478c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.190030 Jun 17 13:26:42.182191 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1256/2479] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:41 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:42.828889 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-bbc9d9e9-60ea-4f35-85b4-23a8d5123928 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:42.829893 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-bbc9d9e9-60ea-4f35-85b4-23a8d5123928 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:42.837728 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bbc9d9e9-60ea-4f35-85b4-23a8d5123928 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:42.838214 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bbc9d9e9-60ea-4f35-85b4-23a8d5123928 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:42.838971 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bbc9d9e9-60ea-4f35-85b4-23a8d5123928 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:42.839405 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bbc9d9e9-60ea-4f35-85b4-23a8d5123928 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:42.859094 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=100 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:26:42.903546 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-bbc9d9e9-60ea-4f35-85b4-23a8d5123928 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:42.912314 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-bbc9d9e9-60ea-4f35-85b4-23a8d5123928 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:42.913790 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-bbc9d9e9-60ea-4f35-85b4-23a8d5123928 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:42.914947 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-bbc9d9e9-60ea-4f35-85b4-23a8d5123928 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.092740 Jun 17 13:26:42.915481 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1224/2480] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:26:42 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:26:43.129247 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-18faf355-fd3b-4a0e-a9c5-6a019a9765bc tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:43.129867 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-18faf355-fd3b-4a0e-a9c5-6a019a9765bc tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:43.136936 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-18faf355-fd3b-4a0e-a9c5-6a019a9765bc tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:43.137391 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-18faf355-fd3b-4a0e-a9c5-6a019a9765bc tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:43.138140 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-18faf355-fd3b-4a0e-a9c5-6a019a9765bc tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:43.138606 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-18faf355-fd3b-4a0e-a9c5-6a019a9765bc tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:43.198846 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-f8505087-44fa-477a-b444-db479d850411 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:43.199376 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-f8505087-44fa-477a-b444-db479d850411 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:43.201497 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-18faf355-fd3b-4a0e-a9c5-6a019a9765bc tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:43.207877 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f8505087-44fa-477a-b444-db479d850411 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:43.208352 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f8505087-44fa-477a-b444-db479d850411 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:43.209482 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f8505087-44fa-477a-b444-db479d850411 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:43.209917 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f8505087-44fa-477a-b444-db479d850411 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:43.212114 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-18faf355-fd3b-4a0e-a9c5-6a019a9765bc tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.086806 Jun 17 13:26:43.212749 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1257/2481] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:43 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:43.344991 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-f8505087-44fa-477a-b444-db479d850411 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:43.353755 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-f8505087-44fa-477a-b444-db479d850411 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.158934 Jun 17 13:26:43.354657 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1225/2482] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:43 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:43.936551 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-2842fe50-ad2a-49e6-ac3e-5f64f727cf17 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:43.937553 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-2842fe50-ad2a-49e6-ac3e-5f64f727cf17 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:43.946129 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2842fe50-ad2a-49e6-ac3e-5f64f727cf17 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:43.946592 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2842fe50-ad2a-49e6-ac3e-5f64f727cf17 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:43.947349 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2842fe50-ad2a-49e6-ac3e-5f64f727cf17 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:43.947786 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2842fe50-ad2a-49e6-ac3e-5f64f727cf17 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:44.016006 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-2842fe50-ad2a-49e6-ac3e-5f64f727cf17 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:44.030176 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-2842fe50-ad2a-49e6-ac3e-5f64f727cf17 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:44.032652 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-2842fe50-ad2a-49e6-ac3e-5f64f727cf17 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:44.034433 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-2842fe50-ad2a-49e6-ac3e-5f64f727cf17 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.103555 Jun 17 13:26:44.035230 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1258/2483] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:26:43 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:26:44.233285 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-c0b197ef-e388-4f34-8468-2e350f395d06 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:44.234427 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-c0b197ef-e388-4f34-8468-2e350f395d06 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:44.242733 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c0b197ef-e388-4f34-8468-2e350f395d06 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:44.243179 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c0b197ef-e388-4f34-8468-2e350f395d06 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:44.243938 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c0b197ef-e388-4f34-8468-2e350f395d06 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:44.244367 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c0b197ef-e388-4f34-8468-2e350f395d06 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:44.318802 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-c0b197ef-e388-4f34-8468-2e350f395d06 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:44.332061 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-c0b197ef-e388-4f34-8468-2e350f395d06 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.105433 Jun 17 13:26:44.332732 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1226/2484] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:44 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:44.371824 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-8d183f1c-53fc-4015-a84f-8869b7c960df tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:44.372493 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-8d183f1c-53fc-4015-a84f-8869b7c960df tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:44.379419 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8d183f1c-53fc-4015-a84f-8869b7c960df tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:44.379867 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8d183f1c-53fc-4015-a84f-8869b7c960df tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:44.380624 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8d183f1c-53fc-4015-a84f-8869b7c960df tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:44.381059 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8d183f1c-53fc-4015-a84f-8869b7c960df tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:44.518565 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-8d183f1c-53fc-4015-a84f-8869b7c960df tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:44.531002 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-8d183f1c-53fc-4015-a84f-8869b7c960df tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.162739 Jun 17 13:26:44.531832 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1259/2485] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:44 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:45.057509 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-ffc9e76e-51c4-482d-ad7a-a673c992808a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:45.058646 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-ffc9e76e-51c4-482d-ad7a-a673c992808a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:45.061549 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_api:SELECT=90,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:26:45.071833 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ffc9e76e-51c4-482d-ad7a-a673c992808a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:45.072648 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ffc9e76e-51c4-482d-ad7a-a673c992808a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:45.073891 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ffc9e76e-51c4-482d-ad7a-a673c992808a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:45.074660 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ffc9e76e-51c4-482d-ad7a-a673c992808a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:45.349446 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-2114365f-6b79-4825-85c5-af4a8d5efc33 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:45.350185 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-2114365f-6b79-4825-85c5-af4a8d5efc33 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:45.357089 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2114365f-6b79-4825-85c5-af4a8d5efc33 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:45.357614 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2114365f-6b79-4825-85c5-af4a8d5efc33 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:45.358418 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2114365f-6b79-4825-85c5-af4a8d5efc33 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:45.358848 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2114365f-6b79-4825-85c5-af4a8d5efc33 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:45.404099 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-ffc9e76e-51c4-482d-ad7a-a673c992808a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:45.412918 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-ffc9e76e-51c4-482d-ad7a-a673c992808a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:45.414421 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-ffc9e76e-51c4-482d-ad7a-a673c992808a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:45.415564 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-ffc9e76e-51c4-482d-ad7a-a673c992808a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.365313 Jun 17 13:26:45.416123 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1227/2486] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:26:45 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:26:45.430327 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-2114365f-6b79-4825-85c5-af4a8d5efc33 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:45.438453 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-2114365f-6b79-4825-85c5-af4a8d5efc33 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.093084 Jun 17 13:26:45.438980 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1260/2487] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:45 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:45.552712 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-c76bda73-65fe-4b0f-b15c-1b5d63d2bfdc tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:45.553759 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-c76bda73-65fe-4b0f-b15c-1b5d63d2bfdc tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:45.564021 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c76bda73-65fe-4b0f-b15c-1b5d63d2bfdc tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:45.564661 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c76bda73-65fe-4b0f-b15c-1b5d63d2bfdc tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:45.565912 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c76bda73-65fe-4b0f-b15c-1b5d63d2bfdc tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:45.567112 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c76bda73-65fe-4b0f-b15c-1b5d63d2bfdc tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:45.703197 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-c76bda73-65fe-4b0f-b15c-1b5d63d2bfdc tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:45.711443 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-c76bda73-65fe-4b0f-b15c-1b5d63d2bfdc tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.165449 Jun 17 13:26:45.712047 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1228/2488] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:45 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:46.439470 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-d7348f75-d5d3-4af2-b659-958c3d66a239 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:46.440467 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-d7348f75-d5d3-4af2-b659-958c3d66a239 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:46.451546 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d7348f75-d5d3-4af2-b659-958c3d66a239 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:46.452292 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d7348f75-d5d3-4af2-b659-958c3d66a239 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:46.453605 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d7348f75-d5d3-4af2-b659-958c3d66a239 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:46.454367 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d7348f75-d5d3-4af2-b659-958c3d66a239 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:46.458710 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-acf87e87-a6dd-481c-8714-0065e40aec07 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:46.459860 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-acf87e87-a6dd-481c-8714-0065e40aec07 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:46.466125 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-acf87e87-a6dd-481c-8714-0065e40aec07 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:46.466574 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-acf87e87-a6dd-481c-8714-0065e40aec07 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:46.467326 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-acf87e87-a6dd-481c-8714-0065e40aec07 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:46.467750 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-acf87e87-a6dd-481c-8714-0065e40aec07 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:46.529506 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-d7348f75-d5d3-4af2-b659-958c3d66a239 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:46.538598 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-d7348f75-d5d3-4af2-b659-958c3d66a239 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:46.540128 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-d7348f75-d5d3-4af2-b659-958c3d66a239 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:46.541283 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-d7348f75-d5d3-4af2-b659-958c3d66a239 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.108687 Jun 17 13:26:46.541851 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1261/2489] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:26:46 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:26:46.546322 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-acf87e87-a6dd-481c-8714-0065e40aec07 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:46.554670 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-acf87e87-a6dd-481c-8714-0065e40aec07 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.101735 Jun 17 13:26:46.555208 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1229/2490] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:46 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:46.734155 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-b08d7e85-4ab6-45c9-aa7c-bb78e68824a0 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:46.735019 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-b08d7e85-4ab6-45c9-aa7c-bb78e68824a0 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:46.743607 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b08d7e85-4ab6-45c9-aa7c-bb78e68824a0 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:46.744214 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b08d7e85-4ab6-45c9-aa7c-bb78e68824a0 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:46.745236 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b08d7e85-4ab6-45c9-aa7c-bb78e68824a0 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:46.745832 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b08d7e85-4ab6-45c9-aa7c-bb78e68824a0 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:46.879478 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-b08d7e85-4ab6-45c9-aa7c-bb78e68824a0 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:46.887900 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-b08d7e85-4ab6-45c9-aa7c-bb78e68824a0 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.159271 Jun 17 13:26:46.888474 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1262/2491] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:46 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:47.564511 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-7e25f280-4929-492e-b58f-37e2f9e767d3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:47.565396 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-7e25f280-4929-492e-b58f-37e2f9e767d3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:47.572888 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-6a440770-984f-4301-8234-064df6a27eed tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:47.573413 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7e25f280-4929-492e-b58f-37e2f9e767d3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:47.573548 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-6a440770-984f-4301-8234-064df6a27eed tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:47.573664 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7e25f280-4929-492e-b58f-37e2f9e767d3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:47.574446 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7e25f280-4929-492e-b58f-37e2f9e767d3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:47.574877 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7e25f280-4929-492e-b58f-37e2f9e767d3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:47.580234 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6a440770-984f-4301-8234-064df6a27eed tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:47.580757 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6a440770-984f-4301-8234-064df6a27eed tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:47.581622 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6a440770-984f-4301-8234-064df6a27eed tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:47.582822 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6a440770-984f-4301-8234-064df6a27eed tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:47.648914 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-7e25f280-4929-492e-b58f-37e2f9e767d3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:47.657664 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-7e25f280-4929-492e-b58f-37e2f9e767d3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:47.659175 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-7e25f280-4929-492e-b58f-37e2f9e767d3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:47.660400 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-7e25f280-4929-492e-b58f-37e2f9e767d3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.102760 Jun 17 13:26:47.661061 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1230/2492] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:26:47 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:26:47.664610 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-6a440770-984f-4301-8234-064df6a27eed tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:47.673539 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-6a440770-984f-4301-8234-064df6a27eed tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.104694 Jun 17 13:26:47.674347 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1263/2493] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:47 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:47.908670 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-b9a6f40d-654d-404b-bc7a-ea435ffbdbfe tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:47.909913 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-b9a6f40d-654d-404b-bc7a-ea435ffbdbfe tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:47.920264 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b9a6f40d-654d-404b-bc7a-ea435ffbdbfe tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:47.921021 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b9a6f40d-654d-404b-bc7a-ea435ffbdbfe tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:47.922326 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b9a6f40d-654d-404b-bc7a-ea435ffbdbfe tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:47.923046 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b9a6f40d-654d-404b-bc7a-ea435ffbdbfe tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:48.061003 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-b9a6f40d-654d-404b-bc7a-ea435ffbdbfe tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:48.069563 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-b9a6f40d-654d-404b-bc7a-ea435ffbdbfe tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.167378 Jun 17 13:26:48.070144 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1231/2494] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:47 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:48.681341 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-390ccf30-9d4c-449b-8dc4-c74909bb0a09 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:48.681990 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-390ccf30-9d4c-449b-8dc4-c74909bb0a09 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:48.690131 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-390ccf30-9d4c-449b-8dc4-c74909bb0a09 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:48.690612 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-8a101c40-949f-4686-8d92-fa2b3c335421 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:48.691114 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-390ccf30-9d4c-449b-8dc4-c74909bb0a09 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:48.691231 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-8a101c40-949f-4686-8d92-fa2b3c335421 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:48.691660 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-390ccf30-9d4c-449b-8dc4-c74909bb0a09 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:48.692123 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-390ccf30-9d4c-449b-8dc4-c74909bb0a09 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:48.698602 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8a101c40-949f-4686-8d92-fa2b3c335421 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:48.699074 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8a101c40-949f-4686-8d92-fa2b3c335421 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:48.699871 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8a101c40-949f-4686-8d92-fa2b3c335421 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:48.700298 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8a101c40-949f-4686-8d92-fa2b3c335421 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:48.762775 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-390ccf30-9d4c-449b-8dc4-c74909bb0a09 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:48.771855 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-390ccf30-9d4c-449b-8dc4-c74909bb0a09 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:48.773333 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-390ccf30-9d4c-449b-8dc4-c74909bb0a09 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:48.774499 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-390ccf30-9d4c-449b-8dc4-c74909bb0a09 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.097986 Jun 17 13:26:48.775299 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1264/2495] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:26:48 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:26:48.781709 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-8a101c40-949f-4686-8d92-fa2b3c335421 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:48.792687 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-8a101c40-949f-4686-8d92-fa2b3c335421 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.105852 Jun 17 13:26:48.793540 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1232/2496] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:48 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:49.095458 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-73952f31-cfd8-49cc-a4c1-539074634d01 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:49.096450 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-73952f31-cfd8-49cc-a4c1-539074634d01 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:49.104016 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-73952f31-cfd8-49cc-a4c1-539074634d01 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:49.104795 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-73952f31-cfd8-49cc-a4c1-539074634d01 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:49.105554 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-73952f31-cfd8-49cc-a4c1-539074634d01 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:49.105982 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-73952f31-cfd8-49cc-a4c1-539074634d01 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:49.248543 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-73952f31-cfd8-49cc-a4c1-539074634d01 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:49.257433 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-73952f31-cfd8-49cc-a4c1-539074634d01 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.168282 Jun 17 13:26:49.257938 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1265/2497] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:49 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:49.794827 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-f505ff8a-c0de-452d-9b15-6bac6e276d53 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:49.795625 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-f505ff8a-c0de-452d-9b15-6bac6e276d53 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:49.802859 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f505ff8a-c0de-452d-9b15-6bac6e276d53 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:49.803331 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f505ff8a-c0de-452d-9b15-6bac6e276d53 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:49.804160 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f505ff8a-c0de-452d-9b15-6bac6e276d53 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:49.804592 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f505ff8a-c0de-452d-9b15-6bac6e276d53 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:49.813833 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-01ba1c44-6e44-4f15-b3f0-a148675b91de tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:49.814521 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-01ba1c44-6e44-4f15-b3f0-a148675b91de tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:49.821412 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-01ba1c44-6e44-4f15-b3f0-a148675b91de tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:49.821856 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-01ba1c44-6e44-4f15-b3f0-a148675b91de tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:49.822644 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-01ba1c44-6e44-4f15-b3f0-a148675b91de tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:49.823070 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-01ba1c44-6e44-4f15-b3f0-a148675b91de tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:49.870500 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-f505ff8a-c0de-452d-9b15-6bac6e276d53 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:49.879501 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-f505ff8a-c0de-452d-9b15-6bac6e276d53 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:49.881209 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-f505ff8a-c0de-452d-9b15-6bac6e276d53 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:49.882383 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-f505ff8a-c0de-452d-9b15-6bac6e276d53 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.092906 Jun 17 13:26:49.882968 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1233/2498] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:26:49 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:26:49.897389 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-01ba1c44-6e44-4f15-b3f0-a148675b91de tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:49.905631 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-01ba1c44-6e44-4f15-b3f0-a148675b91de tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.096695 Jun 17 13:26:49.906197 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1266/2499] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:49 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 13:26:50.289019 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-6f5a0f9c-74f9-45fb-8852-39fbd2b9c1d7 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:50.290612 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-6f5a0f9c-74f9-45fb-8852-39fbd2b9c1d7 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:50.303576 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6f5a0f9c-74f9-45fb-8852-39fbd2b9c1d7 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:50.304239 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6f5a0f9c-74f9-45fb-8852-39fbd2b9c1d7 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:50.305400 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6f5a0f9c-74f9-45fb-8852-39fbd2b9c1d7 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:50.306070 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6f5a0f9c-74f9-45fb-8852-39fbd2b9c1d7 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:50.450787 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-6f5a0f9c-74f9-45fb-8852-39fbd2b9c1d7 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:50.459907 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-6f5a0f9c-74f9-45fb-8852-39fbd2b9c1d7 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.181268 Jun 17 13:26:50.460480 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1234/2500] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:50 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:50.905013 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-c3f265c5-788b-4b67-8d13-24b0537ab979 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:50.905953 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-c3f265c5-788b-4b67-8d13-24b0537ab979 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:50.917988 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c3f265c5-788b-4b67-8d13-24b0537ab979 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:50.918786 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c3f265c5-788b-4b67-8d13-24b0537ab979 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:50.920033 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c3f265c5-788b-4b67-8d13-24b0537ab979 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:50.920756 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c3f265c5-788b-4b67-8d13-24b0537ab979 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:50.926904 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-d97b7591-5d3e-4a86-a5aa-99e2f77127cb tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:50.927504 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-d97b7591-5d3e-4a86-a5aa-99e2f77127cb tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:50.933879 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d97b7591-5d3e-4a86-a5aa-99e2f77127cb tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:50.934364 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d97b7591-5d3e-4a86-a5aa-99e2f77127cb tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:50.935134 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d97b7591-5d3e-4a86-a5aa-99e2f77127cb tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:50.935575 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d97b7591-5d3e-4a86-a5aa-99e2f77127cb tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:51.004084 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-c3f265c5-788b-4b67-8d13-24b0537ab979 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:51.007621 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_cell1:SELECT=100 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:26:51.013116 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-c3f265c5-788b-4b67-8d13-24b0537ab979 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:51.014632 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-c3f265c5-788b-4b67-8d13-24b0537ab979 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:51.015857 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-c3f265c5-788b-4b67-8d13-24b0537ab979 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.117535 Jun 17 13:26:51.016415 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1267/2501] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:26:50 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:26:51.021747 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-d97b7591-5d3e-4a86-a5aa-99e2f77127cb tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:51.030223 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-d97b7591-5d3e-4a86-a5aa-99e2f77127cb tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.109725 Jun 17 13:26:51.030826 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1235/2502] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:50 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:51.480523 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-5c9eb507-9045-4ce5-b33a-58cd951e3ad4 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:51.481329 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-5c9eb507-9045-4ce5-b33a-58cd951e3ad4 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:51.490013 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-5c9eb507-9045-4ce5-b33a-58cd951e3ad4 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:51.490652 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-5c9eb507-9045-4ce5-b33a-58cd951e3ad4 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:51.491658 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-5c9eb507-9045-4ce5-b33a-58cd951e3ad4 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:51.492246 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-5c9eb507-9045-4ce5-b33a-58cd951e3ad4 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:51.634788 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-5c9eb507-9045-4ce5-b33a-58cd951e3ad4 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:51.642864 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-5c9eb507-9045-4ce5-b33a-58cd951e3ad4 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.168354 Jun 17 13:26:51.643437 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1268/2503] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:51 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 13:26:52.039185 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-0f274a27-670a-47e7-bf4b-f917e2331953 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:52.040240 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-0f274a27-670a-47e7-bf4b-f917e2331953 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:52.051269 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-208b47b2-e21a-48e4-a132-645efa22f81c tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:52.052075 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0f274a27-670a-47e7-bf4b-f917e2331953 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:52.052448 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0f274a27-670a-47e7-bf4b-f917e2331953 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:52.052743 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-208b47b2-e21a-48e4-a132-645efa22f81c tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:52.053709 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0f274a27-670a-47e7-bf4b-f917e2331953 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:52.054484 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0f274a27-670a-47e7-bf4b-f917e2331953 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:52.062840 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-208b47b2-e21a-48e4-a132-645efa22f81c tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:52.063630 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-208b47b2-e21a-48e4-a132-645efa22f81c tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:52.064875 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-208b47b2-e21a-48e4-a132-645efa22f81c tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:52.065592 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-208b47b2-e21a-48e4-a132-645efa22f81c tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:52.127928 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-0f274a27-670a-47e7-bf4b-f917e2331953 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:52.136627 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-0f274a27-670a-47e7-bf4b-f917e2331953 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:52.138132 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-0f274a27-670a-47e7-bf4b-f917e2331953 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:52.139300 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-0f274a27-670a-47e7-bf4b-f917e2331953 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.106921 Jun 17 13:26:52.139872 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1236/2504] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:26:52 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:26:52.144437 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-208b47b2-e21a-48e4-a132-645efa22f81c tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:52.155022 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-208b47b2-e21a-48e4-a132-645efa22f81c tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.109901 Jun 17 13:26:52.155721 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1269/2505] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:52 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:52.665287 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-a5143760-849c-46e0-9725-8656692ef2f2 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:52.666304 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-a5143760-849c-46e0-9725-8656692ef2f2 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:52.675908 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a5143760-849c-46e0-9725-8656692ef2f2 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:52.677246 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a5143760-849c-46e0-9725-8656692ef2f2 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:52.678016 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a5143760-849c-46e0-9725-8656692ef2f2 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:52.678486 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a5143760-849c-46e0-9725-8656692ef2f2 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:52.816473 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-a5143760-849c-46e0-9725-8656692ef2f2 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:52.825327 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-a5143760-849c-46e0-9725-8656692ef2f2 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.167360 Jun 17 13:26:52.825929 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1237/2506] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:52 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:53.157099 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-f74b549b-6f14-4d52-a064-594f95eb54f8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:53.157700 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-f74b549b-6f14-4d52-a064-594f95eb54f8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:53.160056 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_api:SELECT=78 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:26:53.165732 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f74b549b-6f14-4d52-a064-594f95eb54f8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:53.166234 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f74b549b-6f14-4d52-a064-594f95eb54f8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:53.166984 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f74b549b-6f14-4d52-a064-594f95eb54f8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:53.167414 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f74b549b-6f14-4d52-a064-594f95eb54f8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:53.172776 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-fb2851eb-1d5f-46b8-9799-3d46a4d0dd32 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:53.173384 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-fb2851eb-1d5f-46b8-9799-3d46a4d0dd32 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:53.180419 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fb2851eb-1d5f-46b8-9799-3d46a4d0dd32 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:53.180876 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fb2851eb-1d5f-46b8-9799-3d46a4d0dd32 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:53.181640 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fb2851eb-1d5f-46b8-9799-3d46a4d0dd32 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:53.182074 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fb2851eb-1d5f-46b8-9799-3d46a4d0dd32 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:53.231764 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-f74b549b-6f14-4d52-a064-594f95eb54f8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:53.240579 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-f74b549b-6f14-4d52-a064-594f95eb54f8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:53.242114 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-f74b549b-6f14-4d52-a064-594f95eb54f8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:53.243270 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-f74b549b-6f14-4d52-a064-594f95eb54f8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.090142 Jun 17 13:26:53.243840 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1270/2507] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:26:53 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:26:53.258680 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-fb2851eb-1d5f-46b8-9799-3d46a4d0dd32 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:53.270910 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-fb2851eb-1d5f-46b8-9799-3d46a4d0dd32 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.102037 Jun 17 13:26:53.271470 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1238/2508] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:53 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:53.846958 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-25676d6e-56ab-4c8a-a9a7-539b38bbe30e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:53.847927 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-25676d6e-56ab-4c8a-a9a7-539b38bbe30e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:53.858783 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-25676d6e-56ab-4c8a-a9a7-539b38bbe30e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:53.859536 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-25676d6e-56ab-4c8a-a9a7-539b38bbe30e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:53.860786 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-25676d6e-56ab-4c8a-a9a7-539b38bbe30e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:53.861507 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-25676d6e-56ab-4c8a-a9a7-539b38bbe30e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:54.001667 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-25676d6e-56ab-4c8a-a9a7-539b38bbe30e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:54.012894 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-25676d6e-56ab-4c8a-a9a7-539b38bbe30e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.172205 Jun 17 13:26:54.013665 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1271/2509] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:53 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:54.265815 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-dcba0873-4af3-444e-a28c-1e0856bf6b5a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:54.266784 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-dcba0873-4af3-444e-a28c-1e0856bf6b5a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:54.277785 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dcba0873-4af3-444e-a28c-1e0856bf6b5a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:54.278569 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dcba0873-4af3-444e-a28c-1e0856bf6b5a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:54.279810 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dcba0873-4af3-444e-a28c-1e0856bf6b5a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:54.280481 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dcba0873-4af3-444e-a28c-1e0856bf6b5a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:54.289362 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-c650d69d-6220-47cb-aa3a-8eeeef157032 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:54.290010 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-c650d69d-6220-47cb-aa3a-8eeeef157032 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:54.296973 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c650d69d-6220-47cb-aa3a-8eeeef157032 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:54.297408 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c650d69d-6220-47cb-aa3a-8eeeef157032 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:54.298193 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c650d69d-6220-47cb-aa3a-8eeeef157032 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:54.298630 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c650d69d-6220-47cb-aa3a-8eeeef157032 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:54.347468 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-dcba0873-4af3-444e-a28c-1e0856bf6b5a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:54.356803 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-dcba0873-4af3-444e-a28c-1e0856bf6b5a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:54.358305 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-dcba0873-4af3-444e-a28c-1e0856bf6b5a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:54.359438 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-dcba0873-4af3-444e-a28c-1e0856bf6b5a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.100237 Jun 17 13:26:54.359992 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1239/2510] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:26:54 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:26:54.375102 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-c650d69d-6220-47cb-aa3a-8eeeef157032 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:54.384008 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-c650d69d-6220-47cb-aa3a-8eeeef157032 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.099028 Jun 17 13:26:54.384589 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1272/2511] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:54 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:55.034782 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-faa90518-4ebc-42af-8c27-b49962b60056 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:55.035777 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-faa90518-4ebc-42af-8c27-b49962b60056 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:55.042398 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-faa90518-4ebc-42af-8c27-b49962b60056 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:55.042845 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-faa90518-4ebc-42af-8c27-b49962b60056 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:55.043604 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-faa90518-4ebc-42af-8c27-b49962b60056 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:55.044034 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-faa90518-4ebc-42af-8c27-b49962b60056 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:55.179794 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-faa90518-4ebc-42af-8c27-b49962b60056 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:55.189271 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-faa90518-4ebc-42af-8c27-b49962b60056 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.161086 Jun 17 13:26:55.189845 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1240/2512] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:55 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:55.381354 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-c7c4e695-de67-4764-a15a-4e39224b2d51 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:55.382602 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-c7c4e695-de67-4764-a15a-4e39224b2d51 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:55.393886 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c7c4e695-de67-4764-a15a-4e39224b2d51 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:55.394715 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c7c4e695-de67-4764-a15a-4e39224b2d51 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:55.395652 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c7c4e695-de67-4764-a15a-4e39224b2d51 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:55.396080 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c7c4e695-de67-4764-a15a-4e39224b2d51 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:55.403067 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-62af779c-f7b6-48c5-b84e-34c1470446a4 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:55.403705 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-62af779c-f7b6-48c5-b84e-34c1470446a4 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:55.410637 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-62af779c-f7b6-48c5-b84e-34c1470446a4 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:55.411522 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-62af779c-f7b6-48c5-b84e-34c1470446a4 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:55.411852 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-62af779c-f7b6-48c5-b84e-34c1470446a4 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:55.412294 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-62af779c-f7b6-48c5-b84e-34c1470446a4 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:55.416347 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=100 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:26:55.463212 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-c7c4e695-de67-4764-a15a-4e39224b2d51 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:55.472242 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-c7c4e695-de67-4764-a15a-4e39224b2d51 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:55.473770 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-c7c4e695-de67-4764-a15a-4e39224b2d51 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:55.474939 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-c7c4e695-de67-4764-a15a-4e39224b2d51 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.100552 Jun 17 13:26:55.475502 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1273/2513] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:26:55 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:26:55.489625 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-62af779c-f7b6-48c5-b84e-34c1470446a4 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:55.497946 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-62af779c-f7b6-48c5-b84e-34c1470446a4 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.098796 Jun 17 13:26:55.500609 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1241/2514] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:55 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:56.210233 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-ae06f226-4a4f-426f-a53e-c2a1b32ea2a2 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:56.210788 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-ae06f226-4a4f-426f-a53e-c2a1b32ea2a2 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:56.217898 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ae06f226-4a4f-426f-a53e-c2a1b32ea2a2 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:56.218430 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ae06f226-4a4f-426f-a53e-c2a1b32ea2a2 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:56.219256 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ae06f226-4a4f-426f-a53e-c2a1b32ea2a2 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:56.219737 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ae06f226-4a4f-426f-a53e-c2a1b32ea2a2 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:56.357273 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-ae06f226-4a4f-426f-a53e-c2a1b32ea2a2 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:56.367734 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-ae06f226-4a4f-426f-a53e-c2a1b32ea2a2 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.163049 Jun 17 13:26:56.368308 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1274/2515] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:56 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:56.498020 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-18f6445c-9c48-445c-8e16-731e3abc3bb4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:56.498956 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-18f6445c-9c48-445c-8e16-731e3abc3bb4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:56.508040 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-18f6445c-9c48-445c-8e16-731e3abc3bb4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:56.508480 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-18f6445c-9c48-445c-8e16-731e3abc3bb4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:56.509230 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-18f6445c-9c48-445c-8e16-731e3abc3bb4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:56.509652 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-18f6445c-9c48-445c-8e16-731e3abc3bb4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:56.514531 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-6d83e7a9-049b-4e87-a35c-c3be6ba99fff tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:56.515146 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-6d83e7a9-049b-4e87-a35c-c3be6ba99fff tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:56.522637 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6d83e7a9-049b-4e87-a35c-c3be6ba99fff tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:56.523091 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6d83e7a9-049b-4e87-a35c-c3be6ba99fff tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:56.523853 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6d83e7a9-049b-4e87-a35c-c3be6ba99fff tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:56.524292 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6d83e7a9-049b-4e87-a35c-c3be6ba99fff tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:56.573438 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-18f6445c-9c48-445c-8e16-731e3abc3bb4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:56.582333 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-18f6445c-9c48-445c-8e16-731e3abc3bb4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:56.584066 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-18f6445c-9c48-445c-8e16-731e3abc3bb4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:56.585230 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-18f6445c-9c48-445c-8e16-731e3abc3bb4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.093907 Jun 17 13:26:56.585775 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1242/2516] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:26:56 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:26:56.603111 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-6d83e7a9-049b-4e87-a35c-c3be6ba99fff tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:56.611637 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-6d83e7a9-049b-4e87-a35c-c3be6ba99fff tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.100968 Jun 17 13:26:56.612201 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1275/2517] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:56 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:57.393988 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-798738c0-1384-491c-a958-5b7af75ba3b3 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:57.395086 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-798738c0-1384-491c-a958-5b7af75ba3b3 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:57.406213 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-798738c0-1384-491c-a958-5b7af75ba3b3 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:57.406945 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-798738c0-1384-491c-a958-5b7af75ba3b3 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:57.408247 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-798738c0-1384-491c-a958-5b7af75ba3b3 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:57.409153 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-798738c0-1384-491c-a958-5b7af75ba3b3 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:57.554543 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-798738c0-1384-491c-a958-5b7af75ba3b3 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:57.563176 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-798738c0-1384-491c-a958-5b7af75ba3b3 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.175840 Jun 17 13:26:57.563755 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1243/2518] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:57 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:57.606969 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-331bf433-9c6a-40e0-9a89-1bc82c43e9e5 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:57.607490 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-331bf433-9c6a-40e0-9a89-1bc82c43e9e5 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:57.616523 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-331bf433-9c6a-40e0-9a89-1bc82c43e9e5 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:57.616933 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-331bf433-9c6a-40e0-9a89-1bc82c43e9e5 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:57.617709 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-331bf433-9c6a-40e0-9a89-1bc82c43e9e5 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:57.618147 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-331bf433-9c6a-40e0-9a89-1bc82c43e9e5 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:57.628734 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-3d2713b0-fc10-470e-9f80-04a47e3037ea tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:57.629543 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-3d2713b0-fc10-470e-9f80-04a47e3037ea tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:57.636091 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3d2713b0-fc10-470e-9f80-04a47e3037ea tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:57.636529 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3d2713b0-fc10-470e-9f80-04a47e3037ea tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:57.637314 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3d2713b0-fc10-470e-9f80-04a47e3037ea tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:57.637744 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3d2713b0-fc10-470e-9f80-04a47e3037ea tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:57.691270 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-331bf433-9c6a-40e0-9a89-1bc82c43e9e5 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:57.700605 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-331bf433-9c6a-40e0-9a89-1bc82c43e9e5 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:57.702167 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-331bf433-9c6a-40e0-9a89-1bc82c43e9e5 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:57.703323 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-331bf433-9c6a-40e0-9a89-1bc82c43e9e5 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.102859 Jun 17 13:26:57.703925 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1276/2519] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:26:57 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:26:57.708125 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-3d2713b0-fc10-470e-9f80-04a47e3037ea tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:57.716151 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-3d2713b0-fc10-470e-9f80-04a47e3037ea tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.091321 Jun 17 13:26:57.716718 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1244/2520] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:57 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:58.585131 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-0387977a-688f-490d-ac74-1f7fd90c82ee tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:58.586057 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-0387977a-688f-490d-ac74-1f7fd90c82ee tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:58.596308 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0387977a-688f-490d-ac74-1f7fd90c82ee tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:58.597043 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0387977a-688f-490d-ac74-1f7fd90c82ee tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:58.598467 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0387977a-688f-490d-ac74-1f7fd90c82ee tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:58.599181 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0387977a-688f-490d-ac74-1f7fd90c82ee tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:58.723669 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-b5755960-d3a3-4c96-8efb-a1a665c4c8d8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:58.724267 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-b5755960-d3a3-4c96-8efb-a1a665c4c8d8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:58.732248 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b5755960-d3a3-4c96-8efb-a1a665c4c8d8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:58.732696 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b5755960-d3a3-4c96-8efb-a1a665c4c8d8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:58.733459 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b5755960-d3a3-4c96-8efb-a1a665c4c8d8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:58.733889 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b5755960-d3a3-4c96-8efb-a1a665c4c8d8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:58.747809 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-0387977a-688f-490d-ac74-1f7fd90c82ee tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:58.756828 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-0387977a-688f-490d-ac74-1f7fd90c82ee tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.178628 Jun 17 13:26:58.757421 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1277/2521] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:58 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:58.762021 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-76a918b0-2116-47b3-8406-5b5e5a51ea75 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:58.762658 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-76a918b0-2116-47b3-8406-5b5e5a51ea75 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:58.769090 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-76a918b0-2116-47b3-8406-5b5e5a51ea75 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:58.769574 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-76a918b0-2116-47b3-8406-5b5e5a51ea75 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:58.770518 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-76a918b0-2116-47b3-8406-5b5e5a51ea75 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:58.770959 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-76a918b0-2116-47b3-8406-5b5e5a51ea75 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:58.796820 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-b5755960-d3a3-4c96-8efb-a1a665c4c8d8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:58.806376 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-b5755960-d3a3-4c96-8efb-a1a665c4c8d8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:58.808012 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-b5755960-d3a3-4c96-8efb-a1a665c4c8d8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:58.809244 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-b5755960-d3a3-4c96-8efb-a1a665c4c8d8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.089796 Jun 17 13:26:58.809883 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1245/2522] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:26:58 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:26:58.832299 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-76a918b0-2116-47b3-8406-5b5e5a51ea75 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:58.840416 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-76a918b0-2116-47b3-8406-5b5e5a51ea75 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.082031 Jun 17 13:26:58.840900 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1278/2523] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:58 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:26:59.778244 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-c9aabcea-b472-4bbf-8761-8f1d88d08767 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:59.779330 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-c9aabcea-b472-4bbf-8761-8f1d88d08767 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:59.789874 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c9aabcea-b472-4bbf-8761-8f1d88d08767 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:59.790442 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c9aabcea-b472-4bbf-8761-8f1d88d08767 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:59.791309 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c9aabcea-b472-4bbf-8761-8f1d88d08767 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:59.791759 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c9aabcea-b472-4bbf-8761-8f1d88d08767 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:59.829626 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-38373cce-ad35-4e3b-a17a-024383619a0b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:59.830772 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-38373cce-ad35-4e3b-a17a-024383619a0b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:59.838824 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-38373cce-ad35-4e3b-a17a-024383619a0b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:59.839352 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-38373cce-ad35-4e3b-a17a-024383619a0b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:59.840128 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-38373cce-ad35-4e3b-a17a-024383619a0b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:59.840564 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-38373cce-ad35-4e3b-a17a-024383619a0b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:59.918281 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-38373cce-ad35-4e3b-a17a-024383619a0b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:59.927201 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-38373cce-ad35-4e3b-a17a-024383619a0b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:59.928783 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-38373cce-ad35-4e3b-a17a-024383619a0b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:59.929938 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-38373cce-ad35-4e3b-a17a-024383619a0b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.105819 Jun 17 13:26:59.930531 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1279/2524] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:26:59 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:26:59.934950 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-531cc133-6787-4c1f-bf64-7b10bbfcdee6 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:26:59.935557 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-531cc133-6787-4c1f-bf64-7b10bbfcdee6 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:26:59.941504 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-531cc133-6787-4c1f-bf64-7b10bbfcdee6 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:59.941959 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-531cc133-6787-4c1f-bf64-7b10bbfcdee6 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:59.942768 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-531cc133-6787-4c1f-bf64-7b10bbfcdee6 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:26:59.943204 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-531cc133-6787-4c1f-bf64-7b10bbfcdee6 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:26:59.952946 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-c9aabcea-b472-4bbf-8761-8f1d88d08767 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:26:59.961256 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-c9aabcea-b472-4bbf-8761-8f1d88d08767 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.190758 Jun 17 13:26:59.961825 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1246/2525] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:59 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:27:00.006839 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-531cc133-6787-4c1f-bf64-7b10bbfcdee6 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:00.018543 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-531cc133-6787-4c1f-bf64-7b10bbfcdee6 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.086946 Jun 17 13:27:00.019323 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1280/2526] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:26:59 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:27:00.952655 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-84c82578-6e1b-4c59-a735-a44f19f030fb tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:00.953663 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-84c82578-6e1b-4c59-a735-a44f19f030fb tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:00.964630 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-84c82578-6e1b-4c59-a735-a44f19f030fb tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:00.965381 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-84c82578-6e1b-4c59-a735-a44f19f030fb tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:00.966711 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-84c82578-6e1b-4c59-a735-a44f19f030fb tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:00.967466 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-84c82578-6e1b-4c59-a735-a44f19f030fb tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:00.979937 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-6ba5700a-054f-43ed-be58-4ca56758ff86 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:00.980544 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-6ba5700a-054f-43ed-be58-4ca56758ff86 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:00.987396 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6ba5700a-054f-43ed-be58-4ca56758ff86 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:00.987835 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6ba5700a-054f-43ed-be58-4ca56758ff86 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:00.988591 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6ba5700a-054f-43ed-be58-4ca56758ff86 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:00.989026 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6ba5700a-054f-43ed-be58-4ca56758ff86 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:01.041530 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-84c82578-6e1b-4c59-a735-a44f19f030fb tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:01.050461 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-84c82578-6e1b-4c59-a735-a44f19f030fb tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:01.051957 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-84c82578-6e1b-4c59-a735-a44f19f030fb tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:01.053146 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-84c82578-6e1b-4c59-a735-a44f19f030fb tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.107058 Jun 17 13:27:01.053683 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1247/2527] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:27:00 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:27:01.058072 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-5fedb39e-93d2-4dcf-bf50-6b6c45200760 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:01.058696 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-5fedb39e-93d2-4dcf-bf50-6b6c45200760 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:01.064837 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5fedb39e-93d2-4dcf-bf50-6b6c45200760 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:01.065283 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5fedb39e-93d2-4dcf-bf50-6b6c45200760 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:01.066039 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5fedb39e-93d2-4dcf-bf50-6b6c45200760 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:01.066478 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5fedb39e-93d2-4dcf-bf50-6b6c45200760 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:01.136155 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-5fedb39e-93d2-4dcf-bf50-6b6c45200760 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:01.145349 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-5fedb39e-93d2-4dcf-bf50-6b6c45200760 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.090553 Jun 17 13:27:01.145923 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1248/2528] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:27:01 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:27:01.160691 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-6ba5700a-054f-43ed-be58-4ca56758ff86 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:01.169655 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-6ba5700a-054f-43ed-be58-4ca56758ff86 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.193883 Jun 17 13:27:01.170231 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1281/2529] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:27:00 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:27:02.075913 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-64ca8dab-8c62-4aa8-9cb6-df0aa64f1f96 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:02.076930 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-64ca8dab-8c62-4aa8-9cb6-df0aa64f1f96 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:02.086582 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-64ca8dab-8c62-4aa8-9cb6-df0aa64f1f96 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:02.087034 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-64ca8dab-8c62-4aa8-9cb6-df0aa64f1f96 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:02.087794 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-64ca8dab-8c62-4aa8-9cb6-df0aa64f1f96 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:02.088232 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-64ca8dab-8c62-4aa8-9cb6-df0aa64f1f96 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:02.152815 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-64ca8dab-8c62-4aa8-9cb6-df0aa64f1f96 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:02.161549 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-64ca8dab-8c62-4aa8-9cb6-df0aa64f1f96 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:02.162751 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-c531a6e5-364b-406f-acb5-2eb7480a2df0 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:02.163236 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-64ca8dab-8c62-4aa8-9cb6-df0aa64f1f96 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:02.163369 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-c531a6e5-364b-406f-acb5-2eb7480a2df0 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:02.164426 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-64ca8dab-8c62-4aa8-9cb6-df0aa64f1f96 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.095170 Jun 17 13:27:02.164941 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1249/2530] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:27:02 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:27:02.170608 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c531a6e5-364b-406f-acb5-2eb7480a2df0 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:02.171063 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c531a6e5-364b-406f-acb5-2eb7480a2df0 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:02.171832 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c531a6e5-364b-406f-acb5-2eb7480a2df0 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:02.172263 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c531a6e5-364b-406f-acb5-2eb7480a2df0 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:02.187630 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-8f27645d-7927-45c6-a7cc-417532eb2140 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:02.188258 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-8f27645d-7927-45c6-a7cc-417532eb2140 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:02.194637 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8f27645d-7927-45c6-a7cc-417532eb2140 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:02.195086 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8f27645d-7927-45c6-a7cc-417532eb2140 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:02.195822 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8f27645d-7927-45c6-a7cc-417532eb2140 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:02.196288 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8f27645d-7927-45c6-a7cc-417532eb2140 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:02.248461 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-c531a6e5-364b-406f-acb5-2eb7480a2df0 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:02.256732 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-c531a6e5-364b-406f-acb5-2eb7480a2df0 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.098580 Jun 17 13:27:02.257308 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1282/2531] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:27:02 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:27:02.339655 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-8f27645d-7927-45c6-a7cc-417532eb2140 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:02.348035 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-8f27645d-7927-45c6-a7cc-417532eb2140 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.164328 Jun 17 13:27:02.348618 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1250/2532] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:27:02 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 13:27:03.186627 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-3f062a5f-da26-4235-a46e-95579a75885e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:03.187560 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-3f062a5f-da26-4235-a46e-95579a75885e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:03.197387 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-3f062a5f-da26-4235-a46e-95579a75885e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:03.197849 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-3f062a5f-da26-4235-a46e-95579a75885e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:03.198646 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-3f062a5f-da26-4235-a46e-95579a75885e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:03.199087 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-3f062a5f-da26-4235-a46e-95579a75885e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:03.263522 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-3f062a5f-da26-4235-a46e-95579a75885e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:03.273053 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-e30c9f31-a555-41df-a563-1c7c77026849 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:03.273759 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-3f062a5f-da26-4235-a46e-95579a75885e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:03.274254 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-e30c9f31-a555-41df-a563-1c7c77026849 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:03.274737 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-3f062a5f-da26-4235-a46e-95579a75885e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:03.275880 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-3f062a5f-da26-4235-a46e-95579a75885e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.096621 Jun 17 13:27:03.276433 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1283/2533] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:27:03 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:27:03.280771 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e30c9f31-a555-41df-a563-1c7c77026849 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:03.281219 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e30c9f31-a555-41df-a563-1c7c77026849 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:03.281975 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e30c9f31-a555-41df-a563-1c7c77026849 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:03.282454 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e30c9f31-a555-41df-a563-1c7c77026849 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:03.345324 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-e30c9f31-a555-41df-a563-1c7c77026849 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:03.353771 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-e30c9f31-a555-41df-a563-1c7c77026849 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.084720 Jun 17 13:27:03.354731 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1251/2534] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:27:03 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 13:27:03.364749 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-f599a7b8-bffb-458f-95c2-7de04c9d725b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:03.365361 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-f599a7b8-bffb-458f-95c2-7de04c9d725b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:03.372213 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f599a7b8-bffb-458f-95c2-7de04c9d725b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:03.372666 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f599a7b8-bffb-458f-95c2-7de04c9d725b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:03.373422 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f599a7b8-bffb-458f-95c2-7de04c9d725b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:03.373857 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f599a7b8-bffb-458f-95c2-7de04c9d725b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:03.392448 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_cell1:SELECT=100 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:27:03.516251 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-f599a7b8-bffb-458f-95c2-7de04c9d725b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:03.526950 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-f599a7b8-bffb-458f-95c2-7de04c9d725b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.166040 Jun 17 13:27:03.527535 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1284/2535] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:27:03 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:27:04.298754 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-c0e781b2-0725-4625-add8-3da68ebce972 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:04.299631 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-c0e781b2-0725-4625-add8-3da68ebce972 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:04.308379 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c0e781b2-0725-4625-add8-3da68ebce972 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:04.308812 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c0e781b2-0725-4625-add8-3da68ebce972 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:04.309545 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c0e781b2-0725-4625-add8-3da68ebce972 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:04.310021 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c0e781b2-0725-4625-add8-3da68ebce972 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:04.371322 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-4d568385-3923-4d74-9b88-48ceab374bd9 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:04.371956 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-4d568385-3923-4d74-9b88-48ceab374bd9 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:04.374303 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-c0e781b2-0725-4625-add8-3da68ebce972 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:04.378269 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4d568385-3923-4d74-9b88-48ceab374bd9 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:04.378711 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4d568385-3923-4d74-9b88-48ceab374bd9 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:04.379453 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4d568385-3923-4d74-9b88-48ceab374bd9 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:04.379881 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4d568385-3923-4d74-9b88-48ceab374bd9 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:04.383088 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-c0e781b2-0725-4625-add8-3da68ebce972 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:04.384579 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-c0e781b2-0725-4625-add8-3da68ebce972 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:04.385744 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-c0e781b2-0725-4625-add8-3da68ebce972 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.093647 Jun 17 13:27:04.386333 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1252/2536] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:27:04 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:27:04.442901 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-4d568385-3923-4d74-9b88-48ceab374bd9 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:04.451443 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-4d568385-3923-4d74-9b88-48ceab374bd9 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.084397 Jun 17 13:27:04.451999 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1285/2537] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:27:04 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 13:27:04.548699 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-9931c7cf-f779-40ad-8e73-9fe113beb48b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:04.549795 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-9931c7cf-f779-40ad-8e73-9fe113beb48b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:04.558553 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9931c7cf-f779-40ad-8e73-9fe113beb48b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:04.559002 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9931c7cf-f779-40ad-8e73-9fe113beb48b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:04.559760 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9931c7cf-f779-40ad-8e73-9fe113beb48b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:04.560189 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9931c7cf-f779-40ad-8e73-9fe113beb48b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:04.702309 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-9931c7cf-f779-40ad-8e73-9fe113beb48b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:04.714026 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-9931c7cf-f779-40ad-8e73-9fe113beb48b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.171569 Jun 17 13:27:04.714826 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1253/2538] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:27:04 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:27:05.405324 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-989b013f-1004-4c3f-8025-e1be4f3e3a52 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:05.406055 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-989b013f-1004-4c3f-8025-e1be4f3e3a52 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:05.414630 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-989b013f-1004-4c3f-8025-e1be4f3e3a52 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:05.415331 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-989b013f-1004-4c3f-8025-e1be4f3e3a52 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:05.416092 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-989b013f-1004-4c3f-8025-e1be4f3e3a52 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:05.416529 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-989b013f-1004-4c3f-8025-e1be4f3e3a52 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:05.469209 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-9ac8cdb7-1930-4b70-8efa-a2a16cd06d91 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:05.469767 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-9ac8cdb7-1930-4b70-8efa-a2a16cd06d91 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:05.476685 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9ac8cdb7-1930-4b70-8efa-a2a16cd06d91 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:05.477109 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9ac8cdb7-1930-4b70-8efa-a2a16cd06d91 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:05.478381 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9ac8cdb7-1930-4b70-8efa-a2a16cd06d91 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:05.478809 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9ac8cdb7-1930-4b70-8efa-a2a16cd06d91 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:05.484746 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-989b013f-1004-4c3f-8025-e1be4f3e3a52 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:05.493650 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-989b013f-1004-4c3f-8025-e1be4f3e3a52 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:05.495192 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-989b013f-1004-4c3f-8025-e1be4f3e3a52 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:05.496345 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-989b013f-1004-4c3f-8025-e1be4f3e3a52 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.095936 Jun 17 13:27:05.496908 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1286/2539] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:27:05 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:27:05.541613 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-9ac8cdb7-1930-4b70-8efa-a2a16cd06d91 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:05.549671 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-9ac8cdb7-1930-4b70-8efa-a2a16cd06d91 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.084473 Jun 17 13:27:05.550270 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1254/2540] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:27:05 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:27:05.732200 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-f0c92e45-0833-4a50-8da0-491bb2206cd8 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:05.732754 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-f0c92e45-0833-4a50-8da0-491bb2206cd8 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:05.739382 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f0c92e45-0833-4a50-8da0-491bb2206cd8 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:05.739835 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f0c92e45-0833-4a50-8da0-491bb2206cd8 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:05.740596 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f0c92e45-0833-4a50-8da0-491bb2206cd8 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:05.741031 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f0c92e45-0833-4a50-8da0-491bb2206cd8 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:05.882527 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-f0c92e45-0833-4a50-8da0-491bb2206cd8 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:05.891954 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-f0c92e45-0833-4a50-8da0-491bb2206cd8 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.164085 Jun 17 13:27:05.892737 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1287/2541] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:27:05 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:27:06.519267 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-ed053e33-405c-4c2d-81dd-0a1622ae3f5d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:06.520232 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-ed053e33-405c-4c2d-81dd-0a1622ae3f5d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:06.529562 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ed053e33-405c-4c2d-81dd-0a1622ae3f5d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:06.530004 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ed053e33-405c-4c2d-81dd-0a1622ae3f5d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:06.530786 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ed053e33-405c-4c2d-81dd-0a1622ae3f5d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:06.531212 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ed053e33-405c-4c2d-81dd-0a1622ae3f5d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:06.566817 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-3dcb91c4-52e4-4d03-bd96-20372667fd32 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:06.567380 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-3dcb91c4-52e4-4d03-bd96-20372667fd32 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:06.574532 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-3dcb91c4-52e4-4d03-bd96-20372667fd32 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:06.574985 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-3dcb91c4-52e4-4d03-bd96-20372667fd32 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:06.575754 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-3dcb91c4-52e4-4d03-bd96-20372667fd32 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:06.576189 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-3dcb91c4-52e4-4d03-bd96-20372667fd32 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:06.594199 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-ed053e33-405c-4c2d-81dd-0a1622ae3f5d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:06.602820 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-ed053e33-405c-4c2d-81dd-0a1622ae3f5d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:06.604812 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-ed053e33-405c-4c2d-81dd-0a1622ae3f5d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:06.605955 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-ed053e33-405c-4c2d-81dd-0a1622ae3f5d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.093296 Jun 17 13:27:06.606542 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1255/2542] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:27:06 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:27:06.641220 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-3dcb91c4-52e4-4d03-bd96-20372667fd32 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:06.649311 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-3dcb91c4-52e4-4d03-bd96-20372667fd32 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.086349 Jun 17 13:27:06.649918 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1288/2543] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:27:06 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:27:06.916957 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-e1c873ad-889e-40bf-86c6-0c360cea297c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:06.917650 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-e1c873ad-889e-40bf-86c6-0c360cea297c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:06.924856 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e1c873ad-889e-40bf-86c6-0c360cea297c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:06.925354 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e1c873ad-889e-40bf-86c6-0c360cea297c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:06.926226 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e1c873ad-889e-40bf-86c6-0c360cea297c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:06.926710 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e1c873ad-889e-40bf-86c6-0c360cea297c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:07.078347 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-e1c873ad-889e-40bf-86c6-0c360cea297c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:07.091384 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-e1c873ad-889e-40bf-86c6-0c360cea297c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.181401 Jun 17 13:27:07.092176 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1256/2544] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:27:06 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:27:07.628094 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-e9eb2786-9a82-43df-b83b-0da6672d4385 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:07.629099 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-e9eb2786-9a82-43df-b83b-0da6672d4385 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:07.638694 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e9eb2786-9a82-43df-b83b-0da6672d4385 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:07.639137 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e9eb2786-9a82-43df-b83b-0da6672d4385 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:07.639882 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e9eb2786-9a82-43df-b83b-0da6672d4385 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:07.640310 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e9eb2786-9a82-43df-b83b-0da6672d4385 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:07.667338 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-6162a09f-a64a-4292-abd9-62284e0f07c5 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:07.668006 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-6162a09f-a64a-4292-abd9-62284e0f07c5 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:07.675547 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6162a09f-a64a-4292-abd9-62284e0f07c5 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:07.675993 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6162a09f-a64a-4292-abd9-62284e0f07c5 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:07.676773 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6162a09f-a64a-4292-abd9-62284e0f07c5 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:07.677204 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6162a09f-a64a-4292-abd9-62284e0f07c5 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:07.744192 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-6162a09f-a64a-4292-abd9-62284e0f07c5 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:07.747800 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=100 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:27:07.753881 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-6162a09f-a64a-4292-abd9-62284e0f07c5 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.090486 Jun 17 13:27:07.754501 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1257/2545] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:27:07 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:27:07.869466 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-e9eb2786-9a82-43df-b83b-0da6672d4385 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:07.878314 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-e9eb2786-9a82-43df-b83b-0da6672d4385 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:07.879709 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-e9eb2786-9a82-43df-b83b-0da6672d4385 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:07.880831 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-e9eb2786-9a82-43df-b83b-0da6672d4385 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.259553 Jun 17 13:27:07.881389 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1289/2546] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:27:07 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:27:08.118486 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-54e83900-e78f-4e45-a837-81dd80e9af46 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:08.119920 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-54e83900-e78f-4e45-a837-81dd80e9af46 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:08.127278 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-54e83900-e78f-4e45-a837-81dd80e9af46 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:08.127730 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-54e83900-e78f-4e45-a837-81dd80e9af46 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:08.128665 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-54e83900-e78f-4e45-a837-81dd80e9af46 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:08.129035 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-54e83900-e78f-4e45-a837-81dd80e9af46 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:08.265572 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-54e83900-e78f-4e45-a837-81dd80e9af46 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:08.274419 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-54e83900-e78f-4e45-a837-81dd80e9af46 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.162952 Jun 17 13:27:08.274993 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1258/2547] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:27:08 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:27:08.776707 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-536ecf53-b394-4591-beb0-f82d1e9de4cd tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:08.778651 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-536ecf53-b394-4591-beb0-f82d1e9de4cd tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:08.791235 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-536ecf53-b394-4591-beb0-f82d1e9de4cd tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:08.791989 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-536ecf53-b394-4591-beb0-f82d1e9de4cd tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:08.793376 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-536ecf53-b394-4591-beb0-f82d1e9de4cd tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:08.793818 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-536ecf53-b394-4591-beb0-f82d1e9de4cd tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:08.866210 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-536ecf53-b394-4591-beb0-f82d1e9de4cd tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:08.875211 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-536ecf53-b394-4591-beb0-f82d1e9de4cd tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.106360 Jun 17 13:27:08.875771 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1290/2548] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:27:08 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:27:08.899244 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-5e0b600c-90ba-450d-be14-3716459e4b42 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:08.899811 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-5e0b600c-90ba-450d-be14-3716459e4b42 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:08.906850 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5e0b600c-90ba-450d-be14-3716459e4b42 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:08.907298 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5e0b600c-90ba-450d-be14-3716459e4b42 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:08.908059 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5e0b600c-90ba-450d-be14-3716459e4b42 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:08.908491 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5e0b600c-90ba-450d-be14-3716459e4b42 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:08.983629 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-5e0b600c-90ba-450d-be14-3716459e4b42 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:08.992696 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-5e0b600c-90ba-450d-be14-3716459e4b42 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:08.994215 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-5e0b600c-90ba-450d-be14-3716459e4b42 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:08.995352 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-5e0b600c-90ba-450d-be14-3716459e4b42 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.100055 Jun 17 13:27:08.995911 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1259/2549] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:27:08 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:27:09.296178 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-52475e05-94fd-4e82-b8dc-c8d054821d99 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:09.297180 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-52475e05-94fd-4e82-b8dc-c8d054821d99 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:09.307422 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-52475e05-94fd-4e82-b8dc-c8d054821d99 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:09.308133 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-52475e05-94fd-4e82-b8dc-c8d054821d99 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:09.309648 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-52475e05-94fd-4e82-b8dc-c8d054821d99 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:09.310456 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-52475e05-94fd-4e82-b8dc-c8d054821d99 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:09.450124 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-52475e05-94fd-4e82-b8dc-c8d054821d99 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:09.462926 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-52475e05-94fd-4e82-b8dc-c8d054821d99 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.172879 Jun 17 13:27:09.463687 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1291/2550] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:27:09 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:27:09.895588 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-37228ab3-8047-4dab-b60c-835a9cb6e151 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:09.896520 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-37228ab3-8047-4dab-b60c-835a9cb6e151 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:09.905282 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-37228ab3-8047-4dab-b60c-835a9cb6e151 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:09.905926 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-37228ab3-8047-4dab-b60c-835a9cb6e151 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:09.906513 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-37228ab3-8047-4dab-b60c-835a9cb6e151 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:09.906949 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-37228ab3-8047-4dab-b60c-835a9cb6e151 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:09.978122 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-37228ab3-8047-4dab-b60c-835a9cb6e151 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:09.987022 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-37228ab3-8047-4dab-b60c-835a9cb6e151 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.097462 Jun 17 13:27:09.987589 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1260/2551] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:27:09 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:27:10.013030 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-217eb4a3-d841-4ecf-9d9c-c59cad79a196 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:10.013637 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-217eb4a3-d841-4ecf-9d9c-c59cad79a196 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:10.020594 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-217eb4a3-d841-4ecf-9d9c-c59cad79a196 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:10.021051 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-217eb4a3-d841-4ecf-9d9c-c59cad79a196 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:10.021801 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-217eb4a3-d841-4ecf-9d9c-c59cad79a196 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:10.022292 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-217eb4a3-d841-4ecf-9d9c-c59cad79a196 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:10.086544 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-217eb4a3-d841-4ecf-9d9c-c59cad79a196 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:10.096080 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-217eb4a3-d841-4ecf-9d9c-c59cad79a196 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:10.097573 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-217eb4a3-d841-4ecf-9d9c-c59cad79a196 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:10.098738 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-217eb4a3-d841-4ecf-9d9c-c59cad79a196 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.089623 Jun 17 13:27:10.099291 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1292/2552] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:27:10 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:27:10.489613 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-922fc5e6-12a0-45b9-a56c-30e9a0f37c00 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:10.490739 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-922fc5e6-12a0-45b9-a56c-30e9a0f37c00 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:10.501176 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-922fc5e6-12a0-45b9-a56c-30e9a0f37c00 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:10.501922 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-922fc5e6-12a0-45b9-a56c-30e9a0f37c00 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:10.503213 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-922fc5e6-12a0-45b9-a56c-30e9a0f37c00 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:10.504004 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-922fc5e6-12a0-45b9-a56c-30e9a0f37c00 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:10.645144 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-922fc5e6-12a0-45b9-a56c-30e9a0f37c00 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:10.654190 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-922fc5e6-12a0-45b9-a56c-30e9a0f37c00 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.171186 Jun 17 13:27:10.654753 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1261/2553] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:27:10 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:27:11.008138 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-09363710-c858-425a-aa75-882701d22601 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:11.009137 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-09363710-c858-425a-aa75-882701d22601 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:11.017332 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-09363710-c858-425a-aa75-882701d22601 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:11.017953 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-09363710-c858-425a-aa75-882701d22601 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:11.018550 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-09363710-c858-425a-aa75-882701d22601 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:11.018993 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-09363710-c858-425a-aa75-882701d22601 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:11.091382 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-09363710-c858-425a-aa75-882701d22601 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:11.103289 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-09363710-c858-425a-aa75-882701d22601 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.101379 Jun 17 13:27:11.104046 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1293/2554] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:27:11 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:27:11.117702 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-d1087c1b-2be6-4080-9a3b-e673c205949a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:11.118345 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-d1087c1b-2be6-4080-9a3b-e673c205949a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:11.125860 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d1087c1b-2be6-4080-9a3b-e673c205949a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:11.126348 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d1087c1b-2be6-4080-9a3b-e673c205949a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:11.127108 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d1087c1b-2be6-4080-9a3b-e673c205949a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:11.127553 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d1087c1b-2be6-4080-9a3b-e673c205949a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:11.191430 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-d1087c1b-2be6-4080-9a3b-e673c205949a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:11.202860 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-d1087c1b-2be6-4080-9a3b-e673c205949a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:11.204355 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-d1087c1b-2be6-4080-9a3b-e673c205949a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:11.205544 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-d1087c1b-2be6-4080-9a3b-e673c205949a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.091837 Jun 17 13:27:11.206119 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1262/2555] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:27:11 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:27:11.671650 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-bf8f7306-7054-4d44-8bfd-36db417257ed tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:11.672266 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-bf8f7306-7054-4d44-8bfd-36db417257ed tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:11.681992 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-bf8f7306-7054-4d44-8bfd-36db417257ed tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:11.682680 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-bf8f7306-7054-4d44-8bfd-36db417257ed tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:11.683759 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-bf8f7306-7054-4d44-8bfd-36db417257ed tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:11.684370 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-bf8f7306-7054-4d44-8bfd-36db417257ed tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:11.824884 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-bf8f7306-7054-4d44-8bfd-36db417257ed tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:11.832878 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-bf8f7306-7054-4d44-8bfd-36db417257ed tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.165442 Jun 17 13:27:11.833434 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1294/2556] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:27:11 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:27:12.125434 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-f35b4bde-7220-484c-8810-a78f5c8961b2 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:12.126497 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-f35b4bde-7220-484c-8810-a78f5c8961b2 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:12.138128 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f35b4bde-7220-484c-8810-a78f5c8961b2 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:12.138891 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f35b4bde-7220-484c-8810-a78f5c8961b2 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:12.140152 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f35b4bde-7220-484c-8810-a78f5c8961b2 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:12.140881 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f35b4bde-7220-484c-8810-a78f5c8961b2 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:12.207026 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-f35b4bde-7220-484c-8810-a78f5c8961b2 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:12.216624 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-f35b4bde-7220-484c-8810-a78f5c8961b2 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.097824 Jun 17 13:27:12.217199 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1263/2557] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:27:12 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:27:12.224370 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-05fdd3a6-496e-4d3b-9338-807720bdb698 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:12.224996 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-05fdd3a6-496e-4d3b-9338-807720bdb698 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:12.231961 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-05fdd3a6-496e-4d3b-9338-807720bdb698 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:12.232408 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-05fdd3a6-496e-4d3b-9338-807720bdb698 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:12.233157 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-05fdd3a6-496e-4d3b-9338-807720bdb698 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:12.233583 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-05fdd3a6-496e-4d3b-9338-807720bdb698 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:12.298884 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-05fdd3a6-496e-4d3b-9338-807720bdb698 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:12.307827 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-05fdd3a6-496e-4d3b-9338-807720bdb698 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:12.309740 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-05fdd3a6-496e-4d3b-9338-807720bdb698 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:12.310940 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-05fdd3a6-496e-4d3b-9338-807720bdb698 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.090560 Jun 17 13:27:12.311496 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1295/2558] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:27:12 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:27:12.855064 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-5d4f3d30-c9de-4e08-b15f-f0eb7d8f1e6a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:12.856084 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-5d4f3d30-c9de-4e08-b15f-f0eb7d8f1e6a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:12.866272 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5d4f3d30-c9de-4e08-b15f-f0eb7d8f1e6a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:12.867029 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5d4f3d30-c9de-4e08-b15f-f0eb7d8f1e6a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:12.868295 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5d4f3d30-c9de-4e08-b15f-f0eb7d8f1e6a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:12.869021 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5d4f3d30-c9de-4e08-b15f-f0eb7d8f1e6a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:13.020722 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-5d4f3d30-c9de-4e08-b15f-f0eb7d8f1e6a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:13.031659 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-5d4f3d30-c9de-4e08-b15f-f0eb7d8f1e6a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.183552 Jun 17 13:27:13.032231 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1264/2559] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:27:12 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:27:13.237073 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-98e1ab73-7fe1-44c7-8a1e-8407d62fc343 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:13.237752 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-98e1ab73-7fe1-44c7-8a1e-8407d62fc343 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:13.248132 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-98e1ab73-7fe1-44c7-8a1e-8407d62fc343 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:13.248775 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-98e1ab73-7fe1-44c7-8a1e-8407d62fc343 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:13.249878 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-98e1ab73-7fe1-44c7-8a1e-8407d62fc343 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:13.250712 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-98e1ab73-7fe1-44c7-8a1e-8407d62fc343 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:13.324419 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-98e1ab73-7fe1-44c7-8a1e-8407d62fc343 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:13.330404 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-66f30294-ab17-4474-97f1-7ab2b31aa60f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:13.331102 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-66f30294-ab17-4474-97f1-7ab2b31aa60f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:13.332954 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-98e1ab73-7fe1-44c7-8a1e-8407d62fc343 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.100476 Jun 17 13:27:13.333497 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1296/2560] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:27:13 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:27:13.337722 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-66f30294-ab17-4474-97f1-7ab2b31aa60f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:13.338202 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-66f30294-ab17-4474-97f1-7ab2b31aa60f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:13.339022 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-66f30294-ab17-4474-97f1-7ab2b31aa60f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:13.339456 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-66f30294-ab17-4474-97f1-7ab2b31aa60f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:13.404144 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-66f30294-ab17-4474-97f1-7ab2b31aa60f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:13.412949 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-66f30294-ab17-4474-97f1-7ab2b31aa60f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:13.414471 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-66f30294-ab17-4474-97f1-7ab2b31aa60f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:13.415614 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-66f30294-ab17-4474-97f1-7ab2b31aa60f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.089192 Jun 17 13:27:13.416174 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1265/2561] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:27:13 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:27:14.052775 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-38db0ba6-2867-4e8c-8d2e-ff54a1c2b38d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:14.053862 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-38db0ba6-2867-4e8c-8d2e-ff54a1c2b38d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:14.063884 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-38db0ba6-2867-4e8c-8d2e-ff54a1c2b38d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:14.064619 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-38db0ba6-2867-4e8c-8d2e-ff54a1c2b38d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:14.065860 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-38db0ba6-2867-4e8c-8d2e-ff54a1c2b38d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:14.066637 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-38db0ba6-2867-4e8c-8d2e-ff54a1c2b38d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:14.210081 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-38db0ba6-2867-4e8c-8d2e-ff54a1c2b38d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:14.222996 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-38db0ba6-2867-4e8c-8d2e-ff54a1c2b38d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.176394 Jun 17 13:27:14.223612 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1297/2562] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:27:14 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:27:14.352000 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-be815ce4-c602-4a45-abdc-ba7ba9be94c1 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:14.352819 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-be815ce4-c602-4a45-abdc-ba7ba9be94c1 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:14.362204 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-be815ce4-c602-4a45-abdc-ba7ba9be94c1 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:14.362800 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-be815ce4-c602-4a45-abdc-ba7ba9be94c1 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:14.363840 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-be815ce4-c602-4a45-abdc-ba7ba9be94c1 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:14.364417 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-be815ce4-c602-4a45-abdc-ba7ba9be94c1 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:14.431976 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-be815ce4-c602-4a45-abdc-ba7ba9be94c1 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:14.433354 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-d1544b71-f155-40a5-99de-25bdfe7911b4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:14.433969 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-d1544b71-f155-40a5-99de-25bdfe7911b4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:14.440360 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-be815ce4-c602-4a45-abdc-ba7ba9be94c1 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.093531 Jun 17 13:27:14.440936 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1266/2563] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:27:14 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:27:14.441181 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d1544b71-f155-40a5-99de-25bdfe7911b4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:14.441428 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d1544b71-f155-40a5-99de-25bdfe7911b4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:14.442254 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d1544b71-f155-40a5-99de-25bdfe7911b4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:14.442815 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d1544b71-f155-40a5-99de-25bdfe7911b4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:14.504634 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-d1544b71-f155-40a5-99de-25bdfe7911b4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:14.513178 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-d1544b71-f155-40a5-99de-25bdfe7911b4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:14.515191 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-d1544b71-f155-40a5-99de-25bdfe7911b4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:14.516334 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-d1544b71-f155-40a5-99de-25bdfe7911b4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.087265 Jun 17 13:27:14.516886 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1298/2564] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:27:14 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 13:27:15.240891 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-4e2d5f76-9a13-4074-897a-f779ee666dcd tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:15.241502 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-4e2d5f76-9a13-4074-897a-f779ee666dcd tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:15.243461 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_api:SELECT=80 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:27:15.249721 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4e2d5f76-9a13-4074-897a-f779ee666dcd tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:15.250196 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4e2d5f76-9a13-4074-897a-f779ee666dcd tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:15.250954 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4e2d5f76-9a13-4074-897a-f779ee666dcd tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:15.251386 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4e2d5f76-9a13-4074-897a-f779ee666dcd tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:15.388165 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-4e2d5f76-9a13-4074-897a-f779ee666dcd tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:15.396679 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-4e2d5f76-9a13-4074-897a-f779ee666dcd tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.159743 Jun 17 13:27:15.397216 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1267/2565] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:27:15 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:27:15.461380 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-90a4e75c-bdb2-4691-bde3-80e0d5cc8f2f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:15.462355 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-90a4e75c-bdb2-4691-bde3-80e0d5cc8f2f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:15.473824 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-90a4e75c-bdb2-4691-bde3-80e0d5cc8f2f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:15.474635 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-90a4e75c-bdb2-4691-bde3-80e0d5cc8f2f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:15.475912 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-90a4e75c-bdb2-4691-bde3-80e0d5cc8f2f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:15.476642 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-90a4e75c-bdb2-4691-bde3-80e0d5cc8f2f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:15.534498 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-71c8ea50-8e0a-4354-909b-9668f661dc60 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:15.535258 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-71c8ea50-8e0a-4354-909b-9668f661dc60 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:15.540663 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-90a4e75c-bdb2-4691-bde3-80e0d5cc8f2f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:15.542054 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-71c8ea50-8e0a-4354-909b-9668f661dc60 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:15.542515 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-71c8ea50-8e0a-4354-909b-9668f661dc60 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:15.543288 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-71c8ea50-8e0a-4354-909b-9668f661dc60 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:15.543719 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-71c8ea50-8e0a-4354-909b-9668f661dc60 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:15.549085 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-90a4e75c-bdb2-4691-bde3-80e0d5cc8f2f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.094427 Jun 17 13:27:15.549635 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1299/2566] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:27:15 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:27:15.621030 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-71c8ea50-8e0a-4354-909b-9668f661dc60 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:15.634694 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-71c8ea50-8e0a-4354-909b-9668f661dc60 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:15.636818 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-71c8ea50-8e0a-4354-909b-9668f661dc60 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:15.638869 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-71c8ea50-8e0a-4354-909b-9668f661dc60 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.107759 Jun 17 13:27:15.639623 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1268/2567] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:27:15 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 13:27:16.415137 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-93a82306-b367-4eef-af31-9cbf85a503c7 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:16.415805 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-93a82306-b367-4eef-af31-9cbf85a503c7 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:16.422888 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-93a82306-b367-4eef-af31-9cbf85a503c7 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:16.423341 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-93a82306-b367-4eef-af31-9cbf85a503c7 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:16.424105 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-93a82306-b367-4eef-af31-9cbf85a503c7 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:16.424536 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-93a82306-b367-4eef-af31-9cbf85a503c7 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:16.566252 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-5315e680-7461-4674-991f-5c45a0e8d77f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:16.566703 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-5315e680-7461-4674-991f-5c45a0e8d77f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:16.568138 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-93a82306-b367-4eef-af31-9cbf85a503c7 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:16.573138 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5315e680-7461-4674-991f-5c45a0e8d77f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:16.573562 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5315e680-7461-4674-991f-5c45a0e8d77f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:16.574358 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5315e680-7461-4674-991f-5c45a0e8d77f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:16.574792 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5315e680-7461-4674-991f-5c45a0e8d77f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:16.576969 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-93a82306-b367-4eef-af31-9cbf85a503c7 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.166204 Jun 17 13:27:16.577551 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1300/2568] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:27:16 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:27:16.637377 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-5315e680-7461-4674-991f-5c45a0e8d77f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:16.645422 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-5315e680-7461-4674-991f-5c45a0e8d77f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.083442 Jun 17 13:27:16.645971 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1269/2569] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:27:16 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:27:16.660265 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-4d64918e-2901-45e4-af66-0fef39a23e15 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:16.660870 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-4d64918e-2901-45e4-af66-0fef39a23e15 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:16.667402 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4d64918e-2901-45e4-af66-0fef39a23e15 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:16.667940 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4d64918e-2901-45e4-af66-0fef39a23e15 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:16.668733 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4d64918e-2901-45e4-af66-0fef39a23e15 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:16.669374 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4d64918e-2901-45e4-af66-0fef39a23e15 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:16.675190 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_cell1:SELECT=100 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:27:16.736280 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-4d64918e-2901-45e4-af66-0fef39a23e15 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:16.750904 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-4d64918e-2901-45e4-af66-0fef39a23e15 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:16.753641 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-4d64918e-2901-45e4-af66-0fef39a23e15 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:16.755078 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-4d64918e-2901-45e4-af66-0fef39a23e15 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.098716 Jun 17 13:27:16.755640 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1301/2570] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:27:16 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:27:17.595880 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-dc3b1b5e-9123-4037-9a1b-25e366644399 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:17.596503 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-dc3b1b5e-9123-4037-9a1b-25e366644399 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:17.604027 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dc3b1b5e-9123-4037-9a1b-25e366644399 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:17.604781 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dc3b1b5e-9123-4037-9a1b-25e366644399 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:17.605702 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dc3b1b5e-9123-4037-9a1b-25e366644399 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:17.606140 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dc3b1b5e-9123-4037-9a1b-25e366644399 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:17.663928 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-91895b6a-1028-466b-8c50-777e414c0853 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:17.664679 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-91895b6a-1028-466b-8c50-777e414c0853 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:17.671312 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-91895b6a-1028-466b-8c50-777e414c0853 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:17.671759 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-91895b6a-1028-466b-8c50-777e414c0853 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:17.672527 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-91895b6a-1028-466b-8c50-777e414c0853 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:17.672953 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-91895b6a-1028-466b-8c50-777e414c0853 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:17.766319 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-91895b6a-1028-466b-8c50-777e414c0853 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:17.777973 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-91895b6a-1028-466b-8c50-777e414c0853 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.118539 Jun 17 13:27:17.779201 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1302/2571] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:27:17 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:27:17.785022 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-881f433a-ee7d-4a33-9513-491b86946fab tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:17.785800 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-881f433a-ee7d-4a33-9513-491b86946fab tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:17.794848 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-881f433a-ee7d-4a33-9513-491b86946fab tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:17.795451 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-881f433a-ee7d-4a33-9513-491b86946fab tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:17.795952 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-881f433a-ee7d-4a33-9513-491b86946fab tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:17.796377 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-881f433a-ee7d-4a33-9513-491b86946fab tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:17.808102 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-dc3b1b5e-9123-4037-9a1b-25e366644399 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:17.816638 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-dc3b1b5e-9123-4037-9a1b-25e366644399 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.225659 Jun 17 13:27:17.817222 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1270/2572] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:27:17 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:27:17.859251 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-881f433a-ee7d-4a33-9513-491b86946fab tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:17.868185 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-881f433a-ee7d-4a33-9513-491b86946fab tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:17.869866 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-881f433a-ee7d-4a33-9513-491b86946fab tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:17.871028 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-881f433a-ee7d-4a33-9513-491b86946fab tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.091026 Jun 17 13:27:17.871586 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1303/2573] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:27:17 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:27:18.803363 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-713f90e2-552d-4031-b3f1-95c4ddb388b2 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:18.804315 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-713f90e2-552d-4031-b3f1-95c4ddb388b2 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:18.813708 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-713f90e2-552d-4031-b3f1-95c4ddb388b2 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:18.814189 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-713f90e2-552d-4031-b3f1-95c4ddb388b2 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:18.814937 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-713f90e2-552d-4031-b3f1-95c4ddb388b2 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:18.815362 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-713f90e2-552d-4031-b3f1-95c4ddb388b2 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:18.833907 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-c9441864-36fb-464a-89a1-2cd0086b4fdb tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:18.834637 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-c9441864-36fb-464a-89a1-2cd0086b4fdb tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:18.841512 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c9441864-36fb-464a-89a1-2cd0086b4fdb tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:18.842703 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c9441864-36fb-464a-89a1-2cd0086b4fdb tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:18.843476 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c9441864-36fb-464a-89a1-2cd0086b4fdb tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:18.843918 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c9441864-36fb-464a-89a1-2cd0086b4fdb tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:18.878968 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-713f90e2-552d-4031-b3f1-95c4ddb388b2 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:18.887232 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-713f90e2-552d-4031-b3f1-95c4ddb388b2 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.090776 Jun 17 13:27:18.887910 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1271/2574] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:27:18 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:27:18.893004 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-1aa68c71-50da-4f45-97f5-02829c0c7336 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:18.893604 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-1aa68c71-50da-4f45-97f5-02829c0c7336 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:18.899915 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1aa68c71-50da-4f45-97f5-02829c0c7336 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:18.900328 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1aa68c71-50da-4f45-97f5-02829c0c7336 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:18.901184 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1aa68c71-50da-4f45-97f5-02829c0c7336 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:18.901634 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1aa68c71-50da-4f45-97f5-02829c0c7336 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:18.974043 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-1aa68c71-50da-4f45-97f5-02829c0c7336 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:18.983338 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-1aa68c71-50da-4f45-97f5-02829c0c7336 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:18.985133 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-1aa68c71-50da-4f45-97f5-02829c0c7336 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:18.986382 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-1aa68c71-50da-4f45-97f5-02829c0c7336 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.097344 Jun 17 13:27:18.987107 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1272/2575] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:27:18 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:27:19.009085 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-c9441864-36fb-464a-89a1-2cd0086b4fdb tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:19.017385 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-c9441864-36fb-464a-89a1-2cd0086b4fdb tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.187548 Jun 17 13:27:19.017960 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1304/2576] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:27:18 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:27:19.909334 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-885c4999-125e-4a36-a4be-348f762e60ed tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:19.910337 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-885c4999-125e-4a36-a4be-348f762e60ed tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:19.920694 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-885c4999-125e-4a36-a4be-348f762e60ed tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:19.921268 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-885c4999-125e-4a36-a4be-348f762e60ed tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:19.922026 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-885c4999-125e-4a36-a4be-348f762e60ed tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:19.922483 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-885c4999-125e-4a36-a4be-348f762e60ed tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:19.991922 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-885c4999-125e-4a36-a4be-348f762e60ed tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:20.000566 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-885c4999-125e-4a36-a4be-348f762e60ed tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.098576 Jun 17 13:27:20.001138 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1273/2577] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:27:19 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:27:20.008726 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-8227e2db-3e43-45aa-8704-40f2bbdbf5a4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:20.009401 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-8227e2db-3e43-45aa-8704-40f2bbdbf5a4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:20.016625 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8227e2db-3e43-45aa-8704-40f2bbdbf5a4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:20.017170 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8227e2db-3e43-45aa-8704-40f2bbdbf5a4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:20.017913 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8227e2db-3e43-45aa-8704-40f2bbdbf5a4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:20.018377 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8227e2db-3e43-45aa-8704-40f2bbdbf5a4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:20.033920 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-447f3ab3-1bff-4912-afac-0f7137dab48f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:20.034569 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-447f3ab3-1bff-4912-afac-0f7137dab48f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:20.041006 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-447f3ab3-1bff-4912-afac-0f7137dab48f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:20.041581 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-447f3ab3-1bff-4912-afac-0f7137dab48f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:20.042390 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-447f3ab3-1bff-4912-afac-0f7137dab48f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:20.042832 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-447f3ab3-1bff-4912-afac-0f7137dab48f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:20.062339 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=100 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:27:20.083337 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-8227e2db-3e43-45aa-8704-40f2bbdbf5a4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:20.092398 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-8227e2db-3e43-45aa-8704-40f2bbdbf5a4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:20.093842 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-8227e2db-3e43-45aa-8704-40f2bbdbf5a4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:20.095027 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-8227e2db-3e43-45aa-8704-40f2bbdbf5a4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.090143 Jun 17 13:27:20.095588 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1305/2578] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:27:20 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:27:20.182119 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-447f3ab3-1bff-4912-afac-0f7137dab48f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:20.190787 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-447f3ab3-1bff-4912-afac-0f7137dab48f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.160946 Jun 17 13:27:20.191362 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1274/2579] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:27:20 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:27:21.019524 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-3f23fe7e-98e9-4124-a69f-94bf4186aab8 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:21.020162 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-3f23fe7e-98e9-4124-a69f-94bf4186aab8 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:21.030273 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-3f23fe7e-98e9-4124-a69f-94bf4186aab8 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:21.030734 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-3f23fe7e-98e9-4124-a69f-94bf4186aab8 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:21.031505 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-3f23fe7e-98e9-4124-a69f-94bf4186aab8 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:21.031945 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-3f23fe7e-98e9-4124-a69f-94bf4186aab8 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:21.096331 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-3f23fe7e-98e9-4124-a69f-94bf4186aab8 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:21.107978 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-3f23fe7e-98e9-4124-a69f-94bf4186aab8 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.092436 Jun 17 13:27:21.108537 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1306/2580] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:27:21 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:27:21.113539 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-3d22d52c-7608-4c44-9955-2817a606cb24 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:21.114172 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-3d22d52c-7608-4c44-9955-2817a606cb24 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:21.120838 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3d22d52c-7608-4c44-9955-2817a606cb24 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:21.121283 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3d22d52c-7608-4c44-9955-2817a606cb24 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:21.122034 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3d22d52c-7608-4c44-9955-2817a606cb24 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:21.122494 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3d22d52c-7608-4c44-9955-2817a606cb24 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:21.183867 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-3d22d52c-7608-4c44-9955-2817a606cb24 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:21.192959 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-3d22d52c-7608-4c44-9955-2817a606cb24 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:21.194486 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-3d22d52c-7608-4c44-9955-2817a606cb24 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:21.195639 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-3d22d52c-7608-4c44-9955-2817a606cb24 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.086029 Jun 17 13:27:21.196203 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1275/2581] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:27:21 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:27:21.211109 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-e3ef2053-a059-4bbb-8dec-f27a39c9f7d0 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:21.211913 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-e3ef2053-a059-4bbb-8dec-f27a39c9f7d0 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:21.220126 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e3ef2053-a059-4bbb-8dec-f27a39c9f7d0 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:21.220595 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e3ef2053-a059-4bbb-8dec-f27a39c9f7d0 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:21.221367 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e3ef2053-a059-4bbb-8dec-f27a39c9f7d0 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:21.221808 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e3ef2053-a059-4bbb-8dec-f27a39c9f7d0 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:21.367654 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-e3ef2053-a059-4bbb-8dec-f27a39c9f7d0 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:21.377044 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-e3ef2053-a059-4bbb-8dec-f27a39c9f7d0 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.172189 Jun 17 13:27:21.377620 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1307/2582] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:27:21 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:27:22.129304 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-c1ce76fa-0c83-4312-a161-8dabe63b57c4 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:22.130375 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-c1ce76fa-0c83-4312-a161-8dabe63b57c4 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:22.140472 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c1ce76fa-0c83-4312-a161-8dabe63b57c4 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:22.140915 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c1ce76fa-0c83-4312-a161-8dabe63b57c4 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:22.141659 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c1ce76fa-0c83-4312-a161-8dabe63b57c4 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:22.142083 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c1ce76fa-0c83-4312-a161-8dabe63b57c4 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:22.209558 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-c1ce76fa-0c83-4312-a161-8dabe63b57c4 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:22.216905 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-67f89549-9482-4766-9863-26483c2f93cf tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:22.217511 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-67f89549-9482-4766-9863-26483c2f93cf tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:22.217876 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-c1ce76fa-0c83-4312-a161-8dabe63b57c4 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.095304 Jun 17 13:27:22.218476 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1276/2583] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:27:22 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:27:22.224580 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-67f89549-9482-4766-9863-26483c2f93cf tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:22.225054 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-67f89549-9482-4766-9863-26483c2f93cf tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:22.225829 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-67f89549-9482-4766-9863-26483c2f93cf tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:22.226296 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-67f89549-9482-4766-9863-26483c2f93cf tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:22.290006 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-67f89549-9482-4766-9863-26483c2f93cf tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:22.300078 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-67f89549-9482-4766-9863-26483c2f93cf tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:22.301625 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-67f89549-9482-4766-9863-26483c2f93cf tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:22.302788 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-67f89549-9482-4766-9863-26483c2f93cf tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.089908 Jun 17 13:27:22.303409 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1308/2584] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:27:22 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:27:22.398455 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-b4e33916-fefe-440b-a1ba-7c8b85edaa52 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:22.399432 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-b4e33916-fefe-440b-a1ba-7c8b85edaa52 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:22.410147 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b4e33916-fefe-440b-a1ba-7c8b85edaa52 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:22.410836 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b4e33916-fefe-440b-a1ba-7c8b85edaa52 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:22.411993 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b4e33916-fefe-440b-a1ba-7c8b85edaa52 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:22.412633 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b4e33916-fefe-440b-a1ba-7c8b85edaa52 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:22.551779 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-b4e33916-fefe-440b-a1ba-7c8b85edaa52 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:22.560090 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-b4e33916-fefe-440b-a1ba-7c8b85edaa52 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.167660 Jun 17 13:27:22.561409 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1277/2585] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:27:22 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:27:23.239296 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-e04e74cb-ca74-4852-ad75-680c79070eaa tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:23.240311 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-e04e74cb-ca74-4852-ad75-680c79070eaa tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:23.243970 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_api:SELECT=78 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:27:23.251027 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e04e74cb-ca74-4852-ad75-680c79070eaa tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:23.251484 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e04e74cb-ca74-4852-ad75-680c79070eaa tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:23.252268 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e04e74cb-ca74-4852-ad75-680c79070eaa tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:23.252692 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e04e74cb-ca74-4852-ad75-680c79070eaa tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:23.321389 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-71b697ec-6873-4f8a-b693-af82cd52a191 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:23.322048 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-71b697ec-6873-4f8a-b693-af82cd52a191 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:23.322695 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-e04e74cb-ca74-4852-ad75-680c79070eaa tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:23.329215 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-71b697ec-6873-4f8a-b693-af82cd52a191 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:23.329662 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-71b697ec-6873-4f8a-b693-af82cd52a191 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:23.330459 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-71b697ec-6873-4f8a-b693-af82cd52a191 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:23.330886 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-71b697ec-6873-4f8a-b693-af82cd52a191 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:23.331212 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-e04e74cb-ca74-4852-ad75-680c79070eaa tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.098369 Jun 17 13:27:23.331780 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1309/2586] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:27:23 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:27:23.392755 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-71b697ec-6873-4f8a-b693-af82cd52a191 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:23.405692 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-71b697ec-6873-4f8a-b693-af82cd52a191 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:23.407274 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-71b697ec-6873-4f8a-b693-af82cd52a191 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:23.408458 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-71b697ec-6873-4f8a-b693-af82cd52a191 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.091195 Jun 17 13:27:23.409014 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1278/2587] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:27:23 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 13:27:23.584985 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-47a980da-9571-4415-a59a-601b0ab9f8ad tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:23.585907 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-47a980da-9571-4415-a59a-601b0ab9f8ad tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:23.595145 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-47a980da-9571-4415-a59a-601b0ab9f8ad tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:23.595601 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-47a980da-9571-4415-a59a-601b0ab9f8ad tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:23.596360 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-47a980da-9571-4415-a59a-601b0ab9f8ad tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:23.596791 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-47a980da-9571-4415-a59a-601b0ab9f8ad tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:23.746692 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-47a980da-9571-4415-a59a-601b0ab9f8ad tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:23.758927 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-47a980da-9571-4415-a59a-601b0ab9f8ad tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.180281 Jun 17 13:27:23.759698 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1310/2588] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:27:23 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:27:24.351766 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-87a5f484-c4a6-426d-b39f-04d43ca45de0 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:24.352548 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-87a5f484-c4a6-426d-b39f-04d43ca45de0 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:24.362974 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-87a5f484-c4a6-426d-b39f-04d43ca45de0 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:24.363697 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-87a5f484-c4a6-426d-b39f-04d43ca45de0 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:24.364862 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-87a5f484-c4a6-426d-b39f-04d43ca45de0 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:24.365542 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-87a5f484-c4a6-426d-b39f-04d43ca45de0 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:24.426266 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-15572cbe-6009-48dc-bb1b-e35db1cda009 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:24.426871 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-15572cbe-6009-48dc-bb1b-e35db1cda009 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:24.433765 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-15572cbe-6009-48dc-bb1b-e35db1cda009 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:24.434250 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-15572cbe-6009-48dc-bb1b-e35db1cda009 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:24.434602 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-87a5f484-c4a6-426d-b39f-04d43ca45de0 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:24.435005 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-15572cbe-6009-48dc-bb1b-e35db1cda009 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:24.435572 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-15572cbe-6009-48dc-bb1b-e35db1cda009 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:24.443907 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-87a5f484-c4a6-426d-b39f-04d43ca45de0 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.098192 Jun 17 13:27:24.444522 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1279/2589] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:27:24 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:27:24.497604 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-15572cbe-6009-48dc-bb1b-e35db1cda009 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:24.506806 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-15572cbe-6009-48dc-bb1b-e35db1cda009 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:24.508306 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-15572cbe-6009-48dc-bb1b-e35db1cda009 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:24.509457 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-15572cbe-6009-48dc-bb1b-e35db1cda009 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.087206 Jun 17 13:27:24.510023 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1311/2590] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:27:24 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:27:24.780116 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-c04f1cde-c6c8-43d0-9c79-9d6bc8f7247b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:24.780763 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-c04f1cde-c6c8-43d0-9c79-9d6bc8f7247b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:24.787645 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c04f1cde-c6c8-43d0-9c79-9d6bc8f7247b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:24.788116 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c04f1cde-c6c8-43d0-9c79-9d6bc8f7247b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:24.788910 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c04f1cde-c6c8-43d0-9c79-9d6bc8f7247b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:24.789364 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c04f1cde-c6c8-43d0-9c79-9d6bc8f7247b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:24.922612 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-c04f1cde-c6c8-43d0-9c79-9d6bc8f7247b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:24.930965 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-c04f1cde-c6c8-43d0-9c79-9d6bc8f7247b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.157059 Jun 17 13:27:24.931531 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1280/2591] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:27:24 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:27:25.465380 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-b4b89b57-14c0-4301-b63d-577af41930c8 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:25.466462 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-b4b89b57-14c0-4301-b63d-577af41930c8 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:25.478120 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b4b89b57-14c0-4301-b63d-577af41930c8 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:25.478879 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b4b89b57-14c0-4301-b63d-577af41930c8 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:25.480552 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b4b89b57-14c0-4301-b63d-577af41930c8 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:25.481238 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b4b89b57-14c0-4301-b63d-577af41930c8 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:25.527880 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-adb2b0a3-b3cd-47e3-bc24-509f1c409bfb tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:25.528484 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-adb2b0a3-b3cd-47e3-bc24-509f1c409bfb tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:25.535629 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-adb2b0a3-b3cd-47e3-bc24-509f1c409bfb tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:25.536074 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-adb2b0a3-b3cd-47e3-bc24-509f1c409bfb tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:25.536837 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-adb2b0a3-b3cd-47e3-bc24-509f1c409bfb tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:25.537262 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-adb2b0a3-b3cd-47e3-bc24-509f1c409bfb tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:25.546698 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-b4b89b57-14c0-4301-b63d-577af41930c8 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:25.554673 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-b4b89b57-14c0-4301-b63d-577af41930c8 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.095708 Jun 17 13:27:25.555266 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1312/2592] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:27:25 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:27:25.601297 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-adb2b0a3-b3cd-47e3-bc24-509f1c409bfb tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:25.610784 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-adb2b0a3-b3cd-47e3-bc24-509f1c409bfb tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:25.612272 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-adb2b0a3-b3cd-47e3-bc24-509f1c409bfb tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:25.613414 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-adb2b0a3-b3cd-47e3-bc24-509f1c409bfb tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.089477 Jun 17 13:27:25.614009 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1281/2593] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:27:25 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 13:27:25.948677 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-faa2323f-d338-45d4-a83b-cacaae6f8984 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:25.949290 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-faa2323f-d338-45d4-a83b-cacaae6f8984 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:25.956625 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-faa2323f-d338-45d4-a83b-cacaae6f8984 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:25.957050 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-faa2323f-d338-45d4-a83b-cacaae6f8984 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:25.957824 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-faa2323f-d338-45d4-a83b-cacaae6f8984 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:25.958302 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-faa2323f-d338-45d4-a83b-cacaae6f8984 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:26.093591 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-faa2323f-d338-45d4-a83b-cacaae6f8984 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:26.106072 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-faa2323f-d338-45d4-a83b-cacaae6f8984 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.160991 Jun 17 13:27:26.106840 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1313/2594] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:27:25 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:27:26.576212 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-2a8419b8-acf4-474c-bdd2-855e006fbd20 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:26.577565 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-2a8419b8-acf4-474c-bdd2-855e006fbd20 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:26.588523 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2a8419b8-acf4-474c-bdd2-855e006fbd20 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:26.589264 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2a8419b8-acf4-474c-bdd2-855e006fbd20 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:26.590554 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2a8419b8-acf4-474c-bdd2-855e006fbd20 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:26.591275 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2a8419b8-acf4-474c-bdd2-855e006fbd20 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:26.631046 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-6580d100-2597-454c-b1f8-d2a9ccf77018 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:26.631646 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-6580d100-2597-454c-b1f8-d2a9ccf77018 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:26.638768 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6580d100-2597-454c-b1f8-d2a9ccf77018 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:26.639216 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6580d100-2597-454c-b1f8-d2a9ccf77018 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:26.639982 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6580d100-2597-454c-b1f8-d2a9ccf77018 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:26.640414 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6580d100-2597-454c-b1f8-d2a9ccf77018 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:26.659293 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-2a8419b8-acf4-474c-bdd2-855e006fbd20 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:26.667674 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-2a8419b8-acf4-474c-bdd2-855e006fbd20 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.098056 Jun 17 13:27:26.670700 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1282/2595] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:27:26 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:27:26.706019 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-6580d100-2597-454c-b1f8-d2a9ccf77018 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:26.714544 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-6580d100-2597-454c-b1f8-d2a9ccf77018 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:26.716029 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-6580d100-2597-454c-b1f8-d2a9ccf77018 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:26.717338 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-6580d100-2597-454c-b1f8-d2a9ccf77018 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.090128 Jun 17 13:27:26.717886 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1314/2596] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:27:26 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:27:27.127639 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-0668b9f3-b49e-4246-ae0d-b0a72144b104 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:27.128663 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-0668b9f3-b49e-4246-ae0d-b0a72144b104 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:27.139000 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0668b9f3-b49e-4246-ae0d-b0a72144b104 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:27.139907 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0668b9f3-b49e-4246-ae0d-b0a72144b104 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:27.141201 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0668b9f3-b49e-4246-ae0d-b0a72144b104 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:27.141886 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0668b9f3-b49e-4246-ae0d-b0a72144b104 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:27.280835 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-0668b9f3-b49e-4246-ae0d-b0a72144b104 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:27.289032 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-0668b9f3-b49e-4246-ae0d-b0a72144b104 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.167979 Jun 17 13:27:27.289594 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1283/2597] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:27:27 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:27:27.689222 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-668c50d1-8a19-47ea-9da1-562e016695fb tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:27.690321 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-668c50d1-8a19-47ea-9da1-562e016695fb tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:27.701489 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-668c50d1-8a19-47ea-9da1-562e016695fb tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:27.701901 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-668c50d1-8a19-47ea-9da1-562e016695fb tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:27.702692 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-668c50d1-8a19-47ea-9da1-562e016695fb tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:27.703122 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-668c50d1-8a19-47ea-9da1-562e016695fb tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:27.736524 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-c8192852-c692-4f68-88a3-4e95766f2ff1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:27.737154 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-c8192852-c692-4f68-88a3-4e95766f2ff1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:27.744195 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c8192852-c692-4f68-88a3-4e95766f2ff1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:27.744708 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c8192852-c692-4f68-88a3-4e95766f2ff1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:27.745481 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c8192852-c692-4f68-88a3-4e95766f2ff1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:27.745920 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c8192852-c692-4f68-88a3-4e95766f2ff1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:27.766601 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-668c50d1-8a19-47ea-9da1-562e016695fb tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:27.775397 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-668c50d1-8a19-47ea-9da1-562e016695fb tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.092335 Jun 17 13:27:27.776008 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1315/2598] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:27:27 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:27:27.812219 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-c8192852-c692-4f68-88a3-4e95766f2ff1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:27.825727 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-c8192852-c692-4f68-88a3-4e95766f2ff1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:27.828378 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-c8192852-c692-4f68-88a3-4e95766f2ff1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:27.830198 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-c8192852-c692-4f68-88a3-4e95766f2ff1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.097665 Jun 17 13:27:27.831038 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1284/2599] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:27:27 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:27:28.307127 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-9fa41a89-6c3f-4b63-a6ae-d8f10afa0186 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:28.308066 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-9fa41a89-6c3f-4b63-a6ae-d8f10afa0186 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:28.314855 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9fa41a89-6c3f-4b63-a6ae-d8f10afa0186 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:28.315308 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9fa41a89-6c3f-4b63-a6ae-d8f10afa0186 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:28.316070 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9fa41a89-6c3f-4b63-a6ae-d8f10afa0186 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:28.316504 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9fa41a89-6c3f-4b63-a6ae-d8f10afa0186 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:28.457446 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-9fa41a89-6c3f-4b63-a6ae-d8f10afa0186 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:28.469481 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-9fa41a89-6c3f-4b63-a6ae-d8f10afa0186 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.166029 Jun 17 13:27:28.470433 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1316/2600] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:27:28 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:27:28.795540 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-3c34e09b-dab1-452a-b6b9-81015b3a360f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:28.796248 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-3c34e09b-dab1-452a-b6b9-81015b3a360f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:28.805906 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3c34e09b-dab1-452a-b6b9-81015b3a360f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:28.806504 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3c34e09b-dab1-452a-b6b9-81015b3a360f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:28.807363 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3c34e09b-dab1-452a-b6b9-81015b3a360f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:28.807915 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3c34e09b-dab1-452a-b6b9-81015b3a360f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:28.852942 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-1c91e49a-57ab-48fe-a76a-c39e949e561a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:28.853572 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-1c91e49a-57ab-48fe-a76a-c39e949e561a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:28.860707 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-1c91e49a-57ab-48fe-a76a-c39e949e561a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:28.861155 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-1c91e49a-57ab-48fe-a76a-c39e949e561a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:28.861910 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-1c91e49a-57ab-48fe-a76a-c39e949e561a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:28.862377 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-1c91e49a-57ab-48fe-a76a-c39e949e561a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:28.872285 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-3c34e09b-dab1-452a-b6b9-81015b3a360f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:28.880810 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-3c34e09b-dab1-452a-b6b9-81015b3a360f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.091105 Jun 17 13:27:28.881450 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1285/2601] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:27:28 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:27:28.923796 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-1c91e49a-57ab-48fe-a76a-c39e949e561a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:28.927195 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_cell1:SELECT=100 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:27:28.932554 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-1c91e49a-57ab-48fe-a76a-c39e949e561a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:28.934039 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-1c91e49a-57ab-48fe-a76a-c39e949e561a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:28.935215 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-1c91e49a-57ab-48fe-a76a-c39e949e561a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.086226 Jun 17 13:27:28.935785 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1317/2602] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:27:28 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:27:29.495743 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-1bd20fb3-89e1-41b0-a390-a338c07104ab tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:29.496666 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-1bd20fb3-89e1-41b0-a390-a338c07104ab tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:29.504231 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1bd20fb3-89e1-41b0-a390-a338c07104ab tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:29.504679 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1bd20fb3-89e1-41b0-a390-a338c07104ab tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:29.505457 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1bd20fb3-89e1-41b0-a390-a338c07104ab tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:29.505866 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1bd20fb3-89e1-41b0-a390-a338c07104ab tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:29.623757 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 13:27:29.623981 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Fri Jun 17 13:27:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 17 13:27:29.650514 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-1bd20fb3-89e1-41b0-a390-a338c07104ab tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:29.659441 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-1bd20fb3-89e1-41b0-a390-a338c07104ab tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.170120 Jun 17 13:27:29.660014 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1286/2603] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:27:29 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:27:29.902510 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-91d6a4f6-6446-40df-8a13-30279d7f9b18 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:29.903457 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-91d6a4f6-6446-40df-8a13-30279d7f9b18 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:29.915261 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-91d6a4f6-6446-40df-8a13-30279d7f9b18 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:29.916003 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-91d6a4f6-6446-40df-8a13-30279d7f9b18 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:29.917252 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-91d6a4f6-6446-40df-8a13-30279d7f9b18 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:29.917974 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-91d6a4f6-6446-40df-8a13-30279d7f9b18 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:29.959376 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-12fd153e-92ad-4f65-bf25-91a3303c9bb8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:29.960046 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-12fd153e-92ad-4f65-bf25-91a3303c9bb8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:29.967651 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-12fd153e-92ad-4f65-bf25-91a3303c9bb8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:29.968109 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-12fd153e-92ad-4f65-bf25-91a3303c9bb8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:29.968890 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-12fd153e-92ad-4f65-bf25-91a3303c9bb8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:29.969326 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-12fd153e-92ad-4f65-bf25-91a3303c9bb8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:29.983422 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-91d6a4f6-6446-40df-8a13-30279d7f9b18 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:29.991643 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-91d6a4f6-6446-40df-8a13-30279d7f9b18 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.096197 Jun 17 13:27:29.998480 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1318/2604] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:27:29 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:27:30.040362 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-12fd153e-92ad-4f65-bf25-91a3303c9bb8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:30.049670 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-12fd153e-92ad-4f65-bf25-91a3303c9bb8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:30.051200 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-12fd153e-92ad-4f65-bf25-91a3303c9bb8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:30.052337 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-12fd153e-92ad-4f65-bf25-91a3303c9bb8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.096920 Jun 17 13:27:30.052911 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1287/2605] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:27:29 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:27:30.680850 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-2d44f9a3-c305-4609-81a0-379b6d53a736 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:30.681843 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-2d44f9a3-c305-4609-81a0-379b6d53a736 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:30.692651 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2d44f9a3-c305-4609-81a0-379b6d53a736 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:30.693400 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2d44f9a3-c305-4609-81a0-379b6d53a736 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:30.694898 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2d44f9a3-c305-4609-81a0-379b6d53a736 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:30.695621 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2d44f9a3-c305-4609-81a0-379b6d53a736 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:30.829090 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-2d44f9a3-c305-4609-81a0-379b6d53a736 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:30.837880 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-2d44f9a3-c305-4609-81a0-379b6d53a736 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.163405 Jun 17 13:27:30.838491 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1319/2606] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:27:30 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:27:31.013270 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-c9c829bd-3d55-4582-999e-bbfe96254017 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:31.014175 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-c9c829bd-3d55-4582-999e-bbfe96254017 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:31.025073 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c9c829bd-3d55-4582-999e-bbfe96254017 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:31.025754 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c9c829bd-3d55-4582-999e-bbfe96254017 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:31.027076 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c9c829bd-3d55-4582-999e-bbfe96254017 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:31.027785 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c9c829bd-3d55-4582-999e-bbfe96254017 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:31.071561 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-a1841602-6a98-4c59-b5ee-210c7f9c8c50 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:31.072135 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-a1841602-6a98-4c59-b5ee-210c7f9c8c50 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:31.079036 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a1841602-6a98-4c59-b5ee-210c7f9c8c50 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:31.079486 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a1841602-6a98-4c59-b5ee-210c7f9c8c50 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:31.080242 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a1841602-6a98-4c59-b5ee-210c7f9c8c50 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:31.080675 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a1841602-6a98-4c59-b5ee-210c7f9c8c50 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:31.091055 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-c9c829bd-3d55-4582-999e-bbfe96254017 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:31.099587 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-c9c829bd-3d55-4582-999e-bbfe96254017 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.092756 Jun 17 13:27:31.100157 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1288/2607] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:27:31 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:27:31.142835 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-a1841602-6a98-4c59-b5ee-210c7f9c8c50 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:31.151796 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-a1841602-6a98-4c59-b5ee-210c7f9c8c50 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:31.153258 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-a1841602-6a98-4c59-b5ee-210c7f9c8c50 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:31.154517 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-a1841602-6a98-4c59-b5ee-210c7f9c8c50 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.086955 Jun 17 13:27:31.155099 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1320/2608] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:27:31 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:27:31.855905 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-d2622361-aa20-4593-a212-c4241664b6ed tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:31.856524 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-d2622361-aa20-4593-a212-c4241664b6ed tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:31.863074 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d2622361-aa20-4593-a212-c4241664b6ed tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:31.863525 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d2622361-aa20-4593-a212-c4241664b6ed tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:31.864271 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d2622361-aa20-4593-a212-c4241664b6ed tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:31.864725 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d2622361-aa20-4593-a212-c4241664b6ed tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:32.036364 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-d2622361-aa20-4593-a212-c4241664b6ed tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:32.044687 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-d2622361-aa20-4593-a212-c4241664b6ed tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.192918 Jun 17 13:27:32.045548 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1289/2609] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:27:31 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:27:32.121049 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-6e494c7d-3b29-43db-9c11-976e1f87bf25 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:32.122046 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-6e494c7d-3b29-43db-9c11-976e1f87bf25 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:32.133448 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6e494c7d-3b29-43db-9c11-976e1f87bf25 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:32.134250 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6e494c7d-3b29-43db-9c11-976e1f87bf25 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:32.135505 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6e494c7d-3b29-43db-9c11-976e1f87bf25 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:32.136224 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6e494c7d-3b29-43db-9c11-976e1f87bf25 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:32.173122 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-760ec925-c7ad-47a3-8190-88c552a54de4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:32.173761 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-760ec925-c7ad-47a3-8190-88c552a54de4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:32.180666 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-760ec925-c7ad-47a3-8190-88c552a54de4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:32.181017 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-760ec925-c7ad-47a3-8190-88c552a54de4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:32.181810 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-760ec925-c7ad-47a3-8190-88c552a54de4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:32.182278 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-760ec925-c7ad-47a3-8190-88c552a54de4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:32.201641 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-6e494c7d-3b29-43db-9c11-976e1f87bf25 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:32.209670 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-6e494c7d-3b29-43db-9c11-976e1f87bf25 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.094866 Jun 17 13:27:32.210261 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1321/2610] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:27:32 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:27:32.249556 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-760ec925-c7ad-47a3-8190-88c552a54de4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:32.258429 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-760ec925-c7ad-47a3-8190-88c552a54de4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:32.259929 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-760ec925-c7ad-47a3-8190-88c552a54de4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:32.261077 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-760ec925-c7ad-47a3-8190-88c552a54de4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.091924 Jun 17 13:27:32.261661 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1290/2611] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:27:32 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:27:33.065478 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-46631782-d13d-4308-9328-032e44683be6 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:33.066465 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-46631782-d13d-4308-9328-032e44683be6 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:33.077094 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-46631782-d13d-4308-9328-032e44683be6 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:33.077769 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-46631782-d13d-4308-9328-032e44683be6 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:33.079076 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-46631782-d13d-4308-9328-032e44683be6 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:33.079717 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-46631782-d13d-4308-9328-032e44683be6 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:33.222123 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-46631782-d13d-4308-9328-032e44683be6 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:33.226590 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-dd3a2217-7092-447c-9b82-742f816205d9 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:33.227196 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-dd3a2217-7092-447c-9b82-742f816205d9 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:33.230970 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-46631782-d13d-4308-9328-032e44683be6 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.172057 Jun 17 13:27:33.231548 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1322/2612] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:27:33 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:27:33.234387 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dd3a2217-7092-447c-9b82-742f816205d9 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:33.234831 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dd3a2217-7092-447c-9b82-742f816205d9 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:33.235576 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dd3a2217-7092-447c-9b82-742f816205d9 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:33.236009 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dd3a2217-7092-447c-9b82-742f816205d9 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:33.240004 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=100 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:27:33.279552 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-bd8e2cfd-dae4-4fe1-8ac4-f59adb60fca0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:33.280167 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-bd8e2cfd-dae4-4fe1-8ac4-f59adb60fca0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:33.286555 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-bd8e2cfd-dae4-4fe1-8ac4-f59adb60fca0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:33.287033 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-bd8e2cfd-dae4-4fe1-8ac4-f59adb60fca0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:33.287796 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-bd8e2cfd-dae4-4fe1-8ac4-f59adb60fca0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:33.288227 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-bd8e2cfd-dae4-4fe1-8ac4-f59adb60fca0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:33.297899 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-dd3a2217-7092-447c-9b82-742f816205d9 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:33.306332 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-dd3a2217-7092-447c-9b82-742f816205d9 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.083488 Jun 17 13:27:33.307220 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1291/2613] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:27:33 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:27:33.352586 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-bd8e2cfd-dae4-4fe1-8ac4-f59adb60fca0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:33.362111 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-bd8e2cfd-dae4-4fe1-8ac4-f59adb60fca0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:33.363611 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-bd8e2cfd-dae4-4fe1-8ac4-f59adb60fca0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:33.364751 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-bd8e2cfd-dae4-4fe1-8ac4-f59adb60fca0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.089358 Jun 17 13:27:33.365314 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1323/2614] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:27:33 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:27:34.252545 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-8b680a0d-fc64-4b8b-83ec-599d9cbcfc17 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:34.253435 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-8b680a0d-fc64-4b8b-83ec-599d9cbcfc17 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:34.264239 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8b680a0d-fc64-4b8b-83ec-599d9cbcfc17 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:34.264682 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8b680a0d-fc64-4b8b-83ec-599d9cbcfc17 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:34.265439 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8b680a0d-fc64-4b8b-83ec-599d9cbcfc17 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:34.265862 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8b680a0d-fc64-4b8b-83ec-599d9cbcfc17 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:34.323436 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-07e9e8a1-b780-4ba6-9716-fff8f56ab9d9 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:34.324048 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-07e9e8a1-b780-4ba6-9716-fff8f56ab9d9 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:34.331477 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-07e9e8a1-b780-4ba6-9716-fff8f56ab9d9 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:34.331929 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-07e9e8a1-b780-4ba6-9716-fff8f56ab9d9 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:34.332686 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-07e9e8a1-b780-4ba6-9716-fff8f56ab9d9 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:34.333119 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-07e9e8a1-b780-4ba6-9716-fff8f56ab9d9 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:34.401538 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-07e9e8a1-b780-4ba6-9716-fff8f56ab9d9 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:34.410743 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-07e9e8a1-b780-4ba6-9716-fff8f56ab9d9 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.091123 Jun 17 13:27:34.411305 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1324/2615] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:27:34 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:27:34.415732 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-1751eab7-42dc-4fd8-9aac-6a730f7132b8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:34.416362 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-1751eab7-42dc-4fd8-9aac-6a730f7132b8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:34.423157 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-1751eab7-42dc-4fd8-9aac-6a730f7132b8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:34.423356 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-8b680a0d-fc64-4b8b-83ec-599d9cbcfc17 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:34.423609 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-1751eab7-42dc-4fd8-9aac-6a730f7132b8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:34.424363 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-1751eab7-42dc-4fd8-9aac-6a730f7132b8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:34.424808 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-1751eab7-42dc-4fd8-9aac-6a730f7132b8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:34.431545 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-8b680a0d-fc64-4b8b-83ec-599d9cbcfc17 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.185827 Jun 17 13:27:34.432291 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1292/2616] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:27:34 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:27:34.495588 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-1751eab7-42dc-4fd8-9aac-6a730f7132b8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:34.506158 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-1751eab7-42dc-4fd8-9aac-6a730f7132b8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:34.508346 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-1751eab7-42dc-4fd8-9aac-6a730f7132b8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:34.510037 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-1751eab7-42dc-4fd8-9aac-6a730f7132b8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.097568 Jun 17 13:27:34.510802 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1325/2617] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:27:34 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:27:35.428015 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-c2c60192-28aa-48be-8292-9a176262b3dc tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:35.428640 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-c2c60192-28aa-48be-8292-9a176262b3dc tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:35.436258 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c2c60192-28aa-48be-8292-9a176262b3dc tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:35.436707 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c2c60192-28aa-48be-8292-9a176262b3dc tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:35.437477 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c2c60192-28aa-48be-8292-9a176262b3dc tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:35.437908 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c2c60192-28aa-48be-8292-9a176262b3dc tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:35.448714 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-d34df355-1ad5-4880-9442-35af66d1e6ac tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:35.449280 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-d34df355-1ad5-4880-9442-35af66d1e6ac tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:35.456685 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d34df355-1ad5-4880-9442-35af66d1e6ac tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:35.457146 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d34df355-1ad5-4880-9442-35af66d1e6ac tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:35.457886 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d34df355-1ad5-4880-9442-35af66d1e6ac tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:35.458405 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d34df355-1ad5-4880-9442-35af66d1e6ac tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:35.514480 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-c2c60192-28aa-48be-8292-9a176262b3dc tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:35.522542 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-c2c60192-28aa-48be-8292-9a176262b3dc tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.098375 Jun 17 13:27:35.523118 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1293/2618] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:27:35 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:27:35.534520 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-09c53020-4385-4166-ba08-495b27e051f3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:35.535138 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-09c53020-4385-4166-ba08-495b27e051f3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:35.541538 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-09c53020-4385-4166-ba08-495b27e051f3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:35.541991 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-09c53020-4385-4166-ba08-495b27e051f3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:35.542791 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-09c53020-4385-4166-ba08-495b27e051f3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:35.543225 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-09c53020-4385-4166-ba08-495b27e051f3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:35.817886 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-09c53020-4385-4166-ba08-495b27e051f3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:35.829117 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-09c53020-4385-4166-ba08-495b27e051f3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:35.830627 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-09c53020-4385-4166-ba08-495b27e051f3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:35.831767 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-09c53020-4385-4166-ba08-495b27e051f3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.301113 Jun 17 13:27:35.832317 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1294/2619] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:27:35 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:27:35.875521 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-d34df355-1ad5-4880-9442-35af66d1e6ac tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:35.883777 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-d34df355-1ad5-4880-9442-35af66d1e6ac tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.438941 Jun 17 13:27:35.884382 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1326/2620] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:27:35 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:27:36.541789 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-2262c5a3-6098-4efb-bf5b-7938d7e48419 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:36.542429 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-2262c5a3-6098-4efb-bf5b-7938d7e48419 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:36.550036 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2262c5a3-6098-4efb-bf5b-7938d7e48419 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:36.550523 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2262c5a3-6098-4efb-bf5b-7938d7e48419 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:36.551284 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2262c5a3-6098-4efb-bf5b-7938d7e48419 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:36.551715 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2262c5a3-6098-4efb-bf5b-7938d7e48419 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:36.623341 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-2262c5a3-6098-4efb-bf5b-7938d7e48419 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:36.632074 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-2262c5a3-6098-4efb-bf5b-7938d7e48419 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.096188 Jun 17 13:27:36.632646 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1295/2621] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:27:36 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:27:36.853334 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-348f9c6c-a693-4000-8980-5ab017ff0ef8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:36.853995 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-348f9c6c-a693-4000-8980-5ab017ff0ef8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:36.864335 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-348f9c6c-a693-4000-8980-5ab017ff0ef8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:36.864982 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-348f9c6c-a693-4000-8980-5ab017ff0ef8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:36.866271 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-348f9c6c-a693-4000-8980-5ab017ff0ef8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:36.866976 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-348f9c6c-a693-4000-8980-5ab017ff0ef8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:36.901020 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-a624ad82-b553-4be9-8e21-ef6ad29459c8 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:36.901775 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-a624ad82-b553-4be9-8e21-ef6ad29459c8 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:36.908435 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a624ad82-b553-4be9-8e21-ef6ad29459c8 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:36.908875 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a624ad82-b553-4be9-8e21-ef6ad29459c8 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:36.909724 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a624ad82-b553-4be9-8e21-ef6ad29459c8 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:36.910175 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a624ad82-b553-4be9-8e21-ef6ad29459c8 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:36.934402 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-348f9c6c-a693-4000-8980-5ab017ff0ef8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:36.943348 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-348f9c6c-a693-4000-8980-5ab017ff0ef8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:36.944833 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-348f9c6c-a693-4000-8980-5ab017ff0ef8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:36.946013 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-348f9c6c-a693-4000-8980-5ab017ff0ef8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.099181 Jun 17 13:27:36.946608 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1327/2622] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:27:36 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:27:37.042806 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-a624ad82-b553-4be9-8e21-ef6ad29459c8 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:37.055835 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-a624ad82-b553-4be9-8e21-ef6ad29459c8 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.158489 Jun 17 13:27:37.056641 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1296/2623] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:27:36 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:27:37.654397 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-be02f02b-f098-4f88-9799-b005d343b03e tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:37.654684 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-be02f02b-f098-4f88-9799-b005d343b03e tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:37.661561 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-be02f02b-f098-4f88-9799-b005d343b03e tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:37.662030 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-be02f02b-f098-4f88-9799-b005d343b03e tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:37.662864 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-be02f02b-f098-4f88-9799-b005d343b03e tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:37.663312 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-be02f02b-f098-4f88-9799-b005d343b03e tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:37.727019 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-be02f02b-f098-4f88-9799-b005d343b03e tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:37.739984 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-be02f02b-f098-4f88-9799-b005d343b03e tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.092130 Jun 17 13:27:37.740679 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1328/2624] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:27:37 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:27:37.965050 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-6f5f0477-1985-4380-8b50-0f27a5308760 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:37.966362 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-6f5f0477-1985-4380-8b50-0f27a5308760 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:37.973524 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6f5f0477-1985-4380-8b50-0f27a5308760 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:37.973966 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6f5f0477-1985-4380-8b50-0f27a5308760 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:37.974769 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6f5f0477-1985-4380-8b50-0f27a5308760 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:37.975205 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6f5f0477-1985-4380-8b50-0f27a5308760 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:38.038965 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-6f5f0477-1985-4380-8b50-0f27a5308760 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:38.047914 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-6f5f0477-1985-4380-8b50-0f27a5308760 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:38.049409 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-6f5f0477-1985-4380-8b50-0f27a5308760 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:38.050613 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-6f5f0477-1985-4380-8b50-0f27a5308760 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.089540 Jun 17 13:27:38.051176 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1297/2625] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:27:37 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:27:38.072794 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-7fb51c49-18bd-41dc-ae3b-3c1f4aa47b34 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:38.073435 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-7fb51c49-18bd-41dc-ae3b-3c1f4aa47b34 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:38.080501 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7fb51c49-18bd-41dc-ae3b-3c1f4aa47b34 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:38.080954 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7fb51c49-18bd-41dc-ae3b-3c1f4aa47b34 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:38.081714 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7fb51c49-18bd-41dc-ae3b-3c1f4aa47b34 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:38.082186 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7fb51c49-18bd-41dc-ae3b-3c1f4aa47b34 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:38.214506 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-7fb51c49-18bd-41dc-ae3b-3c1f4aa47b34 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:38.222687 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-7fb51c49-18bd-41dc-ae3b-3c1f4aa47b34 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.153743 Jun 17 13:27:38.223233 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1329/2626] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:27:38 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:27:38.763736 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-802b3663-9724-4684-8bcc-9e51f6daf279 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:38.764348 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-802b3663-9724-4684-8bcc-9e51f6daf279 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:38.770853 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-802b3663-9724-4684-8bcc-9e51f6daf279 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:38.771289 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-802b3663-9724-4684-8bcc-9e51f6daf279 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:38.772096 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-802b3663-9724-4684-8bcc-9e51f6daf279 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:38.772518 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-802b3663-9724-4684-8bcc-9e51f6daf279 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:38.842617 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-802b3663-9724-4684-8bcc-9e51f6daf279 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:38.851358 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-802b3663-9724-4684-8bcc-9e51f6daf279 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.093983 Jun 17 13:27:38.851934 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1298/2627] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:27:38 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:27:39.073581 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-3dc5c9e4-ed69-45d2-a97d-b964dff1c21b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:39.074534 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-3dc5c9e4-ed69-45d2-a97d-b964dff1c21b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:39.084940 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-3dc5c9e4-ed69-45d2-a97d-b964dff1c21b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:39.085690 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-3dc5c9e4-ed69-45d2-a97d-b964dff1c21b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:39.086993 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-3dc5c9e4-ed69-45d2-a97d-b964dff1c21b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:39.087720 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-3dc5c9e4-ed69-45d2-a97d-b964dff1c21b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:39.161877 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-3dc5c9e4-ed69-45d2-a97d-b964dff1c21b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:39.175837 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-3dc5c9e4-ed69-45d2-a97d-b964dff1c21b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:39.178214 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-3dc5c9e4-ed69-45d2-a97d-b964dff1c21b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:39.179961 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-3dc5c9e4-ed69-45d2-a97d-b964dff1c21b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.113132 Jun 17 13:27:39.180748 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1330/2628] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:27:39 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:27:39.242873 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-72ae340b-a8eb-4537-87b7-ed0be8e04b62 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:39.243808 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-72ae340b-a8eb-4537-87b7-ed0be8e04b62 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:39.252384 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-72ae340b-a8eb-4537-87b7-ed0be8e04b62 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:39.252818 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-72ae340b-a8eb-4537-87b7-ed0be8e04b62 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:39.253573 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-72ae340b-a8eb-4537-87b7-ed0be8e04b62 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:39.254009 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-72ae340b-a8eb-4537-87b7-ed0be8e04b62 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:39.397633 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-72ae340b-a8eb-4537-87b7-ed0be8e04b62 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:39.409224 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-72ae340b-a8eb-4537-87b7-ed0be8e04b62 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.172187 Jun 17 13:27:39.409925 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1299/2629] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:27:39 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:27:39.870027 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-4063dc9c-b322-401b-887f-7e111c9956d5 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:39.870745 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-4063dc9c-b322-401b-887f-7e111c9956d5 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:39.878887 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4063dc9c-b322-401b-887f-7e111c9956d5 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:39.879567 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4063dc9c-b322-401b-887f-7e111c9956d5 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:39.880698 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4063dc9c-b322-401b-887f-7e111c9956d5 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:39.881432 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4063dc9c-b322-401b-887f-7e111c9956d5 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:39.955052 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-4063dc9c-b322-401b-887f-7e111c9956d5 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:39.963317 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-4063dc9c-b322-401b-887f-7e111c9956d5 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.097610 Jun 17 13:27:39.963882 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1331/2630] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:27:39 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:27:40.203608 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-049c5ef5-7c36-4229-8db5-8afac4148440 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:40.204266 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-049c5ef5-7c36-4229-8db5-8afac4148440 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:40.212234 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-049c5ef5-7c36-4229-8db5-8afac4148440 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:40.212791 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-049c5ef5-7c36-4229-8db5-8afac4148440 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:40.213726 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-049c5ef5-7c36-4229-8db5-8afac4148440 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:40.214305 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-049c5ef5-7c36-4229-8db5-8afac4148440 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:40.283244 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-049c5ef5-7c36-4229-8db5-8afac4148440 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:40.292103 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-049c5ef5-7c36-4229-8db5-8afac4148440 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:40.293665 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-049c5ef5-7c36-4229-8db5-8afac4148440 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:40.294915 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-049c5ef5-7c36-4229-8db5-8afac4148440 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.097465 Jun 17 13:27:40.295435 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1300/2631] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:27:40 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:27:40.429317 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-9306f95d-56c2-44c1-a652-5e8e08ce1b97 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:40.430052 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-9306f95d-56c2-44c1-a652-5e8e08ce1b97 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:40.439268 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9306f95d-56c2-44c1-a652-5e8e08ce1b97 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:40.439861 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9306f95d-56c2-44c1-a652-5e8e08ce1b97 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:40.440864 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9306f95d-56c2-44c1-a652-5e8e08ce1b97 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:40.441443 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9306f95d-56c2-44c1-a652-5e8e08ce1b97 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:40.581672 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-9306f95d-56c2-44c1-a652-5e8e08ce1b97 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:40.590370 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-9306f95d-56c2-44c1-a652-5e8e08ce1b97 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.166325 Jun 17 13:27:40.590938 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1332/2632] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:27:40 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:27:40.984203 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-5b686f80-3bb2-425f-a458-da6ab76ea891 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:40.984850 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-5b686f80-3bb2-425f-a458-da6ab76ea891 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:40.991741 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5b686f80-3bb2-425f-a458-da6ab76ea891 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:40.992214 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5b686f80-3bb2-425f-a458-da6ab76ea891 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:40.993008 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5b686f80-3bb2-425f-a458-da6ab76ea891 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:40.993459 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5b686f80-3bb2-425f-a458-da6ab76ea891 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:41.055681 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-5b686f80-3bb2-425f-a458-da6ab76ea891 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:41.064178 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-5b686f80-3bb2-425f-a458-da6ab76ea891 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.086261 Jun 17 13:27:41.064745 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1301/2633] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:27:40 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:27:41.314298 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-a005a29d-ec4f-47dc-a554-667e7152c0fc tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:41.314720 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-a005a29d-ec4f-47dc-a554-667e7152c0fc tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:41.321388 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a005a29d-ec4f-47dc-a554-667e7152c0fc tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:41.321837 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a005a29d-ec4f-47dc-a554-667e7152c0fc tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:41.322622 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a005a29d-ec4f-47dc-a554-667e7152c0fc tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:41.323056 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a005a29d-ec4f-47dc-a554-667e7152c0fc tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:41.388088 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-a005a29d-ec4f-47dc-a554-667e7152c0fc tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:41.397545 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-a005a29d-ec4f-47dc-a554-667e7152c0fc tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:41.399071 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-a005a29d-ec4f-47dc-a554-667e7152c0fc tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:41.400212 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-a005a29d-ec4f-47dc-a554-667e7152c0fc tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.090274 Jun 17 13:27:41.400774 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1333/2634] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:27:41 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:27:41.612967 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-8db8491f-9bb8-4f67-8e3e-500b1e179e26 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:41.613802 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-8db8491f-9bb8-4f67-8e3e-500b1e179e26 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:41.624152 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8db8491f-9bb8-4f67-8e3e-500b1e179e26 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:41.624603 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8db8491f-9bb8-4f67-8e3e-500b1e179e26 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:41.625369 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8db8491f-9bb8-4f67-8e3e-500b1e179e26 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:41.625805 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8db8491f-9bb8-4f67-8e3e-500b1e179e26 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:41.776052 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-8db8491f-9bb8-4f67-8e3e-500b1e179e26 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:41.784812 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-8db8491f-9bb8-4f67-8e3e-500b1e179e26 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.179209 Jun 17 13:27:41.785388 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1302/2635] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:27:41 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:27:42.085573 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-9d7be076-f26d-42e4-93e2-11b8a6fa6893 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:42.086666 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-9d7be076-f26d-42e4-93e2-11b8a6fa6893 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:42.095443 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9d7be076-f26d-42e4-93e2-11b8a6fa6893 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:42.095899 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9d7be076-f26d-42e4-93e2-11b8a6fa6893 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:42.096659 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9d7be076-f26d-42e4-93e2-11b8a6fa6893 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:42.097098 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9d7be076-f26d-42e4-93e2-11b8a6fa6893 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:42.115498 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_cell1:SELECT=100 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:27:42.168261 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-9d7be076-f26d-42e4-93e2-11b8a6fa6893 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:42.176869 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-9d7be076-f26d-42e4-93e2-11b8a6fa6893 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.097800 Jun 17 13:27:42.177420 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1334/2636] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:27:42 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:27:42.418876 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-03ade8cf-1659-4063-be37-82de711e212c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:42.419857 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-03ade8cf-1659-4063-be37-82de711e212c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:42.426685 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-03ade8cf-1659-4063-be37-82de711e212c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:42.427135 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-03ade8cf-1659-4063-be37-82de711e212c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:42.427887 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-03ade8cf-1659-4063-be37-82de711e212c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:42.428318 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-03ade8cf-1659-4063-be37-82de711e212c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:42.491623 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-03ade8cf-1659-4063-be37-82de711e212c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:42.500529 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-03ade8cf-1659-4063-be37-82de711e212c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:42.502023 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-03ade8cf-1659-4063-be37-82de711e212c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:42.503211 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-03ade8cf-1659-4063-be37-82de711e212c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.088403 Jun 17 13:27:42.503748 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1303/2637] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:27:42 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:27:42.806236 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-95e13736-2759-4799-90e2-c0a1cd738028 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:42.807256 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-95e13736-2759-4799-90e2-c0a1cd738028 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:42.815145 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-95e13736-2759-4799-90e2-c0a1cd738028 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:42.815596 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-95e13736-2759-4799-90e2-c0a1cd738028 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:42.816361 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-95e13736-2759-4799-90e2-c0a1cd738028 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:42.816859 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-95e13736-2759-4799-90e2-c0a1cd738028 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:42.969276 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-95e13736-2759-4799-90e2-c0a1cd738028 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:42.981138 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-95e13736-2759-4799-90e2-c0a1cd738028 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.181327 Jun 17 13:27:42.982333 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1335/2638] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:27:42 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:27:43.197759 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-3adad1e5-9ca9-4c84-b4a8-fdea3cf36174 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:43.198484 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-3adad1e5-9ca9-4c84-b4a8-fdea3cf36174 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:43.205669 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3adad1e5-9ca9-4c84-b4a8-fdea3cf36174 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:43.206128 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3adad1e5-9ca9-4c84-b4a8-fdea3cf36174 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:43.206900 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3adad1e5-9ca9-4c84-b4a8-fdea3cf36174 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:43.207349 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3adad1e5-9ca9-4c84-b4a8-fdea3cf36174 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:43.276665 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-3adad1e5-9ca9-4c84-b4a8-fdea3cf36174 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:43.285439 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-3adad1e5-9ca9-4c84-b4a8-fdea3cf36174 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.091643 Jun 17 13:27:43.286008 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1304/2639] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:27:43 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:27:43.525517 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-6b7eee55-55c7-424e-bb8d-d8608cf6cd03 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:43.526439 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-6b7eee55-55c7-424e-bb8d-d8608cf6cd03 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:43.534531 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6b7eee55-55c7-424e-bb8d-d8608cf6cd03 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:43.534972 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6b7eee55-55c7-424e-bb8d-d8608cf6cd03 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:43.535733 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6b7eee55-55c7-424e-bb8d-d8608cf6cd03 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:43.536162 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6b7eee55-55c7-424e-bb8d-d8608cf6cd03 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:43.598625 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-6b7eee55-55c7-424e-bb8d-d8608cf6cd03 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:43.607991 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-6b7eee55-55c7-424e-bb8d-d8608cf6cd03 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:43.609477 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-6b7eee55-55c7-424e-bb8d-d8608cf6cd03 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:43.610643 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-6b7eee55-55c7-424e-bb8d-d8608cf6cd03 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.091841 Jun 17 13:27:43.611207 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1336/2640] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:27:43 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:27:43.999534 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-e945d41b-6c74-4c2f-a5b9-ed7fd4c2158c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:44.000140 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-e945d41b-6c74-4c2f-a5b9-ed7fd4c2158c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:44.006733 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e945d41b-6c74-4c2f-a5b9-ed7fd4c2158c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:44.007172 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e945d41b-6c74-4c2f-a5b9-ed7fd4c2158c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:44.007918 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e945d41b-6c74-4c2f-a5b9-ed7fd4c2158c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:44.008342 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e945d41b-6c74-4c2f-a5b9-ed7fd4c2158c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:44.145808 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-e945d41b-6c74-4c2f-a5b9-ed7fd4c2158c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:44.157397 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-e945d41b-6c74-4c2f-a5b9-ed7fd4c2158c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.161476 Jun 17 13:27:44.158156 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1305/2641] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:27:43 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:27:44.307247 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-5fd55333-1f36-4ba8-80b1-4023542dd497 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:44.308139 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-5fd55333-1f36-4ba8-80b1-4023542dd497 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:44.315384 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-5fd55333-1f36-4ba8-80b1-4023542dd497 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:44.315837 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-5fd55333-1f36-4ba8-80b1-4023542dd497 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:44.316593 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-5fd55333-1f36-4ba8-80b1-4023542dd497 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:44.317025 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-5fd55333-1f36-4ba8-80b1-4023542dd497 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:44.390004 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-5fd55333-1f36-4ba8-80b1-4023542dd497 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:44.398544 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-5fd55333-1f36-4ba8-80b1-4023542dd497 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.097919 Jun 17 13:27:44.399102 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1337/2642] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:27:44 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:27:44.636898 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-6194ef79-02db-4a37-a000-7e6c902fab41 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:44.638569 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-6194ef79-02db-4a37-a000-7e6c902fab41 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:44.645563 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6194ef79-02db-4a37-a000-7e6c902fab41 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:44.646023 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6194ef79-02db-4a37-a000-7e6c902fab41 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:44.646849 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6194ef79-02db-4a37-a000-7e6c902fab41 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:44.647264 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6194ef79-02db-4a37-a000-7e6c902fab41 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:44.723105 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-6194ef79-02db-4a37-a000-7e6c902fab41 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:44.733927 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-6194ef79-02db-4a37-a000-7e6c902fab41 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:44.735455 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-6194ef79-02db-4a37-a000-7e6c902fab41 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:44.736606 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-6194ef79-02db-4a37-a000-7e6c902fab41 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.109186 Jun 17 13:27:44.737173 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1306/2643] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:27:44 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:27:45.180354 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-8185aaf3-6162-4858-9acc-c7cce6b79c8f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:45.181163 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-8185aaf3-6162-4858-9acc-c7cce6b79c8f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:45.192846 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8185aaf3-6162-4858-9acc-c7cce6b79c8f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:45.193604 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8185aaf3-6162-4858-9acc-c7cce6b79c8f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:45.194884 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8185aaf3-6162-4858-9acc-c7cce6b79c8f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:45.195603 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8185aaf3-6162-4858-9acc-c7cce6b79c8f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:45.343680 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-8185aaf3-6162-4858-9acc-c7cce6b79c8f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:45.352083 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-8185aaf3-6162-4858-9acc-c7cce6b79c8f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.176778 Jun 17 13:27:45.352911 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1338/2644] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:27:45 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:27:45.420259 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-e5261dcd-7174-49c7-b820-9d9de3b2442e tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:45.420860 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-e5261dcd-7174-49c7-b820-9d9de3b2442e tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:45.422738 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_api:SELECT=80 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:27:45.428175 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e5261dcd-7174-49c7-b820-9d9de3b2442e tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:45.428627 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e5261dcd-7174-49c7-b820-9d9de3b2442e tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:45.429353 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e5261dcd-7174-49c7-b820-9d9de3b2442e tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:45.429862 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e5261dcd-7174-49c7-b820-9d9de3b2442e tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:45.494901 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-e5261dcd-7174-49c7-b820-9d9de3b2442e tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:45.500551 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=100 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:27:45.508686 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-e5261dcd-7174-49c7-b820-9d9de3b2442e tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.093811 Jun 17 13:27:45.509499 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1307/2645] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:27:45 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:27:45.757833 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-328bf5c7-2702-477b-b999-ad5aec7130fb tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:45.758652 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-328bf5c7-2702-477b-b999-ad5aec7130fb tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:45.768119 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-328bf5c7-2702-477b-b999-ad5aec7130fb tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:45.768787 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-328bf5c7-2702-477b-b999-ad5aec7130fb tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:45.769941 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-328bf5c7-2702-477b-b999-ad5aec7130fb tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:45.770564 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-328bf5c7-2702-477b-b999-ad5aec7130fb tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:45.835922 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-328bf5c7-2702-477b-b999-ad5aec7130fb tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:45.845139 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-328bf5c7-2702-477b-b999-ad5aec7130fb tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:45.846735 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-328bf5c7-2702-477b-b999-ad5aec7130fb tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:45.847881 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-328bf5c7-2702-477b-b999-ad5aec7130fb tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.096565 Jun 17 13:27:45.848444 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1339/2646] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:27:45 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:27:46.375343 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-a79c75ec-759f-4a48-bd22-4a11f0ecbac3 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:46.376317 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-a79c75ec-759f-4a48-bd22-4a11f0ecbac3 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:46.388158 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a79c75ec-759f-4a48-bd22-4a11f0ecbac3 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:46.389207 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a79c75ec-759f-4a48-bd22-4a11f0ecbac3 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:46.389993 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a79c75ec-759f-4a48-bd22-4a11f0ecbac3 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:46.390463 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a79c75ec-759f-4a48-bd22-4a11f0ecbac3 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:46.526155 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-a79c75ec-759f-4a48-bd22-4a11f0ecbac3 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:46.527847 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-70f0e329-c304-4c1d-b355-295dd06a1fd2 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:46.528453 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-70f0e329-c304-4c1d-b355-295dd06a1fd2 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:46.534782 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-a79c75ec-759f-4a48-bd22-4a11f0ecbac3 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.166518 Jun 17 13:27:46.535187 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-70f0e329-c304-4c1d-b355-295dd06a1fd2 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:46.535395 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1308/2647] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:27:46 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:27:46.542388 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-70f0e329-c304-4c1d-b355-295dd06a1fd2 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:46.542388 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-70f0e329-c304-4c1d-b355-295dd06a1fd2 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:46.542388 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-70f0e329-c304-4c1d-b355-295dd06a1fd2 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:46.605389 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-70f0e329-c304-4c1d-b355-295dd06a1fd2 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:46.613790 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-70f0e329-c304-4c1d-b355-295dd06a1fd2 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.089748 Jun 17 13:27:46.614386 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1340/2648] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:27:46 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:27:46.876085 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-3f2a52c7-fa56-4a03-929d-a3351746262a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:46.877088 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-3f2a52c7-fa56-4a03-929d-a3351746262a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:46.887351 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3f2a52c7-fa56-4a03-929d-a3351746262a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:46.888180 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3f2a52c7-fa56-4a03-929d-a3351746262a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:46.888941 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3f2a52c7-fa56-4a03-929d-a3351746262a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:46.889371 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3f2a52c7-fa56-4a03-929d-a3351746262a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:46.964930 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-3f2a52c7-fa56-4a03-929d-a3351746262a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:46.973595 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-3f2a52c7-fa56-4a03-929d-a3351746262a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:46.975121 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-3f2a52c7-fa56-4a03-929d-a3351746262a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:46.976265 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-3f2a52c7-fa56-4a03-929d-a3351746262a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.107022 Jun 17 13:27:46.976814 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1309/2649] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:27:46 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:27:47.556054 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-6e71e546-8157-407d-ad52-1642b840ec4a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:47.556961 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-6e71e546-8157-407d-ad52-1642b840ec4a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:47.565151 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6e71e546-8157-407d-ad52-1642b840ec4a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:47.565601 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6e71e546-8157-407d-ad52-1642b840ec4a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:47.566384 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6e71e546-8157-407d-ad52-1642b840ec4a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:47.566820 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6e71e546-8157-407d-ad52-1642b840ec4a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:47.631224 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-923b8332-2db3-45f4-b019-f7af4bc76b5f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:47.631917 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-923b8332-2db3-45f4-b019-f7af4bc76b5f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:47.639181 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-923b8332-2db3-45f4-b019-f7af4bc76b5f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:47.639624 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-923b8332-2db3-45f4-b019-f7af4bc76b5f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:47.640387 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-923b8332-2db3-45f4-b019-f7af4bc76b5f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:47.640810 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-923b8332-2db3-45f4-b019-f7af4bc76b5f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:47.714048 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-923b8332-2db3-45f4-b019-f7af4bc76b5f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:47.722744 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-923b8332-2db3-45f4-b019-f7af4bc76b5f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.095412 Jun 17 13:27:47.723315 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1310/2650] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:27:47 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:27:47.737629 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-6e71e546-8157-407d-ad52-1642b840ec4a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:47.745945 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-6e71e546-8157-407d-ad52-1642b840ec4a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.196422 Jun 17 13:27:47.746540 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1341/2651] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:27:47 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:27:47.995026 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-3d18f72b-cedb-47c0-bbb9-2e3b62a9d297 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:47.995645 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-3d18f72b-cedb-47c0-bbb9-2e3b62a9d297 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:48.002486 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3d18f72b-cedb-47c0-bbb9-2e3b62a9d297 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:48.002935 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3d18f72b-cedb-47c0-bbb9-2e3b62a9d297 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:48.003705 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3d18f72b-cedb-47c0-bbb9-2e3b62a9d297 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:48.004137 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3d18f72b-cedb-47c0-bbb9-2e3b62a9d297 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:48.074826 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-3d18f72b-cedb-47c0-bbb9-2e3b62a9d297 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:48.083862 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-3d18f72b-cedb-47c0-bbb9-2e3b62a9d297 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:48.085358 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-3d18f72b-cedb-47c0-bbb9-2e3b62a9d297 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:48.086540 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-3d18f72b-cedb-47c0-bbb9-2e3b62a9d297 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.095504 Jun 17 13:27:48.087110 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1311/2652] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:27:47 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:27:48.744200 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-ecab9f15-7881-406d-a97a-63b4aa60e7c5 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:48.745259 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-ecab9f15-7881-406d-a97a-63b4aa60e7c5 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:48.753093 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ecab9f15-7881-406d-a97a-63b4aa60e7c5 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:48.753540 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ecab9f15-7881-406d-a97a-63b4aa60e7c5 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:48.754322 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ecab9f15-7881-406d-a97a-63b4aa60e7c5 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:48.754755 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ecab9f15-7881-406d-a97a-63b4aa60e7c5 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:48.763008 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-7a0aa433-724c-4a54-b5a9-6442118016b1 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:48.763746 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-7a0aa433-724c-4a54-b5a9-6442118016b1 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:48.771228 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7a0aa433-724c-4a54-b5a9-6442118016b1 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:48.771678 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7a0aa433-724c-4a54-b5a9-6442118016b1 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:48.772449 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7a0aa433-724c-4a54-b5a9-6442118016b1 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:48.772883 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7a0aa433-724c-4a54-b5a9-6442118016b1 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:48.824736 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-ecab9f15-7881-406d-a97a-63b4aa60e7c5 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:48.834574 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-ecab9f15-7881-406d-a97a-63b4aa60e7c5 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.096658 Jun 17 13:27:48.835168 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1342/2653] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:27:48 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:27:48.920410 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-7a0aa433-724c-4a54-b5a9-6442118016b1 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:48.928918 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-7a0aa433-724c-4a54-b5a9-6442118016b1 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.169801 Jun 17 13:27:48.929489 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1312/2654] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:27:48 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:27:49.110026 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-ce5e3296-a779-4eb4-9545-673de9725737 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:49.111176 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-ce5e3296-a779-4eb4-9545-673de9725737 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:49.121373 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ce5e3296-a779-4eb4-9545-673de9725737 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:49.122156 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ce5e3296-a779-4eb4-9545-673de9725737 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:49.123678 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ce5e3296-a779-4eb4-9545-673de9725737 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:49.124117 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ce5e3296-a779-4eb4-9545-673de9725737 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:49.198058 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-ce5e3296-a779-4eb4-9545-673de9725737 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:49.207745 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-ce5e3296-a779-4eb4-9545-673de9725737 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:49.209225 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-ce5e3296-a779-4eb4-9545-673de9725737 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:49.210373 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-ce5e3296-a779-4eb4-9545-673de9725737 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.108205 Jun 17 13:27:49.210904 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1343/2655] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:27:49 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:27:49.851975 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-26b17c59-fd4e-4afc-8874-189d12ad826a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:49.852658 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-26b17c59-fd4e-4afc-8874-189d12ad826a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:49.859376 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-26b17c59-fd4e-4afc-8874-189d12ad826a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:49.859827 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-26b17c59-fd4e-4afc-8874-189d12ad826a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:49.860579 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-26b17c59-fd4e-4afc-8874-189d12ad826a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:49.861010 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-26b17c59-fd4e-4afc-8874-189d12ad826a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:49.926684 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-26b17c59-fd4e-4afc-8874-189d12ad826a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:49.935890 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-26b17c59-fd4e-4afc-8874-189d12ad826a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.087379 Jun 17 13:27:49.936302 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1313/2656] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:27:49 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:27:49.946262 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-6a150fd2-0540-4a6b-87cc-0c24fb658968 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:49.946909 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-6a150fd2-0540-4a6b-87cc-0c24fb658968 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:49.954148 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6a150fd2-0540-4a6b-87cc-0c24fb658968 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:49.954625 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6a150fd2-0540-4a6b-87cc-0c24fb658968 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:49.955382 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6a150fd2-0540-4a6b-87cc-0c24fb658968 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:49.955811 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6a150fd2-0540-4a6b-87cc-0c24fb658968 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:50.100844 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-6a150fd2-0540-4a6b-87cc-0c24fb658968 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:50.109750 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-6a150fd2-0540-4a6b-87cc-0c24fb658968 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.167231 Jun 17 13:27:50.110284 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1344/2657] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:27:49 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:27:50.231835 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-5f0f0f9d-1978-436c-80bb-0dc129d10b1d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:50.232563 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-5f0f0f9d-1978-436c-80bb-0dc129d10b1d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:50.238962 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5f0f0f9d-1978-436c-80bb-0dc129d10b1d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:50.239410 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5f0f0f9d-1978-436c-80bb-0dc129d10b1d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:50.240167 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5f0f0f9d-1978-436c-80bb-0dc129d10b1d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:50.240593 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5f0f0f9d-1978-436c-80bb-0dc129d10b1d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:50.305937 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-5f0f0f9d-1978-436c-80bb-0dc129d10b1d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:50.314717 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-5f0f0f9d-1978-436c-80bb-0dc129d10b1d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:50.316210 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-5f0f0f9d-1978-436c-80bb-0dc129d10b1d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:50.317342 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-5f0f0f9d-1978-436c-80bb-0dc129d10b1d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.092007 Jun 17 13:27:50.317898 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1314/2658] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:27:50 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:27:50.955542 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-2bc6f5da-9e8d-42ed-8738-ae279e0fb3db tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:50.956174 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-2bc6f5da-9e8d-42ed-8738-ae279e0fb3db tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:50.963273 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2bc6f5da-9e8d-42ed-8738-ae279e0fb3db tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:50.963723 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2bc6f5da-9e8d-42ed-8738-ae279e0fb3db tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:50.964479 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2bc6f5da-9e8d-42ed-8738-ae279e0fb3db tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:50.964912 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2bc6f5da-9e8d-42ed-8738-ae279e0fb3db tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:51.040013 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-2bc6f5da-9e8d-42ed-8738-ae279e0fb3db tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:51.049030 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-2bc6f5da-9e8d-42ed-8738-ae279e0fb3db tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.097318 Jun 17 13:27:51.049547 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1345/2659] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:27:50 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:27:51.128933 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-ca9b4bd2-042d-4832-99de-a7889d162454 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:51.129856 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-ca9b4bd2-042d-4832-99de-a7889d162454 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:51.139803 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ca9b4bd2-042d-4832-99de-a7889d162454 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:51.140454 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ca9b4bd2-042d-4832-99de-a7889d162454 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:51.141531 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ca9b4bd2-042d-4832-99de-a7889d162454 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:51.142254 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ca9b4bd2-042d-4832-99de-a7889d162454 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:51.298644 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-ca9b4bd2-042d-4832-99de-a7889d162454 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:51.308569 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-ca9b4bd2-042d-4832-99de-a7889d162454 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.185159 Jun 17 13:27:51.309178 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1315/2660] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:27:51 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:27:51.336329 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-04e5110d-89ca-43b9-99e7-389cab1d4692 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:51.336946 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-04e5110d-89ca-43b9-99e7-389cab1d4692 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:51.343656 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-04e5110d-89ca-43b9-99e7-389cab1d4692 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:51.344109 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-04e5110d-89ca-43b9-99e7-389cab1d4692 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:51.344944 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-04e5110d-89ca-43b9-99e7-389cab1d4692 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:51.345382 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-04e5110d-89ca-43b9-99e7-389cab1d4692 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:51.420457 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-04e5110d-89ca-43b9-99e7-389cab1d4692 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:51.429310 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-04e5110d-89ca-43b9-99e7-389cab1d4692 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:51.430859 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-04e5110d-89ca-43b9-99e7-389cab1d4692 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:51.432008 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-04e5110d-89ca-43b9-99e7-389cab1d4692 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.099737 Jun 17 13:27:51.432574 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1346/2661] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:27:51 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:27:52.069481 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-84eace43-c877-4bf2-98f1-073e20878cd8 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:52.070537 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-84eace43-c877-4bf2-98f1-073e20878cd8 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:52.081921 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-84eace43-c877-4bf2-98f1-073e20878cd8 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:52.082723 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-84eace43-c877-4bf2-98f1-073e20878cd8 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:52.083969 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-84eace43-c877-4bf2-98f1-073e20878cd8 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:52.084698 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-84eace43-c877-4bf2-98f1-073e20878cd8 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:52.150851 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-84eace43-c877-4bf2-98f1-073e20878cd8 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:52.163132 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-84eace43-c877-4bf2-98f1-073e20878cd8 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.099921 Jun 17 13:27:52.163806 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1316/2662] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:27:52 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:27:52.327522 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-6022fd61-9a64-43f7-9bc8-e21cc3cebe32 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:52.328159 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-6022fd61-9a64-43f7-9bc8-e21cc3cebe32 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:52.335166 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6022fd61-9a64-43f7-9bc8-e21cc3cebe32 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:52.335620 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6022fd61-9a64-43f7-9bc8-e21cc3cebe32 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:52.336377 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6022fd61-9a64-43f7-9bc8-e21cc3cebe32 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:52.336818 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6022fd61-9a64-43f7-9bc8-e21cc3cebe32 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:52.450573 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-b81e44e7-cfc7-485e-beb9-225d1fe5baa0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:52.451193 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-b81e44e7-cfc7-485e-beb9-225d1fe5baa0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:52.457075 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b81e44e7-cfc7-485e-beb9-225d1fe5baa0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:52.457526 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b81e44e7-cfc7-485e-beb9-225d1fe5baa0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:52.458370 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b81e44e7-cfc7-485e-beb9-225d1fe5baa0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:52.458759 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b81e44e7-cfc7-485e-beb9-225d1fe5baa0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:52.494013 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-6022fd61-9a64-43f7-9bc8-e21cc3cebe32 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:52.502625 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-6022fd61-9a64-43f7-9bc8-e21cc3cebe32 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.179668 Jun 17 13:27:52.503209 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1347/2663] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:27:52 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:27:52.522612 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-b81e44e7-cfc7-485e-beb9-225d1fe5baa0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:52.532716 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-b81e44e7-cfc7-485e-beb9-225d1fe5baa0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:52.534318 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-b81e44e7-cfc7-485e-beb9-225d1fe5baa0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:52.535450 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-b81e44e7-cfc7-485e-beb9-225d1fe5baa0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.088856 Jun 17 13:27:52.536011 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1317/2664] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:27:52 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:27:53.182100 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-1af8759f-84a0-47a4-af8f-2af4b10c91aa tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:53.182741 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-1af8759f-84a0-47a4-af8f-2af4b10c91aa tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:53.189240 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-1af8759f-84a0-47a4-af8f-2af4b10c91aa tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:53.189678 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-1af8759f-84a0-47a4-af8f-2af4b10c91aa tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:53.190462 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-1af8759f-84a0-47a4-af8f-2af4b10c91aa tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:53.190890 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-1af8759f-84a0-47a4-af8f-2af4b10c91aa tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:53.252534 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-1af8759f-84a0-47a4-af8f-2af4b10c91aa tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:53.263983 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-1af8759f-84a0-47a4-af8f-2af4b10c91aa tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.085094 Jun 17 13:27:53.264562 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1348/2665] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:27:53 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:27:53.523596 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-47ac7225-f107-4e07-a572-9991f7ef560b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:53.524469 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-47ac7225-f107-4e07-a572-9991f7ef560b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:53.533073 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-47ac7225-f107-4e07-a572-9991f7ef560b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:53.533518 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-47ac7225-f107-4e07-a572-9991f7ef560b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:53.534308 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-47ac7225-f107-4e07-a572-9991f7ef560b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:53.534733 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-47ac7225-f107-4e07-a572-9991f7ef560b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:53.554111 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-2acccc6f-f8ec-4d2b-ab06-6afa0d97b9b1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:53.554820 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-2acccc6f-f8ec-4d2b-ab06-6afa0d97b9b1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:53.557200 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_api:SELECT=80 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:27:53.563153 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2acccc6f-f8ec-4d2b-ab06-6afa0d97b9b1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:53.563595 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2acccc6f-f8ec-4d2b-ab06-6afa0d97b9b1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:53.564356 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2acccc6f-f8ec-4d2b-ab06-6afa0d97b9b1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:53.564785 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2acccc6f-f8ec-4d2b-ab06-6afa0d97b9b1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:53.635732 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-2acccc6f-f8ec-4d2b-ab06-6afa0d97b9b1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:53.644639 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-2acccc6f-f8ec-4d2b-ab06-6afa0d97b9b1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:53.646110 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-2acccc6f-f8ec-4d2b-ab06-6afa0d97b9b1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:53.647282 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-2acccc6f-f8ec-4d2b-ab06-6afa0d97b9b1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.097227 Jun 17 13:27:53.647836 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1349/2666] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:27:53 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:27:53.701059 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-47ac7225-f107-4e07-a572-9991f7ef560b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:53.709309 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-47ac7225-f107-4e07-a572-9991f7ef560b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.192241 Jun 17 13:27:53.709870 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1318/2667] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:27:53 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:27:54.286362 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-7c4ed23f-0005-4e89-be60-259067dcb692 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:54.287250 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-7c4ed23f-0005-4e89-be60-259067dcb692 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:54.299250 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7c4ed23f-0005-4e89-be60-259067dcb692 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:54.300023 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7c4ed23f-0005-4e89-be60-259067dcb692 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:54.301284 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7c4ed23f-0005-4e89-be60-259067dcb692 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:54.302012 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7c4ed23f-0005-4e89-be60-259067dcb692 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:54.387332 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-7c4ed23f-0005-4e89-be60-259067dcb692 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:54.396298 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-7c4ed23f-0005-4e89-be60-259067dcb692 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.117306 Jun 17 13:27:54.396876 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1350/2668] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:27:54 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:27:54.669422 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-ec28c8c8-ac16-42d3-a5d0-3c0fda285310 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:54.670181 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-ec28c8c8-ac16-42d3-a5d0-3c0fda285310 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:54.677167 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ec28c8c8-ac16-42d3-a5d0-3c0fda285310 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:54.677637 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ec28c8c8-ac16-42d3-a5d0-3c0fda285310 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:54.678441 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ec28c8c8-ac16-42d3-a5d0-3c0fda285310 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:54.678876 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ec28c8c8-ac16-42d3-a5d0-3c0fda285310 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:54.728237 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-aab81403-f439-4fe5-af53-e5143d0d571f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:54.728842 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-aab81403-f439-4fe5-af53-e5143d0d571f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:54.736658 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-aab81403-f439-4fe5-af53-e5143d0d571f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:54.737111 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-aab81403-f439-4fe5-af53-e5143d0d571f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:54.737868 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-aab81403-f439-4fe5-af53-e5143d0d571f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:54.738333 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-aab81403-f439-4fe5-af53-e5143d0d571f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:54.742307 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_cell1:SELECT=100 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:27:54.749727 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-ec28c8c8-ac16-42d3-a5d0-3c0fda285310 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:54.758289 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-ec28c8c8-ac16-42d3-a5d0-3c0fda285310 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:54.759783 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-ec28c8c8-ac16-42d3-a5d0-3c0fda285310 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:54.760931 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-ec28c8c8-ac16-42d3-a5d0-3c0fda285310 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.097945 Jun 17 13:27:54.761493 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1319/2669] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:27:54 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:27:54.876171 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-aab81403-f439-4fe5-af53-e5143d0d571f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:54.888597 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-aab81403-f439-4fe5-af53-e5143d0d571f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.165165 Jun 17 13:27:54.889224 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1351/2670] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:27:54 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:27:55.416350 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-1bf2880b-c697-409d-8cf9-8fbd3e06c669 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:55.417283 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-1bf2880b-c697-409d-8cf9-8fbd3e06c669 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:55.424679 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1bf2880b-c697-409d-8cf9-8fbd3e06c669 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:55.425127 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1bf2880b-c697-409d-8cf9-8fbd3e06c669 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:55.425878 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1bf2880b-c697-409d-8cf9-8fbd3e06c669 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:55.426353 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1bf2880b-c697-409d-8cf9-8fbd3e06c669 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:55.491571 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-1bf2880b-c697-409d-8cf9-8fbd3e06c669 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:55.501692 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-1bf2880b-c697-409d-8cf9-8fbd3e06c669 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.091463 Jun 17 13:27:55.502291 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1320/2671] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:27:55 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:27:55.783541 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-01c22038-c105-452d-8b93-1a39663f6bb5 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:55.784594 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-01c22038-c105-452d-8b93-1a39663f6bb5 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:55.795863 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-01c22038-c105-452d-8b93-1a39663f6bb5 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:55.796619 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-01c22038-c105-452d-8b93-1a39663f6bb5 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:55.797872 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-01c22038-c105-452d-8b93-1a39663f6bb5 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:55.798643 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-01c22038-c105-452d-8b93-1a39663f6bb5 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:55.875817 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-01c22038-c105-452d-8b93-1a39663f6bb5 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:55.884686 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-01c22038-c105-452d-8b93-1a39663f6bb5 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:55.886207 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-01c22038-c105-452d-8b93-1a39663f6bb5 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:55.887346 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-01c22038-c105-452d-8b93-1a39663f6bb5 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.110568 Jun 17 13:27:55.887969 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1352/2672] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:27:55 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:27:55.906845 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-22d917e0-e9f0-433b-a923-7413483dda98 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:55.907469 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-22d917e0-e9f0-433b-a923-7413483dda98 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:55.914205 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-22d917e0-e9f0-433b-a923-7413483dda98 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:55.914647 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-22d917e0-e9f0-433b-a923-7413483dda98 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:55.915390 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-22d917e0-e9f0-433b-a923-7413483dda98 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:55.915818 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-22d917e0-e9f0-433b-a923-7413483dda98 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:56.053543 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-22d917e0-e9f0-433b-a923-7413483dda98 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:56.066269 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-22d917e0-e9f0-433b-a923-7413483dda98 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.163645 Jun 17 13:27:56.067021 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1321/2673] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:27:55 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:27:56.523038 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-0e0a9608-0f29-4058-a5a9-05fd441d45a9 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:56.524042 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-0e0a9608-0f29-4058-a5a9-05fd441d45a9 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:56.532355 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0e0a9608-0f29-4058-a5a9-05fd441d45a9 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:56.532814 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0e0a9608-0f29-4058-a5a9-05fd441d45a9 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:56.533575 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0e0a9608-0f29-4058-a5a9-05fd441d45a9 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:56.534009 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0e0a9608-0f29-4058-a5a9-05fd441d45a9 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:56.595990 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-0e0a9608-0f29-4058-a5a9-05fd441d45a9 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:56.604619 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-0e0a9608-0f29-4058-a5a9-05fd441d45a9 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.087831 Jun 17 13:27:56.605197 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1353/2674] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:27:56 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:27:56.910502 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-588e73a4-8f4d-4c94-b38e-f4c7e3719584 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:56.911466 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-588e73a4-8f4d-4c94-b38e-f4c7e3719584 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:56.921382 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-588e73a4-8f4d-4c94-b38e-f4c7e3719584 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:56.921827 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-588e73a4-8f4d-4c94-b38e-f4c7e3719584 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:56.922618 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-588e73a4-8f4d-4c94-b38e-f4c7e3719584 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:56.923047 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-588e73a4-8f4d-4c94-b38e-f4c7e3719584 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:56.987710 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-588e73a4-8f4d-4c94-b38e-f4c7e3719584 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:57.000241 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-588e73a4-8f4d-4c94-b38e-f4c7e3719584 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:57.001744 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-588e73a4-8f4d-4c94-b38e-f4c7e3719584 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:57.002914 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-588e73a4-8f4d-4c94-b38e-f4c7e3719584 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.099324 Jun 17 13:27:57.003484 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1322/2675] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:27:56 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:27:57.090584 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-0f61104d-5a88-46ec-ad8a-29ca20c4ba97 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:57.091978 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-0f61104d-5a88-46ec-ad8a-29ca20c4ba97 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:57.099317 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0f61104d-5a88-46ec-ad8a-29ca20c4ba97 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:57.099811 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0f61104d-5a88-46ec-ad8a-29ca20c4ba97 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:57.100641 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0f61104d-5a88-46ec-ad8a-29ca20c4ba97 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:57.101117 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0f61104d-5a88-46ec-ad8a-29ca20c4ba97 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:57.244457 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-0f61104d-5a88-46ec-ad8a-29ca20c4ba97 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:57.252881 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-0f61104d-5a88-46ec-ad8a-29ca20c4ba97 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.168712 Jun 17 13:27:57.253447 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1354/2676] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:27:57 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:27:57.625626 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-70a21efd-adf1-4419-9ffd-c827eb7c343e tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:57.626704 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-70a21efd-adf1-4419-9ffd-c827eb7c343e tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:57.636875 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-70a21efd-adf1-4419-9ffd-c827eb7c343e tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:57.637821 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-70a21efd-adf1-4419-9ffd-c827eb7c343e tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:57.638634 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-70a21efd-adf1-4419-9ffd-c827eb7c343e tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:57.639069 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-70a21efd-adf1-4419-9ffd-c827eb7c343e tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:57.702145 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-70a21efd-adf1-4419-9ffd-c827eb7c343e tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:57.714277 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-70a21efd-adf1-4419-9ffd-c827eb7c343e tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.094927 Jun 17 13:27:57.715043 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1323/2677] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:27:57 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:27:58.021904 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-a10024b6-9b83-425f-8cf8-3b0311b2c6d7 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:58.022656 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-a10024b6-9b83-425f-8cf8-3b0311b2c6d7 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:58.030266 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a10024b6-9b83-425f-8cf8-3b0311b2c6d7 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:58.030717 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a10024b6-9b83-425f-8cf8-3b0311b2c6d7 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:58.031478 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a10024b6-9b83-425f-8cf8-3b0311b2c6d7 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:58.031919 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a10024b6-9b83-425f-8cf8-3b0311b2c6d7 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:58.104000 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-a10024b6-9b83-425f-8cf8-3b0311b2c6d7 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:58.113803 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-a10024b6-9b83-425f-8cf8-3b0311b2c6d7 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:58.115357 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-a10024b6-9b83-425f-8cf8-3b0311b2c6d7 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:58.116502 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-a10024b6-9b83-425f-8cf8-3b0311b2c6d7 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.099319 Jun 17 13:27:58.117068 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1355/2678] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:27:58 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:27:58.275236 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-5c0b5351-c8ce-4712-a5ed-b92e65b790a0 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:58.276117 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-5c0b5351-c8ce-4712-a5ed-b92e65b790a0 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:58.287426 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5c0b5351-c8ce-4712-a5ed-b92e65b790a0 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:58.288166 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5c0b5351-c8ce-4712-a5ed-b92e65b790a0 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:58.289461 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5c0b5351-c8ce-4712-a5ed-b92e65b790a0 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:58.290173 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5c0b5351-c8ce-4712-a5ed-b92e65b790a0 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:58.310315 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=100 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:27:58.431610 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-5c0b5351-c8ce-4712-a5ed-b92e65b790a0 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:58.443834 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-5c0b5351-c8ce-4712-a5ed-b92e65b790a0 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.175102 Jun 17 13:27:58.444520 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1324/2679] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:27:58 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:27:58.741471 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-a8e1e7c1-55a0-42d3-9d02-142c33389743 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:58.742557 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-a8e1e7c1-55a0-42d3-9d02-142c33389743 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:58.750859 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a8e1e7c1-55a0-42d3-9d02-142c33389743 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:58.751305 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a8e1e7c1-55a0-42d3-9d02-142c33389743 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:58.752061 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a8e1e7c1-55a0-42d3-9d02-142c33389743 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:58.752491 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a8e1e7c1-55a0-42d3-9d02-142c33389743 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:58.814119 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-a8e1e7c1-55a0-42d3-9d02-142c33389743 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:58.822323 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-a8e1e7c1-55a0-42d3-9d02-142c33389743 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.087255 Jun 17 13:27:58.822886 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1356/2680] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:27:58 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:27:59.139851 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-5a90ebd6-54a1-4e47-bb2b-40952d0b7efc tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:59.140857 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-5a90ebd6-54a1-4e47-bb2b-40952d0b7efc tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:59.151271 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5a90ebd6-54a1-4e47-bb2b-40952d0b7efc tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:59.152022 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5a90ebd6-54a1-4e47-bb2b-40952d0b7efc tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:59.153567 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5a90ebd6-54a1-4e47-bb2b-40952d0b7efc tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:59.153984 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5a90ebd6-54a1-4e47-bb2b-40952d0b7efc tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:59.221912 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-5a90ebd6-54a1-4e47-bb2b-40952d0b7efc tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:59.231077 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-5a90ebd6-54a1-4e47-bb2b-40952d0b7efc tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:59.232671 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-5a90ebd6-54a1-4e47-bb2b-40952d0b7efc tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:59.233809 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-5a90ebd6-54a1-4e47-bb2b-40952d0b7efc tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.101021 Jun 17 13:27:59.234401 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1325/2681] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:27:59 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:27:59.467375 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-c91e08ad-9bb1-4f82-acf2-65df57e50d57 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:59.467944 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-c91e08ad-9bb1-4f82-acf2-65df57e50d57 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:59.475241 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c91e08ad-9bb1-4f82-acf2-65df57e50d57 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:59.475718 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c91e08ad-9bb1-4f82-acf2-65df57e50d57 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:59.476513 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c91e08ad-9bb1-4f82-acf2-65df57e50d57 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:59.476970 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c91e08ad-9bb1-4f82-acf2-65df57e50d57 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:59.621758 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-c91e08ad-9bb1-4f82-acf2-65df57e50d57 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:59.630398 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-c91e08ad-9bb1-4f82-acf2-65df57e50d57 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.169446 Jun 17 13:27:59.630981 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1357/2682] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:27:59 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:27:59.839841 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-5f01e16f-eacd-473c-9cd1-92d533b86461 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:27:59.840418 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-5f01e16f-eacd-473c-9cd1-92d533b86461 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:27:59.847334 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5f01e16f-eacd-473c-9cd1-92d533b86461 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:59.847781 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5f01e16f-eacd-473c-9cd1-92d533b86461 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:59.848548 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5f01e16f-eacd-473c-9cd1-92d533b86461 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:27:59.848979 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5f01e16f-eacd-473c-9cd1-92d533b86461 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:27:59.913593 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-5f01e16f-eacd-473c-9cd1-92d533b86461 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:27:59.922421 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-5f01e16f-eacd-473c-9cd1-92d533b86461 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.086659 Jun 17 13:27:59.922987 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1326/2683] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:27:59 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:28:00.253192 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-87ff69a4-b8dc-47f4-bc94-2758118db5a2 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:00.253813 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-87ff69a4-b8dc-47f4-bc94-2758118db5a2 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:00.260856 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-87ff69a4-b8dc-47f4-bc94-2758118db5a2 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:00.261312 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-87ff69a4-b8dc-47f4-bc94-2758118db5a2 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:00.262071 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-87ff69a4-b8dc-47f4-bc94-2758118db5a2 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:00.262530 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-87ff69a4-b8dc-47f4-bc94-2758118db5a2 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:00.327686 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-87ff69a4-b8dc-47f4-bc94-2758118db5a2 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:00.336867 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-87ff69a4-b8dc-47f4-bc94-2758118db5a2 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:00.338418 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-87ff69a4-b8dc-47f4-bc94-2758118db5a2 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:00.339582 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-87ff69a4-b8dc-47f4-bc94-2758118db5a2 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.090646 Jun 17 13:28:00.340156 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1358/2684] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:28:00 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:28:00.650770 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-6a2654c3-b9b7-4013-b782-4ae8708ed4c3 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:00.651568 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-6a2654c3-b9b7-4013-b782-4ae8708ed4c3 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:00.659982 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6a2654c3-b9b7-4013-b782-4ae8708ed4c3 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:00.660427 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6a2654c3-b9b7-4013-b782-4ae8708ed4c3 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:00.661195 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6a2654c3-b9b7-4013-b782-4ae8708ed4c3 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:00.661621 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6a2654c3-b9b7-4013-b782-4ae8708ed4c3 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:00.813201 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-6a2654c3-b9b7-4013-b782-4ae8708ed4c3 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:00.825997 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-6a2654c3-b9b7-4013-b782-4ae8708ed4c3 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.181253 Jun 17 13:28:00.826859 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1327/2685] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:28:00 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:28:00.943618 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-847802c3-71fe-4e33-94d2-b4a66d98b59e tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:00.944512 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-847802c3-71fe-4e33-94d2-b4a66d98b59e tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:00.955535 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-847802c3-71fe-4e33-94d2-b4a66d98b59e tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:00.955978 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-847802c3-71fe-4e33-94d2-b4a66d98b59e tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:00.956730 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-847802c3-71fe-4e33-94d2-b4a66d98b59e tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:00.957154 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-847802c3-71fe-4e33-94d2-b4a66d98b59e tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:01.029222 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-847802c3-71fe-4e33-94d2-b4a66d98b59e tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:01.039407 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-847802c3-71fe-4e33-94d2-b4a66d98b59e tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.102476 Jun 17 13:28:01.040046 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1359/2686] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:28:00 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:28:01.362954 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-2448e16c-36af-42da-8c60-03d3a32ab3bb tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:01.363595 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-2448e16c-36af-42da-8c60-03d3a32ab3bb tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:01.373997 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2448e16c-36af-42da-8c60-03d3a32ab3bb tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:01.374691 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2448e16c-36af-42da-8c60-03d3a32ab3bb tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:01.375892 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2448e16c-36af-42da-8c60-03d3a32ab3bb tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:01.376427 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2448e16c-36af-42da-8c60-03d3a32ab3bb tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:01.439712 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-2448e16c-36af-42da-8c60-03d3a32ab3bb tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:01.448543 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-2448e16c-36af-42da-8c60-03d3a32ab3bb tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:01.450047 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-2448e16c-36af-42da-8c60-03d3a32ab3bb tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:01.451269 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-2448e16c-36af-42da-8c60-03d3a32ab3bb tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.095204 Jun 17 13:28:01.451834 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1328/2687] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:28:01 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:28:01.849175 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-b73c5f2b-0be3-4ca0-a201-b7e6f83bff80 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:01.849783 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-b73c5f2b-0be3-4ca0-a201-b7e6f83bff80 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:01.858569 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b73c5f2b-0be3-4ca0-a201-b7e6f83bff80 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:01.859277 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b73c5f2b-0be3-4ca0-a201-b7e6f83bff80 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:01.860459 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b73c5f2b-0be3-4ca0-a201-b7e6f83bff80 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:01.861106 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b73c5f2b-0be3-4ca0-a201-b7e6f83bff80 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:02.018681 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-b73c5f2b-0be3-4ca0-a201-b7e6f83bff80 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:02.031117 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-b73c5f2b-0be3-4ca0-a201-b7e6f83bff80 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.185815 Jun 17 13:28:02.031967 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1360/2688] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:28:01 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:28:02.060014 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-3fccc549-5e3c-42a0-b036-7552f45dd9d6 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:02.060826 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-3fccc549-5e3c-42a0-b036-7552f45dd9d6 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:02.068716 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3fccc549-5e3c-42a0-b036-7552f45dd9d6 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:02.069163 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3fccc549-5e3c-42a0-b036-7552f45dd9d6 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:02.069919 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3fccc549-5e3c-42a0-b036-7552f45dd9d6 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:02.070393 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3fccc549-5e3c-42a0-b036-7552f45dd9d6 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:02.145036 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-3fccc549-5e3c-42a0-b036-7552f45dd9d6 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:02.153720 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-3fccc549-5e3c-42a0-b036-7552f45dd9d6 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.099821 Jun 17 13:28:02.154305 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1329/2689] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:28:02 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:28:02.469547 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-2ff39714-f0eb-49f0-82f6-9ad88f4158fb tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:02.470067 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-2ff39714-f0eb-49f0-82f6-9ad88f4158fb tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:02.476350 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2ff39714-f0eb-49f0-82f6-9ad88f4158fb tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:02.476794 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2ff39714-f0eb-49f0-82f6-9ad88f4158fb tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:02.477536 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2ff39714-f0eb-49f0-82f6-9ad88f4158fb tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:02.477966 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2ff39714-f0eb-49f0-82f6-9ad88f4158fb tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:02.550486 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-2ff39714-f0eb-49f0-82f6-9ad88f4158fb tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:02.559039 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-2ff39714-f0eb-49f0-82f6-9ad88f4158fb tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:02.560520 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-2ff39714-f0eb-49f0-82f6-9ad88f4158fb tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:02.561656 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-2ff39714-f0eb-49f0-82f6-9ad88f4158fb tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.096184 Jun 17 13:28:02.562241 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1361/2690] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:28:02 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:28:03.052266 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-8086a593-33a5-481f-ab37-16dd7012bbfc tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:03.052884 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-8086a593-33a5-481f-ab37-16dd7012bbfc tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:03.059999 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8086a593-33a5-481f-ab37-16dd7012bbfc tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:03.060449 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8086a593-33a5-481f-ab37-16dd7012bbfc tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:03.061206 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8086a593-33a5-481f-ab37-16dd7012bbfc tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:03.061637 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8086a593-33a5-481f-ab37-16dd7012bbfc tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:03.176733 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-a6d37599-4f1e-43a5-a7f6-c6335ac93406 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:03.177363 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-a6d37599-4f1e-43a5-a7f6-c6335ac93406 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:03.184075 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a6d37599-4f1e-43a5-a7f6-c6335ac93406 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:03.184528 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a6d37599-4f1e-43a5-a7f6-c6335ac93406 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:03.185286 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a6d37599-4f1e-43a5-a7f6-c6335ac93406 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:03.185727 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a6d37599-4f1e-43a5-a7f6-c6335ac93406 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:03.205310 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-8086a593-33a5-481f-ab37-16dd7012bbfc tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:03.213539 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-8086a593-33a5-481f-ab37-16dd7012bbfc tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.166533 Jun 17 13:28:03.214075 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1330/2691] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:28:03 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:28:03.250825 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-a6d37599-4f1e-43a5-a7f6-c6335ac93406 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:03.259168 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-a6d37599-4f1e-43a5-a7f6-c6335ac93406 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.086887 Jun 17 13:28:03.259733 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1362/2692] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:28:03 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 13:28:03.581554 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-aed778b6-6620-464a-b96d-8e1ef6657031 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:03.582112 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-aed778b6-6620-464a-b96d-8e1ef6657031 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:03.589397 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-aed778b6-6620-464a-b96d-8e1ef6657031 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:03.589859 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-aed778b6-6620-464a-b96d-8e1ef6657031 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:03.590683 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-aed778b6-6620-464a-b96d-8e1ef6657031 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:03.591137 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-aed778b6-6620-464a-b96d-8e1ef6657031 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:03.665958 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-aed778b6-6620-464a-b96d-8e1ef6657031 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:03.674883 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-aed778b6-6620-464a-b96d-8e1ef6657031 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:03.676527 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-aed778b6-6620-464a-b96d-8e1ef6657031 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:03.678132 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-aed778b6-6620-464a-b96d-8e1ef6657031 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.100832 Jun 17 13:28:03.678695 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1331/2693] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:28:03 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:28:04.236126 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-b66224eb-3972-4bf4-ba33-c2fc7e99b6c4 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:04.237093 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-b66224eb-3972-4bf4-ba33-c2fc7e99b6c4 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:04.248187 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b66224eb-3972-4bf4-ba33-c2fc7e99b6c4 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:04.248941 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b66224eb-3972-4bf4-ba33-c2fc7e99b6c4 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:04.250200 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b66224eb-3972-4bf4-ba33-c2fc7e99b6c4 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:04.250930 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b66224eb-3972-4bf4-ba33-c2fc7e99b6c4 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:04.275398 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-67e41c8f-32a5-491d-a052-38aa78093dc1 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:04.276215 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-67e41c8f-32a5-491d-a052-38aa78093dc1 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:04.282625 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-67e41c8f-32a5-491d-a052-38aa78093dc1 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:04.283065 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-67e41c8f-32a5-491d-a052-38aa78093dc1 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:04.283826 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-67e41c8f-32a5-491d-a052-38aa78093dc1 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:04.284277 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-67e41c8f-32a5-491d-a052-38aa78093dc1 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:04.356911 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-67e41c8f-32a5-491d-a052-38aa78093dc1 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:04.365138 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-67e41c8f-32a5-491d-a052-38aa78093dc1 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.093554 Jun 17 13:28:04.365774 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1332/2694] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:28:04 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:28:04.417288 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-b66224eb-3972-4bf4-ba33-c2fc7e99b6c4 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:04.425660 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-b66224eb-3972-4bf4-ba33-c2fc7e99b6c4 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.196800 Jun 17 13:28:04.426293 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1363/2695] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:28:04 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:28:04.697247 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-e21f54d7-eb85-4a4e-8421-6963dbe03eba tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:04.697853 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-e21f54d7-eb85-4a4e-8421-6963dbe03eba tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:04.704568 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e21f54d7-eb85-4a4e-8421-6963dbe03eba tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:04.705007 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e21f54d7-eb85-4a4e-8421-6963dbe03eba tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:04.705753 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e21f54d7-eb85-4a4e-8421-6963dbe03eba tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:04.706209 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e21f54d7-eb85-4a4e-8421-6963dbe03eba tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:04.770747 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-e21f54d7-eb85-4a4e-8421-6963dbe03eba tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:04.779507 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-e21f54d7-eb85-4a4e-8421-6963dbe03eba tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:04.781002 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-e21f54d7-eb85-4a4e-8421-6963dbe03eba tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:04.782272 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-e21f54d7-eb85-4a4e-8421-6963dbe03eba tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.088992 Jun 17 13:28:04.782882 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1333/2696] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:28:04 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:28:05.381587 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-15aef6e7-6ede-44bb-9628-67c0252e85c2 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:05.382310 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-15aef6e7-6ede-44bb-9628-67c0252e85c2 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:05.389245 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-15aef6e7-6ede-44bb-9628-67c0252e85c2 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:05.389684 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-15aef6e7-6ede-44bb-9628-67c0252e85c2 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:05.390476 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-15aef6e7-6ede-44bb-9628-67c0252e85c2 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:05.390869 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-15aef6e7-6ede-44bb-9628-67c0252e85c2 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:05.443246 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-75903e15-5267-45a0-9edb-f8e16952b6e2 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:05.443900 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-75903e15-5267-45a0-9edb-f8e16952b6e2 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:05.451030 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-75903e15-5267-45a0-9edb-f8e16952b6e2 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:05.451489 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-75903e15-5267-45a0-9edb-f8e16952b6e2 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:05.452283 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-75903e15-5267-45a0-9edb-f8e16952b6e2 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:05.452718 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-75903e15-5267-45a0-9edb-f8e16952b6e2 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:05.458363 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-15aef6e7-6ede-44bb-9628-67c0252e85c2 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:05.466836 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-15aef6e7-6ede-44bb-9628-67c0252e85c2 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.089211 Jun 17 13:28:05.467416 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1364/2697] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:28:05 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:28:05.590634 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-75903e15-5267-45a0-9edb-f8e16952b6e2 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:05.599057 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-75903e15-5267-45a0-9edb-f8e16952b6e2 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.159702 Jun 17 13:28:05.599634 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1334/2698] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:28:05 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:28:05.804898 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-974a0e7f-cd7f-45a1-a0de-fb2bed0145e6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:05.806327 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-974a0e7f-cd7f-45a1-a0de-fb2bed0145e6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:05.812779 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-974a0e7f-cd7f-45a1-a0de-fb2bed0145e6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:05.813230 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-974a0e7f-cd7f-45a1-a0de-fb2bed0145e6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:05.813984 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-974a0e7f-cd7f-45a1-a0de-fb2bed0145e6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:05.814457 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-974a0e7f-cd7f-45a1-a0de-fb2bed0145e6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:05.876203 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-974a0e7f-cd7f-45a1-a0de-fb2bed0145e6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:05.885296 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-974a0e7f-cd7f-45a1-a0de-fb2bed0145e6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:05.886805 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-974a0e7f-cd7f-45a1-a0de-fb2bed0145e6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:05.887948 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-974a0e7f-cd7f-45a1-a0de-fb2bed0145e6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.089705 Jun 17 13:28:05.888541 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1365/2699] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:28:05 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:28:06.488304 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-c0605175-64f1-4742-9539-ccc905321e6c tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:06.489315 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-c0605175-64f1-4742-9539-ccc905321e6c tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:06.500284 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c0605175-64f1-4742-9539-ccc905321e6c tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:06.501028 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c0605175-64f1-4742-9539-ccc905321e6c tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:06.502326 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c0605175-64f1-4742-9539-ccc905321e6c tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:06.503040 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c0605175-64f1-4742-9539-ccc905321e6c tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:06.580121 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-c0605175-64f1-4742-9539-ccc905321e6c tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:06.589801 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-c0605175-64f1-4742-9539-ccc905321e6c tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.107904 Jun 17 13:28:06.590439 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1335/2700] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:28:06 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:28:06.619013 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-7f09266e-c8bc-48a6-9c22-8c4ddb266c6a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:06.619613 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-7f09266e-c8bc-48a6-9c22-8c4ddb266c6a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:06.626600 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7f09266e-c8bc-48a6-9c22-8c4ddb266c6a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:06.627046 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7f09266e-c8bc-48a6-9c22-8c4ddb266c6a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:06.627787 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7f09266e-c8bc-48a6-9c22-8c4ddb266c6a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:06.628214 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7f09266e-c8bc-48a6-9c22-8c4ddb266c6a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:06.759298 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-7f09266e-c8bc-48a6-9c22-8c4ddb266c6a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:06.767716 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-7f09266e-c8bc-48a6-9c22-8c4ddb266c6a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.154446 Jun 17 13:28:06.768293 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1366/2701] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:28:06 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:28:06.909475 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-5ddd5285-f55c-4c36-b41f-27534adacd24 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:06.910510 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-5ddd5285-f55c-4c36-b41f-27534adacd24 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:06.919434 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5ddd5285-f55c-4c36-b41f-27534adacd24 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:06.919873 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5ddd5285-f55c-4c36-b41f-27534adacd24 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:06.920622 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5ddd5285-f55c-4c36-b41f-27534adacd24 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:06.921044 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5ddd5285-f55c-4c36-b41f-27534adacd24 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:06.994557 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-5ddd5285-f55c-4c36-b41f-27534adacd24 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:07.007804 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-5ddd5285-f55c-4c36-b41f-27534adacd24 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:07.009626 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-5ddd5285-f55c-4c36-b41f-27534adacd24 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:07.010805 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-5ddd5285-f55c-4c36-b41f-27534adacd24 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.107044 Jun 17 13:28:07.011368 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1336/2702] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:28:06 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:28:07.611599 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-ead88d87-b9dd-4022-b284-73db45745beb tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:07.612464 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-ead88d87-b9dd-4022-b284-73db45745beb tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:07.621898 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ead88d87-b9dd-4022-b284-73db45745beb tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:07.622561 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ead88d87-b9dd-4022-b284-73db45745beb tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:07.623115 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ead88d87-b9dd-4022-b284-73db45745beb tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:07.623549 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ead88d87-b9dd-4022-b284-73db45745beb tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:07.690744 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-ead88d87-b9dd-4022-b284-73db45745beb tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:07.694142 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_cell1:SELECT=100 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:28:07.699078 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-ead88d87-b9dd-4022-b284-73db45745beb tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.094098 Jun 17 13:28:07.699673 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1367/2703] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:28:07 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:28:07.791448 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-c796ccf9-1e29-41eb-b7bb-bb7a8a8a3a31 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:07.792455 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-c796ccf9-1e29-41eb-b7bb-bb7a8a8a3a31 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:07.803596 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c796ccf9-1e29-41eb-b7bb-bb7a8a8a3a31 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:07.804340 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c796ccf9-1e29-41eb-b7bb-bb7a8a8a3a31 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:07.805591 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c796ccf9-1e29-41eb-b7bb-bb7a8a8a3a31 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:07.806350 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c796ccf9-1e29-41eb-b7bb-bb7a8a8a3a31 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:07.948455 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-c796ccf9-1e29-41eb-b7bb-bb7a8a8a3a31 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:07.956889 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-c796ccf9-1e29-41eb-b7bb-bb7a8a8a3a31 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.172251 Jun 17 13:28:07.957466 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1337/2704] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:28:07 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:28:08.033774 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-3b10370c-ae9c-4bac-9cea-bcf3e94601c0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:08.034854 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-3b10370c-ae9c-4bac-9cea-bcf3e94601c0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:08.044349 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-3b10370c-ae9c-4bac-9cea-bcf3e94601c0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:08.044799 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-3b10370c-ae9c-4bac-9cea-bcf3e94601c0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:08.045547 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-3b10370c-ae9c-4bac-9cea-bcf3e94601c0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:08.045974 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-3b10370c-ae9c-4bac-9cea-bcf3e94601c0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:08.119220 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-3b10370c-ae9c-4bac-9cea-bcf3e94601c0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:08.128344 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-3b10370c-ae9c-4bac-9cea-bcf3e94601c0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:08.129847 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-3b10370c-ae9c-4bac-9cea-bcf3e94601c0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:08.131044 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-3b10370c-ae9c-4bac-9cea-bcf3e94601c0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.104745 Jun 17 13:28:08.131666 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1368/2705] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:28:08 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:28:08.718781 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-425aea71-b0a2-438c-a8ee-c427060eb706 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:08.719565 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-425aea71-b0a2-438c-a8ee-c427060eb706 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:08.727701 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-425aea71-b0a2-438c-a8ee-c427060eb706 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:08.728262 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-425aea71-b0a2-438c-a8ee-c427060eb706 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:08.729746 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-425aea71-b0a2-438c-a8ee-c427060eb706 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:08.730326 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-425aea71-b0a2-438c-a8ee-c427060eb706 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:08.799416 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-425aea71-b0a2-438c-a8ee-c427060eb706 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:08.808239 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-425aea71-b0a2-438c-a8ee-c427060eb706 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.094763 Jun 17 13:28:08.808841 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1338/2706] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:28:08 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:28:08.981423 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-84d3b849-3d2e-4e8a-ad7c-6d22bfd03dad tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:08.982067 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-84d3b849-3d2e-4e8a-ad7c-6d22bfd03dad tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:08.989172 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-84d3b849-3d2e-4e8a-ad7c-6d22bfd03dad tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:08.989684 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-84d3b849-3d2e-4e8a-ad7c-6d22bfd03dad tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:08.990559 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-84d3b849-3d2e-4e8a-ad7c-6d22bfd03dad tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:08.991046 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-84d3b849-3d2e-4e8a-ad7c-6d22bfd03dad tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:09.140420 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-84d3b849-3d2e-4e8a-ad7c-6d22bfd03dad tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:09.148959 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-84d3b849-3d2e-4e8a-ad7c-6d22bfd03dad tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.175044 Jun 17 13:28:09.149320 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-17ec7e36-e4c1-46e5-98fd-23870d73c803 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:09.152741 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1369/2707] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:28:08 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:28:09.152930 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-17ec7e36-e4c1-46e5-98fd-23870d73c803 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:09.156266 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-17ec7e36-e4c1-46e5-98fd-23870d73c803 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:09.156718 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-17ec7e36-e4c1-46e5-98fd-23870d73c803 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:09.157481 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-17ec7e36-e4c1-46e5-98fd-23870d73c803 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:09.157919 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-17ec7e36-e4c1-46e5-98fd-23870d73c803 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:09.221640 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-17ec7e36-e4c1-46e5-98fd-23870d73c803 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:09.230979 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-17ec7e36-e4c1-46e5-98fd-23870d73c803 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:09.232551 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-17ec7e36-e4c1-46e5-98fd-23870d73c803 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:09.233643 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-17ec7e36-e4c1-46e5-98fd-23870d73c803 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.088236 Jun 17 13:28:09.234233 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1339/2708] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:28:09 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:28:09.827921 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-6e0dc3fb-0fb2-408c-ae5b-17235dc2c634 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:09.828589 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-6e0dc3fb-0fb2-408c-ae5b-17235dc2c634 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:09.835598 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6e0dc3fb-0fb2-408c-ae5b-17235dc2c634 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:09.836098 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6e0dc3fb-0fb2-408c-ae5b-17235dc2c634 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:09.836932 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6e0dc3fb-0fb2-408c-ae5b-17235dc2c634 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:09.837410 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6e0dc3fb-0fb2-408c-ae5b-17235dc2c634 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:09.903137 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-6e0dc3fb-0fb2-408c-ae5b-17235dc2c634 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:09.912140 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-6e0dc3fb-0fb2-408c-ae5b-17235dc2c634 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.088554 Jun 17 13:28:09.912974 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1370/2709] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:28:09 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:28:10.170383 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-45569480-e84f-4f3f-aea1-da83e93446ab tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:10.171298 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-45569480-e84f-4f3f-aea1-da83e93446ab tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:10.182766 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-45569480-e84f-4f3f-aea1-da83e93446ab tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:10.183560 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-45569480-e84f-4f3f-aea1-da83e93446ab tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:10.183872 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-45569480-e84f-4f3f-aea1-da83e93446ab tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:10.184299 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-45569480-e84f-4f3f-aea1-da83e93446ab tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:10.252186 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-8363bfa0-d58a-46a2-9d63-4103468a2a46 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:10.252807 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-8363bfa0-d58a-46a2-9d63-4103468a2a46 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:10.259985 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8363bfa0-d58a-46a2-9d63-4103468a2a46 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:10.260717 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8363bfa0-d58a-46a2-9d63-4103468a2a46 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:10.262031 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8363bfa0-d58a-46a2-9d63-4103468a2a46 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:10.262502 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8363bfa0-d58a-46a2-9d63-4103468a2a46 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:10.336884 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-8363bfa0-d58a-46a2-9d63-4103468a2a46 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:10.345893 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-8363bfa0-d58a-46a2-9d63-4103468a2a46 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:10.347405 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-8363bfa0-d58a-46a2-9d63-4103468a2a46 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:10.348511 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-8363bfa0-d58a-46a2-9d63-4103468a2a46 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.100444 Jun 17 13:28:10.349059 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1371/2710] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:28:10 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:28:10.359355 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-45569480-e84f-4f3f-aea1-da83e93446ab tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:10.372996 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-45569480-e84f-4f3f-aea1-da83e93446ab tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.208848 Jun 17 13:28:10.373780 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1340/2711] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:28:10 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:28:10.937083 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-299d269b-b722-45f9-bda0-ab1e87ac1f21 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:10.938157 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-299d269b-b722-45f9-bda0-ab1e87ac1f21 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:10.949077 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-299d269b-b722-45f9-bda0-ab1e87ac1f21 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:10.949834 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-299d269b-b722-45f9-bda0-ab1e87ac1f21 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:10.951148 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-299d269b-b722-45f9-bda0-ab1e87ac1f21 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:10.951882 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-299d269b-b722-45f9-bda0-ab1e87ac1f21 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:11.021718 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-299d269b-b722-45f9-bda0-ab1e87ac1f21 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:11.035605 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-299d269b-b722-45f9-bda0-ab1e87ac1f21 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.105740 Jun 17 13:28:11.036528 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1372/2712] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:28:10 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:28:11.370782 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-0c07db0a-6d8c-4d3b-9274-6b3692fd048e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:11.371400 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-0c07db0a-6d8c-4d3b-9274-6b3692fd048e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:11.378601 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0c07db0a-6d8c-4d3b-9274-6b3692fd048e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:11.379046 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0c07db0a-6d8c-4d3b-9274-6b3692fd048e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:11.379814 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0c07db0a-6d8c-4d3b-9274-6b3692fd048e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:11.380244 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0c07db0a-6d8c-4d3b-9274-6b3692fd048e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:11.384262 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=100 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:28:11.395414 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-0daaaf5a-6da6-484f-b7f5-5f83e1f30ec5 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:11.395988 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-0daaaf5a-6da6-484f-b7f5-5f83e1f30ec5 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:11.403740 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0daaaf5a-6da6-484f-b7f5-5f83e1f30ec5 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:11.404195 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0daaaf5a-6da6-484f-b7f5-5f83e1f30ec5 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:11.404961 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0daaaf5a-6da6-484f-b7f5-5f83e1f30ec5 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:11.405399 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0daaaf5a-6da6-484f-b7f5-5f83e1f30ec5 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:11.449048 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-0c07db0a-6d8c-4d3b-9274-6b3692fd048e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:11.458402 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-0c07db0a-6d8c-4d3b-9274-6b3692fd048e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:11.459889 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-0c07db0a-6d8c-4d3b-9274-6b3692fd048e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:11.461084 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-0c07db0a-6d8c-4d3b-9274-6b3692fd048e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.096361 Jun 17 13:28:11.461649 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1341/2713] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:28:11 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:28:11.543116 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-0daaaf5a-6da6-484f-b7f5-5f83e1f30ec5 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:11.551150 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-0daaaf5a-6da6-484f-b7f5-5f83e1f30ec5 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.159738 Jun 17 13:28:11.551716 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1373/2714] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:28:11 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:28:12.058558 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-1598bb69-c721-443c-825d-e977ec410c05 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:12.059627 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-1598bb69-c721-443c-825d-e977ec410c05 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:12.069835 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1598bb69-c721-443c-825d-e977ec410c05 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:12.070638 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1598bb69-c721-443c-825d-e977ec410c05 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:12.071952 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1598bb69-c721-443c-825d-e977ec410c05 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:12.072850 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1598bb69-c721-443c-825d-e977ec410c05 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:12.143394 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-1598bb69-c721-443c-825d-e977ec410c05 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:12.152166 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-1598bb69-c721-443c-825d-e977ec410c05 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.101049 Jun 17 13:28:12.152734 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1342/2715] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:28:12 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:28:12.485651 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-4da61833-66f7-4fa2-bdd1-2019e4b47a90 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:12.486811 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-4da61833-66f7-4fa2-bdd1-2019e4b47a90 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:12.497996 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4da61833-66f7-4fa2-bdd1-2019e4b47a90 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:12.498473 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4da61833-66f7-4fa2-bdd1-2019e4b47a90 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:12.499228 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4da61833-66f7-4fa2-bdd1-2019e4b47a90 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:12.499663 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4da61833-66f7-4fa2-bdd1-2019e4b47a90 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:12.565726 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-4da61833-66f7-4fa2-bdd1-2019e4b47a90 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:12.570638 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-07c50855-402f-4d89-b088-83403b36e137 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:12.571179 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-07c50855-402f-4d89-b088-83403b36e137 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:12.577573 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-4da61833-66f7-4fa2-bdd1-2019e4b47a90 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:12.578544 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-07c50855-402f-4d89-b088-83403b36e137 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:12.579100 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-07c50855-402f-4d89-b088-83403b36e137 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:12.579420 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-4da61833-66f7-4fa2-bdd1-2019e4b47a90 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:12.579963 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-07c50855-402f-4d89-b088-83403b36e137 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:12.580401 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-07c50855-402f-4d89-b088-83403b36e137 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:12.580570 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-4da61833-66f7-4fa2-bdd1-2019e4b47a90 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.102620 Jun 17 13:28:12.581349 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1374/2716] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:28:12 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:28:12.711674 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-07c50855-402f-4d89-b088-83403b36e137 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:12.719771 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-07c50855-402f-4d89-b088-83403b36e137 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.152981 Jun 17 13:28:12.720341 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1343/2717] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:28:12 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 13:28:13.178307 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-f3379310-5641-41af-a876-19aa1e98bd77 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:13.179312 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-f3379310-5641-41af-a876-19aa1e98bd77 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:13.187317 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f3379310-5641-41af-a876-19aa1e98bd77 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:13.187762 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f3379310-5641-41af-a876-19aa1e98bd77 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:13.188518 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f3379310-5641-41af-a876-19aa1e98bd77 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:13.188954 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f3379310-5641-41af-a876-19aa1e98bd77 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:13.249982 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-f3379310-5641-41af-a876-19aa1e98bd77 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:13.258057 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-f3379310-5641-41af-a876-19aa1e98bd77 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.086522 Jun 17 13:28:13.258715 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1375/2718] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:28:13 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:28:13.603520 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-023a734f-91d9-479d-bf2a-cd70afffc3eb tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:13.604905 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-023a734f-91d9-479d-bf2a-cd70afffc3eb tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:13.611868 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-023a734f-91d9-479d-bf2a-cd70afffc3eb tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:13.612497 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-023a734f-91d9-479d-bf2a-cd70afffc3eb tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:13.613229 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-023a734f-91d9-479d-bf2a-cd70afffc3eb tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:13.613659 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-023a734f-91d9-479d-bf2a-cd70afffc3eb tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:13.678657 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-023a734f-91d9-479d-bf2a-cd70afffc3eb tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:13.687589 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-023a734f-91d9-479d-bf2a-cd70afffc3eb tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:13.689088 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-023a734f-91d9-479d-bf2a-cd70afffc3eb tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:13.690248 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-023a734f-91d9-479d-bf2a-cd70afffc3eb tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.093265 Jun 17 13:28:13.690815 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1344/2719] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:28:13 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:28:13.740734 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-db967608-3649-4b3b-8424-c841c5b0f19e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:13.741298 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-db967608-3649-4b3b-8424-c841c5b0f19e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:13.748915 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-db967608-3649-4b3b-8424-c841c5b0f19e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:13.749374 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-db967608-3649-4b3b-8424-c841c5b0f19e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:13.750175 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-db967608-3649-4b3b-8424-c841c5b0f19e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:13.750611 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-db967608-3649-4b3b-8424-c841c5b0f19e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:13.885671 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-db967608-3649-4b3b-8424-c841c5b0f19e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:13.893669 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-db967608-3649-4b3b-8424-c841c5b0f19e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.159279 Jun 17 13:28:13.894292 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1376/2720] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:28:13 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:28:14.279461 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-9c0a641a-a4ba-4426-be1a-ea45ef40c265 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:14.280461 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-9c0a641a-a4ba-4426-be1a-ea45ef40c265 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:14.290894 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9c0a641a-a4ba-4426-be1a-ea45ef40c265 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:14.291687 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9c0a641a-a4ba-4426-be1a-ea45ef40c265 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:14.292447 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9c0a641a-a4ba-4426-be1a-ea45ef40c265 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:14.292882 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9c0a641a-a4ba-4426-be1a-ea45ef40c265 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:14.353750 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-9c0a641a-a4ba-4426-be1a-ea45ef40c265 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:14.362602 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-9c0a641a-a4ba-4426-be1a-ea45ef40c265 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.089680 Jun 17 13:28:14.363161 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1345/2721] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:28:14 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:28:14.712864 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-d6e67bcc-78d0-4f7a-97a5-cd0a2c7f3bee tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:14.714436 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-d6e67bcc-78d0-4f7a-97a5-cd0a2c7f3bee tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:14.720999 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d6e67bcc-78d0-4f7a-97a5-cd0a2c7f3bee tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:14.721456 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d6e67bcc-78d0-4f7a-97a5-cd0a2c7f3bee tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:14.722245 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d6e67bcc-78d0-4f7a-97a5-cd0a2c7f3bee tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:14.722711 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d6e67bcc-78d0-4f7a-97a5-cd0a2c7f3bee tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:14.794311 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-d6e67bcc-78d0-4f7a-97a5-cd0a2c7f3bee tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:14.806254 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-d6e67bcc-78d0-4f7a-97a5-cd0a2c7f3bee tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:14.808138 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-d6e67bcc-78d0-4f7a-97a5-cd0a2c7f3bee tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:14.809855 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-d6e67bcc-78d0-4f7a-97a5-cd0a2c7f3bee tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.103344 Jun 17 13:28:14.810640 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1377/2722] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:28:14 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:28:14.916635 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-82034b34-53db-41e6-8bce-ebbd1c705ad6 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:14.917447 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-82034b34-53db-41e6-8bce-ebbd1c705ad6 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:14.925031 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-82034b34-53db-41e6-8bce-ebbd1c705ad6 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:14.925530 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-82034b34-53db-41e6-8bce-ebbd1c705ad6 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:14.926405 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-82034b34-53db-41e6-8bce-ebbd1c705ad6 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:14.926884 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-82034b34-53db-41e6-8bce-ebbd1c705ad6 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:15.073567 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-82034b34-53db-41e6-8bce-ebbd1c705ad6 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:15.085283 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-82034b34-53db-41e6-8bce-ebbd1c705ad6 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.174966 Jun 17 13:28:15.086042 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1346/2723] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:28:14 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:28:15.379724 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-5cca8ca0-1798-49c1-b33e-895b65205ccc tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:15.380696 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-5cca8ca0-1798-49c1-b33e-895b65205ccc tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:15.387746 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-5cca8ca0-1798-49c1-b33e-895b65205ccc tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:15.388193 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-5cca8ca0-1798-49c1-b33e-895b65205ccc tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:15.388942 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-5cca8ca0-1798-49c1-b33e-895b65205ccc tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:15.389375 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-5cca8ca0-1798-49c1-b33e-895b65205ccc tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:15.461202 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-5cca8ca0-1798-49c1-b33e-895b65205ccc tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:15.469688 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-5cca8ca0-1798-49c1-b33e-895b65205ccc tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.093927 Jun 17 13:28:15.470320 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1378/2724] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:28:15 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:28:15.837386 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-72efa047-d16a-41da-99fe-645cebeee4cf tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:15.838720 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-72efa047-d16a-41da-99fe-645cebeee4cf tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:15.840441 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_api:SELECT=80 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:28:15.846046 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-72efa047-d16a-41da-99fe-645cebeee4cf tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:15.846512 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-72efa047-d16a-41da-99fe-645cebeee4cf tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:15.847255 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-72efa047-d16a-41da-99fe-645cebeee4cf tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:15.847679 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-72efa047-d16a-41da-99fe-645cebeee4cf tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:15.912002 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-72efa047-d16a-41da-99fe-645cebeee4cf tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:15.922071 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-72efa047-d16a-41da-99fe-645cebeee4cf tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:15.923566 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-72efa047-d16a-41da-99fe-645cebeee4cf tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:15.924697 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-72efa047-d16a-41da-99fe-645cebeee4cf tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.093905 Jun 17 13:28:15.925254 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1347/2725] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:28:15 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:28:16.113944 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-f5d8c4f8-b4d9-4972-9478-2775f41c6cc8 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:16.114870 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-f5d8c4f8-b4d9-4972-9478-2775f41c6cc8 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:16.126002 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f5d8c4f8-b4d9-4972-9478-2775f41c6cc8 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:16.126815 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f5d8c4f8-b4d9-4972-9478-2775f41c6cc8 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:16.128341 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f5d8c4f8-b4d9-4972-9478-2775f41c6cc8 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:16.129087 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f5d8c4f8-b4d9-4972-9478-2775f41c6cc8 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:16.268277 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-f5d8c4f8-b4d9-4972-9478-2775f41c6cc8 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:16.278995 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-f5d8c4f8-b4d9-4972-9478-2775f41c6cc8 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.171708 Jun 17 13:28:16.279604 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1379/2726] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:28:16 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:28:16.491044 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-bb86d99e-d9db-4cc1-b66d-3f5e08a03f00 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:16.492055 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-bb86d99e-d9db-4cc1-b66d-3f5e08a03f00 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:16.500086 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bb86d99e-d9db-4cc1-b66d-3f5e08a03f00 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:16.500511 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bb86d99e-d9db-4cc1-b66d-3f5e08a03f00 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:16.501304 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bb86d99e-d9db-4cc1-b66d-3f5e08a03f00 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:16.501730 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bb86d99e-d9db-4cc1-b66d-3f5e08a03f00 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:16.571531 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-bb86d99e-d9db-4cc1-b66d-3f5e08a03f00 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:16.579814 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-bb86d99e-d9db-4cc1-b66d-3f5e08a03f00 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.095424 Jun 17 13:28:16.580379 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1348/2727] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:28:16 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:28:16.943432 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-c3a01ee5-e65e-4b5d-9065-88c6f57642e9 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:16.944030 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-c3a01ee5-e65e-4b5d-9065-88c6f57642e9 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:16.950958 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c3a01ee5-e65e-4b5d-9065-88c6f57642e9 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:16.951429 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c3a01ee5-e65e-4b5d-9065-88c6f57642e9 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:16.952196 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c3a01ee5-e65e-4b5d-9065-88c6f57642e9 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:16.952607 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c3a01ee5-e65e-4b5d-9065-88c6f57642e9 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:17.023700 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-c3a01ee5-e65e-4b5d-9065-88c6f57642e9 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:17.032445 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-c3a01ee5-e65e-4b5d-9065-88c6f57642e9 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:17.033904 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-c3a01ee5-e65e-4b5d-9065-88c6f57642e9 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:17.035065 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-c3a01ee5-e65e-4b5d-9065-88c6f57642e9 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.095762 Jun 17 13:28:17.035709 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1380/2728] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:28:16 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:28:17.305259 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-2db8fb04-8b43-4518-8b20-469c23a86948 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:17.305866 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-2db8fb04-8b43-4518-8b20-469c23a86948 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:17.313075 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2db8fb04-8b43-4518-8b20-469c23a86948 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:17.314343 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2db8fb04-8b43-4518-8b20-469c23a86948 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:17.314343 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2db8fb04-8b43-4518-8b20-469c23a86948 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:17.314750 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2db8fb04-8b43-4518-8b20-469c23a86948 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:17.491969 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-2db8fb04-8b43-4518-8b20-469c23a86948 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:17.501255 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-2db8fb04-8b43-4518-8b20-469c23a86948 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.199862 Jun 17 13:28:17.501810 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1349/2729] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:28:17 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:28:17.604606 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-b89d1b73-2982-4a30-9d5a-b0200b40b793 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:17.605430 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-b89d1b73-2982-4a30-9d5a-b0200b40b793 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:17.616387 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b89d1b73-2982-4a30-9d5a-b0200b40b793 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:17.617121 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b89d1b73-2982-4a30-9d5a-b0200b40b793 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:17.618422 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b89d1b73-2982-4a30-9d5a-b0200b40b793 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:17.619134 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b89d1b73-2982-4a30-9d5a-b0200b40b793 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:17.691619 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-b89d1b73-2982-4a30-9d5a-b0200b40b793 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:17.700356 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-b89d1b73-2982-4a30-9d5a-b0200b40b793 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.103378 Jun 17 13:28:17.700944 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1381/2730] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:28:17 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:28:18.055817 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-162bed28-cba3-4a23-b46c-8c87d8be2a41 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:18.056428 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-162bed28-cba3-4a23-b46c-8c87d8be2a41 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:18.063047 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-162bed28-cba3-4a23-b46c-8c87d8be2a41 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:18.063494 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-162bed28-cba3-4a23-b46c-8c87d8be2a41 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:18.064259 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-162bed28-cba3-4a23-b46c-8c87d8be2a41 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:18.064690 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-162bed28-cba3-4a23-b46c-8c87d8be2a41 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:18.131640 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-162bed28-cba3-4a23-b46c-8c87d8be2a41 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:18.141763 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-162bed28-cba3-4a23-b46c-8c87d8be2a41 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:18.143328 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-162bed28-cba3-4a23-b46c-8c87d8be2a41 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:18.144450 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-162bed28-cba3-4a23-b46c-8c87d8be2a41 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.093270 Jun 17 13:28:18.145003 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1350/2731] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:28:18 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:28:18.522579 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-b48f4362-7d34-430f-9100-31977bb8cdf5 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:18.523580 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-b48f4362-7d34-430f-9100-31977bb8cdf5 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:18.531035 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b48f4362-7d34-430f-9100-31977bb8cdf5 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:18.531484 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b48f4362-7d34-430f-9100-31977bb8cdf5 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:18.532235 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b48f4362-7d34-430f-9100-31977bb8cdf5 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:18.532665 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b48f4362-7d34-430f-9100-31977bb8cdf5 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:18.664710 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-b48f4362-7d34-430f-9100-31977bb8cdf5 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:18.673623 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-b48f4362-7d34-430f-9100-31977bb8cdf5 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.157533 Jun 17 13:28:18.674225 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1382/2732] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:28:18 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:28:18.721553 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-5b4f0af0-00a3-4ef5-924d-a4dd1ec807c4 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:18.722142 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-5b4f0af0-00a3-4ef5-924d-a4dd1ec807c4 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:18.731362 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5b4f0af0-00a3-4ef5-924d-a4dd1ec807c4 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:18.731807 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5b4f0af0-00a3-4ef5-924d-a4dd1ec807c4 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:18.732555 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5b4f0af0-00a3-4ef5-924d-a4dd1ec807c4 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:18.732982 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5b4f0af0-00a3-4ef5-924d-a4dd1ec807c4 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:18.807674 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-5b4f0af0-00a3-4ef5-924d-a4dd1ec807c4 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:18.819979 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-5b4f0af0-00a3-4ef5-924d-a4dd1ec807c4 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.104306 Jun 17 13:28:18.820740 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1351/2733] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:28:18 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:28:19.167471 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-040a6af9-1f81-427a-8316-ffd978292b43 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:19.168706 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-040a6af9-1f81-427a-8316-ffd978292b43 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:19.179106 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-040a6af9-1f81-427a-8316-ffd978292b43 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:19.179856 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-040a6af9-1f81-427a-8316-ffd978292b43 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:19.181111 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-040a6af9-1f81-427a-8316-ffd978292b43 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:19.182126 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-040a6af9-1f81-427a-8316-ffd978292b43 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:19.245830 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-040a6af9-1f81-427a-8316-ffd978292b43 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:19.254452 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-040a6af9-1f81-427a-8316-ffd978292b43 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:19.255942 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-040a6af9-1f81-427a-8316-ffd978292b43 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:19.257082 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-040a6af9-1f81-427a-8316-ffd978292b43 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.096569 Jun 17 13:28:19.257639 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1383/2734] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:28:19 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:28:19.691399 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-c00b912a-cad6-493a-aa1d-681d47873bdd tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:19.691915 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-c00b912a-cad6-493a-aa1d-681d47873bdd tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:19.698668 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c00b912a-cad6-493a-aa1d-681d47873bdd tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:19.699111 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c00b912a-cad6-493a-aa1d-681d47873bdd tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:19.699889 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c00b912a-cad6-493a-aa1d-681d47873bdd tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:19.700317 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c00b912a-cad6-493a-aa1d-681d47873bdd tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:19.832951 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-c00b912a-cad6-493a-aa1d-681d47873bdd tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:19.836739 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-bc0958a1-daea-44c2-94e3-19722d958d56 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:19.837346 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-bc0958a1-daea-44c2-94e3-19722d958d56 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:19.841682 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-c00b912a-cad6-493a-aa1d-681d47873bdd tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.154370 Jun 17 13:28:19.842321 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1352/2735] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:28:19 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:28:19.844368 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-bc0958a1-daea-44c2-94e3-19722d958d56 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:19.844849 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-bc0958a1-daea-44c2-94e3-19722d958d56 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:19.845655 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-bc0958a1-daea-44c2-94e3-19722d958d56 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:19.846114 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-bc0958a1-daea-44c2-94e3-19722d958d56 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:19.865143 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_cell1:SELECT=100 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:28:19.909443 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-bc0958a1-daea-44c2-94e3-19722d958d56 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:19.917565 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-bc0958a1-daea-44c2-94e3-19722d958d56 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.084673 Jun 17 13:28:19.918258 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1384/2736] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:28:19 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:28:20.280238 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-46e7777b-ddaf-451f-baf2-e106a622276a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:20.281107 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-46e7777b-ddaf-451f-baf2-e106a622276a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:20.291432 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-46e7777b-ddaf-451f-baf2-e106a622276a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:20.291878 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-46e7777b-ddaf-451f-baf2-e106a622276a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:20.292663 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-46e7777b-ddaf-451f-baf2-e106a622276a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:20.293098 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-46e7777b-ddaf-451f-baf2-e106a622276a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:20.357440 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-46e7777b-ddaf-451f-baf2-e106a622276a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:20.366249 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-46e7777b-ddaf-451f-baf2-e106a622276a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:20.367736 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-46e7777b-ddaf-451f-baf2-e106a622276a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:20.368896 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-46e7777b-ddaf-451f-baf2-e106a622276a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.095392 Jun 17 13:28:20.369458 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1353/2737] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:28:20 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:28:20.862935 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-79a70dd1-c45c-410c-aca1-5b4b455e0e01 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:20.863933 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-79a70dd1-c45c-410c-aca1-5b4b455e0e01 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:20.873215 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-79a70dd1-c45c-410c-aca1-5b4b455e0e01 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:20.873687 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-79a70dd1-c45c-410c-aca1-5b4b455e0e01 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:20.874452 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-79a70dd1-c45c-410c-aca1-5b4b455e0e01 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:20.874887 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-79a70dd1-c45c-410c-aca1-5b4b455e0e01 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:20.936529 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-1a10f989-07c9-4a7d-975a-87a9448fc773 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:20.937098 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-1a10f989-07c9-4a7d-975a-87a9448fc773 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:20.944016 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1a10f989-07c9-4a7d-975a-87a9448fc773 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:20.944500 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1a10f989-07c9-4a7d-975a-87a9448fc773 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:20.945239 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1a10f989-07c9-4a7d-975a-87a9448fc773 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:20.945672 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1a10f989-07c9-4a7d-975a-87a9448fc773 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:21.014854 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-1a10f989-07c9-4a7d-975a-87a9448fc773 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:21.032423 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-1a10f989-07c9-4a7d-975a-87a9448fc773 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.099732 Jun 17 13:28:21.033017 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1354/2738] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:28:20 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:28:21.037626 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-79a70dd1-c45c-410c-aca1-5b4b455e0e01 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:21.046204 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-79a70dd1-c45c-410c-aca1-5b4b455e0e01 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.189740 Jun 17 13:28:21.046797 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1385/2739] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:28:20 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:28:21.392816 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-4584d1e5-d41b-4686-9314-1db52ea25a51 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:21.393454 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-4584d1e5-d41b-4686-9314-1db52ea25a51 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:21.399883 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4584d1e5-d41b-4686-9314-1db52ea25a51 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:21.400330 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4584d1e5-d41b-4686-9314-1db52ea25a51 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:21.401142 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4584d1e5-d41b-4686-9314-1db52ea25a51 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:21.401574 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4584d1e5-d41b-4686-9314-1db52ea25a51 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:21.464969 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-4584d1e5-d41b-4686-9314-1db52ea25a51 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:21.473490 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-4584d1e5-d41b-4686-9314-1db52ea25a51 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:21.475021 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-4584d1e5-d41b-4686-9314-1db52ea25a51 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:21.476155 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-4584d1e5-d41b-4686-9314-1db52ea25a51 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.087402 Jun 17 13:28:21.476719 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1355/2740] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:28:21 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:28:22.054326 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-e644bcb6-d0ce-46d0-8e49-3c39d2136d04 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:22.055352 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-e644bcb6-d0ce-46d0-8e49-3c39d2136d04 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:22.067737 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e644bcb6-d0ce-46d0-8e49-3c39d2136d04 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:22.068487 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e644bcb6-d0ce-46d0-8e49-3c39d2136d04 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:22.068981 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-ba7c8c73-935f-4a94-b797-d0bda237e7c4 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:22.069751 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e644bcb6-d0ce-46d0-8e49-3c39d2136d04 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:22.069936 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-ba7c8c73-935f-4a94-b797-d0bda237e7c4 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:22.070553 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e644bcb6-d0ce-46d0-8e49-3c39d2136d04 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:22.079090 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ba7c8c73-935f-4a94-b797-d0bda237e7c4 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:22.079537 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ba7c8c73-935f-4a94-b797-d0bda237e7c4 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:22.080310 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ba7c8c73-935f-4a94-b797-d0bda237e7c4 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:22.080743 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ba7c8c73-935f-4a94-b797-d0bda237e7c4 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:22.156395 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-e644bcb6-d0ce-46d0-8e49-3c39d2136d04 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:22.164728 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-e644bcb6-d0ce-46d0-8e49-3c39d2136d04 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.116889 Jun 17 13:28:22.165357 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1386/2741] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:28:22 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:28:22.236709 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-ba7c8c73-935f-4a94-b797-d0bda237e7c4 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:22.248167 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-ba7c8c73-935f-4a94-b797-d0bda237e7c4 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.185317 Jun 17 13:28:22.248702 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1356/2742] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:28:22 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:28:22.498675 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-79f53482-9c07-4416-aa1f-c9a45e75451a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:22.499366 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-79f53482-9c07-4416-aa1f-c9a45e75451a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:22.508553 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-79f53482-9c07-4416-aa1f-c9a45e75451a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:22.509125 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-79f53482-9c07-4416-aa1f-c9a45e75451a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:22.510340 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-79f53482-9c07-4416-aa1f-c9a45e75451a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:22.511039 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-79f53482-9c07-4416-aa1f-c9a45e75451a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:22.579563 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-79f53482-9c07-4416-aa1f-c9a45e75451a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:22.588544 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-79f53482-9c07-4416-aa1f-c9a45e75451a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:22.590070 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-79f53482-9c07-4416-aa1f-c9a45e75451a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:22.591269 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-79f53482-9c07-4416-aa1f-c9a45e75451a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.098830 Jun 17 13:28:22.591847 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1387/2743] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:28:22 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:28:23.186283 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-d24c5da6-7c20-4d01-b463-2957dfa3f424 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:23.186918 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-d24c5da6-7c20-4d01-b463-2957dfa3f424 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:23.193867 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d24c5da6-7c20-4d01-b463-2957dfa3f424 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:23.194350 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d24c5da6-7c20-4d01-b463-2957dfa3f424 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:23.195116 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d24c5da6-7c20-4d01-b463-2957dfa3f424 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:23.195549 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d24c5da6-7c20-4d01-b463-2957dfa3f424 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:23.262747 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-d24c5da6-7c20-4d01-b463-2957dfa3f424 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:23.265780 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-ccbab9a9-d2b8-4fe1-9be2-42add04a3beb tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:23.266319 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=100 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:28:23.266430 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-ccbab9a9-d2b8-4fe1-9be2-42add04a3beb tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:23.272341 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-d24c5da6-7c20-4d01-b463-2957dfa3f424 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.092108 Jun 17 13:28:23.272922 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1357/2744] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:28:23 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:28:23.273300 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ccbab9a9-d2b8-4fe1-9be2-42add04a3beb tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:23.273744 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ccbab9a9-d2b8-4fe1-9be2-42add04a3beb tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:23.274524 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ccbab9a9-d2b8-4fe1-9be2-42add04a3beb tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:23.274951 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ccbab9a9-d2b8-4fe1-9be2-42add04a3beb tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:23.406898 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-ccbab9a9-d2b8-4fe1-9be2-42add04a3beb tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:23.415114 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-ccbab9a9-d2b8-4fe1-9be2-42add04a3beb tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.153802 Jun 17 13:28:23.415660 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1388/2745] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:28:23 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 13:28:23.613334 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-9c41f866-1817-46e8-9296-06de52f9226c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:23.614376 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-9c41f866-1817-46e8-9296-06de52f9226c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:23.624794 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9c41f866-1817-46e8-9296-06de52f9226c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:23.625570 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9c41f866-1817-46e8-9296-06de52f9226c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:23.626927 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9c41f866-1817-46e8-9296-06de52f9226c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:23.627636 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9c41f866-1817-46e8-9296-06de52f9226c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:23.693706 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-9c41f866-1817-46e8-9296-06de52f9226c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:23.702663 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-9c41f866-1817-46e8-9296-06de52f9226c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:23.704146 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-9c41f866-1817-46e8-9296-06de52f9226c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:23.705242 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-9c41f866-1817-46e8-9296-06de52f9226c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.098503 Jun 17 13:28:23.705824 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1358/2746] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:28:23 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:28:24.293657 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-575f79a5-7dc9-4351-ba2f-f00c8b3af32b tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:24.294438 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-575f79a5-7dc9-4351-ba2f-f00c8b3af32b tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:24.297014 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_api:SELECT=80 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:28:24.303288 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-575f79a5-7dc9-4351-ba2f-f00c8b3af32b tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:24.303828 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-575f79a5-7dc9-4351-ba2f-f00c8b3af32b tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:24.304664 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-575f79a5-7dc9-4351-ba2f-f00c8b3af32b tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:24.305144 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-575f79a5-7dc9-4351-ba2f-f00c8b3af32b tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:24.376510 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-575f79a5-7dc9-4351-ba2f-f00c8b3af32b tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:24.387656 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-575f79a5-7dc9-4351-ba2f-f00c8b3af32b tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.099878 Jun 17 13:28:24.388273 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1389/2747] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:28:24 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:28:24.432612 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-ce2d7b54-5dd9-4d84-ac46-9396bc550ea8 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:24.433201 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-ce2d7b54-5dd9-4d84-ac46-9396bc550ea8 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:24.440292 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ce2d7b54-5dd9-4d84-ac46-9396bc550ea8 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:24.440723 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ce2d7b54-5dd9-4d84-ac46-9396bc550ea8 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:24.441489 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ce2d7b54-5dd9-4d84-ac46-9396bc550ea8 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:24.441922 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ce2d7b54-5dd9-4d84-ac46-9396bc550ea8 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:24.581749 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-ce2d7b54-5dd9-4d84-ac46-9396bc550ea8 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:24.592737 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-ce2d7b54-5dd9-4d84-ac46-9396bc550ea8 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.164158 Jun 17 13:28:24.593340 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1359/2748] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:28:24 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:28:24.727800 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-c762fe7a-0fbc-456f-b2e4-58f30e782a65 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:24.728800 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-c762fe7a-0fbc-456f-b2e4-58f30e782a65 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:24.739414 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c762fe7a-0fbc-456f-b2e4-58f30e782a65 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:24.740157 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c762fe7a-0fbc-456f-b2e4-58f30e782a65 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:24.741437 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c762fe7a-0fbc-456f-b2e4-58f30e782a65 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:24.742168 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c762fe7a-0fbc-456f-b2e4-58f30e782a65 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:24.804552 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-c762fe7a-0fbc-456f-b2e4-58f30e782a65 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:24.813832 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-c762fe7a-0fbc-456f-b2e4-58f30e782a65 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:24.815375 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-c762fe7a-0fbc-456f-b2e4-58f30e782a65 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:24.816512 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-c762fe7a-0fbc-456f-b2e4-58f30e782a65 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.095551 Jun 17 13:28:24.817074 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1390/2749] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:28:24 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:28:25.410274 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-43496238-e579-41f2-8e88-8804b3971959 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:25.411274 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-43496238-e579-41f2-8e88-8804b3971959 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:25.420588 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-43496238-e579-41f2-8e88-8804b3971959 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:25.421285 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-43496238-e579-41f2-8e88-8804b3971959 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:25.422532 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-43496238-e579-41f2-8e88-8804b3971959 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:25.423205 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-43496238-e579-41f2-8e88-8804b3971959 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:25.490298 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-43496238-e579-41f2-8e88-8804b3971959 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:25.500468 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-43496238-e579-41f2-8e88-8804b3971959 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.095431 Jun 17 13:28:25.501044 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1360/2750] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:28:25 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:28:25.613409 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-a0280be6-e9b0-49fb-9768-5866e817440f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:25.613986 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-a0280be6-e9b0-49fb-9768-5866e817440f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:25.624267 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a0280be6-e9b0-49fb-9768-5866e817440f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:25.624885 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a0280be6-e9b0-49fb-9768-5866e817440f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:25.626034 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a0280be6-e9b0-49fb-9768-5866e817440f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:25.626727 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a0280be6-e9b0-49fb-9768-5866e817440f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:25.775833 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-a0280be6-e9b0-49fb-9768-5866e817440f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:25.784987 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-a0280be6-e9b0-49fb-9768-5866e817440f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.178119 Jun 17 13:28:25.785561 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1391/2751] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:28:25 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:28:25.834946 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-5ee8ea01-876c-4120-a07f-44698b388d4f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:25.835554 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-5ee8ea01-876c-4120-a07f-44698b388d4f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:25.842214 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5ee8ea01-876c-4120-a07f-44698b388d4f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:25.842666 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5ee8ea01-876c-4120-a07f-44698b388d4f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:25.843418 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5ee8ea01-876c-4120-a07f-44698b388d4f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:25.843851 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5ee8ea01-876c-4120-a07f-44698b388d4f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:25.911970 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-5ee8ea01-876c-4120-a07f-44698b388d4f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:25.922703 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-5ee8ea01-876c-4120-a07f-44698b388d4f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:25.924201 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-5ee8ea01-876c-4120-a07f-44698b388d4f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:25.925341 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-5ee8ea01-876c-4120-a07f-44698b388d4f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.094481 Jun 17 13:28:25.925902 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1361/2752] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:28:25 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:28:26.521949 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-b63e7d7b-d943-4428-865f-442b8533cc7d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:26.523075 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-b63e7d7b-d943-4428-865f-442b8533cc7d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:26.533782 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b63e7d7b-d943-4428-865f-442b8533cc7d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:26.534586 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b63e7d7b-d943-4428-865f-442b8533cc7d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:26.535875 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b63e7d7b-d943-4428-865f-442b8533cc7d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:26.536609 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b63e7d7b-d943-4428-865f-442b8533cc7d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:26.598987 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-b63e7d7b-d943-4428-865f-442b8533cc7d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:26.607407 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-b63e7d7b-d943-4428-865f-442b8533cc7d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.091979 Jun 17 13:28:26.607968 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1392/2753] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:28:26 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:28:26.808891 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-96e18a66-0680-472c-84cb-f4e276a259fa tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:26.809574 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-96e18a66-0680-472c-84cb-f4e276a259fa tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:26.816382 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-96e18a66-0680-472c-84cb-f4e276a259fa tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:26.816825 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-96e18a66-0680-472c-84cb-f4e276a259fa tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:26.817575 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-96e18a66-0680-472c-84cb-f4e276a259fa tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:26.818000 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-96e18a66-0680-472c-84cb-f4e276a259fa tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:26.943794 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-e808f8ae-3b4e-4a59-b924-d3ddd61b5919 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:26.944484 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-e808f8ae-3b4e-4a59-b924-d3ddd61b5919 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:26.951246 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e808f8ae-3b4e-4a59-b924-d3ddd61b5919 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:26.951797 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e808f8ae-3b4e-4a59-b924-d3ddd61b5919 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:26.952624 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e808f8ae-3b4e-4a59-b924-d3ddd61b5919 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:26.953107 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e808f8ae-3b4e-4a59-b924-d3ddd61b5919 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:26.957097 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-96e18a66-0680-472c-84cb-f4e276a259fa tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:26.966044 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-96e18a66-0680-472c-84cb-f4e276a259fa tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.163587 Jun 17 13:28:26.966824 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1362/2754] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:28:26 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:28:27.016094 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-e808f8ae-3b4e-4a59-b924-d3ddd61b5919 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:27.024857 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-e808f8ae-3b4e-4a59-b924-d3ddd61b5919 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:27.026406 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-e808f8ae-3b4e-4a59-b924-d3ddd61b5919 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:27.027662 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-e808f8ae-3b4e-4a59-b924-d3ddd61b5919 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.087694 Jun 17 13:28:27.028525 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1393/2755] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:28:26 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 13:28:27.629042 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-021d6e71-66b5-4c76-b053-4c4f8f852704 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:27.630059 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-021d6e71-66b5-4c76-b053-4c4f8f852704 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:27.640244 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-021d6e71-66b5-4c76-b053-4c4f8f852704 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:27.640982 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-021d6e71-66b5-4c76-b053-4c4f8f852704 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:27.642285 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-021d6e71-66b5-4c76-b053-4c4f8f852704 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:27.643004 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-021d6e71-66b5-4c76-b053-4c4f8f852704 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:27.711323 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-021d6e71-66b5-4c76-b053-4c4f8f852704 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:27.720056 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-021d6e71-66b5-4c76-b053-4c4f8f852704 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.097607 Jun 17 13:28:27.720590 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1363/2756] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:28:27 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:28:27.985670 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-f86e2de3-5f86-43ab-8e0a-8c7cea3a75f8 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:27.986313 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-f86e2de3-5f86-43ab-8e0a-8c7cea3a75f8 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:27.993551 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f86e2de3-5f86-43ab-8e0a-8c7cea3a75f8 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:27.994002 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f86e2de3-5f86-43ab-8e0a-8c7cea3a75f8 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:27.994792 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f86e2de3-5f86-43ab-8e0a-8c7cea3a75f8 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:27.995235 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f86e2de3-5f86-43ab-8e0a-8c7cea3a75f8 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:28.045872 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-7849954c-33b6-43a5-94ea-9f07f97813a2 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:28.046495 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-7849954c-33b6-43a5-94ea-9f07f97813a2 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:28.053401 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7849954c-33b6-43a5-94ea-9f07f97813a2 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:28.053846 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7849954c-33b6-43a5-94ea-9f07f97813a2 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:28.054646 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7849954c-33b6-43a5-94ea-9f07f97813a2 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:28.055075 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7849954c-33b6-43a5-94ea-9f07f97813a2 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:28.127224 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-7849954c-33b6-43a5-94ea-9f07f97813a2 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:28.136299 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-7849954c-33b6-43a5-94ea-9f07f97813a2 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:28.138373 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-7849954c-33b6-43a5-94ea-9f07f97813a2 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:28.139539 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-7849954c-33b6-43a5-94ea-9f07f97813a2 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.097836 Jun 17 13:28:28.140095 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1364/2757] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:28:28 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:28:28.159084 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-f86e2de3-5f86-43ab-8e0a-8c7cea3a75f8 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:28.167517 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-f86e2de3-5f86-43ab-8e0a-8c7cea3a75f8 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.185874 Jun 17 13:28:28.168207 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1394/2758] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:28:27 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:28:28.741178 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-e107e887-bc05-4401-9dac-a73f76fee785 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:28.742224 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-e107e887-bc05-4401-9dac-a73f76fee785 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:28.753018 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e107e887-bc05-4401-9dac-a73f76fee785 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:28.753748 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e107e887-bc05-4401-9dac-a73f76fee785 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:28.755004 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e107e887-bc05-4401-9dac-a73f76fee785 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:28.755736 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e107e887-bc05-4401-9dac-a73f76fee785 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:28.820247 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-e107e887-bc05-4401-9dac-a73f76fee785 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:28.828593 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-e107e887-bc05-4401-9dac-a73f76fee785 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.093898 Jun 17 13:28:28.829386 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1365/2759] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:28:28 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:28:29.161882 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-8be509cd-f879-4b6b-a768-d9d62193e287 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:29.162923 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-8be509cd-f879-4b6b-a768-d9d62193e287 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:29.174529 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8be509cd-f879-4b6b-a768-d9d62193e287 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:29.175280 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8be509cd-f879-4b6b-a768-d9d62193e287 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:29.176527 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8be509cd-f879-4b6b-a768-d9d62193e287 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:29.177257 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8be509cd-f879-4b6b-a768-d9d62193e287 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:29.187065 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-acf9d953-56f8-4da9-b26c-32e17d5d7373 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:29.187669 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-acf9d953-56f8-4da9-b26c-32e17d5d7373 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:29.194540 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-acf9d953-56f8-4da9-b26c-32e17d5d7373 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:29.194975 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-acf9d953-56f8-4da9-b26c-32e17d5d7373 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:29.195738 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-acf9d953-56f8-4da9-b26c-32e17d5d7373 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:29.196157 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-acf9d953-56f8-4da9-b26c-32e17d5d7373 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:29.251844 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-8be509cd-f879-4b6b-a768-d9d62193e287 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:29.260763 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-8be509cd-f879-4b6b-a768-d9d62193e287 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:29.262449 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-8be509cd-f879-4b6b-a768-d9d62193e287 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:29.263463 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-8be509cd-f879-4b6b-a768-d9d62193e287 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.108110 Jun 17 13:28:29.264010 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1395/2760] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:28:29 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:28:29.337621 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-acf9d953-56f8-4da9-b26c-32e17d5d7373 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:29.346313 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-acf9d953-56f8-4da9-b26c-32e17d5d7373 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.164076 Jun 17 13:28:29.346887 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1366/2761] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:28:29 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:28:29.854925 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-ce7891f0-9842-423f-9df6-c1c97ae4cc10 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:29.856060 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-ce7891f0-9842-423f-9df6-c1c97ae4cc10 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:29.866356 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ce7891f0-9842-423f-9df6-c1c97ae4cc10 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:29.867094 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ce7891f0-9842-423f-9df6-c1c97ae4cc10 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:29.868343 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ce7891f0-9842-423f-9df6-c1c97ae4cc10 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:29.869054 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ce7891f0-9842-423f-9df6-c1c97ae4cc10 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:29.933258 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-ce7891f0-9842-423f-9df6-c1c97ae4cc10 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:29.942055 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-ce7891f0-9842-423f-9df6-c1c97ae4cc10 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.094085 Jun 17 13:28:29.942658 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1396/2762] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:28:29 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:28:30.285066 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-f54afa30-5a13-4045-a9a2-025cc9cba202 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:30.286061 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-f54afa30-5a13-4045-a9a2-025cc9cba202 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:30.295698 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f54afa30-5a13-4045-a9a2-025cc9cba202 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:30.296148 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f54afa30-5a13-4045-a9a2-025cc9cba202 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:30.296906 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f54afa30-5a13-4045-a9a2-025cc9cba202 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:30.297339 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f54afa30-5a13-4045-a9a2-025cc9cba202 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:30.361193 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-f54afa30-5a13-4045-a9a2-025cc9cba202 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:30.364091 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-a70fa54e-93a0-4dd2-b16a-36cce08d39c0 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:30.364709 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-a70fa54e-93a0-4dd2-b16a-36cce08d39c0 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:30.370178 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-f54afa30-5a13-4045-a9a2-025cc9cba202 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:30.371368 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a70fa54e-93a0-4dd2-b16a-36cce08d39c0 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:30.371831 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a70fa54e-93a0-4dd2-b16a-36cce08d39c0 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:30.372485 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-f54afa30-5a13-4045-a9a2-025cc9cba202 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:30.372660 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a70fa54e-93a0-4dd2-b16a-36cce08d39c0 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:30.373053 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a70fa54e-93a0-4dd2-b16a-36cce08d39c0 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:30.373773 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-f54afa30-5a13-4045-a9a2-025cc9cba202 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.095504 Jun 17 13:28:30.374367 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1367/2763] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:28:30 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:28:30.507037 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-a70fa54e-93a0-4dd2-b16a-36cce08d39c0 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:30.515833 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-a70fa54e-93a0-4dd2-b16a-36cce08d39c0 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.155581 Jun 17 13:28:30.516411 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1397/2764] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:28:30 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:28:30.960156 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-605fab12-f2dd-43c8-ad96-186e3a4b6fdf tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:30.960695 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-605fab12-f2dd-43c8-ad96-186e3a4b6fdf tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:30.967643 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-605fab12-f2dd-43c8-ad96-186e3a4b6fdf tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:30.968083 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-605fab12-f2dd-43c8-ad96-186e3a4b6fdf tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:30.968842 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-605fab12-f2dd-43c8-ad96-186e3a4b6fdf tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:30.969270 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-605fab12-f2dd-43c8-ad96-186e3a4b6fdf tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:31.033077 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-605fab12-f2dd-43c8-ad96-186e3a4b6fdf tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:31.042739 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-605fab12-f2dd-43c8-ad96-186e3a4b6fdf tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.086635 Jun 17 13:28:31.043386 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1368/2765] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:28:30 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:28:31.392033 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-a36a10ca-d5b2-4b35-8cc6-e9102f37143a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:31.392606 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-a36a10ca-d5b2-4b35-8cc6-e9102f37143a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:31.399495 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a36a10ca-d5b2-4b35-8cc6-e9102f37143a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:31.399941 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a36a10ca-d5b2-4b35-8cc6-e9102f37143a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:31.400791 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a36a10ca-d5b2-4b35-8cc6-e9102f37143a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:31.401226 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a36a10ca-d5b2-4b35-8cc6-e9102f37143a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:31.473234 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-a36a10ca-d5b2-4b35-8cc6-e9102f37143a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:31.482388 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-a36a10ca-d5b2-4b35-8cc6-e9102f37143a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:31.483872 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-a36a10ca-d5b2-4b35-8cc6-e9102f37143a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:31.485031 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-a36a10ca-d5b2-4b35-8cc6-e9102f37143a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.097008 Jun 17 13:28:31.485589 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1398/2766] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:28:31 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:28:31.534046 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-70be89fa-430b-42d5-af85-4d8e7a203c7f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:31.534717 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-70be89fa-430b-42d5-af85-4d8e7a203c7f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:31.541572 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-70be89fa-430b-42d5-af85-4d8e7a203c7f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:31.542052 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-70be89fa-430b-42d5-af85-4d8e7a203c7f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:31.542858 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-70be89fa-430b-42d5-af85-4d8e7a203c7f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:31.543289 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-70be89fa-430b-42d5-af85-4d8e7a203c7f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:32.008455 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-70be89fa-430b-42d5-af85-4d8e7a203c7f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:32.018851 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-70be89fa-430b-42d5-af85-4d8e7a203c7f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.488684 Jun 17 13:28:32.019670 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1369/2767] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:28:31 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:28:32.060142 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-05fe7df2-c466-4451-a6ce-3367c6d8979d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:32.060744 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-05fe7df2-c466-4451-a6ce-3367c6d8979d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:32.066870 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-05fe7df2-c466-4451-a6ce-3367c6d8979d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:32.067323 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-05fe7df2-c466-4451-a6ce-3367c6d8979d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:32.068114 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-05fe7df2-c466-4451-a6ce-3367c6d8979d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:32.068917 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-05fe7df2-c466-4451-a6ce-3367c6d8979d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:32.142917 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-05fe7df2-c466-4451-a6ce-3367c6d8979d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:32.151130 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-05fe7df2-c466-4451-a6ce-3367c6d8979d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.094967 Jun 17 13:28:32.151719 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1399/2768] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:28:32 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:28:32.507660 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-363f7b91-f667-4a9a-bb40-0c524b3001c2 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:32.508546 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-363f7b91-f667-4a9a-bb40-0c524b3001c2 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:32.516396 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-363f7b91-f667-4a9a-bb40-0c524b3001c2 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:32.516875 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-363f7b91-f667-4a9a-bb40-0c524b3001c2 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:32.517629 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-363f7b91-f667-4a9a-bb40-0c524b3001c2 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:32.518058 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-363f7b91-f667-4a9a-bb40-0c524b3001c2 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:32.581430 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-363f7b91-f667-4a9a-bb40-0c524b3001c2 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:32.591001 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-363f7b91-f667-4a9a-bb40-0c524b3001c2 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:32.592527 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-363f7b91-f667-4a9a-bb40-0c524b3001c2 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:32.593678 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-363f7b91-f667-4a9a-bb40-0c524b3001c2 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.092907 Jun 17 13:28:32.594272 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1370/2769] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:28:32 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:28:33.040792 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-93a90a25-d2a9-42f0-b7e7-1455b0998a77 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:33.041741 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-93a90a25-d2a9-42f0-b7e7-1455b0998a77 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:33.053151 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-93a90a25-d2a9-42f0-b7e7-1455b0998a77 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:33.053909 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-93a90a25-d2a9-42f0-b7e7-1455b0998a77 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:33.055206 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-93a90a25-d2a9-42f0-b7e7-1455b0998a77 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:33.055928 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-93a90a25-d2a9-42f0-b7e7-1455b0998a77 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:33.169442 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-f4f9a922-e663-4cee-b6c3-ff74960b9644 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:33.170046 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-f4f9a922-e663-4cee-b6c3-ff74960b9644 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:33.176355 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f4f9a922-e663-4cee-b6c3-ff74960b9644 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:33.176796 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f4f9a922-e663-4cee-b6c3-ff74960b9644 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:33.177546 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f4f9a922-e663-4cee-b6c3-ff74960b9644 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:33.177970 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f4f9a922-e663-4cee-b6c3-ff74960b9644 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:33.193278 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-93a90a25-d2a9-42f0-b7e7-1455b0998a77 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:33.201853 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-93a90a25-d2a9-42f0-b7e7-1455b0998a77 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.167457 Jun 17 13:28:33.202524 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1400/2770] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:28:33 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:28:33.239420 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-f4f9a922-e663-4cee-b6c3-ff74960b9644 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:33.247486 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-f4f9a922-e663-4cee-b6c3-ff74960b9644 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.082353 Jun 17 13:28:33.248029 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1371/2771] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:28:33 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:28:33.620106 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-152b1fd7-232a-4fc5-a00e-bbbe54efe69e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:33.621207 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-152b1fd7-232a-4fc5-a00e-bbbe54efe69e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:33.627834 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-152b1fd7-232a-4fc5-a00e-bbbe54efe69e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:33.628289 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-152b1fd7-232a-4fc5-a00e-bbbe54efe69e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:33.629012 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-152b1fd7-232a-4fc5-a00e-bbbe54efe69e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:33.629446 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-152b1fd7-232a-4fc5-a00e-bbbe54efe69e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:33.633472 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_cell1:SELECT=100 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:28:33.699580 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-152b1fd7-232a-4fc5-a00e-bbbe54efe69e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:33.707776 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-152b1fd7-232a-4fc5-a00e-bbbe54efe69e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:33.709280 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-152b1fd7-232a-4fc5-a00e-bbbe54efe69e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:33.710451 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-152b1fd7-232a-4fc5-a00e-bbbe54efe69e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.097024 Jun 17 13:28:33.710986 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1401/2772] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:28:33 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:28:34.222074 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-db0d2649-f17f-4845-b9ff-cb7edca64ed1 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:34.222806 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-db0d2649-f17f-4845-b9ff-cb7edca64ed1 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:34.231943 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-db0d2649-f17f-4845-b9ff-cb7edca64ed1 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:34.232385 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-db0d2649-f17f-4845-b9ff-cb7edca64ed1 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:34.233131 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-db0d2649-f17f-4845-b9ff-cb7edca64ed1 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:34.233563 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-db0d2649-f17f-4845-b9ff-cb7edca64ed1 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:34.264521 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-c512ff1c-fa96-4166-a430-ec3e643e4e8a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:34.265081 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-c512ff1c-fa96-4166-a430-ec3e643e4e8a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:34.273181 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c512ff1c-fa96-4166-a430-ec3e643e4e8a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:34.273633 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c512ff1c-fa96-4166-a430-ec3e643e4e8a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:34.274485 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c512ff1c-fa96-4166-a430-ec3e643e4e8a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:34.274924 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c512ff1c-fa96-4166-a430-ec3e643e4e8a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:34.359117 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-c512ff1c-fa96-4166-a430-ec3e643e4e8a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:34.367663 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-c512ff1c-fa96-4166-a430-ec3e643e4e8a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.107020 Jun 17 13:28:34.368484 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1402/2773] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:28:34 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:28:34.394796 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-db0d2649-f17f-4845-b9ff-cb7edca64ed1 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:34.403243 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-db0d2649-f17f-4845-b9ff-cb7edca64ed1 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.186584 Jun 17 13:28:34.403851 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1372/2774] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:28:34 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:28:34.734443 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-ee601fe6-8c8c-4b91-8ee4-3efc519597a6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:34.735244 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-ee601fe6-8c8c-4b91-8ee4-3efc519597a6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:34.743541 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ee601fe6-8c8c-4b91-8ee4-3efc519597a6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:34.744138 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ee601fe6-8c8c-4b91-8ee4-3efc519597a6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:34.745131 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ee601fe6-8c8c-4b91-8ee4-3efc519597a6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:34.745719 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ee601fe6-8c8c-4b91-8ee4-3efc519597a6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:34.810589 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-ee601fe6-8c8c-4b91-8ee4-3efc519597a6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:34.819247 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-ee601fe6-8c8c-4b91-8ee4-3efc519597a6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:34.820732 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-ee601fe6-8c8c-4b91-8ee4-3efc519597a6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:34.821872 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-ee601fe6-8c8c-4b91-8ee4-3efc519597a6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.093610 Jun 17 13:28:34.822477 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1403/2775] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:28:34 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:28:35.384658 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-482a0ad1-563b-486d-b4bb-2a57ac6274f7 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:35.385235 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-482a0ad1-563b-486d-b4bb-2a57ac6274f7 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:35.392758 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-482a0ad1-563b-486d-b4bb-2a57ac6274f7 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:35.393197 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-482a0ad1-563b-486d-b4bb-2a57ac6274f7 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:35.393947 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-482a0ad1-563b-486d-b4bb-2a57ac6274f7 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:35.394411 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-482a0ad1-563b-486d-b4bb-2a57ac6274f7 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:35.420488 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-5b55a845-2413-4fcf-951f-591537755a88 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:35.421078 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-5b55a845-2413-4fcf-951f-591537755a88 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:35.427884 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-5b55a845-2413-4fcf-951f-591537755a88 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:35.428335 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-5b55a845-2413-4fcf-951f-591537755a88 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:35.429102 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-5b55a845-2413-4fcf-951f-591537755a88 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:35.429537 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-5b55a845-2413-4fcf-951f-591537755a88 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:35.456590 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-482a0ad1-563b-486d-b4bb-2a57ac6274f7 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:35.464685 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-482a0ad1-563b-486d-b4bb-2a57ac6274f7 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.084176 Jun 17 13:28:35.465541 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1373/2776] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:28:35 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:28:35.562202 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-5b55a845-2413-4fcf-951f-591537755a88 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:35.570824 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-5b55a845-2413-4fcf-951f-591537755a88 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.154184 Jun 17 13:28:35.571329 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1404/2777] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:28:35 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:28:35.845701 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-bda7e1fd-b605-4a21-9d4a-411b17ebb939 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:35.846589 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-bda7e1fd-b605-4a21-9d4a-411b17ebb939 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:35.858269 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bda7e1fd-b605-4a21-9d4a-411b17ebb939 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:35.859086 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bda7e1fd-b605-4a21-9d4a-411b17ebb939 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:35.860354 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bda7e1fd-b605-4a21-9d4a-411b17ebb939 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:35.861081 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bda7e1fd-b605-4a21-9d4a-411b17ebb939 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:35.883416 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=100 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:28:35.930703 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-bda7e1fd-b605-4a21-9d4a-411b17ebb939 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:35.940922 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-bda7e1fd-b605-4a21-9d4a-411b17ebb939 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:35.942469 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-bda7e1fd-b605-4a21-9d4a-411b17ebb939 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:35.943613 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-bda7e1fd-b605-4a21-9d4a-411b17ebb939 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.105682 Jun 17 13:28:35.944174 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1374/2778] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:28:35 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:28:36.484505 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-bf3dbb1e-2298-446e-87fd-7e4340aa24f6 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:36.485166 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-bf3dbb1e-2298-446e-87fd-7e4340aa24f6 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:36.492725 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-bf3dbb1e-2298-446e-87fd-7e4340aa24f6 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:36.493220 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-bf3dbb1e-2298-446e-87fd-7e4340aa24f6 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:36.494058 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-bf3dbb1e-2298-446e-87fd-7e4340aa24f6 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:36.494574 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-bf3dbb1e-2298-446e-87fd-7e4340aa24f6 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:36.556615 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-bf3dbb1e-2298-446e-87fd-7e4340aa24f6 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:36.566003 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-bf3dbb1e-2298-446e-87fd-7e4340aa24f6 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.086637 Jun 17 13:28:36.566554 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1405/2779] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:28:36 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:28:36.590550 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-1e9c9701-d90f-47c5-9f89-fbe75c5d8dfb tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:36.591182 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-1e9c9701-d90f-47c5-9f89-fbe75c5d8dfb tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:36.598284 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1e9c9701-d90f-47c5-9f89-fbe75c5d8dfb tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:36.598933 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1e9c9701-d90f-47c5-9f89-fbe75c5d8dfb tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:36.599515 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1e9c9701-d90f-47c5-9f89-fbe75c5d8dfb tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:36.599944 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1e9c9701-d90f-47c5-9f89-fbe75c5d8dfb tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:36.735953 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-1e9c9701-d90f-47c5-9f89-fbe75c5d8dfb tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:36.744327 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-1e9c9701-d90f-47c5-9f89-fbe75c5d8dfb tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.158454 Jun 17 13:28:36.744890 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1375/2780] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:28:36 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:28:36.965179 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-55bd03b6-26d4-44e5-b155-2a6a6a1fa3bc tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:36.966283 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-55bd03b6-26d4-44e5-b155-2a6a6a1fa3bc tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:36.973596 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-55bd03b6-26d4-44e5-b155-2a6a6a1fa3bc tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:36.974056 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-55bd03b6-26d4-44e5-b155-2a6a6a1fa3bc tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:36.974855 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-55bd03b6-26d4-44e5-b155-2a6a6a1fa3bc tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:36.975294 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-55bd03b6-26d4-44e5-b155-2a6a6a1fa3bc tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:37.039670 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-55bd03b6-26d4-44e5-b155-2a6a6a1fa3bc tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:37.048529 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-55bd03b6-26d4-44e5-b155-2a6a6a1fa3bc tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:37.050032 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-55bd03b6-26d4-44e5-b155-2a6a6a1fa3bc tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:37.051215 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-55bd03b6-26d4-44e5-b155-2a6a6a1fa3bc tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.093384 Jun 17 13:28:37.051780 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1406/2781] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:28:36 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:28:37.587207 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-509ba3f7-271f-4c67-b08f-97a9fdf3033b tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:37.588071 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-509ba3f7-271f-4c67-b08f-97a9fdf3033b tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:37.595681 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-509ba3f7-271f-4c67-b08f-97a9fdf3033b tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:37.596299 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-509ba3f7-271f-4c67-b08f-97a9fdf3033b tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:37.596864 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-509ba3f7-271f-4c67-b08f-97a9fdf3033b tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:37.597293 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-509ba3f7-271f-4c67-b08f-97a9fdf3033b tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:37.670957 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-509ba3f7-271f-4c67-b08f-97a9fdf3033b tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:37.679409 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-509ba3f7-271f-4c67-b08f-97a9fdf3033b tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.098959 Jun 17 13:28:37.680210 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1376/2782] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:28:37 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:28:37.764093 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-c7c4ab7b-ac66-4cc6-8795-b455113ccd49 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:37.764721 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-c7c4ab7b-ac66-4cc6-8795-b455113ccd49 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:37.772020 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c7c4ab7b-ac66-4cc6-8795-b455113ccd49 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:37.772490 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c7c4ab7b-ac66-4cc6-8795-b455113ccd49 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:37.773304 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c7c4ab7b-ac66-4cc6-8795-b455113ccd49 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:37.773743 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c7c4ab7b-ac66-4cc6-8795-b455113ccd49 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:37.913413 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-c7c4ab7b-ac66-4cc6-8795-b455113ccd49 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:37.921975 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-c7c4ab7b-ac66-4cc6-8795-b455113ccd49 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.163215 Jun 17 13:28:37.922599 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1407/2783] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:28:37 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:28:38.080309 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-fddd6432-d42a-4433-b13c-dd0e3af84596 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:38.081304 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-fddd6432-d42a-4433-b13c-dd0e3af84596 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:38.090969 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fddd6432-d42a-4433-b13c-dd0e3af84596 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:38.091414 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fddd6432-d42a-4433-b13c-dd0e3af84596 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:38.092163 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fddd6432-d42a-4433-b13c-dd0e3af84596 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:38.092593 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fddd6432-d42a-4433-b13c-dd0e3af84596 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:38.156363 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-fddd6432-d42a-4433-b13c-dd0e3af84596 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:38.166904 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-fddd6432-d42a-4433-b13c-dd0e3af84596 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:38.168913 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-fddd6432-d42a-4433-b13c-dd0e3af84596 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:38.170580 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-fddd6432-d42a-4433-b13c-dd0e3af84596 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.096898 Jun 17 13:28:38.171376 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1377/2784] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:28:38 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:28:38.705557 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-affa3b28-41b8-4f16-81a3-26900a1c7b83 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:38.706595 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-affa3b28-41b8-4f16-81a3-26900a1c7b83 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:38.717004 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-affa3b28-41b8-4f16-81a3-26900a1c7b83 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:38.717755 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-affa3b28-41b8-4f16-81a3-26900a1c7b83 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:38.719048 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-affa3b28-41b8-4f16-81a3-26900a1c7b83 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:38.719755 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-affa3b28-41b8-4f16-81a3-26900a1c7b83 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:38.787332 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-affa3b28-41b8-4f16-81a3-26900a1c7b83 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:38.795897 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-affa3b28-41b8-4f16-81a3-26900a1c7b83 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.097645 Jun 17 13:28:38.796466 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1408/2785] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:28:38 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:28:38.943741 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-59869f0a-4e44-4278-bf59-5a1825b92f09 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:38.944678 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-59869f0a-4e44-4278-bf59-5a1825b92f09 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:38.956093 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-59869f0a-4e44-4278-bf59-5a1825b92f09 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:38.956767 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-59869f0a-4e44-4278-bf59-5a1825b92f09 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:38.957996 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-59869f0a-4e44-4278-bf59-5a1825b92f09 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:38.958861 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-59869f0a-4e44-4278-bf59-5a1825b92f09 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:39.103936 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-59869f0a-4e44-4278-bf59-5a1825b92f09 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:39.112674 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-59869f0a-4e44-4278-bf59-5a1825b92f09 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.175454 Jun 17 13:28:39.113255 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1378/2786] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:28:38 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:28:39.193469 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-77dbaf3b-728c-4eb7-84f4-f1b8bb9418d2 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:39.194529 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-77dbaf3b-728c-4eb7-84f4-f1b8bb9418d2 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:39.202994 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-77dbaf3b-728c-4eb7-84f4-f1b8bb9418d2 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:39.203447 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-77dbaf3b-728c-4eb7-84f4-f1b8bb9418d2 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:39.204197 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-77dbaf3b-728c-4eb7-84f4-f1b8bb9418d2 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:39.204628 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-77dbaf3b-728c-4eb7-84f4-f1b8bb9418d2 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:39.270305 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-77dbaf3b-728c-4eb7-84f4-f1b8bb9418d2 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:39.279689 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-77dbaf3b-728c-4eb7-84f4-f1b8bb9418d2 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:39.281173 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-77dbaf3b-728c-4eb7-84f4-f1b8bb9418d2 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:39.282346 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-77dbaf3b-728c-4eb7-84f4-f1b8bb9418d2 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.095302 Jun 17 13:28:39.282902 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1409/2787] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:28:39 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:28:39.817552 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-81199910-0936-4402-b358-f9aba82ab575 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:39.818583 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-81199910-0936-4402-b358-f9aba82ab575 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:39.829141 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-81199910-0936-4402-b358-f9aba82ab575 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:39.829867 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-81199910-0936-4402-b358-f9aba82ab575 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:39.831146 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-81199910-0936-4402-b358-f9aba82ab575 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:39.831852 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-81199910-0936-4402-b358-f9aba82ab575 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:39.897986 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-81199910-0936-4402-b358-f9aba82ab575 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:39.906482 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-81199910-0936-4402-b358-f9aba82ab575 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.095403 Jun 17 13:28:39.907049 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1379/2788] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:28:39 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:28:40.133160 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-301b6054-cf70-44cf-9907-656cd4fd930a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:40.134142 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-301b6054-cf70-44cf-9907-656cd4fd930a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:40.142330 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-301b6054-cf70-44cf-9907-656cd4fd930a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:40.142781 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-301b6054-cf70-44cf-9907-656cd4fd930a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:40.143536 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-301b6054-cf70-44cf-9907-656cd4fd930a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:40.144004 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-301b6054-cf70-44cf-9907-656cd4fd930a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:40.287477 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-301b6054-cf70-44cf-9907-656cd4fd930a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:40.300368 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-301b6054-cf70-44cf-9907-656cd4fd930a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.173619 Jun 17 13:28:40.301118 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1410/2789] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:28:40 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:28:40.303654 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-84d6c695-06c7-4cb2-86ee-915c184159b1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:40.304297 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-84d6c695-06c7-4cb2-86ee-915c184159b1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:40.311541 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-84d6c695-06c7-4cb2-86ee-915c184159b1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:40.312282 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-84d6c695-06c7-4cb2-86ee-915c184159b1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:40.312739 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-84d6c695-06c7-4cb2-86ee-915c184159b1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:40.313167 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-84d6c695-06c7-4cb2-86ee-915c184159b1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:40.379174 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-84d6c695-06c7-4cb2-86ee-915c184159b1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:40.389558 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-84d6c695-06c7-4cb2-86ee-915c184159b1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:40.391026 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-84d6c695-06c7-4cb2-86ee-915c184159b1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:40.392764 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-84d6c695-06c7-4cb2-86ee-915c184159b1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.095006 Jun 17 13:28:40.393527 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1380/2790] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:28:40 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:28:40.928557 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-fffac3d6-bc20-45e3-aa8b-60a422ab3ecf tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:40.929696 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-fffac3d6-bc20-45e3-aa8b-60a422ab3ecf tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:40.940554 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-fffac3d6-bc20-45e3-aa8b-60a422ab3ecf tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:40.941360 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-fffac3d6-bc20-45e3-aa8b-60a422ab3ecf tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:40.942809 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-fffac3d6-bc20-45e3-aa8b-60a422ab3ecf tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:40.943649 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-fffac3d6-bc20-45e3-aa8b-60a422ab3ecf tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:41.019744 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-fffac3d6-bc20-45e3-aa8b-60a422ab3ecf tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:41.031240 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-fffac3d6-bc20-45e3-aa8b-60a422ab3ecf tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.109889 Jun 17 13:28:41.031839 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1411/2791] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:28:40 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:28:41.322966 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-de037871-99a7-4037-b2f3-8cec411ee8b5 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:41.323855 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-de037871-99a7-4037-b2f3-8cec411ee8b5 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:41.331926 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-de037871-99a7-4037-b2f3-8cec411ee8b5 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:41.332376 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-de037871-99a7-4037-b2f3-8cec411ee8b5 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:41.333149 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-de037871-99a7-4037-b2f3-8cec411ee8b5 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:41.333583 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-de037871-99a7-4037-b2f3-8cec411ee8b5 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:41.415090 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-2f7a9259-6a05-4ac6-ab85-04990615e072 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:41.415784 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-2f7a9259-6a05-4ac6-ab85-04990615e072 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:41.422930 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2f7a9259-6a05-4ac6-ab85-04990615e072 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:41.423395 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2f7a9259-6a05-4ac6-ab85-04990615e072 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:41.424163 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2f7a9259-6a05-4ac6-ab85-04990615e072 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:41.424596 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2f7a9259-6a05-4ac6-ab85-04990615e072 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:41.501836 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-2f7a9259-6a05-4ac6-ab85-04990615e072 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:41.509028 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-de037871-99a7-4037-b2f3-8cec411ee8b5 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:41.510916 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-2f7a9259-6a05-4ac6-ab85-04990615e072 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:41.512692 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-2f7a9259-6a05-4ac6-ab85-04990615e072 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:41.513893 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-2f7a9259-6a05-4ac6-ab85-04990615e072 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.103269 Jun 17 13:28:41.514762 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1412/2792] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:28:41 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 13:28:41.518008 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-de037871-99a7-4037-b2f3-8cec411ee8b5 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.201384 Jun 17 13:28:41.518673 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1381/2793] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:28:41 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:28:42.053860 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-0cf40e3e-2e21-4bea-bd4c-0de77eae116c tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:42.054501 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-0cf40e3e-2e21-4bea-bd4c-0de77eae116c tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:42.061115 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0cf40e3e-2e21-4bea-bd4c-0de77eae116c tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:42.061554 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0cf40e3e-2e21-4bea-bd4c-0de77eae116c tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:42.062333 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0cf40e3e-2e21-4bea-bd4c-0de77eae116c tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:42.062760 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0cf40e3e-2e21-4bea-bd4c-0de77eae116c tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:42.133362 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-0cf40e3e-2e21-4bea-bd4c-0de77eae116c tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:42.145743 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-0cf40e3e-2e21-4bea-bd4c-0de77eae116c tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.095712 Jun 17 13:28:42.146459 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1413/2794] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:28:42 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:28:42.536076 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-13c99412-fbe0-44bf-9dcb-9d5248fd7ac3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:42.536713 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-13c99412-fbe0-44bf-9dcb-9d5248fd7ac3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:42.538718 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-19e35614-c6ae-4041-a6cb-7496233f60fc tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:42.539338 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-19e35614-c6ae-4041-a6cb-7496233f60fc tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:42.543864 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-13c99412-fbe0-44bf-9dcb-9d5248fd7ac3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:42.544322 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-13c99412-fbe0-44bf-9dcb-9d5248fd7ac3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:42.545091 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-13c99412-fbe0-44bf-9dcb-9d5248fd7ac3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:42.545530 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-13c99412-fbe0-44bf-9dcb-9d5248fd7ac3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:42.546526 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-19e35614-c6ae-4041-a6cb-7496233f60fc tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:42.547040 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-19e35614-c6ae-4041-a6cb-7496233f60fc tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:42.547873 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-19e35614-c6ae-4041-a6cb-7496233f60fc tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:42.548389 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-19e35614-c6ae-4041-a6cb-7496233f60fc tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:42.635516 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-13c99412-fbe0-44bf-9dcb-9d5248fd7ac3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:42.645085 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-13c99412-fbe0-44bf-9dcb-9d5248fd7ac3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:42.646765 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-13c99412-fbe0-44bf-9dcb-9d5248fd7ac3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:42.647998 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-13c99412-fbe0-44bf-9dcb-9d5248fd7ac3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.117543 Jun 17 13:28:42.648571 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1382/2795] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:28:42 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:28:42.707129 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-19e35614-c6ae-4041-a6cb-7496233f60fc tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:42.715242 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-19e35614-c6ae-4041-a6cb-7496233f60fc tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.181997 Jun 17 13:28:42.715815 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1414/2796] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:28:42 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:28:43.164056 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-fa7c3f8f-d407-480a-a06e-439d08712c5a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:43.164667 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-fa7c3f8f-d407-480a-a06e-439d08712c5a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:43.171348 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fa7c3f8f-d407-480a-a06e-439d08712c5a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:43.171794 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fa7c3f8f-d407-480a-a06e-439d08712c5a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:43.172552 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fa7c3f8f-d407-480a-a06e-439d08712c5a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:43.172982 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fa7c3f8f-d407-480a-a06e-439d08712c5a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:43.239972 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-fa7c3f8f-d407-480a-a06e-439d08712c5a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:43.248654 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-fa7c3f8f-d407-480a-a06e-439d08712c5a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.088626 Jun 17 13:28:43.249223 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1383/2797] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:28:43 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:28:43.670744 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-ef98a55f-dae1-4405-8d23-3c22be51c8aa tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:43.671386 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-ef98a55f-dae1-4405-8d23-3c22be51c8aa tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:43.680296 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ef98a55f-dae1-4405-8d23-3c22be51c8aa tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:43.680791 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ef98a55f-dae1-4405-8d23-3c22be51c8aa tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:43.681588 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ef98a55f-dae1-4405-8d23-3c22be51c8aa tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:43.682065 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ef98a55f-dae1-4405-8d23-3c22be51c8aa tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:43.745056 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-32b8a90a-cee1-46d5-9152-c677e31a68c5 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:43.745720 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-32b8a90a-cee1-46d5-9152-c677e31a68c5 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:43.753313 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-ef98a55f-dae1-4405-8d23-3c22be51c8aa tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:43.753691 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-32b8a90a-cee1-46d5-9152-c677e31a68c5 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:43.754415 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-32b8a90a-cee1-46d5-9152-c677e31a68c5 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:43.755282 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-32b8a90a-cee1-46d5-9152-c677e31a68c5 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:43.755961 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-32b8a90a-cee1-46d5-9152-c677e31a68c5 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:43.765640 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-ef98a55f-dae1-4405-8d23-3c22be51c8aa tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:43.767806 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-ef98a55f-dae1-4405-8d23-3c22be51c8aa tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:43.769591 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-ef98a55f-dae1-4405-8d23-3c22be51c8aa tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.105291 Jun 17 13:28:43.770409 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1415/2798] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:28:43 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:28:43.902460 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-32b8a90a-cee1-46d5-9152-c677e31a68c5 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:43.910682 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-32b8a90a-cee1-46d5-9152-c677e31a68c5 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.175095 Jun 17 13:28:43.911307 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1384/2799] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:28:43 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:28:44.270962 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-4307843f-a5a8-4d47-9be6-021a8094f781 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:44.271856 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-4307843f-a5a8-4d47-9be6-021a8094f781 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:44.279387 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4307843f-a5a8-4d47-9be6-021a8094f781 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:44.279835 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4307843f-a5a8-4d47-9be6-021a8094f781 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:44.280624 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4307843f-a5a8-4d47-9be6-021a8094f781 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:44.281058 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4307843f-a5a8-4d47-9be6-021a8094f781 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:44.351863 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-4307843f-a5a8-4d47-9be6-021a8094f781 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:44.360633 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-4307843f-a5a8-4d47-9be6-021a8094f781 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.096375 Jun 17 13:28:44.361207 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1416/2800] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:28:44 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:28:44.788348 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-def46b32-f15b-41e9-ba23-2e2c5dc44d9f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:44.789029 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-def46b32-f15b-41e9-ba23-2e2c5dc44d9f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:44.797097 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-def46b32-f15b-41e9-ba23-2e2c5dc44d9f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:44.797537 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-def46b32-f15b-41e9-ba23-2e2c5dc44d9f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:44.798402 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-def46b32-f15b-41e9-ba23-2e2c5dc44d9f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:44.798859 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-def46b32-f15b-41e9-ba23-2e2c5dc44d9f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:44.867820 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-def46b32-f15b-41e9-ba23-2e2c5dc44d9f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:44.876783 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-def46b32-f15b-41e9-ba23-2e2c5dc44d9f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:44.878417 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-def46b32-f15b-41e9-ba23-2e2c5dc44d9f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:44.879559 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-def46b32-f15b-41e9-ba23-2e2c5dc44d9f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.095396 Jun 17 13:28:44.880184 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1385/2801] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:28:44 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:28:44.933612 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-10f72fe5-58d5-4596-9f90-1a58e93b3a37 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:44.934298 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-10f72fe5-58d5-4596-9f90-1a58e93b3a37 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:44.942922 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-10f72fe5-58d5-4596-9f90-1a58e93b3a37 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:44.943586 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-10f72fe5-58d5-4596-9f90-1a58e93b3a37 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:44.944727 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-10f72fe5-58d5-4596-9f90-1a58e93b3a37 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:44.945131 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-10f72fe5-58d5-4596-9f90-1a58e93b3a37 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:45.086471 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-10f72fe5-58d5-4596-9f90-1a58e93b3a37 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:45.090179 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_cell1:SELECT=100 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:28:45.095634 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-10f72fe5-58d5-4596-9f90-1a58e93b3a37 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.166199 Jun 17 13:28:45.096211 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1417/2802] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:28:44 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:28:45.382402 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-a8978163-1955-4f96-b69c-9ac381eb0fbe tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:45.383576 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-a8978163-1955-4f96-b69c-9ac381eb0fbe tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:45.391001 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a8978163-1955-4f96-b69c-9ac381eb0fbe tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:45.391431 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a8978163-1955-4f96-b69c-9ac381eb0fbe tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:45.392177 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a8978163-1955-4f96-b69c-9ac381eb0fbe tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:45.392602 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a8978163-1955-4f96-b69c-9ac381eb0fbe tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:45.454217 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-a8978163-1955-4f96-b69c-9ac381eb0fbe tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:45.462188 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-a8978163-1955-4f96-b69c-9ac381eb0fbe tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.086587 Jun 17 13:28:45.462718 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1386/2803] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:28:45 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:28:45.902226 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-ef5d146c-1fb8-4d1d-82a7-0aa40d8d8588 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:45.903256 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-ef5d146c-1fb8-4d1d-82a7-0aa40d8d8588 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:45.913641 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ef5d146c-1fb8-4d1d-82a7-0aa40d8d8588 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:45.914441 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ef5d146c-1fb8-4d1d-82a7-0aa40d8d8588 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:45.915767 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ef5d146c-1fb8-4d1d-82a7-0aa40d8d8588 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:45.916400 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ef5d146c-1fb8-4d1d-82a7-0aa40d8d8588 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:45.984249 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-ef5d146c-1fb8-4d1d-82a7-0aa40d8d8588 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:45.993170 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-ef5d146c-1fb8-4d1d-82a7-0aa40d8d8588 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:45.994738 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-ef5d146c-1fb8-4d1d-82a7-0aa40d8d8588 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:45.996430 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-ef5d146c-1fb8-4d1d-82a7-0aa40d8d8588 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.100961 Jun 17 13:28:45.997024 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1418/2804] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:28:45 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:28:46.117427 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-fd8a4a7c-b5d3-4cfc-a752-3e451078bd80 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:46.118538 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-fd8a4a7c-b5d3-4cfc-a752-3e451078bd80 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:46.122632 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_api:SELECT=80 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:28:46.132890 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fd8a4a7c-b5d3-4cfc-a752-3e451078bd80 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:46.133631 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fd8a4a7c-b5d3-4cfc-a752-3e451078bd80 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:46.134928 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fd8a4a7c-b5d3-4cfc-a752-3e451078bd80 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:46.135644 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fd8a4a7c-b5d3-4cfc-a752-3e451078bd80 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:46.281857 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-fd8a4a7c-b5d3-4cfc-a752-3e451078bd80 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:46.295470 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-fd8a4a7c-b5d3-4cfc-a752-3e451078bd80 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.184259 Jun 17 13:28:46.296299 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1387/2805] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:28:46 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:28:46.488574 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-b7456ece-daa5-4e3a-85c9-170809baa7a6 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:46.489465 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-b7456ece-daa5-4e3a-85c9-170809baa7a6 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:46.498220 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b7456ece-daa5-4e3a-85c9-170809baa7a6 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:46.498670 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b7456ece-daa5-4e3a-85c9-170809baa7a6 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:46.499444 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b7456ece-daa5-4e3a-85c9-170809baa7a6 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:46.499900 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b7456ece-daa5-4e3a-85c9-170809baa7a6 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:46.562290 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-b7456ece-daa5-4e3a-85c9-170809baa7a6 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:46.570850 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-b7456ece-daa5-4e3a-85c9-170809baa7a6 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.088871 Jun 17 13:28:46.571455 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1419/2806] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:28:46 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:28:47.018449 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-dad74e66-a0c4-4c69-89ed-20b4bbd1a9ee tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:47.019427 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-dad74e66-a0c4-4c69-89ed-20b4bbd1a9ee tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:47.028789 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dad74e66-a0c4-4c69-89ed-20b4bbd1a9ee tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:47.029234 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dad74e66-a0c4-4c69-89ed-20b4bbd1a9ee tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:47.029996 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dad74e66-a0c4-4c69-89ed-20b4bbd1a9ee tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:47.030464 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dad74e66-a0c4-4c69-89ed-20b4bbd1a9ee tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:47.098945 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-dad74e66-a0c4-4c69-89ed-20b4bbd1a9ee tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:47.108530 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-dad74e66-a0c4-4c69-89ed-20b4bbd1a9ee tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:47.110024 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-dad74e66-a0c4-4c69-89ed-20b4bbd1a9ee tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:47.111241 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-dad74e66-a0c4-4c69-89ed-20b4bbd1a9ee tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.099298 Jun 17 13:28:47.111821 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1388/2807] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:28:47 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:28:47.317009 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-f6731489-92bc-464d-a231-bb848770092c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:47.317623 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-f6731489-92bc-464d-a231-bb848770092c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:47.324647 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f6731489-92bc-464d-a231-bb848770092c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:47.325228 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f6731489-92bc-464d-a231-bb848770092c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:47.325989 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f6731489-92bc-464d-a231-bb848770092c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:47.326454 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f6731489-92bc-464d-a231-bb848770092c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:47.463958 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-f6731489-92bc-464d-a231-bb848770092c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:47.472325 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-f6731489-92bc-464d-a231-bb848770092c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.159291 Jun 17 13:28:47.472872 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1420/2808] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:28:47 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:28:47.598639 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-7fdd4ad8-999d-43f6-a693-b583cd67addc tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:47.599555 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-7fdd4ad8-999d-43f6-a693-b583cd67addc tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:47.609444 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7fdd4ad8-999d-43f6-a693-b583cd67addc tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:47.609889 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7fdd4ad8-999d-43f6-a693-b583cd67addc tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:47.610685 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7fdd4ad8-999d-43f6-a693-b583cd67addc tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:47.611120 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7fdd4ad8-999d-43f6-a693-b583cd67addc tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:47.682860 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-7fdd4ad8-999d-43f6-a693-b583cd67addc tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:47.691239 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-7fdd4ad8-999d-43f6-a693-b583cd67addc tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.099417 Jun 17 13:28:47.691857 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1389/2809] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:28:47 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:28:48.133626 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-23d722b2-a1cb-44ca-8f9d-ca7cd0cd6be6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:48.134664 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-23d722b2-a1cb-44ca-8f9d-ca7cd0cd6be6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:48.142403 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-23d722b2-a1cb-44ca-8f9d-ca7cd0cd6be6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:48.142875 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-23d722b2-a1cb-44ca-8f9d-ca7cd0cd6be6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:48.143664 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-23d722b2-a1cb-44ca-8f9d-ca7cd0cd6be6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:48.144115 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-23d722b2-a1cb-44ca-8f9d-ca7cd0cd6be6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:48.216716 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-23d722b2-a1cb-44ca-8f9d-ca7cd0cd6be6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:48.225667 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-23d722b2-a1cb-44ca-8f9d-ca7cd0cd6be6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:48.227143 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-23d722b2-a1cb-44ca-8f9d-ca7cd0cd6be6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:48.228292 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-23d722b2-a1cb-44ca-8f9d-ca7cd0cd6be6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.101106 Jun 17 13:28:48.228862 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1421/2810] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:28:48 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:28:48.493434 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-c2db1de1-1709-4297-a070-4e05c1c84025 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:48.494422 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-c2db1de1-1709-4297-a070-4e05c1c84025 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:48.501874 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c2db1de1-1709-4297-a070-4e05c1c84025 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:48.502368 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c2db1de1-1709-4297-a070-4e05c1c84025 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:48.503161 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c2db1de1-1709-4297-a070-4e05c1c84025 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:48.503592 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c2db1de1-1709-4297-a070-4e05c1c84025 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:48.639293 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-c2db1de1-1709-4297-a070-4e05c1c84025 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:48.647428 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-c2db1de1-1709-4297-a070-4e05c1c84025 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.160603 Jun 17 13:28:48.647996 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1390/2811] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:28:48 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:28:48.709723 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-fc0cd654-1cce-41d5-a453-0007c1c218da tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:48.710369 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-fc0cd654-1cce-41d5-a453-0007c1c218da tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:48.717355 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-fc0cd654-1cce-41d5-a453-0007c1c218da tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:48.717866 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-fc0cd654-1cce-41d5-a453-0007c1c218da tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:48.718665 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-fc0cd654-1cce-41d5-a453-0007c1c218da tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:48.719106 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-fc0cd654-1cce-41d5-a453-0007c1c218da tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:48.783927 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-fc0cd654-1cce-41d5-a453-0007c1c218da tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:48.796043 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-fc0cd654-1cce-41d5-a453-0007c1c218da tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.089937 Jun 17 13:28:48.796774 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1422/2812] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:28:48 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:28:49.249258 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-f9e5441e-eea4-4f58-b35f-34558b13fd18 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:49.249866 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-f9e5441e-eea4-4f58-b35f-34558b13fd18 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:49.256634 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f9e5441e-eea4-4f58-b35f-34558b13fd18 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:49.257076 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f9e5441e-eea4-4f58-b35f-34558b13fd18 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:49.257826 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f9e5441e-eea4-4f58-b35f-34558b13fd18 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:49.258288 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f9e5441e-eea4-4f58-b35f-34558b13fd18 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:49.262198 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=100 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:28:49.323280 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-f9e5441e-eea4-4f58-b35f-34558b13fd18 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:49.331890 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-f9e5441e-eea4-4f58-b35f-34558b13fd18 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:49.333366 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-f9e5441e-eea4-4f58-b35f-34558b13fd18 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:49.334555 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-f9e5441e-eea4-4f58-b35f-34558b13fd18 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.090145 Jun 17 13:28:49.335106 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1391/2813] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:28:49 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:28:49.665906 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-976ca093-68c2-4ff4-991c-167331bb03d3 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:49.666550 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-976ca093-68c2-4ff4-991c-167331bb03d3 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:49.673185 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-976ca093-68c2-4ff4-991c-167331bb03d3 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:49.673652 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-976ca093-68c2-4ff4-991c-167331bb03d3 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:49.674443 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-976ca093-68c2-4ff4-991c-167331bb03d3 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:49.674880 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-976ca093-68c2-4ff4-991c-167331bb03d3 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:49.813471 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-976ca093-68c2-4ff4-991c-167331bb03d3 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:49.816861 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-1e5080df-1387-47aa-aec4-ea71220a742a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:49.817469 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-1e5080df-1387-47aa-aec4-ea71220a742a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:49.821597 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-976ca093-68c2-4ff4-991c-167331bb03d3 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.159630 Jun 17 13:28:49.822189 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1423/2814] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:28:49 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:28:49.823743 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1e5080df-1387-47aa-aec4-ea71220a742a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:49.824230 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1e5080df-1387-47aa-aec4-ea71220a742a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:49.825315 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1e5080df-1387-47aa-aec4-ea71220a742a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:49.825751 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1e5080df-1387-47aa-aec4-ea71220a742a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:49.887346 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-1e5080df-1387-47aa-aec4-ea71220a742a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:49.898841 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-1e5080df-1387-47aa-aec4-ea71220a742a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.085713 Jun 17 13:28:49.899519 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1392/2815] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:28:49 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 13:28:50.353772 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-10611e5e-1e72-442c-a645-11ec103a4147 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:50.354800 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-10611e5e-1e72-442c-a645-11ec103a4147 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:50.361756 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-10611e5e-1e72-442c-a645-11ec103a4147 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:50.362233 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-10611e5e-1e72-442c-a645-11ec103a4147 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:50.362987 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-10611e5e-1e72-442c-a645-11ec103a4147 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:50.363420 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-10611e5e-1e72-442c-a645-11ec103a4147 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:50.426620 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-10611e5e-1e72-442c-a645-11ec103a4147 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:50.436158 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-10611e5e-1e72-442c-a645-11ec103a4147 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:50.437662 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-10611e5e-1e72-442c-a645-11ec103a4147 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:50.438843 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-10611e5e-1e72-442c-a645-11ec103a4147 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.089544 Jun 17 13:28:50.439382 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1424/2816] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:28:50 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:28:50.843409 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-812579aa-05fa-4b5a-a5be-14ca0dac58b3 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:50.844387 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-812579aa-05fa-4b5a-a5be-14ca0dac58b3 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:50.855832 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-812579aa-05fa-4b5a-a5be-14ca0dac58b3 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:50.856556 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-812579aa-05fa-4b5a-a5be-14ca0dac58b3 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:50.857802 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-812579aa-05fa-4b5a-a5be-14ca0dac58b3 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:50.858545 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-812579aa-05fa-4b5a-a5be-14ca0dac58b3 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:50.919776 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-ebd53316-a241-4623-9b0a-8cdfb1aa70f4 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:50.920452 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-ebd53316-a241-4623-9b0a-8cdfb1aa70f4 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:50.927504 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ebd53316-a241-4623-9b0a-8cdfb1aa70f4 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:50.927956 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ebd53316-a241-4623-9b0a-8cdfb1aa70f4 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:50.928685 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ebd53316-a241-4623-9b0a-8cdfb1aa70f4 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:50.929118 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ebd53316-a241-4623-9b0a-8cdfb1aa70f4 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:51.003392 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-ebd53316-a241-4623-9b0a-8cdfb1aa70f4 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:51.013078 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-ebd53316-a241-4623-9b0a-8cdfb1aa70f4 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.096716 Jun 17 13:28:51.013682 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1425/2817] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:28:50 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:28:51.027872 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-812579aa-05fa-4b5a-a5be-14ca0dac58b3 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:51.035980 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-812579aa-05fa-4b5a-a5be-14ca0dac58b3 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.199298 Jun 17 13:28:51.036550 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1393/2818] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:28:50 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:28:51.461868 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-8a7e2e28-babb-4884-84e9-9ed1334a5b8c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:51.462910 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-8a7e2e28-babb-4884-84e9-9ed1334a5b8c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:51.470601 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8a7e2e28-babb-4884-84e9-9ed1334a5b8c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:51.471060 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8a7e2e28-babb-4884-84e9-9ed1334a5b8c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:51.471814 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8a7e2e28-babb-4884-84e9-9ed1334a5b8c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:51.472238 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8a7e2e28-babb-4884-84e9-9ed1334a5b8c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:51.545333 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-8a7e2e28-babb-4884-84e9-9ed1334a5b8c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:51.558537 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-8a7e2e28-babb-4884-84e9-9ed1334a5b8c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:51.560835 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-8a7e2e28-babb-4884-84e9-9ed1334a5b8c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:51.562191 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-8a7e2e28-babb-4884-84e9-9ed1334a5b8c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.107150 Jun 17 13:28:51.562757 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1426/2819] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:28:51 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:28:52.034761 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-d3c4dc28-56c1-429a-a651-32373e022fe8 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:52.035763 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-d3c4dc28-56c1-429a-a651-32373e022fe8 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:52.046955 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d3c4dc28-56c1-429a-a651-32373e022fe8 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:52.047468 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d3c4dc28-56c1-429a-a651-32373e022fe8 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:52.048227 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d3c4dc28-56c1-429a-a651-32373e022fe8 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:52.048657 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d3c4dc28-56c1-429a-a651-32373e022fe8 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:52.054016 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-4c69defd-5726-461f-be3c-2d36a8bb0fb3 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:52.054711 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-4c69defd-5726-461f-be3c-2d36a8bb0fb3 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:52.061353 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4c69defd-5726-461f-be3c-2d36a8bb0fb3 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:52.061803 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4c69defd-5726-461f-be3c-2d36a8bb0fb3 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:52.062634 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4c69defd-5726-461f-be3c-2d36a8bb0fb3 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:52.063030 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4c69defd-5726-461f-be3c-2d36a8bb0fb3 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:52.113934 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-d3c4dc28-56c1-429a-a651-32373e022fe8 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:52.122436 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-d3c4dc28-56c1-429a-a651-32373e022fe8 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.094275 Jun 17 13:28:52.122992 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1394/2820] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:28:52 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:28:52.211663 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-4c69defd-5726-461f-be3c-2d36a8bb0fb3 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:52.219947 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-4c69defd-5726-461f-be3c-2d36a8bb0fb3 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.170338 Jun 17 13:28:52.220556 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1427/2821] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:28:52 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:28:52.583789 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-10ba094e-d9ae-4fa7-a7d9-8aaaa4ed3ac4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:52.584513 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-10ba094e-d9ae-4fa7-a7d9-8aaaa4ed3ac4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:52.591472 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-10ba094e-d9ae-4fa7-a7d9-8aaaa4ed3ac4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:52.591928 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-10ba094e-d9ae-4fa7-a7d9-8aaaa4ed3ac4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:52.592767 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-10ba094e-d9ae-4fa7-a7d9-8aaaa4ed3ac4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:52.593252 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-10ba094e-d9ae-4fa7-a7d9-8aaaa4ed3ac4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:52.664380 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-10ba094e-d9ae-4fa7-a7d9-8aaaa4ed3ac4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:52.680465 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-10ba094e-d9ae-4fa7-a7d9-8aaaa4ed3ac4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:52.682003 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-10ba094e-d9ae-4fa7-a7d9-8aaaa4ed3ac4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:52.683190 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-10ba094e-d9ae-4fa7-a7d9-8aaaa4ed3ac4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.103816 Jun 17 13:28:52.683757 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1395/2822] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:28:52 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:28:53.142717 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-fbd7cc57-d3b7-49a7-b734-210dfe08efcb tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:53.143699 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-fbd7cc57-d3b7-49a7-b734-210dfe08efcb tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:53.154878 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-fbd7cc57-d3b7-49a7-b734-210dfe08efcb tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:53.155628 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-fbd7cc57-d3b7-49a7-b734-210dfe08efcb tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:53.156884 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-fbd7cc57-d3b7-49a7-b734-210dfe08efcb tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:53.157338 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-fbd7cc57-d3b7-49a7-b734-210dfe08efcb tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:53.220089 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-fbd7cc57-d3b7-49a7-b734-210dfe08efcb tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:53.228161 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-fbd7cc57-d3b7-49a7-b734-210dfe08efcb tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.092070 Jun 17 13:28:53.228735 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1428/2823] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:28:53 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:28:53.237440 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-d641c675-1178-4f1a-8829-f4d0df2d9747 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:53.238028 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-d641c675-1178-4f1a-8829-f4d0df2d9747 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:53.245152 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d641c675-1178-4f1a-8829-f4d0df2d9747 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:53.245605 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d641c675-1178-4f1a-8829-f4d0df2d9747 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:53.246404 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d641c675-1178-4f1a-8829-f4d0df2d9747 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:53.246871 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d641c675-1178-4f1a-8829-f4d0df2d9747 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:53.401747 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-d641c675-1178-4f1a-8829-f4d0df2d9747 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:53.410086 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-d641c675-1178-4f1a-8829-f4d0df2d9747 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.177206 Jun 17 13:28:53.410680 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1396/2824] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:28:53 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:28:53.706916 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-73458291-bd27-48d8-bb4c-58c52cac7714 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:53.707792 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-73458291-bd27-48d8-bb4c-58c52cac7714 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:53.718149 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-73458291-bd27-48d8-bb4c-58c52cac7714 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:53.718967 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-73458291-bd27-48d8-bb4c-58c52cac7714 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:53.719960 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-73458291-bd27-48d8-bb4c-58c52cac7714 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:53.720407 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-73458291-bd27-48d8-bb4c-58c52cac7714 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:53.785291 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-73458291-bd27-48d8-bb4c-58c52cac7714 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:53.794061 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-73458291-bd27-48d8-bb4c-58c52cac7714 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:53.795598 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-73458291-bd27-48d8-bb4c-58c52cac7714 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:53.796740 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-73458291-bd27-48d8-bb4c-58c52cac7714 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.096576 Jun 17 13:28:53.797283 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1429/2825] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:28:53 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:28:54.250470 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-52936085-4004-4176-b9ae-a8536bafb3f3 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:54.252158 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-52936085-4004-4176-b9ae-a8536bafb3f3 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:54.262373 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-52936085-4004-4176-b9ae-a8536bafb3f3 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:54.263105 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-52936085-4004-4176-b9ae-a8536bafb3f3 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:54.264356 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-52936085-4004-4176-b9ae-a8536bafb3f3 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:54.265075 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-52936085-4004-4176-b9ae-a8536bafb3f3 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:54.331554 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-52936085-4004-4176-b9ae-a8536bafb3f3 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:54.340060 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-52936085-4004-4176-b9ae-a8536bafb3f3 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.096191 Jun 17 13:28:54.340626 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1397/2826] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:28:54 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:28:54.427798 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-dfafa441-27b1-46e1-b116-e9649cadfa29 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:54.428405 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-dfafa441-27b1-46e1-b116-e9649cadfa29 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:54.430888 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_api:SELECT=82 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:28:54.436585 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-dfafa441-27b1-46e1-b116-e9649cadfa29 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:54.437036 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-dfafa441-27b1-46e1-b116-e9649cadfa29 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:54.437804 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-dfafa441-27b1-46e1-b116-e9649cadfa29 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:54.438317 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-dfafa441-27b1-46e1-b116-e9649cadfa29 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:54.579745 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-dfafa441-27b1-46e1-b116-e9649cadfa29 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:54.588223 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-dfafa441-27b1-46e1-b116-e9649cadfa29 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.164338 Jun 17 13:28:54.588804 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1430/2827] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:28:54 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:28:54.819209 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-c5ba8fa6-29e1-4c82-a890-97ff022a41c8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:54.820075 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-c5ba8fa6-29e1-4c82-a890-97ff022a41c8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:54.829942 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c5ba8fa6-29e1-4c82-a890-97ff022a41c8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:54.830414 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c5ba8fa6-29e1-4c82-a890-97ff022a41c8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:54.831160 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c5ba8fa6-29e1-4c82-a890-97ff022a41c8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:54.831567 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c5ba8fa6-29e1-4c82-a890-97ff022a41c8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:54.893720 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-c5ba8fa6-29e1-4c82-a890-97ff022a41c8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:54.906802 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-c5ba8fa6-29e1-4c82-a890-97ff022a41c8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:54.908846 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-c5ba8fa6-29e1-4c82-a890-97ff022a41c8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:54.910655 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-c5ba8fa6-29e1-4c82-a890-97ff022a41c8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.097749 Jun 17 13:28:54.911447 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1398/2828] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:28:54 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:28:55.360729 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-e6a104e9-0129-4adb-ae6c-1fb17c107318 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:55.361581 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-e6a104e9-0129-4adb-ae6c-1fb17c107318 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:55.370530 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e6a104e9-0129-4adb-ae6c-1fb17c107318 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:55.371154 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e6a104e9-0129-4adb-ae6c-1fb17c107318 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:55.372214 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e6a104e9-0129-4adb-ae6c-1fb17c107318 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:55.372860 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e6a104e9-0129-4adb-ae6c-1fb17c107318 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:55.436157 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-e6a104e9-0129-4adb-ae6c-1fb17c107318 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:55.444629 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-e6a104e9-0129-4adb-ae6c-1fb17c107318 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.089444 Jun 17 13:28:55.445191 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1431/2829] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:28:55 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:28:55.610041 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-af0fb78a-2db8-45ec-8b0a-d1da34d2ef4d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:55.611065 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-af0fb78a-2db8-45ec-8b0a-d1da34d2ef4d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:55.618256 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-af0fb78a-2db8-45ec-8b0a-d1da34d2ef4d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:55.618698 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-af0fb78a-2db8-45ec-8b0a-d1da34d2ef4d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:55.619466 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-af0fb78a-2db8-45ec-8b0a-d1da34d2ef4d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:55.619897 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-af0fb78a-2db8-45ec-8b0a-d1da34d2ef4d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:55.753664 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-af0fb78a-2db8-45ec-8b0a-d1da34d2ef4d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:55.766276 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-af0fb78a-2db8-45ec-8b0a-d1da34d2ef4d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.162965 Jun 17 13:28:55.766815 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1399/2830] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:28:55 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:28:55.930372 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-e67e0999-ae68-4e67-9ad2-0bf623082c78 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:55.931084 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-e67e0999-ae68-4e67-9ad2-0bf623082c78 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:55.938204 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e67e0999-ae68-4e67-9ad2-0bf623082c78 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:55.938659 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e67e0999-ae68-4e67-9ad2-0bf623082c78 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:55.939407 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e67e0999-ae68-4e67-9ad2-0bf623082c78 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:55.939839 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e67e0999-ae68-4e67-9ad2-0bf623082c78 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:56.002043 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-e67e0999-ae68-4e67-9ad2-0bf623082c78 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:56.010544 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-e67e0999-ae68-4e67-9ad2-0bf623082c78 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:56.012032 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-e67e0999-ae68-4e67-9ad2-0bf623082c78 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:56.013267 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-e67e0999-ae68-4e67-9ad2-0bf623082c78 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.087458 Jun 17 13:28:56.013824 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1432/2831] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:28:55 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:28:56.470532 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-064a202e-1ca7-4bb2-860e-e838e693a91c tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:56.471540 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-064a202e-1ca7-4bb2-860e-e838e693a91c tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:56.482286 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-064a202e-1ca7-4bb2-860e-e838e693a91c tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:56.483036 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-064a202e-1ca7-4bb2-860e-e838e693a91c tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:56.484289 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-064a202e-1ca7-4bb2-860e-e838e693a91c tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:56.485085 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-064a202e-1ca7-4bb2-860e-e838e693a91c tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:56.546831 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-064a202e-1ca7-4bb2-860e-e838e693a91c tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:56.554886 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-064a202e-1ca7-4bb2-860e-e838e693a91c tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.091021 Jun 17 13:28:56.555447 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1400/2832] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:28:56 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:28:56.786494 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-ff57532d-eece-40c5-a3c0-2d5605e65092 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:56.787220 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-ff57532d-eece-40c5-a3c0-2d5605e65092 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:56.795506 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ff57532d-eece-40c5-a3c0-2d5605e65092 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:56.796087 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ff57532d-eece-40c5-a3c0-2d5605e65092 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:56.796953 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ff57532d-eece-40c5-a3c0-2d5605e65092 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:56.798158 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ff57532d-eece-40c5-a3c0-2d5605e65092 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:56.935394 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-ff57532d-eece-40c5-a3c0-2d5605e65092 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:56.944910 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-ff57532d-eece-40c5-a3c0-2d5605e65092 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.164338 Jun 17 13:28:56.945496 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1433/2833] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:28:56 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:28:57.035836 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-f5df5520-3fe2-46d9-810d-e4de18a872c9 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:57.036931 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-f5df5520-3fe2-46d9-810d-e4de18a872c9 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:57.047697 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f5df5520-3fe2-46d9-810d-e4de18a872c9 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:57.048144 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f5df5520-3fe2-46d9-810d-e4de18a872c9 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:57.048899 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f5df5520-3fe2-46d9-810d-e4de18a872c9 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:57.049332 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f5df5520-3fe2-46d9-810d-e4de18a872c9 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:57.123340 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-f5df5520-3fe2-46d9-810d-e4de18a872c9 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:57.132270 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-f5df5520-3fe2-46d9-810d-e4de18a872c9 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:57.133761 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-f5df5520-3fe2-46d9-810d-e4de18a872c9 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:57.134923 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-f5df5520-3fe2-46d9-810d-e4de18a872c9 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.105663 Jun 17 13:28:57.135478 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1401/2834] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:28:57 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:28:57.576109 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-d3d42ce5-6e23-455e-8259-417753810937 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:57.576989 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-d3d42ce5-6e23-455e-8259-417753810937 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:57.587294 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d3d42ce5-6e23-455e-8259-417753810937 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:57.588045 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d3d42ce5-6e23-455e-8259-417753810937 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:57.589297 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d3d42ce5-6e23-455e-8259-417753810937 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:57.590030 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d3d42ce5-6e23-455e-8259-417753810937 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:57.610541 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_cell1:SELECT=100 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:28:57.664080 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-d3d42ce5-6e23-455e-8259-417753810937 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:57.676383 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-d3d42ce5-6e23-455e-8259-417753810937 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.106649 Jun 17 13:28:57.677128 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1434/2835] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:28:57 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:28:57.966647 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-5edc7123-9341-4021-80a1-5b1681da1cb2 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:57.967754 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-5edc7123-9341-4021-80a1-5b1681da1cb2 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:57.978273 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5edc7123-9341-4021-80a1-5b1681da1cb2 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:57.979007 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5edc7123-9341-4021-80a1-5b1681da1cb2 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:57.981491 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5edc7123-9341-4021-80a1-5b1681da1cb2 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:57.981491 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5edc7123-9341-4021-80a1-5b1681da1cb2 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:58.114083 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-5edc7123-9341-4021-80a1-5b1681da1cb2 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:58.126667 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-5edc7123-9341-4021-80a1-5b1681da1cb2 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.166491 Jun 17 13:28:58.127206 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1402/2836] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:28:57 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:28:58.153824 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-e0e48fff-4d07-4116-9f9d-bc4fed9c1b5e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:58.154559 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-e0e48fff-4d07-4116-9f9d-bc4fed9c1b5e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:58.161310 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e0e48fff-4d07-4116-9f9d-bc4fed9c1b5e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:58.162003 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e0e48fff-4d07-4116-9f9d-bc4fed9c1b5e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:58.162806 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e0e48fff-4d07-4116-9f9d-bc4fed9c1b5e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:58.163253 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e0e48fff-4d07-4116-9f9d-bc4fed9c1b5e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:58.229624 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-e0e48fff-4d07-4116-9f9d-bc4fed9c1b5e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:58.238725 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-e0e48fff-4d07-4116-9f9d-bc4fed9c1b5e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:58.240222 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-e0e48fff-4d07-4116-9f9d-bc4fed9c1b5e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:58.241373 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-e0e48fff-4d07-4116-9f9d-bc4fed9c1b5e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.091673 Jun 17 13:28:58.241932 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1435/2837] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:28:58 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:28:58.701173 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-b5a8f593-c4ad-4c75-a823-a11e25f61f72 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:58.702150 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-b5a8f593-c4ad-4c75-a823-a11e25f61f72 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:58.709503 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b5a8f593-c4ad-4c75-a823-a11e25f61f72 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:58.709953 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b5a8f593-c4ad-4c75-a823-a11e25f61f72 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:58.710750 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b5a8f593-c4ad-4c75-a823-a11e25f61f72 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:58.711180 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b5a8f593-c4ad-4c75-a823-a11e25f61f72 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:58.782343 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-b5a8f593-c4ad-4c75-a823-a11e25f61f72 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:58.790972 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-b5a8f593-c4ad-4c75-a823-a11e25f61f72 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.096484 Jun 17 13:28:58.791541 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1403/2838] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:28:58 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:28:58.878301 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 13:28:58.878692 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Fri Jun 17 13:28:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 17 13:28:59.149124 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-6d075c6a-d611-489a-9435-d158acae7b9d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:59.150194 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-6d075c6a-d611-489a-9435-d158acae7b9d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:59.160197 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6d075c6a-d611-489a-9435-d158acae7b9d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:59.160806 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6d075c6a-d611-489a-9435-d158acae7b9d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:59.161392 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6d075c6a-d611-489a-9435-d158acae7b9d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:59.161827 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6d075c6a-d611-489a-9435-d158acae7b9d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:59.259368 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-2a69a03c-69d6-4b8b-9dcc-c7f6c42d832e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:59.259929 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-2a69a03c-69d6-4b8b-9dcc-c7f6c42d832e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:59.267057 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2a69a03c-69d6-4b8b-9dcc-c7f6c42d832e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:59.267517 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2a69a03c-69d6-4b8b-9dcc-c7f6c42d832e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:59.268263 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2a69a03c-69d6-4b8b-9dcc-c7f6c42d832e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:59.268685 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2a69a03c-69d6-4b8b-9dcc-c7f6c42d832e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:59.304011 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-6d075c6a-d611-489a-9435-d158acae7b9d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:59.312643 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-6d075c6a-d611-489a-9435-d158acae7b9d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.170804 Jun 17 13:28:59.313271 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1436/2839] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:28:59 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:28:59.343014 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-2a69a03c-69d6-4b8b-9dcc-c7f6c42d832e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:59.352439 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-2a69a03c-69d6-4b8b-9dcc-c7f6c42d832e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:59.353950 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-2a69a03c-69d6-4b8b-9dcc-c7f6c42d832e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:59.355448 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-2a69a03c-69d6-4b8b-9dcc-c7f6c42d832e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.099938 Jun 17 13:28:59.355995 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1404/2840] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:28:59 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 13:28:59.813104 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-13ffcd6f-77a0-4ca9-8329-845b67cf2931 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:28:59.813916 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-13ffcd6f-77a0-4ca9-8329-845b67cf2931 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:28:59.820557 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-13ffcd6f-77a0-4ca9-8329-845b67cf2931 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:59.821009 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-13ffcd6f-77a0-4ca9-8329-845b67cf2931 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:59.821768 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-13ffcd6f-77a0-4ca9-8329-845b67cf2931 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:28:59.822233 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-13ffcd6f-77a0-4ca9-8329-845b67cf2931 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:28:59.892342 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-13ffcd6f-77a0-4ca9-8329-845b67cf2931 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:28:59.900857 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-13ffcd6f-77a0-4ca9-8329-845b67cf2931 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.094425 Jun 17 13:28:59.901447 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1437/2841] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:28:59 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:29:00.329077 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-d96336d9-2acc-4a07-875c-6502f923ac93 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:29:00.329681 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-d96336d9-2acc-4a07-875c-6502f923ac93 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:29:00.336680 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d96336d9-2acc-4a07-875c-6502f923ac93 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:00.337118 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d96336d9-2acc-4a07-875c-6502f923ac93 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:00.337863 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d96336d9-2acc-4a07-875c-6502f923ac93 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:00.338406 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d96336d9-2acc-4a07-875c-6502f923ac93 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:00.373688 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-fa5a9d72-9f94-4730-a9a7-5b558e6d938a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:29:00.374304 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-fa5a9d72-9f94-4730-a9a7-5b558e6d938a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:29:00.381451 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-fa5a9d72-9f94-4730-a9a7-5b558e6d938a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:00.381874 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-fa5a9d72-9f94-4730-a9a7-5b558e6d938a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:00.382862 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-fa5a9d72-9f94-4730-a9a7-5b558e6d938a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:00.383291 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-fa5a9d72-9f94-4730-a9a7-5b558e6d938a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:00.459308 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-fa5a9d72-9f94-4730-a9a7-5b558e6d938a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:00.468057 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-fa5a9d72-9f94-4730-a9a7-5b558e6d938a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:00.469540 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-fa5a9d72-9f94-4730-a9a7-5b558e6d938a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:00.470717 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-fa5a9d72-9f94-4730-a9a7-5b558e6d938a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.100852 Jun 17 13:29:00.471594 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1438/2842] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:29:00 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:29:00.490995 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-d96336d9-2acc-4a07-875c-6502f923ac93 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:00.499051 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-d96336d9-2acc-4a07-875c-6502f923ac93 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.173860 Jun 17 13:29:00.499606 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1405/2843] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:29:00 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:29:00.922444 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-fb51ecce-9061-48b2-8a93-2801d0a54ac7 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:29:00.923492 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-fb51ecce-9061-48b2-8a93-2801d0a54ac7 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:29:00.930539 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-fb51ecce-9061-48b2-8a93-2801d0a54ac7 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:00.930992 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-fb51ecce-9061-48b2-8a93-2801d0a54ac7 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:00.931741 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-fb51ecce-9061-48b2-8a93-2801d0a54ac7 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:00.932175 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-fb51ecce-9061-48b2-8a93-2801d0a54ac7 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:00.997406 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-fb51ecce-9061-48b2-8a93-2801d0a54ac7 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:01.010195 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-fb51ecce-9061-48b2-8a93-2801d0a54ac7 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.093975 Jun 17 13:29:01.011151 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1439/2844] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:29:00 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:29:01.261771 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 13:29:01.262132 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Fri Jun 17 13:29:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 17 13:29:01.494548 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-e4374c05-15b5-4b35-8e47-e2086b1a1df1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:29:01.495533 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-e4374c05-15b5-4b35-8e47-e2086b1a1df1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:29:01.507387 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e4374c05-15b5-4b35-8e47-e2086b1a1df1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:01.508133 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e4374c05-15b5-4b35-8e47-e2086b1a1df1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:01.511644 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e4374c05-15b5-4b35-8e47-e2086b1a1df1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:01.511644 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e4374c05-15b5-4b35-8e47-e2086b1a1df1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:01.520106 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-88dbff3b-97be-4f4a-a334-5efaa427dcd0 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:29:01.520653 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-88dbff3b-97be-4f4a-a334-5efaa427dcd0 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:29:01.527448 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-88dbff3b-97be-4f4a-a334-5efaa427dcd0 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:01.527901 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-88dbff3b-97be-4f4a-a334-5efaa427dcd0 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:01.528667 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-88dbff3b-97be-4f4a-a334-5efaa427dcd0 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:01.529099 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-88dbff3b-97be-4f4a-a334-5efaa427dcd0 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:01.578116 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-e4374c05-15b5-4b35-8e47-e2086b1a1df1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:01.587329 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-e4374c05-15b5-4b35-8e47-e2086b1a1df1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:01.588858 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-e4374c05-15b5-4b35-8e47-e2086b1a1df1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:01.590176 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-e4374c05-15b5-4b35-8e47-e2086b1a1df1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.103186 Jun 17 13:29:01.590769 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1406/2845] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:29:01 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:29:01.682351 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-88dbff3b-97be-4f4a-a334-5efaa427dcd0 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:01.694536 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-88dbff3b-97be-4f4a-a334-5efaa427dcd0 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.180812 Jun 17 13:29:01.695311 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1440/2846] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:29:01 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:29:02.031248 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-582742ab-5c2b-4bf4-93a8-423df95c928a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:29:02.032176 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-582742ab-5c2b-4bf4-93a8-423df95c928a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:29:02.039717 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-582742ab-5c2b-4bf4-93a8-423df95c928a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:02.040162 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-582742ab-5c2b-4bf4-93a8-423df95c928a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:02.040924 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-582742ab-5c2b-4bf4-93a8-423df95c928a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:02.041363 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-582742ab-5c2b-4bf4-93a8-423df95c928a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:02.114030 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-582742ab-5c2b-4bf4-93a8-423df95c928a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:02.118920 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=100 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:29:02.127063 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-582742ab-5c2b-4bf4-93a8-423df95c928a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.101599 Jun 17 13:29:02.127864 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1407/2847] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:29:02 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:29:02.609482 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-27746535-e531-4f23-92ad-8c016253568c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:29:02.610080 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-27746535-e531-4f23-92ad-8c016253568c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:29:02.617011 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-27746535-e531-4f23-92ad-8c016253568c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:02.617450 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-27746535-e531-4f23-92ad-8c016253568c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:02.618231 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-27746535-e531-4f23-92ad-8c016253568c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:02.618659 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-27746535-e531-4f23-92ad-8c016253568c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:02.686870 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-27746535-e531-4f23-92ad-8c016253568c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:02.696113 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-27746535-e531-4f23-92ad-8c016253568c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:02.697631 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-27746535-e531-4f23-92ad-8c016253568c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:02.698930 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-27746535-e531-4f23-92ad-8c016253568c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.093507 Jun 17 13:29:02.699489 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1441/2848] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:29:02 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:29:02.716336 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-2bb07945-88c4-4598-935f-e04510671ea3 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:29:02.716933 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-2bb07945-88c4-4598-935f-e04510671ea3 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:29:02.723872 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2bb07945-88c4-4598-935f-e04510671ea3 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:02.724311 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2bb07945-88c4-4598-935f-e04510671ea3 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:02.725063 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2bb07945-88c4-4598-935f-e04510671ea3 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:02.725483 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2bb07945-88c4-4598-935f-e04510671ea3 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:02.877434 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-2bb07945-88c4-4598-935f-e04510671ea3 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:02.886375 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-2bb07945-88c4-4598-935f-e04510671ea3 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.174189 Jun 17 13:29:02.886942 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1408/2849] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:29:02 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:29:03.146012 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-4b1b99a1-85d0-46f2-99de-2fc3d17f0195 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:29:03.146567 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-4b1b99a1-85d0-46f2-99de-2fc3d17f0195 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:29:03.153517 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4b1b99a1-85d0-46f2-99de-2fc3d17f0195 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:03.153972 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4b1b99a1-85d0-46f2-99de-2fc3d17f0195 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:03.154764 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4b1b99a1-85d0-46f2-99de-2fc3d17f0195 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:03.155206 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4b1b99a1-85d0-46f2-99de-2fc3d17f0195 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:03.225940 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-4b1b99a1-85d0-46f2-99de-2fc3d17f0195 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:03.234828 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-4b1b99a1-85d0-46f2-99de-2fc3d17f0195 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.093508 Jun 17 13:29:03.235411 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1442/2850] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:29:03 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:29:03.725651 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-22430060-807e-4800-8cb4-eaad2ef51c7b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:29:03.726680 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-22430060-807e-4800-8cb4-eaad2ef51c7b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:29:03.738112 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-22430060-807e-4800-8cb4-eaad2ef51c7b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:03.738557 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-22430060-807e-4800-8cb4-eaad2ef51c7b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:03.739312 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-22430060-807e-4800-8cb4-eaad2ef51c7b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:03.739736 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-22430060-807e-4800-8cb4-eaad2ef51c7b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:03.813908 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-22430060-807e-4800-8cb4-eaad2ef51c7b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:03.828437 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-22430060-807e-4800-8cb4-eaad2ef51c7b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:03.830993 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-22430060-807e-4800-8cb4-eaad2ef51c7b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:03.832867 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-22430060-807e-4800-8cb4-eaad2ef51c7b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.114836 Jun 17 13:29:03.833406 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1409/2851] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:29:03 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:29:03.907172 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-ffdfc081-def6-4f48-81d5-b28704b350ae tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:29:03.908105 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-ffdfc081-def6-4f48-81d5-b28704b350ae tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:29:03.919646 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ffdfc081-def6-4f48-81d5-b28704b350ae tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:03.920413 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ffdfc081-def6-4f48-81d5-b28704b350ae tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:03.921644 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ffdfc081-def6-4f48-81d5-b28704b350ae tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:03.922432 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ffdfc081-def6-4f48-81d5-b28704b350ae tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:04.063622 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-ffdfc081-def6-4f48-81d5-b28704b350ae tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:04.072382 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-ffdfc081-def6-4f48-81d5-b28704b350ae tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.171661 Jun 17 13:29:04.072955 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1443/2852] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:29:03 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:29:04.256230 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-0fbba021-a552-4492-a6f2-aad0887045ec tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:29:04.257314 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-0fbba021-a552-4492-a6f2-aad0887045ec tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:29:04.265292 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0fbba021-a552-4492-a6f2-aad0887045ec tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:04.265842 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0fbba021-a552-4492-a6f2-aad0887045ec tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:04.266819 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0fbba021-a552-4492-a6f2-aad0887045ec tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:04.267345 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0fbba021-a552-4492-a6f2-aad0887045ec tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:04.333285 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-0fbba021-a552-4492-a6f2-aad0887045ec tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:04.341844 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-0fbba021-a552-4492-a6f2-aad0887045ec tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.092077 Jun 17 13:29:04.342445 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1410/2853] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:29:04 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:29:04.859939 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-f5254caa-41d2-4ca7-90ae-59a1e7b8f821 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:29:04.860988 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-f5254caa-41d2-4ca7-90ae-59a1e7b8f821 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:29:04.872002 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f5254caa-41d2-4ca7-90ae-59a1e7b8f821 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:04.872752 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f5254caa-41d2-4ca7-90ae-59a1e7b8f821 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:04.874013 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f5254caa-41d2-4ca7-90ae-59a1e7b8f821 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:04.874821 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f5254caa-41d2-4ca7-90ae-59a1e7b8f821 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:04.941437 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-f5254caa-41d2-4ca7-90ae-59a1e7b8f821 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:04.950482 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-f5254caa-41d2-4ca7-90ae-59a1e7b8f821 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:04.951986 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-f5254caa-41d2-4ca7-90ae-59a1e7b8f821 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:04.953123 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-f5254caa-41d2-4ca7-90ae-59a1e7b8f821 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.100318 Jun 17 13:29:04.953685 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1444/2854] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:29:04 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:29:05.089668 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-d42bf26d-465d-4a6e-8f6c-773c79b77df0 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:29:05.090388 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-d42bf26d-465d-4a6e-8f6c-773c79b77df0 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:29:05.097424 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d42bf26d-465d-4a6e-8f6c-773c79b77df0 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:05.097863 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d42bf26d-465d-4a6e-8f6c-773c79b77df0 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:05.098692 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d42bf26d-465d-4a6e-8f6c-773c79b77df0 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:05.099117 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d42bf26d-465d-4a6e-8f6c-773c79b77df0 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:05.247081 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-d42bf26d-465d-4a6e-8f6c-773c79b77df0 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:05.256206 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-d42bf26d-465d-4a6e-8f6c-773c79b77df0 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.170357 Jun 17 13:29:05.256753 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1411/2855] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:29:05 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:29:05.359655 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-d40427f1-f581-4fb0-b62f-de779e6ce019 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:29:05.360279 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-d40427f1-f581-4fb0-b62f-de779e6ce019 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:29:05.366775 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d40427f1-f581-4fb0-b62f-de779e6ce019 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:05.367294 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d40427f1-f581-4fb0-b62f-de779e6ce019 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:05.368131 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d40427f1-f581-4fb0-b62f-de779e6ce019 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:05.368631 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d40427f1-f581-4fb0-b62f-de779e6ce019 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:05.450460 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-d40427f1-f581-4fb0-b62f-de779e6ce019 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:05.458887 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-d40427f1-f581-4fb0-b62f-de779e6ce019 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.103164 Jun 17 13:29:05.459467 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1445/2856] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:29:05 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:29:05.974453 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-054e69e3-c8b9-4d13-9f9a-4ab80f6c45f0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:29:05.975317 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-054e69e3-c8b9-4d13-9f9a-4ab80f6c45f0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:29:05.985391 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-054e69e3-c8b9-4d13-9f9a-4ab80f6c45f0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:05.985582 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-054e69e3-c8b9-4d13-9f9a-4ab80f6c45f0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:05.986822 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-054e69e3-c8b9-4d13-9f9a-4ab80f6c45f0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:05.987439 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-054e69e3-c8b9-4d13-9f9a-4ab80f6c45f0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:06.220858 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-054e69e3-c8b9-4d13-9f9a-4ab80f6c45f0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:06.230656 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-054e69e3-c8b9-4d13-9f9a-4ab80f6c45f0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:06.232082 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-054e69e3-c8b9-4d13-9f9a-4ab80f6c45f0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:06.233241 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-054e69e3-c8b9-4d13-9f9a-4ab80f6c45f0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.264571 Jun 17 13:29:06.233794 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1412/2857] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:29:05 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:29:06.275190 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-37162028-3701-4949-8048-8c4ebb7a4caf tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:29:06.275791 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-37162028-3701-4949-8048-8c4ebb7a4caf tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:29:06.283217 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-37162028-3701-4949-8048-8c4ebb7a4caf tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:06.283676 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-37162028-3701-4949-8048-8c4ebb7a4caf tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:06.284437 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-37162028-3701-4949-8048-8c4ebb7a4caf tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:06.284883 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-37162028-3701-4949-8048-8c4ebb7a4caf tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:06.428420 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-37162028-3701-4949-8048-8c4ebb7a4caf tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:06.436775 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-37162028-3701-4949-8048-8c4ebb7a4caf tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.165695 Jun 17 13:29:06.437382 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1446/2858] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:29:06 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:29:06.477259 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-5a092612-9d1a-46fe-9f51-19125cc6e6e4 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:29:06.477865 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-5a092612-9d1a-46fe-9f51-19125cc6e6e4 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:29:06.484825 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5a092612-9d1a-46fe-9f51-19125cc6e6e4 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:06.485195 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5a092612-9d1a-46fe-9f51-19125cc6e6e4 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:06.485934 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5a092612-9d1a-46fe-9f51-19125cc6e6e4 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:06.486396 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5a092612-9d1a-46fe-9f51-19125cc6e6e4 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:06.554307 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-5a092612-9d1a-46fe-9f51-19125cc6e6e4 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:06.563254 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-5a092612-9d1a-46fe-9f51-19125cc6e6e4 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.090677 Jun 17 13:29:06.563858 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1413/2859] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:29:06 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:29:07.255637 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-2d1d1898-35d3-4057-b07a-15e44c7765e7 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:29:07.256282 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-2d1d1898-35d3-4057-b07a-15e44c7765e7 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:29:07.263274 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2d1d1898-35d3-4057-b07a-15e44c7765e7 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:07.263748 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2d1d1898-35d3-4057-b07a-15e44c7765e7 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:07.264539 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2d1d1898-35d3-4057-b07a-15e44c7765e7 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:07.264999 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2d1d1898-35d3-4057-b07a-15e44c7765e7 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:07.332882 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-2d1d1898-35d3-4057-b07a-15e44c7765e7 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:07.341824 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-2d1d1898-35d3-4057-b07a-15e44c7765e7 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:07.343360 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-2d1d1898-35d3-4057-b07a-15e44c7765e7 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:07.344511 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-2d1d1898-35d3-4057-b07a-15e44c7765e7 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.095365 Jun 17 13:29:07.345073 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1447/2860] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:29:07 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:29:07.457624 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-23529199-ab2c-4dba-8126-f8d9f247d39a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:29:07.458301 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-23529199-ab2c-4dba-8126-f8d9f247d39a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:29:07.465654 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-23529199-ab2c-4dba-8126-f8d9f247d39a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:07.466120 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-23529199-ab2c-4dba-8126-f8d9f247d39a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:07.466982 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-23529199-ab2c-4dba-8126-f8d9f247d39a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:07.467435 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-23529199-ab2c-4dba-8126-f8d9f247d39a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:07.579874 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-19c40802-f701-40c0-8ce4-8cb3d7ac387a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:29:07.580512 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-19c40802-f701-40c0-8ce4-8cb3d7ac387a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:29:07.587056 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-19c40802-f701-40c0-8ce4-8cb3d7ac387a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:07.587508 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-19c40802-f701-40c0-8ce4-8cb3d7ac387a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:07.588266 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-19c40802-f701-40c0-8ce4-8cb3d7ac387a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:07.588697 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-19c40802-f701-40c0-8ce4-8cb3d7ac387a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:07.606236 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-23529199-ab2c-4dba-8126-f8d9f247d39a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:07.614474 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-23529199-ab2c-4dba-8126-f8d9f247d39a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.162814 Jun 17 13:29:07.615038 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1414/2861] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:29:07 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:29:07.652183 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-19c40802-f701-40c0-8ce4-8cb3d7ac387a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:07.663032 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-19c40802-f701-40c0-8ce4-8cb3d7ac387a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.087139 Jun 17 13:29:07.663767 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1448/2862] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:29:07 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:29:07.893170 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 13:29:07.893554 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Fri Jun 17 13:29:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 17 13:29:08.364664 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-aa4bb71f-c04f-4df8-936f-6e6abb63cd4c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:29:08.365300 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-aa4bb71f-c04f-4df8-936f-6e6abb63cd4c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:29:08.372133 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-aa4bb71f-c04f-4df8-936f-6e6abb63cd4c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:08.372605 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-aa4bb71f-c04f-4df8-936f-6e6abb63cd4c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:08.373370 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-aa4bb71f-c04f-4df8-936f-6e6abb63cd4c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:08.373801 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-aa4bb71f-c04f-4df8-936f-6e6abb63cd4c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:08.444976 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-aa4bb71f-c04f-4df8-936f-6e6abb63cd4c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:08.453958 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-aa4bb71f-c04f-4df8-936f-6e6abb63cd4c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:08.455492 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-aa4bb71f-c04f-4df8-936f-6e6abb63cd4c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:08.456649 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-aa4bb71f-c04f-4df8-936f-6e6abb63cd4c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.096403 Jun 17 13:29:08.457196 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1415/2863] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:29:08 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:29:08.636070 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-92936dce-6818-4c28-8f1c-d023a436053e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:29:08.637002 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-92936dce-6818-4c28-8f1c-d023a436053e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:29:08.648089 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-92936dce-6818-4c28-8f1c-d023a436053e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:08.648834 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-92936dce-6818-4c28-8f1c-d023a436053e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:08.650128 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-92936dce-6818-4c28-8f1c-d023a436053e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:08.650881 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-92936dce-6818-4c28-8f1c-d023a436053e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:08.684907 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-15f8c4d5-b59d-49b1-9dad-605c8dc9efd4 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:29:08.685534 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-15f8c4d5-b59d-49b1-9dad-605c8dc9efd4 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:29:08.692832 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-15f8c4d5-b59d-49b1-9dad-605c8dc9efd4 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:08.693188 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-15f8c4d5-b59d-49b1-9dad-605c8dc9efd4 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:08.693973 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-15f8c4d5-b59d-49b1-9dad-605c8dc9efd4 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:08.694431 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-15f8c4d5-b59d-49b1-9dad-605c8dc9efd4 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:08.775838 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-15f8c4d5-b59d-49b1-9dad-605c8dc9efd4 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:08.784301 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-15f8c4d5-b59d-49b1-9dad-605c8dc9efd4 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.103241 Jun 17 13:29:08.785085 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1416/2864] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:29:08 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:29:08.812707 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-92936dce-6818-4c28-8f1c-d023a436053e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:08.822694 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-92936dce-6818-4c28-8f1c-d023a436053e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.193411 Jun 17 13:29:08.823243 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1449/2865] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:29:08 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:29:09.484956 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-153b3e95-1136-4bcb-a7e1-39f6069183d5 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:29:09.485952 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-153b3e95-1136-4bcb-a7e1-39f6069183d5 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:29:09.496413 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-153b3e95-1136-4bcb-a7e1-39f6069183d5 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:09.497186 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-153b3e95-1136-4bcb-a7e1-39f6069183d5 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:09.498503 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-153b3e95-1136-4bcb-a7e1-39f6069183d5 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:09.499211 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-153b3e95-1136-4bcb-a7e1-39f6069183d5 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:09.561903 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-153b3e95-1136-4bcb-a7e1-39f6069183d5 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:09.570800 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-153b3e95-1136-4bcb-a7e1-39f6069183d5 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:09.572205 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-153b3e95-1136-4bcb-a7e1-39f6069183d5 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:09.573328 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-153b3e95-1136-4bcb-a7e1-39f6069183d5 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.095366 Jun 17 13:29:09.573878 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1417/2866] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:29:09 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:29:09.803188 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-5a8e0c96-25e7-47fd-801f-a066d562e984 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:29:09.803869 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-5a8e0c96-25e7-47fd-801f-a066d562e984 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:29:09.811822 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-5a8e0c96-25e7-47fd-801f-a066d562e984 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:09.812315 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-5a8e0c96-25e7-47fd-801f-a066d562e984 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:09.813169 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-5a8e0c96-25e7-47fd-801f-a066d562e984 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:09.813660 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-5a8e0c96-25e7-47fd-801f-a066d562e984 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:09.840696 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-6cd5256a-b8d5-48c7-b1b0-56c398f5a5ae tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:29:09.841274 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-6cd5256a-b8d5-48c7-b1b0-56c398f5a5ae tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:29:09.848046 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6cd5256a-b8d5-48c7-b1b0-56c398f5a5ae tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:09.848534 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6cd5256a-b8d5-48c7-b1b0-56c398f5a5ae tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:09.849309 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6cd5256a-b8d5-48c7-b1b0-56c398f5a5ae tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:09.849738 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6cd5256a-b8d5-48c7-b1b0-56c398f5a5ae tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:09.878071 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-5a8e0c96-25e7-47fd-801f-a066d562e984 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:09.886722 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-5a8e0c96-25e7-47fd-801f-a066d562e984 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.088217 Jun 17 13:29:09.887304 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1450/2867] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:29:09 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:29:09.985995 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-6cd5256a-b8d5-48c7-b1b0-56c398f5a5ae tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:09.996020 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-6cd5256a-b8d5-48c7-b1b0-56c398f5a5ae tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.159203 Jun 17 13:29:09.996769 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1418/2868] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:29:09 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:29:10.595755 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-3874ac0e-9d0a-4892-953e-f03e75554827 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:29:10.596627 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-3874ac0e-9d0a-4892-953e-f03e75554827 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:29:10.611144 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-3874ac0e-9d0a-4892-953e-f03e75554827 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:10.611881 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-3874ac0e-9d0a-4892-953e-f03e75554827 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:10.613172 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-3874ac0e-9d0a-4892-953e-f03e75554827 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:10.614067 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-3874ac0e-9d0a-4892-953e-f03e75554827 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:10.618071 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_cell1:SELECT=100 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:29:10.678910 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-3874ac0e-9d0a-4892-953e-f03e75554827 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:10.692830 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-3874ac0e-9d0a-4892-953e-f03e75554827 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:10.695183 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-3874ac0e-9d0a-4892-953e-f03e75554827 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:10.696943 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-3874ac0e-9d0a-4892-953e-f03e75554827 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.107662 Jun 17 13:29:10.697772 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1451/2869] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:29:10 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:29:10.908450 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-dd28394e-aa81-4afd-b40f-d1feb2275b1e tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:29:10.909489 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-dd28394e-aa81-4afd-b40f-d1feb2275b1e tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:29:10.916995 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dd28394e-aa81-4afd-b40f-d1feb2275b1e tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:10.917443 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dd28394e-aa81-4afd-b40f-d1feb2275b1e tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:10.918243 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dd28394e-aa81-4afd-b40f-d1feb2275b1e tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:10.918680 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dd28394e-aa81-4afd-b40f-d1feb2275b1e tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:10.989932 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-dd28394e-aa81-4afd-b40f-d1feb2275b1e tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:10.998676 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-dd28394e-aa81-4afd-b40f-d1feb2275b1e tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.096666 Jun 17 13:29:10.999235 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1419/2870] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:29:10 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:29:11.015048 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-2a35b850-4928-4091-89ee-8e3594f8eb29 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:29:11.015630 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-2a35b850-4928-4091-89ee-8e3594f8eb29 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:29:11.025453 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2a35b850-4928-4091-89ee-8e3594f8eb29 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:11.026055 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2a35b850-4928-4091-89ee-8e3594f8eb29 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:11.027273 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2a35b850-4928-4091-89ee-8e3594f8eb29 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:11.027888 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2a35b850-4928-4091-89ee-8e3594f8eb29 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:11.166871 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-2a35b850-4928-4091-89ee-8e3594f8eb29 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:11.175477 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-2a35b850-4928-4091-89ee-8e3594f8eb29 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.166536 Jun 17 13:29:11.176089 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1452/2871] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:29:11 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:29:11.799760 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-bf1459f7-334d-4783-9afe-ca9c69ad4e49 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:29:11.800369 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-bf1459f7-334d-4783-9afe-ca9c69ad4e49 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:29:11.806558 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bf1459f7-334d-4783-9afe-ca9c69ad4e49 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:11.806995 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bf1459f7-334d-4783-9afe-ca9c69ad4e49 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:11.807740 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bf1459f7-334d-4783-9afe-ca9c69ad4e49 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:11.808167 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bf1459f7-334d-4783-9afe-ca9c69ad4e49 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:11.869980 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-bf1459f7-334d-4783-9afe-ca9c69ad4e49 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:11.882545 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-bf1459f7-334d-4783-9afe-ca9c69ad4e49 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:11.884981 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-bf1459f7-334d-4783-9afe-ca9c69ad4e49 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:11.886809 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-bf1459f7-334d-4783-9afe-ca9c69ad4e49 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.170416 Jun 17 13:29:11.887685 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1420/2872] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:29:11 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:29:12.019979 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-138ed07c-2b0e-42bb-9ef7-268a07ed4471 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:29:12.020913 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-138ed07c-2b0e-42bb-9ef7-268a07ed4471 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:29:12.028155 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-138ed07c-2b0e-42bb-9ef7-268a07ed4471 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:12.028607 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-138ed07c-2b0e-42bb-9ef7-268a07ed4471 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:12.029366 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-138ed07c-2b0e-42bb-9ef7-268a07ed4471 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:12.029803 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-138ed07c-2b0e-42bb-9ef7-268a07ed4471 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:12.098015 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-138ed07c-2b0e-42bb-9ef7-268a07ed4471 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:12.106912 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-138ed07c-2b0e-42bb-9ef7-268a07ed4471 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.092944 Jun 17 13:29:12.107481 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1453/2873] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:29:12 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:29:12.271360 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-83bbd3e8-6dbf-413d-9bd5-5a25e997b02f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:29:12.272059 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-83bbd3e8-6dbf-413d-9bd5-5a25e997b02f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:29:12.278718 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-83bbd3e8-6dbf-413d-9bd5-5a25e997b02f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:12.279170 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-83bbd3e8-6dbf-413d-9bd5-5a25e997b02f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:12.279929 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-83bbd3e8-6dbf-413d-9bd5-5a25e997b02f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:12.280367 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-83bbd3e8-6dbf-413d-9bd5-5a25e997b02f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:12.416583 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-83bbd3e8-6dbf-413d-9bd5-5a25e997b02f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:12.424928 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-83bbd3e8-6dbf-413d-9bd5-5a25e997b02f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.235034 Jun 17 13:29:12.425499 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1421/2874] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:29:12 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:29:12.910458 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-7ba448aa-6fbf-4925-8063-124a7d2eb36c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:29:12.911576 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-7ba448aa-6fbf-4925-8063-124a7d2eb36c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:29:12.922596 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7ba448aa-6fbf-4925-8063-124a7d2eb36c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:12.923343 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7ba448aa-6fbf-4925-8063-124a7d2eb36c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:12.924585 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7ba448aa-6fbf-4925-8063-124a7d2eb36c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:12.925310 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7ba448aa-6fbf-4925-8063-124a7d2eb36c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:12.989066 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-7ba448aa-6fbf-4925-8063-124a7d2eb36c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:12.998678 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-7ba448aa-6fbf-4925-8063-124a7d2eb36c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:13.000181 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-7ba448aa-6fbf-4925-8063-124a7d2eb36c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:13.001356 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-7ba448aa-6fbf-4925-8063-124a7d2eb36c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.097551 Jun 17 13:29:13.001924 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1454/2875] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:29:12 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:29:13.127159 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-f9e21b05-7f31-4e2b-a961-71e1a6821d98 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:29:13.128157 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-f9e21b05-7f31-4e2b-a961-71e1a6821d98 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:29:13.135759 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f9e21b05-7f31-4e2b-a961-71e1a6821d98 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:13.136207 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f9e21b05-7f31-4e2b-a961-71e1a6821d98 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:13.136953 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f9e21b05-7f31-4e2b-a961-71e1a6821d98 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:13.137388 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f9e21b05-7f31-4e2b-a961-71e1a6821d98 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:13.206127 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-f9e21b05-7f31-4e2b-a961-71e1a6821d98 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:13.214315 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-f9e21b05-7f31-4e2b-a961-71e1a6821d98 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.093611 Jun 17 13:29:13.215084 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1422/2876] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:29:13 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:29:13.446689 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-22e40ee6-6058-48b6-9283-075da1944dc2 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:29:13.447755 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-22e40ee6-6058-48b6-9283-075da1944dc2 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:29:13.459045 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-22e40ee6-6058-48b6-9283-075da1944dc2 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:13.459362 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-22e40ee6-6058-48b6-9283-075da1944dc2 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:13.460239 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-22e40ee6-6058-48b6-9283-075da1944dc2 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:13.460673 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-22e40ee6-6058-48b6-9283-075da1944dc2 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:13.605456 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-22e40ee6-6058-48b6-9283-075da1944dc2 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:13.613767 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-22e40ee6-6058-48b6-9283-075da1944dc2 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.173690 Jun 17 13:29:13.614383 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1455/2877] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:29:13 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:29:14.021836 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-00bb09d2-0683-4528-a3aa-b93b4126de8d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:29:14.022702 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-00bb09d2-0683-4528-a3aa-b93b4126de8d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:29:14.030660 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-00bb09d2-0683-4528-a3aa-b93b4126de8d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:14.031227 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-00bb09d2-0683-4528-a3aa-b93b4126de8d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:14.032179 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-00bb09d2-0683-4528-a3aa-b93b4126de8d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:14.032724 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-00bb09d2-0683-4528-a3aa-b93b4126de8d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:14.096463 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-00bb09d2-0683-4528-a3aa-b93b4126de8d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:14.105436 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-00bb09d2-0683-4528-a3aa-b93b4126de8d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:14.106968 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-00bb09d2-0683-4528-a3aa-b93b4126de8d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:14.108113 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-00bb09d2-0683-4528-a3aa-b93b4126de8d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.091234 Jun 17 13:29:14.108667 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1423/2878] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:29:14 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:29:14.235548 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-e738aac1-1cae-415a-87f8-e65216908021 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:29:14.236553 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-e738aac1-1cae-415a-87f8-e65216908021 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:29:14.244722 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e738aac1-1cae-415a-87f8-e65216908021 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:14.245104 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e738aac1-1cae-415a-87f8-e65216908021 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:14.245855 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e738aac1-1cae-415a-87f8-e65216908021 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:14.246336 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e738aac1-1cae-415a-87f8-e65216908021 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:14.317132 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-e738aac1-1cae-415a-87f8-e65216908021 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:14.325848 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-e738aac1-1cae-415a-87f8-e65216908021 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.097196 Jun 17 13:29:14.326466 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1456/2879] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:29:14 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:29:14.635526 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-9295fef5-ed36-4c6c-8d9b-358cadca0002 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:29:14.636523 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-9295fef5-ed36-4c6c-8d9b-358cadca0002 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:29:14.647141 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9295fef5-ed36-4c6c-8d9b-358cadca0002 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:14.647586 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9295fef5-ed36-4c6c-8d9b-358cadca0002 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:14.648337 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9295fef5-ed36-4c6c-8d9b-358cadca0002 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:14.648763 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9295fef5-ed36-4c6c-8d9b-358cadca0002 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:14.667002 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=100 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:29:14.793979 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-9295fef5-ed36-4c6c-8d9b-358cadca0002 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:14.805513 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-9295fef5-ed36-4c6c-8d9b-358cadca0002 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.176623 Jun 17 13:29:14.806078 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1424/2880] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:29:14 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:29:15.130126 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-2c1c4471-69e2-472b-9971-34851b5c11e1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:29:15.131375 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-2c1c4471-69e2-472b-9971-34851b5c11e1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:29:15.139636 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2c1c4471-69e2-472b-9971-34851b5c11e1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:15.140143 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2c1c4471-69e2-472b-9971-34851b5c11e1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:15.141037 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2c1c4471-69e2-472b-9971-34851b5c11e1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:15.141549 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2c1c4471-69e2-472b-9971-34851b5c11e1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:15.212865 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-2c1c4471-69e2-472b-9971-34851b5c11e1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:15.224939 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-2c1c4471-69e2-472b-9971-34851b5c11e1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:15.226408 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-2c1c4471-69e2-472b-9971-34851b5c11e1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:15.227536 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-2c1c4471-69e2-472b-9971-34851b5c11e1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.103885 Jun 17 13:29:15.228090 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1457/2881] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:29:15 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:29:15.343340 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-ed60ae97-cccf-450c-ada6-7b4a5b87f5b2 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:29:15.343954 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-ed60ae97-cccf-450c-ada6-7b4a5b87f5b2 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:29:15.352193 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ed60ae97-cccf-450c-ada6-7b4a5b87f5b2 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:15.352715 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ed60ae97-cccf-450c-ada6-7b4a5b87f5b2 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:15.353802 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ed60ae97-cccf-450c-ada6-7b4a5b87f5b2 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:15.354605 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ed60ae97-cccf-450c-ada6-7b4a5b87f5b2 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:15.419246 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-ed60ae97-cccf-450c-ada6-7b4a5b87f5b2 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:15.427363 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-ed60ae97-cccf-450c-ada6-7b4a5b87f5b2 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.088009 Jun 17 13:29:15.427947 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1425/2882] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:29:15 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:29:15.827535 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-186a3b0a-94cb-4071-8899-0cf46c55dd7f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:29:15.828438 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-186a3b0a-94cb-4071-8899-0cf46c55dd7f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:29:15.839035 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-186a3b0a-94cb-4071-8899-0cf46c55dd7f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:15.839795 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-186a3b0a-94cb-4071-8899-0cf46c55dd7f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:15.841043 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-186a3b0a-94cb-4071-8899-0cf46c55dd7f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:15.841784 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-186a3b0a-94cb-4071-8899-0cf46c55dd7f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:15.984475 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-186a3b0a-94cb-4071-8899-0cf46c55dd7f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:15.996903 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-186a3b0a-94cb-4071-8899-0cf46c55dd7f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.176001 Jun 17 13:29:15.997762 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1458/2883] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:29:15 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:29:16.254109 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-878094d5-a2fb-4b0d-b4f4-d6f62ea98c44 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:29:16.255112 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-878094d5-a2fb-4b0d-b4f4-d6f62ea98c44 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:29:16.258729 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_api:SELECT=78 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:29:16.267876 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-878094d5-a2fb-4b0d-b4f4-d6f62ea98c44 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:16.268607 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-878094d5-a2fb-4b0d-b4f4-d6f62ea98c44 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:16.269845 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-878094d5-a2fb-4b0d-b4f4-d6f62ea98c44 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:16.270785 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-878094d5-a2fb-4b0d-b4f4-d6f62ea98c44 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:16.344786 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-878094d5-a2fb-4b0d-b4f4-d6f62ea98c44 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:16.353489 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-878094d5-a2fb-4b0d-b4f4-d6f62ea98c44 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:16.355334 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-878094d5-a2fb-4b0d-b4f4-d6f62ea98c44 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:16.356470 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-878094d5-a2fb-4b0d-b4f4-d6f62ea98c44 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.108961 Jun 17 13:29:16.357021 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1426/2884] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:29:16 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:29:16.445302 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-7daa9dd1-ade9-4fc9-8355-4aa05e602478 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:29:16.445922 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-7daa9dd1-ade9-4fc9-8355-4aa05e602478 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:29:16.453027 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7daa9dd1-ade9-4fc9-8355-4aa05e602478 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:16.453479 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7daa9dd1-ade9-4fc9-8355-4aa05e602478 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:16.454306 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7daa9dd1-ade9-4fc9-8355-4aa05e602478 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:16.454742 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7daa9dd1-ade9-4fc9-8355-4aa05e602478 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:16.524764 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-7daa9dd1-ade9-4fc9-8355-4aa05e602478 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:16.533419 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-7daa9dd1-ade9-4fc9-8355-4aa05e602478 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.092701 Jun 17 13:29:16.533983 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1459/2885] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:29:16 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:29:17.021918 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-6964d691-cb12-4b47-b962-b58eb503309e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:29:17.022820 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-6964d691-cb12-4b47-b962-b58eb503309e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:29:17.030718 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6964d691-cb12-4b47-b962-b58eb503309e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:17.031270 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6964d691-cb12-4b47-b962-b58eb503309e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:17.032206 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6964d691-cb12-4b47-b962-b58eb503309e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:17.032739 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6964d691-cb12-4b47-b962-b58eb503309e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:17.168249 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-6964d691-cb12-4b47-b962-b58eb503309e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:17.176458 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-6964d691-cb12-4b47-b962-b58eb503309e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.161138 Jun 17 13:29:17.177027 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1427/2886] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:29:17 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:29:17.379523 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-dc3192e0-a86e-4cea-b624-fc33f657f0e5 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:29:17.380642 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-dc3192e0-a86e-4cea-b624-fc33f657f0e5 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:29:17.387251 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-dc3192e0-a86e-4cea-b624-fc33f657f0e5 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:17.387699 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-dc3192e0-a86e-4cea-b624-fc33f657f0e5 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:17.388457 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-dc3192e0-a86e-4cea-b624-fc33f657f0e5 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:17.388894 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-dc3192e0-a86e-4cea-b624-fc33f657f0e5 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:17.454365 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-dc3192e0-a86e-4cea-b624-fc33f657f0e5 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:17.463040 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-dc3192e0-a86e-4cea-b624-fc33f657f0e5 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:17.464541 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-dc3192e0-a86e-4cea-b624-fc33f657f0e5 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:17.465689 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-dc3192e0-a86e-4cea-b624-fc33f657f0e5 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.092706 Jun 17 13:29:17.466276 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1460/2887] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:29:17 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:29:17.554677 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-3e529c7d-67e0-4fb1-b5b7-a07bd4d285e0 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:29:17.555309 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-3e529c7d-67e0-4fb1-b5b7-a07bd4d285e0 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:29:17.563097 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3e529c7d-67e0-4fb1-b5b7-a07bd4d285e0 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:17.563558 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3e529c7d-67e0-4fb1-b5b7-a07bd4d285e0 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:17.564453 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3e529c7d-67e0-4fb1-b5b7-a07bd4d285e0 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:17.565005 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3e529c7d-67e0-4fb1-b5b7-a07bd4d285e0 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:17.631293 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-3e529c7d-67e0-4fb1-b5b7-a07bd4d285e0 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:17.639445 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-3e529c7d-67e0-4fb1-b5b7-a07bd4d285e0 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.091341 Jun 17 13:29:17.640019 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1428/2888] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:29:17 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:29:18.197647 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-9bd2cae2-ed48-4373-976a-14e51cfdd862 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:29:18.198357 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-9bd2cae2-ed48-4373-976a-14e51cfdd862 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:29:18.205116 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9bd2cae2-ed48-4373-976a-14e51cfdd862 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:18.205569 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9bd2cae2-ed48-4373-976a-14e51cfdd862 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:18.206367 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9bd2cae2-ed48-4373-976a-14e51cfdd862 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:18.206791 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9bd2cae2-ed48-4373-976a-14e51cfdd862 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:18.338668 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-9bd2cae2-ed48-4373-976a-14e51cfdd862 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:18.347209 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-9bd2cae2-ed48-4373-976a-14e51cfdd862 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.153549 Jun 17 13:29:18.347788 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1461/2889] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:29:18 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:29:18.487825 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-a5fdc014-6a96-439b-9d11-eefb41055270 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:29:18.488828 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-a5fdc014-6a96-439b-9d11-eefb41055270 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:29:18.495862 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a5fdc014-6a96-439b-9d11-eefb41055270 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:18.496295 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a5fdc014-6a96-439b-9d11-eefb41055270 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:18.497040 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a5fdc014-6a96-439b-9d11-eefb41055270 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:18.497464 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a5fdc014-6a96-439b-9d11-eefb41055270 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:18.564462 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-a5fdc014-6a96-439b-9d11-eefb41055270 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:18.573565 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-a5fdc014-6a96-439b-9d11-eefb41055270 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:18.575077 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-a5fdc014-6a96-439b-9d11-eefb41055270 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:18.576209 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-a5fdc014-6a96-439b-9d11-eefb41055270 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.094968 Jun 17 13:29:18.576754 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1429/2890] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:29:18 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:29:18.660894 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-669f30a9-96c8-4039-9c16-e4a8f7b76607 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:29:18.661881 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-669f30a9-96c8-4039-9c16-e4a8f7b76607 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:29:18.670765 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-669f30a9-96c8-4039-9c16-e4a8f7b76607 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:18.671320 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-669f30a9-96c8-4039-9c16-e4a8f7b76607 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:18.672251 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-669f30a9-96c8-4039-9c16-e4a8f7b76607 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:18.672783 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-669f30a9-96c8-4039-9c16-e4a8f7b76607 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:18.752376 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-669f30a9-96c8-4039-9c16-e4a8f7b76607 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:18.762708 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-669f30a9-96c8-4039-9c16-e4a8f7b76607 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.108201 Jun 17 13:29:18.763278 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1462/2891] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:29:18 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:29:19.366825 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-e6622051-7ffa-4da8-b8e8-02c316445398 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:29:19.367428 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-e6622051-7ffa-4da8-b8e8-02c316445398 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:29:19.374048 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e6622051-7ffa-4da8-b8e8-02c316445398 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:19.374519 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e6622051-7ffa-4da8-b8e8-02c316445398 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:19.375291 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e6622051-7ffa-4da8-b8e8-02c316445398 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:19.375731 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e6622051-7ffa-4da8-b8e8-02c316445398 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:19.528342 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-e6622051-7ffa-4da8-b8e8-02c316445398 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:19.538145 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-e6622051-7ffa-4da8-b8e8-02c316445398 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.176108 Jun 17 13:29:19.538730 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1430/2892] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:29:19 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:29:19.596030 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-8ca1ccc7-2d13-4a21-bd44-78f38e0204da tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:29:19.596529 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-8ca1ccc7-2d13-4a21-bd44-78f38e0204da tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:29:19.605097 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8ca1ccc7-2d13-4a21-bd44-78f38e0204da tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:19.605542 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8ca1ccc7-2d13-4a21-bd44-78f38e0204da tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:19.606348 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8ca1ccc7-2d13-4a21-bd44-78f38e0204da tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:19.606799 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8ca1ccc7-2d13-4a21-bd44-78f38e0204da tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:19.678492 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-8ca1ccc7-2d13-4a21-bd44-78f38e0204da tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:19.690421 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-8ca1ccc7-2d13-4a21-bd44-78f38e0204da tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:19.692785 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-8ca1ccc7-2d13-4a21-bd44-78f38e0204da tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:19.694348 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-8ca1ccc7-2d13-4a21-bd44-78f38e0204da tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.102473 Jun 17 13:29:19.694903 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1463/2893] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:29:19 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:29:19.781067 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-b63840fd-ac3d-466f-9d33-3db27c85755f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:29:19.781685 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-b63840fd-ac3d-466f-9d33-3db27c85755f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:29:19.790716 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b63840fd-ac3d-466f-9d33-3db27c85755f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:19.791296 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b63840fd-ac3d-466f-9d33-3db27c85755f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:19.792406 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b63840fd-ac3d-466f-9d33-3db27c85755f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:19.792949 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b63840fd-ac3d-466f-9d33-3db27c85755f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:19.859787 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-b63840fd-ac3d-466f-9d33-3db27c85755f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:19.868311 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-b63840fd-ac3d-466f-9d33-3db27c85755f tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.091745 Jun 17 13:29:19.868878 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1431/2894] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:29:19 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:29:20.564891 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-d5a56acb-efb5-4c94-bc65-287243bb8f5b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:29:20.565995 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-d5a56acb-efb5-4c94-bc65-287243bb8f5b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:29:20.576344 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d5a56acb-efb5-4c94-bc65-287243bb8f5b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:20.577079 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d5a56acb-efb5-4c94-bc65-287243bb8f5b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:20.578385 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d5a56acb-efb5-4c94-bc65-287243bb8f5b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:20.579074 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d5a56acb-efb5-4c94-bc65-287243bb8f5b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:20.713377 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-5f575477-d7e9-4413-941b-07bf11af0011 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:29:20.714128 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-5f575477-d7e9-4413-941b-07bf11af0011 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:29:20.721367 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5f575477-d7e9-4413-941b-07bf11af0011 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:20.721888 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5f575477-d7e9-4413-941b-07bf11af0011 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:20.722765 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5f575477-d7e9-4413-941b-07bf11af0011 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:20.723263 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5f575477-d7e9-4413-941b-07bf11af0011 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:20.942948 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-5f575477-d7e9-4413-941b-07bf11af0011 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:20.951801 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-5f575477-d7e9-4413-941b-07bf11af0011 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:20.953298 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-5f575477-d7e9-4413-941b-07bf11af0011 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:20.954474 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-5f575477-d7e9-4413-941b-07bf11af0011 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.245347 Jun 17 13:29:20.955267 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1432/2895] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:29:20 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:29:20.959593 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-dd515214-811a-4fbf-93c6-83b38fe6c322 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:29:20.960239 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-dd515214-811a-4fbf-93c6-83b38fe6c322 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:29:20.966415 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dd515214-811a-4fbf-93c6-83b38fe6c322 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:20.966862 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dd515214-811a-4fbf-93c6-83b38fe6c322 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:20.967620 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dd515214-811a-4fbf-93c6-83b38fe6c322 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:20.968056 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dd515214-811a-4fbf-93c6-83b38fe6c322 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:21.000271 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-d5a56acb-efb5-4c94-bc65-287243bb8f5b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:21.008762 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-d5a56acb-efb5-4c94-bc65-287243bb8f5b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.456212 Jun 17 13:29:21.009370 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1464/2896] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:29:20 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:29:21.029091 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-dd515214-811a-4fbf-93c6-83b38fe6c322 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:21.037026 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-dd515214-811a-4fbf-93c6-83b38fe6c322 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.081074 Jun 17 13:29:21.037772 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1433/2897] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:29:20 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:29:21.977057 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-26e82792-5071-4101-9ed4-8fc6233418f2 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:29:21.977773 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-26e82792-5071-4101-9ed4-8fc6233418f2 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:29:21.986129 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-26e82792-5071-4101-9ed4-8fc6233418f2 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:21.986698 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-26e82792-5071-4101-9ed4-8fc6233418f2 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:21.987579 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-26e82792-5071-4101-9ed4-8fc6233418f2 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:21.988122 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-26e82792-5071-4101-9ed4-8fc6233418f2 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:22.025155 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-0e0eac37-aeab-45b2-9a74-d5bfaa6f8afd tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:29:22.025743 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-0e0eac37-aeab-45b2-9a74-d5bfaa6f8afd tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:29:22.032745 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0e0eac37-aeab-45b2-9a74-d5bfaa6f8afd tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:22.033185 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0e0eac37-aeab-45b2-9a74-d5bfaa6f8afd tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:22.033913 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0e0eac37-aeab-45b2-9a74-d5bfaa6f8afd tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:22.034376 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0e0eac37-aeab-45b2-9a74-d5bfaa6f8afd tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:22.054894 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-26e82792-5071-4101-9ed4-8fc6233418f2 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:22.063733 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-26e82792-5071-4101-9ed4-8fc6233418f2 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:22.065247 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-26e82792-5071-4101-9ed4-8fc6233418f2 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:22.066441 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-26e82792-5071-4101-9ed4-8fc6233418f2 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.096023 Jun 17 13:29:22.067011 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1465/2898] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:29:21 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:29:22.071429 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-ae71df2f-d8c8-4cc6-878e-a7c9e61cb8e3 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:29:22.072038 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-ae71df2f-d8c8-4cc6-878e-a7c9e61cb8e3 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:29:22.078325 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ae71df2f-d8c8-4cc6-878e-a7c9e61cb8e3 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:22.078782 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ae71df2f-d8c8-4cc6-878e-a7c9e61cb8e3 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:22.079584 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ae71df2f-d8c8-4cc6-878e-a7c9e61cb8e3 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:22.080027 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ae71df2f-d8c8-4cc6-878e-a7c9e61cb8e3 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:22.155936 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-ae71df2f-d8c8-4cc6-878e-a7c9e61cb8e3 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:22.164330 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-ae71df2f-d8c8-4cc6-878e-a7c9e61cb8e3 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.096321 Jun 17 13:29:22.165120 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1466/2899] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:29:22 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:29:22.187175 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-0e0eac37-aeab-45b2-9a74-d5bfaa6f8afd tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:22.195416 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-0e0eac37-aeab-45b2-9a74-d5bfaa6f8afd tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.174365 Jun 17 13:29:22.196227 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1434/2900] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:29:22 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:29:23.090064 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-1e1b3241-bc93-433c-a0e6-8adce3c65417 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:29:23.091114 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-1e1b3241-bc93-433c-a0e6-8adce3c65417 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:29:23.102222 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-1e1b3241-bc93-433c-a0e6-8adce3c65417 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:23.102682 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-1e1b3241-bc93-433c-a0e6-8adce3c65417 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:23.103443 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-1e1b3241-bc93-433c-a0e6-8adce3c65417 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:23.103883 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-1e1b3241-bc93-433c-a0e6-8adce3c65417 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:23.170338 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-1e1b3241-bc93-433c-a0e6-8adce3c65417 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:23.175223 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_cell1:SELECT=100 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:29:23.181453 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-bedb304f-6a3b-47af-b7a4-10820c9b9c93 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:29:23.181999 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-1e1b3241-bc93-433c-a0e6-8adce3c65417 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:23.182227 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-bedb304f-6a3b-47af-b7a4-10820c9b9c93 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:29:23.183086 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-1e1b3241-bc93-433c-a0e6-8adce3c65417 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:23.184231 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-1e1b3241-bc93-433c-a0e6-8adce3c65417 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.101356 Jun 17 13:29:23.184785 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1467/2901] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:29:23 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:29:23.188768 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bedb304f-6a3b-47af-b7a4-10820c9b9c93 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:23.189208 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bedb304f-6a3b-47af-b7a4-10820c9b9c93 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:23.189955 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bedb304f-6a3b-47af-b7a4-10820c9b9c93 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:23.190411 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bedb304f-6a3b-47af-b7a4-10820c9b9c93 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:23.213087 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-0a7612f5-5f26-434f-bd2c-2faa69f23ccc tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:29:23.213696 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-0a7612f5-5f26-434f-bd2c-2faa69f23ccc tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:29:23.220610 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0a7612f5-5f26-434f-bd2c-2faa69f23ccc tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:23.221068 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0a7612f5-5f26-434f-bd2c-2faa69f23ccc tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:23.221866 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0a7612f5-5f26-434f-bd2c-2faa69f23ccc tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:23.222337 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0a7612f5-5f26-434f-bd2c-2faa69f23ccc tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:23.267464 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-bedb304f-6a3b-47af-b7a4-10820c9b9c93 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:23.276534 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-bedb304f-6a3b-47af-b7a4-10820c9b9c93 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.099310 Jun 17 13:29:23.277097 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1435/2902] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:29:23 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:29:23.352490 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-0a7612f5-5f26-434f-bd2c-2faa69f23ccc tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:23.361136 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-0a7612f5-5f26-434f-bd2c-2faa69f23ccc tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.152547 Jun 17 13:29:23.361711 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1468/2903] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:29:23 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:29:24.206056 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-a636b160-5d8e-4d38-a096-24f3ea9ac1a5 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:29:24.207215 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-a636b160-5d8e-4d38-a096-24f3ea9ac1a5 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:29:24.216147 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a636b160-5d8e-4d38-a096-24f3ea9ac1a5 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:24.216596 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a636b160-5d8e-4d38-a096-24f3ea9ac1a5 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:24.217353 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a636b160-5d8e-4d38-a096-24f3ea9ac1a5 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:24.217786 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a636b160-5d8e-4d38-a096-24f3ea9ac1a5 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:24.282123 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-a636b160-5d8e-4d38-a096-24f3ea9ac1a5 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:24.291504 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-a636b160-5d8e-4d38-a096-24f3ea9ac1a5 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:24.293828 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-a636b160-5d8e-4d38-a096-24f3ea9ac1a5 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:24.294083 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-4019bf16-9564-45b5-a49f-1ba3ca7a347b tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:29:24.295016 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-4019bf16-9564-45b5-a49f-1ba3ca7a347b tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:29:24.295612 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-a636b160-5d8e-4d38-a096-24f3ea9ac1a5 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.096031 Jun 17 13:29:24.296615 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1436/2904] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:29:24 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:29:24.305633 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4019bf16-9564-45b5-a49f-1ba3ca7a347b tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:24.306061 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4019bf16-9564-45b5-a49f-1ba3ca7a347b tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:24.306891 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4019bf16-9564-45b5-a49f-1ba3ca7a347b tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:24.307298 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4019bf16-9564-45b5-a49f-1ba3ca7a347b tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:24.373021 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-4019bf16-9564-45b5-a49f-1ba3ca7a347b tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:24.378612 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-62283a11-f377-4968-9d8b-9b5dbb49b4f6 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:29:24.379224 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-62283a11-f377-4968-9d8b-9b5dbb49b4f6 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:29:24.381406 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-4019bf16-9564-45b5-a49f-1ba3ca7a347b tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.092350 Jun 17 13:29:24.381994 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1469/2905] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:29:24 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:29:24.385438 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-62283a11-f377-4968-9d8b-9b5dbb49b4f6 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:24.385886 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-62283a11-f377-4968-9d8b-9b5dbb49b4f6 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:24.386691 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-62283a11-f377-4968-9d8b-9b5dbb49b4f6 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:24.387101 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-62283a11-f377-4968-9d8b-9b5dbb49b4f6 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:24.524004 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-62283a11-f377-4968-9d8b-9b5dbb49b4f6 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:24.532360 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-62283a11-f377-4968-9d8b-9b5dbb49b4f6 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.157758 Jun 17 13:29:24.532854 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1437/2906] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:29:24 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:29:24.644773 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 13:29:24.645033 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Fri Jun 17 13:29:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 17 13:29:25.316777 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-6388746a-59a9-48b6-b1ad-954995c0c141 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:29:25.317419 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-6388746a-59a9-48b6-b1ad-954995c0c141 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:29:25.319790 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_api:SELECT=80 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:29:25.325380 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6388746a-59a9-48b6-b1ad-954995c0c141 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:25.325831 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6388746a-59a9-48b6-b1ad-954995c0c141 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:25.326614 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6388746a-59a9-48b6-b1ad-954995c0c141 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:25.327047 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6388746a-59a9-48b6-b1ad-954995c0c141 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:25.397813 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-6388746a-59a9-48b6-b1ad-954995c0c141 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:25.399179 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-3b16e433-3d67-4ad2-9491-5d8118e6b925 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:29:25.399808 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-3b16e433-3d67-4ad2-9491-5d8118e6b925 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:29:25.406928 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3b16e433-3d67-4ad2-9491-5d8118e6b925 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:25.407124 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-6388746a-59a9-48b6-b1ad-954995c0c141 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:25.407379 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3b16e433-3d67-4ad2-9491-5d8118e6b925 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:25.408147 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3b16e433-3d67-4ad2-9491-5d8118e6b925 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:25.408542 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-6388746a-59a9-48b6-b1ad-954995c0c141 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:25.408677 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3b16e433-3d67-4ad2-9491-5d8118e6b925 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:25.409690 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-6388746a-59a9-48b6-b1ad-954995c0c141 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.097047 Jun 17 13:29:25.410488 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1470/2907] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:29:25 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:29:25.474930 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-3b16e433-3d67-4ad2-9491-5d8118e6b925 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:25.484402 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-3b16e433-3d67-4ad2-9491-5d8118e6b925 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.089320 Jun 17 13:29:25.484957 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1438/2908] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:29:25 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:29:25.553746 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-d107b237-27e2-49b2-a1f4-22f508c360b4 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:29:25.554746 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-d107b237-27e2-49b2-a1f4-22f508c360b4 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:29:25.565022 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d107b237-27e2-49b2-a1f4-22f508c360b4 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:25.565651 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d107b237-27e2-49b2-a1f4-22f508c360b4 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:25.566933 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d107b237-27e2-49b2-a1f4-22f508c360b4 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:25.567665 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d107b237-27e2-49b2-a1f4-22f508c360b4 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:25.701880 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-d107b237-27e2-49b2-a1f4-22f508c360b4 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:25.709955 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-d107b237-27e2-49b2-a1f4-22f508c360b4 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.162641 Jun 17 13:29:25.710560 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1471/2909] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:29:25 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:29:26.428299 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-b603338a-1f31-437b-8a6c-f1be90173b45 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:29:26.428898 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-b603338a-1f31-437b-8a6c-f1be90173b45 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:29:26.435885 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b603338a-1f31-437b-8a6c-f1be90173b45 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:26.436337 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b603338a-1f31-437b-8a6c-f1be90173b45 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:26.437097 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b603338a-1f31-437b-8a6c-f1be90173b45 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:26.437530 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b603338a-1f31-437b-8a6c-f1be90173b45 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:26.500853 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-3c5f4e60-c6c1-40be-afbd-67411ff618ad tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:29:26.501459 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-3c5f4e60-c6c1-40be-afbd-67411ff618ad tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:29:26.509030 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-3c5f4e60-c6c1-40be-afbd-67411ff618ad tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:26.509267 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-b603338a-1f31-437b-8a6c-f1be90173b45 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:26.509473 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-3c5f4e60-c6c1-40be-afbd-67411ff618ad tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:26.510273 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-3c5f4e60-c6c1-40be-afbd-67411ff618ad tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:26.510706 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-3c5f4e60-c6c1-40be-afbd-67411ff618ad tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:26.518173 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-b603338a-1f31-437b-8a6c-f1be90173b45 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:26.519646 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-b603338a-1f31-437b-8a6c-f1be90173b45 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:26.520776 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-b603338a-1f31-437b-8a6c-f1be90173b45 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.096585 Jun 17 13:29:26.521322 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1439/2910] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:29:26 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:29:26.572695 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-3c5f4e60-c6c1-40be-afbd-67411ff618ad tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:26.580925 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-3c5f4e60-c6c1-40be-afbd-67411ff618ad tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.083920 Jun 17 13:29:26.581476 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1472/2911] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:29:26 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:29:26.727283 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-16b129ef-7345-44b0-ab2d-fef2ce0a89e9 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:29:26.727901 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-16b129ef-7345-44b0-ab2d-fef2ce0a89e9 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:29:26.734526 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-16b129ef-7345-44b0-ab2d-fef2ce0a89e9 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:26.734977 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-16b129ef-7345-44b0-ab2d-fef2ce0a89e9 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:26.735732 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-16b129ef-7345-44b0-ab2d-fef2ce0a89e9 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:26.736163 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-16b129ef-7345-44b0-ab2d-fef2ce0a89e9 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:26.885186 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-16b129ef-7345-44b0-ab2d-fef2ce0a89e9 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:26.893849 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-16b129ef-7345-44b0-ab2d-fef2ce0a89e9 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.170565 Jun 17 13:29:26.894436 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1440/2912] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:29:26 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:29:27.544421 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-40076821-84b1-4764-96c1-0334d8c41ad3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:29:27.545415 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-40076821-84b1-4764-96c1-0334d8c41ad3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:29:27.555982 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-40076821-84b1-4764-96c1-0334d8c41ad3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:27.556418 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-40076821-84b1-4764-96c1-0334d8c41ad3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:27.557160 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-40076821-84b1-4764-96c1-0334d8c41ad3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:27.557588 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-40076821-84b1-4764-96c1-0334d8c41ad3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:27.597951 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-c83a7612-e2fb-42ea-91e3-d44f0132c53b tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:29:27.598576 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-c83a7612-e2fb-42ea-91e3-d44f0132c53b tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:29:27.606131 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c83a7612-e2fb-42ea-91e3-d44f0132c53b tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:27.606603 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c83a7612-e2fb-42ea-91e3-d44f0132c53b tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:27.607348 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c83a7612-e2fb-42ea-91e3-d44f0132c53b tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:27.607771 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c83a7612-e2fb-42ea-91e3-d44f0132c53b tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:27.611811 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=100 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:29:27.620234 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-40076821-84b1-4764-96c1-0334d8c41ad3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:27.628822 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-40076821-84b1-4764-96c1-0334d8c41ad3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:27.630326 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-40076821-84b1-4764-96c1-0334d8c41ad3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:27.631461 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-40076821-84b1-4764-96c1-0334d8c41ad3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.094014 Jun 17 13:29:27.631990 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1473/2913] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:29:27 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:29:27.670677 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-c83a7612-e2fb-42ea-91e3-d44f0132c53b tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:27.678768 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-c83a7612-e2fb-42ea-91e3-d44f0132c53b tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.084693 Jun 17 13:29:27.679328 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1441/2914] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:29:27 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 13:29:27.915429 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-6d65b124-2f45-4f8d-aee9-9bf623feff87 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:29:27.916179 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-6d65b124-2f45-4f8d-aee9-9bf623feff87 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:29:27.924252 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6d65b124-2f45-4f8d-aee9-9bf623feff87 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:27.924808 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6d65b124-2f45-4f8d-aee9-9bf623feff87 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:27.925731 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6d65b124-2f45-4f8d-aee9-9bf623feff87 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:27.926318 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6d65b124-2f45-4f8d-aee9-9bf623feff87 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:28.078401 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-6d65b124-2f45-4f8d-aee9-9bf623feff87 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:28.089078 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-6d65b124-2f45-4f8d-aee9-9bf623feff87 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.179810 Jun 17 13:29:28.089654 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1474/2915] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:29:27 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:29:28.416904 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 13:29:28.417137 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Fri Jun 17 13:29:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 17 13:29:28.655611 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-994ce506-ee05-4f0a-871d-87626e576289 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:29:28.656667 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-994ce506-ee05-4f0a-871d-87626e576289 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:29:28.667061 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-994ce506-ee05-4f0a-871d-87626e576289 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:28.667580 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-994ce506-ee05-4f0a-871d-87626e576289 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:28.668466 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-994ce506-ee05-4f0a-871d-87626e576289 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:28.668970 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-994ce506-ee05-4f0a-871d-87626e576289 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:28.697303 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-8c0f20dd-8d65-41f4-a95c-779d9f811849 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:29:28.697904 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-8c0f20dd-8d65-41f4-a95c-779d9f811849 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:29:28.704849 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8c0f20dd-8d65-41f4-a95c-779d9f811849 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:28.705300 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8c0f20dd-8d65-41f4-a95c-779d9f811849 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:28.706057 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8c0f20dd-8d65-41f4-a95c-779d9f811849 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:28.706520 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8c0f20dd-8d65-41f4-a95c-779d9f811849 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:28.737326 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-994ce506-ee05-4f0a-871d-87626e576289 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:28.746133 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-994ce506-ee05-4f0a-871d-87626e576289 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:28.747716 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-994ce506-ee05-4f0a-871d-87626e576289 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:28.748850 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-994ce506-ee05-4f0a-871d-87626e576289 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.100958 Jun 17 13:29:28.749401 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1442/2916] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:29:28 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:29:28.773256 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-8c0f20dd-8d65-41f4-a95c-779d9f811849 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:28.781345 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-8c0f20dd-8d65-41f4-a95c-779d9f811849 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.088834 Jun 17 13:29:28.781897 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1475/2917] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:29:28 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:29:29.110599 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-5ce02350-d3df-4f65-9b43-d977cf49273c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:29:29.111463 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-5ce02350-d3df-4f65-9b43-d977cf49273c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:29:29.121544 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5ce02350-d3df-4f65-9b43-d977cf49273c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:29.122325 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5ce02350-d3df-4f65-9b43-d977cf49273c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:29.123504 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5ce02350-d3df-4f65-9b43-d977cf49273c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:29.124257 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5ce02350-d3df-4f65-9b43-d977cf49273c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:29.261838 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-5ce02350-d3df-4f65-9b43-d977cf49273c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:29.270685 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-5ce02350-d3df-4f65-9b43-d977cf49273c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.166948 Jun 17 13:29:29.271249 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1443/2918] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:29:29 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:29:29.771445 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-fdd7fb5d-7621-4ccf-b283-1dbaa8477458 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:29:29.772417 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-fdd7fb5d-7621-4ccf-b283-1dbaa8477458 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:29:29.780442 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-fdd7fb5d-7621-4ccf-b283-1dbaa8477458 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:29.780894 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-fdd7fb5d-7621-4ccf-b283-1dbaa8477458 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:29.781651 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-fdd7fb5d-7621-4ccf-b283-1dbaa8477458 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:29.782117 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-fdd7fb5d-7621-4ccf-b283-1dbaa8477458 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:29.798619 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-ace3a261-4188-438a-8be3-74dca1aeb1e1 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:29:29.799305 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-ace3a261-4188-438a-8be3-74dca1aeb1e1 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:29:29.806210 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ace3a261-4188-438a-8be3-74dca1aeb1e1 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:29.806653 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ace3a261-4188-438a-8be3-74dca1aeb1e1 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:29.807375 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ace3a261-4188-438a-8be3-74dca1aeb1e1 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:29.807833 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ace3a261-4188-438a-8be3-74dca1aeb1e1 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:29.855794 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-fdd7fb5d-7621-4ccf-b283-1dbaa8477458 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:29.864375 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-fdd7fb5d-7621-4ccf-b283-1dbaa8477458 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:29.865871 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-fdd7fb5d-7621-4ccf-b283-1dbaa8477458 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:29.867084 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-fdd7fb5d-7621-4ccf-b283-1dbaa8477458 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.102340 Jun 17 13:29:29.867660 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1476/2919] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:29:29 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:29:29.872534 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-ace3a261-4188-438a-8be3-74dca1aeb1e1 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:29.880678 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-ace3a261-4188-438a-8be3-74dca1aeb1e1 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.085984 Jun 17 13:29:29.881219 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1444/2920] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:29:29 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:29:30.292349 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-5094076b-efc9-49ba-9db1-e50054cfe593 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:29:30.293367 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-5094076b-efc9-49ba-9db1-e50054cfe593 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:29:30.303707 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-5094076b-efc9-49ba-9db1-e50054cfe593 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:30.304460 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-5094076b-efc9-49ba-9db1-e50054cfe593 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:30.305681 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-5094076b-efc9-49ba-9db1-e50054cfe593 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:30.305842 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-5094076b-efc9-49ba-9db1-e50054cfe593 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:30.447741 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-5094076b-efc9-49ba-9db1-e50054cfe593 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:30.455986 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-5094076b-efc9-49ba-9db1-e50054cfe593 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.170735 Jun 17 13:29:30.456547 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1477/2921] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:29:30 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:29:30.888463 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-e7c29709-fa18-4046-9c41-6eb35b14a289 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:29:30.889199 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-e7c29709-fa18-4046-9c41-6eb35b14a289 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:29:30.897753 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e7c29709-fa18-4046-9c41-6eb35b14a289 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:30.898375 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e7c29709-fa18-4046-9c41-6eb35b14a289 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:30.899434 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-9072ea27-617d-495f-a592-bc1d57262e63 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:29:30.900302 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e7c29709-fa18-4046-9c41-6eb35b14a289 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:30.900440 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-9072ea27-617d-495f-a592-bc1d57262e63 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:29:30.900652 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e7c29709-fa18-4046-9c41-6eb35b14a289 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:30.908655 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9072ea27-617d-495f-a592-bc1d57262e63 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:30.909244 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9072ea27-617d-495f-a592-bc1d57262e63 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:30.910200 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9072ea27-617d-495f-a592-bc1d57262e63 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:30.910737 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9072ea27-617d-495f-a592-bc1d57262e63 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:30.988046 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-e7c29709-fa18-4046-9c41-6eb35b14a289 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:30.990572 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-9072ea27-617d-495f-a592-bc1d57262e63 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:30.998792 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-e7c29709-fa18-4046-9c41-6eb35b14a289 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:30.999924 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-9072ea27-617d-495f-a592-bc1d57262e63 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.105367 Jun 17 13:29:31.000324 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-e7c29709-fa18-4046-9c41-6eb35b14a289 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:31.000487 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1478/2922] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:29:30 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:29:31.001827 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-e7c29709-fa18-4046-9c41-6eb35b14a289 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.118919 Jun 17 13:29:31.002430 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1445/2923] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:29:30 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:29:31.477450 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-4310c72c-5315-4c4a-bf64-8e84c2332efa tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:29:31.478171 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-4310c72c-5315-4c4a-bf64-8e84c2332efa tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:29:31.486038 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4310c72c-5315-4c4a-bf64-8e84c2332efa tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:31.486612 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4310c72c-5315-4c4a-bf64-8e84c2332efa tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:31.487500 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4310c72c-5315-4c4a-bf64-8e84c2332efa tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:31.488012 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4310c72c-5315-4c4a-bf64-8e84c2332efa tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:31.630880 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-4310c72c-5315-4c4a-bf64-8e84c2332efa tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:31.640742 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-4310c72c-5315-4c4a-bf64-8e84c2332efa tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.169847 Jun 17 13:29:31.641322 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1479/2924] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:29:31 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:29:32.021107 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-3e7832e7-c411-4117-b23d-5e3a0a1fd5de tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:29:32.022175 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-3e7832e7-c411-4117-b23d-5e3a0a1fd5de tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:29:32.026508 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-647ce8a6-a153-4187-85bf-fb6a7e349a7a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:29:32.026969 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-647ce8a6-a153-4187-85bf-fb6a7e349a7a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:29:32.029952 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3e7832e7-c411-4117-b23d-5e3a0a1fd5de tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:32.030436 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3e7832e7-c411-4117-b23d-5e3a0a1fd5de tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:32.031202 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3e7832e7-c411-4117-b23d-5e3a0a1fd5de tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:32.031629 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3e7832e7-c411-4117-b23d-5e3a0a1fd5de tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:32.033496 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-647ce8a6-a153-4187-85bf-fb6a7e349a7a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:32.033938 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-647ce8a6-a153-4187-85bf-fb6a7e349a7a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:32.034709 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-647ce8a6-a153-4187-85bf-fb6a7e349a7a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:32.035173 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-647ce8a6-a153-4187-85bf-fb6a7e349a7a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:32.120803 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-3e7832e7-c411-4117-b23d-5e3a0a1fd5de tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:32.123656 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-647ce8a6-a153-4187-85bf-fb6a7e349a7a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:32.129822 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-3e7832e7-c411-4117-b23d-5e3a0a1fd5de tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.115412 Jun 17 13:29:32.130463 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1446/2925] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:29:32 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:29:32.141912 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-647ce8a6-a153-4187-85bf-fb6a7e349a7a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:32.143450 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-647ce8a6-a153-4187-85bf-fb6a7e349a7a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:32.144648 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-647ce8a6-a153-4187-85bf-fb6a7e349a7a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.124449 Jun 17 13:29:32.145219 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1480/2926] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:29:32 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:29:32.662479 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-be378246-77e9-458a-a18f-a8d72363a1de tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:29:32.663551 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-be378246-77e9-458a-a18f-a8d72363a1de tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:29:32.674614 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-be378246-77e9-458a-a18f-a8d72363a1de tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:32.675367 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-be378246-77e9-458a-a18f-a8d72363a1de tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:32.676671 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-be378246-77e9-458a-a18f-a8d72363a1de tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:32.677396 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-be378246-77e9-458a-a18f-a8d72363a1de tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:32.820049 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-be378246-77e9-458a-a18f-a8d72363a1de tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:32.828218 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-be378246-77e9-458a-a18f-a8d72363a1de tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.172272 Jun 17 13:29:32.828780 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1447/2927] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:29:32 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:29:33.151198 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-e8761de1-087f-4f08-b3b8-1d8212aff842 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:29:33.152205 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-e8761de1-087f-4f08-b3b8-1d8212aff842 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:29:33.163422 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e8761de1-087f-4f08-b3b8-1d8212aff842 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:33.164118 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e8761de1-087f-4f08-b3b8-1d8212aff842 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:33.165196 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e8761de1-087f-4f08-b3b8-1d8212aff842 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:33.165650 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e8761de1-087f-4f08-b3b8-1d8212aff842 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:33.165934 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-5898f5fa-6921-46c5-bcf7-3a7027cdca95 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:29:33.166570 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-5898f5fa-6921-46c5-bcf7-3a7027cdca95 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:29:33.176768 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5898f5fa-6921-46c5-bcf7-3a7027cdca95 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:33.177485 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5898f5fa-6921-46c5-bcf7-3a7027cdca95 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:33.178746 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5898f5fa-6921-46c5-bcf7-3a7027cdca95 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:33.179453 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5898f5fa-6921-46c5-bcf7-3a7027cdca95 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:33.262392 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-e8761de1-087f-4f08-b3b8-1d8212aff842 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:33.270826 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-e8761de1-087f-4f08-b3b8-1d8212aff842 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.126162 Jun 17 13:29:33.271375 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1481/2928] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:29:33 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:29:33.278677 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-5898f5fa-6921-46c5-bcf7-3a7027cdca95 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:33.287429 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-5898f5fa-6921-46c5-bcf7-3a7027cdca95 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:33.288926 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-5898f5fa-6921-46c5-bcf7-3a7027cdca95 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:33.290078 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-5898f5fa-6921-46c5-bcf7-3a7027cdca95 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.130483 Jun 17 13:29:33.290679 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1448/2929] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:29:33 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:29:33.845799 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-98dfacda-5e21-4b86-9828-53ab4158ae13 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:29:33.846439 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-98dfacda-5e21-4b86-9828-53ab4158ae13 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:29:33.853190 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-98dfacda-5e21-4b86-9828-53ab4158ae13 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:33.853647 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-98dfacda-5e21-4b86-9828-53ab4158ae13 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:33.854856 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-98dfacda-5e21-4b86-9828-53ab4158ae13 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:33.855300 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-98dfacda-5e21-4b86-9828-53ab4158ae13 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:34.022488 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-98dfacda-5e21-4b86-9828-53ab4158ae13 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:34.031350 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-98dfacda-5e21-4b86-9828-53ab4158ae13 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.189447 Jun 17 13:29:34.031922 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1482/2930] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:29:33 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:29:34.293916 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-86256887-fa60-4e71-a029-14e466e45daa tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:29:34.294822 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-86256887-fa60-4e71-a029-14e466e45daa tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:29:34.306600 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-86256887-fa60-4e71-a029-14e466e45daa tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:34.307053 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-86256887-fa60-4e71-a029-14e466e45daa tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:34.307843 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-86256887-fa60-4e71-a029-14e466e45daa tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:34.308278 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-86256887-fa60-4e71-a029-14e466e45daa tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:34.314631 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-ba0f17ea-9594-4886-b8df-65c9e27966a4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:29:34.315247 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-ba0f17ea-9594-4886-b8df-65c9e27966a4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:29:34.322501 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ba0f17ea-9594-4886-b8df-65c9e27966a4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:34.322954 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ba0f17ea-9594-4886-b8df-65c9e27966a4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:34.323710 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ba0f17ea-9594-4886-b8df-65c9e27966a4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:34.324145 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ba0f17ea-9594-4886-b8df-65c9e27966a4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:34.383812 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-86256887-fa60-4e71-a029-14e466e45daa tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:34.392323 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-86256887-fa60-4e71-a029-14e466e45daa tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.106109 Jun 17 13:29:34.392929 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1449/2931] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:29:34 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:29:34.405823 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-ba0f17ea-9594-4886-b8df-65c9e27966a4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:34.415179 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-ba0f17ea-9594-4886-b8df-65c9e27966a4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:34.416701 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-ba0f17ea-9594-4886-b8df-65c9e27966a4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:34.417928 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-ba0f17ea-9594-4886-b8df-65c9e27966a4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.112148 Jun 17 13:29:34.418549 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1483/2932] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:29:34 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:29:35.053541 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-d2776ba1-461c-47df-9d68-d9a37bb25b4b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:29:35.054464 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-d2776ba1-461c-47df-9d68-d9a37bb25b4b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:29:35.061831 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d2776ba1-461c-47df-9d68-d9a37bb25b4b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:35.062334 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d2776ba1-461c-47df-9d68-d9a37bb25b4b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:35.063098 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d2776ba1-461c-47df-9d68-d9a37bb25b4b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:35.063524 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d2776ba1-461c-47df-9d68-d9a37bb25b4b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:35.198761 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-d2776ba1-461c-47df-9d68-d9a37bb25b4b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:35.207137 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-d2776ba1-461c-47df-9d68-d9a37bb25b4b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.160275 Jun 17 13:29:35.207714 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1450/2933] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:29:35 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:29:35.408957 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-9f73f79d-74c5-4bcb-abe9-10be619af712 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:29:35.409605 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-9f73f79d-74c5-4bcb-abe9-10be619af712 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:29:35.417094 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9f73f79d-74c5-4bcb-abe9-10be619af712 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:35.417526 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9f73f79d-74c5-4bcb-abe9-10be619af712 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:35.418355 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9f73f79d-74c5-4bcb-abe9-10be619af712 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:35.418801 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9f73f79d-74c5-4bcb-abe9-10be619af712 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:35.437272 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_cell1:SELECT=100 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:29:35.441394 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-6129202a-e255-4634-be74-b771c5e3ff63 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:29:35.442001 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-6129202a-e255-4634-be74-b771c5e3ff63 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:29:35.449130 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6129202a-e255-4634-be74-b771c5e3ff63 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:35.449573 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6129202a-e255-4634-be74-b771c5e3ff63 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:35.450390 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6129202a-e255-4634-be74-b771c5e3ff63 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:35.450988 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6129202a-e255-4634-be74-b771c5e3ff63 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:35.485914 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-9f73f79d-74c5-4bcb-abe9-10be619af712 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:35.495757 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-9f73f79d-74c5-4bcb-abe9-10be619af712 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.090699 Jun 17 13:29:35.496357 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1484/2934] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:29:35 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:29:35.519897 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-6129202a-e255-4634-be74-b771c5e3ff63 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:35.528609 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-6129202a-e255-4634-be74-b771c5e3ff63 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:35.530109 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-6129202a-e255-4634-be74-b771c5e3ff63 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:35.531273 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-6129202a-e255-4634-be74-b771c5e3ff63 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.094253 Jun 17 13:29:35.531798 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1451/2935] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:29:35 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:29:36.229580 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-128586e0-9ce5-4b7b-ad1f-47485350809b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:29:36.230632 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-128586e0-9ce5-4b7b-ad1f-47485350809b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:29:36.240818 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-128586e0-9ce5-4b7b-ad1f-47485350809b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:36.241563 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-128586e0-9ce5-4b7b-ad1f-47485350809b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:36.242919 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-128586e0-9ce5-4b7b-ad1f-47485350809b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:36.243374 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-128586e0-9ce5-4b7b-ad1f-47485350809b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:36.380413 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-128586e0-9ce5-4b7b-ad1f-47485350809b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:36.390275 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-128586e0-9ce5-4b7b-ad1f-47485350809b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.168082 Jun 17 13:29:36.390828 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1485/2936] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:29:36 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:29:36.517312 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-a501e6a1-1f33-4504-9b5b-61e1a892eba4 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:29:36.518413 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-a501e6a1-1f33-4504-9b5b-61e1a892eba4 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:29:36.527426 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a501e6a1-1f33-4504-9b5b-61e1a892eba4 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:36.527879 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a501e6a1-1f33-4504-9b5b-61e1a892eba4 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:36.528646 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a501e6a1-1f33-4504-9b5b-61e1a892eba4 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:36.529080 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a501e6a1-1f33-4504-9b5b-61e1a892eba4 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:36.548930 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-f572922b-270f-48b8-a25a-6a88689fcc48 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:29:36.549534 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-f572922b-270f-48b8-a25a-6a88689fcc48 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:29:36.556383 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f572922b-270f-48b8-a25a-6a88689fcc48 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:36.556973 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f572922b-270f-48b8-a25a-6a88689fcc48 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:36.557859 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f572922b-270f-48b8-a25a-6a88689fcc48 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:36.558301 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f572922b-270f-48b8-a25a-6a88689fcc48 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:36.597488 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-a501e6a1-1f33-4504-9b5b-61e1a892eba4 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:36.606577 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-a501e6a1-1f33-4504-9b5b-61e1a892eba4 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.095678 Jun 17 13:29:36.607412 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1452/2937] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:29:36 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:29:36.625417 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-f572922b-270f-48b8-a25a-6a88689fcc48 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:36.634473 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-f572922b-270f-48b8-a25a-6a88689fcc48 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:36.635976 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-f572922b-270f-48b8-a25a-6a88689fcc48 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:36.637117 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-f572922b-270f-48b8-a25a-6a88689fcc48 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.092127 Jun 17 13:29:36.637673 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1486/2938] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:29:36 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:29:37.411869 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-f04d2072-444a-4e12-8c3d-82a8e11dc0f5 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:29:37.412618 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-f04d2072-444a-4e12-8c3d-82a8e11dc0f5 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:29:37.419623 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f04d2072-444a-4e12-8c3d-82a8e11dc0f5 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:37.420079 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f04d2072-444a-4e12-8c3d-82a8e11dc0f5 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:37.420841 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f04d2072-444a-4e12-8c3d-82a8e11dc0f5 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:37.421267 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f04d2072-444a-4e12-8c3d-82a8e11dc0f5 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:37.556394 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-f04d2072-444a-4e12-8c3d-82a8e11dc0f5 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:37.564730 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-f04d2072-444a-4e12-8c3d-82a8e11dc0f5 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.157681 Jun 17 13:29:37.565294 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1453/2939] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:29:37 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:29:37.629813 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-2577f4c3-9fc9-470f-99a0-55f8e9d1df9e tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:29:37.630481 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-2577f4c3-9fc9-470f-99a0-55f8e9d1df9e tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:29:37.637628 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2577f4c3-9fc9-470f-99a0-55f8e9d1df9e tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:37.638072 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2577f4c3-9fc9-470f-99a0-55f8e9d1df9e tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:37.638837 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2577f4c3-9fc9-470f-99a0-55f8e9d1df9e tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:37.639265 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2577f4c3-9fc9-470f-99a0-55f8e9d1df9e tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:37.655281 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-dc0ab17e-6ee4-44a9-a211-e5db3af1d077 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:29:37.655895 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-dc0ab17e-6ee4-44a9-a211-e5db3af1d077 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:29:37.662217 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dc0ab17e-6ee4-44a9-a211-e5db3af1d077 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:37.662668 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dc0ab17e-6ee4-44a9-a211-e5db3af1d077 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:37.663450 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dc0ab17e-6ee4-44a9-a211-e5db3af1d077 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:37.663880 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dc0ab17e-6ee4-44a9-a211-e5db3af1d077 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:37.710700 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-2577f4c3-9fc9-470f-99a0-55f8e9d1df9e tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:37.719313 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-2577f4c3-9fc9-470f-99a0-55f8e9d1df9e tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.093388 Jun 17 13:29:37.719887 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1487/2940] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:29:37 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:29:37.727134 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-dc0ab17e-6ee4-44a9-a211-e5db3af1d077 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:37.736280 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-dc0ab17e-6ee4-44a9-a211-e5db3af1d077 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:37.737768 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-dc0ab17e-6ee4-44a9-a211-e5db3af1d077 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:37.738933 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-dc0ab17e-6ee4-44a9-a211-e5db3af1d077 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.087569 Jun 17 13:29:37.739445 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1454/2941] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:29:37 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:29:38.585346 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-dd96766b-c77f-410d-9f19-2a7695fb52ee tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:29:38.586538 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-dd96766b-c77f-410d-9f19-2a7695fb52ee tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:29:38.593106 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-dd96766b-c77f-410d-9f19-2a7695fb52ee tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:38.593562 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-dd96766b-c77f-410d-9f19-2a7695fb52ee tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:38.594349 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-dd96766b-c77f-410d-9f19-2a7695fb52ee tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:38.594777 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-dd96766b-c77f-410d-9f19-2a7695fb52ee tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:38.736738 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-240c27f2-f07b-45f9-8a47-1d92cf541dfd tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:29:38.737362 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-240c27f2-f07b-45f9-8a47-1d92cf541dfd tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:29:38.744565 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-240c27f2-f07b-45f9-8a47-1d92cf541dfd tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:38.745019 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-240c27f2-f07b-45f9-8a47-1d92cf541dfd tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:38.745788 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-240c27f2-f07b-45f9-8a47-1d92cf541dfd tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:38.746247 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-240c27f2-f07b-45f9-8a47-1d92cf541dfd tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:38.751330 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-dd96766b-c77f-410d-9f19-2a7695fb52ee tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:38.760007 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-dd96766b-c77f-410d-9f19-2a7695fb52ee tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.181139 Jun 17 13:29:38.760782 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1488/2942] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:29:38 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:29:38.765113 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-f78077ab-d84d-4a84-9f13-624a687e861f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:29:38.765702 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-f78077ab-d84d-4a84-9f13-624a687e861f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:29:38.772071 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f78077ab-d84d-4a84-9f13-624a687e861f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:38.772519 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f78077ab-d84d-4a84-9f13-624a687e861f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:38.773254 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f78077ab-d84d-4a84-9f13-624a687e861f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:38.773797 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f78077ab-d84d-4a84-9f13-624a687e861f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:38.810736 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-240c27f2-f07b-45f9-8a47-1d92cf541dfd tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:38.818835 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-240c27f2-f07b-45f9-8a47-1d92cf541dfd tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.086265 Jun 17 13:29:38.819395 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1455/2943] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:29:38 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:29:38.839077 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-f78077ab-d84d-4a84-9f13-624a687e861f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:38.847459 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-f78077ab-d84d-4a84-9f13-624a687e861f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:38.848945 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-f78077ab-d84d-4a84-9f13-624a687e861f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:38.850096 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-f78077ab-d84d-4a84-9f13-624a687e861f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.088549 Jun 17 13:29:38.850675 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1489/2944] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:29:38 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:29:39.781569 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-d2ce414a-67b3-4b0a-a052-2b2f812e821b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:29:39.782583 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-d2ce414a-67b3-4b0a-a052-2b2f812e821b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:29:39.792466 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d2ce414a-67b3-4b0a-a052-2b2f812e821b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:39.792915 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d2ce414a-67b3-4b0a-a052-2b2f812e821b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:39.793676 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d2ce414a-67b3-4b0a-a052-2b2f812e821b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:39.794299 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d2ce414a-67b3-4b0a-a052-2b2f812e821b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:39.835847 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-8664d881-5368-4b92-aeab-e108a344f365 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:29:39.837037 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-8664d881-5368-4b92-aeab-e108a344f365 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:29:39.843983 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8664d881-5368-4b92-aeab-e108a344f365 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:39.844431 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8664d881-5368-4b92-aeab-e108a344f365 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:39.845203 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8664d881-5368-4b92-aeab-e108a344f365 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:39.845635 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8664d881-5368-4b92-aeab-e108a344f365 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:39.915257 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-8664d881-5368-4b92-aeab-e108a344f365 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:39.923517 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-8664d881-5368-4b92-aeab-e108a344f365 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.091438 Jun 17 13:29:39.924068 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1490/2945] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:29:39 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:29:39.928621 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-ab2a6a5b-0893-4229-98c7-b40da86eb94e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:29:39.929220 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-ab2a6a5b-0893-4229-98c7-b40da86eb94e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:29:39.935404 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ab2a6a5b-0893-4229-98c7-b40da86eb94e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:39.935851 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ab2a6a5b-0893-4229-98c7-b40da86eb94e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:39.936581 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ab2a6a5b-0893-4229-98c7-b40da86eb94e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:39.937200 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ab2a6a5b-0893-4229-98c7-b40da86eb94e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:39.955127 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-d2ce414a-67b3-4b0a-a052-2b2f812e821b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:39.964321 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-d2ce414a-67b3-4b0a-a052-2b2f812e821b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.189207 Jun 17 13:29:39.964899 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1456/2946] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:29:39 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:29:39.999998 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-ab2a6a5b-0893-4229-98c7-b40da86eb94e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:40.008787 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-ab2a6a5b-0893-4229-98c7-b40da86eb94e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:40.010313 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-ab2a6a5b-0893-4229-98c7-b40da86eb94e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:40.011464 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-ab2a6a5b-0893-4229-98c7-b40da86eb94e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.086482 Jun 17 13:29:40.012024 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1491/2947] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:29:39 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:29:40.945382 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-3ae63b33-ea72-4470-abfd-895e16fd04eb tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:29:40.946914 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-3ae63b33-ea72-4470-abfd-895e16fd04eb tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:29:40.957416 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3ae63b33-ea72-4470-abfd-895e16fd04eb tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:40.958171 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3ae63b33-ea72-4470-abfd-895e16fd04eb tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:40.959453 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3ae63b33-ea72-4470-abfd-895e16fd04eb tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:40.960172 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3ae63b33-ea72-4470-abfd-895e16fd04eb tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:40.982461 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-27ffb722-de29-4aaa-a39a-2df2d9272994 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:29:40.983084 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-27ffb722-de29-4aaa-a39a-2df2d9272994 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:29:40.990052 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-27ffb722-de29-4aaa-a39a-2df2d9272994 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:40.990528 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-27ffb722-de29-4aaa-a39a-2df2d9272994 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:40.991278 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-27ffb722-de29-4aaa-a39a-2df2d9272994 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:40.991704 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-27ffb722-de29-4aaa-a39a-2df2d9272994 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:41.025032 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-3ae63b33-ea72-4470-abfd-895e16fd04eb tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:41.030369 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=100 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:29:41.036028 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-3ae63b33-ea72-4470-abfd-895e16fd04eb tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.096958 Jun 17 13:29:41.036612 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1457/2948] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:29:40 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:29:41.041304 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-9541c076-69cc-485d-b92f-9595b5f7cc4c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:29:41.041905 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-9541c076-69cc-485d-b92f-9595b5f7cc4c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:29:41.048396 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9541c076-69cc-485d-b92f-9595b5f7cc4c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:41.048838 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9541c076-69cc-485d-b92f-9595b5f7cc4c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:41.049592 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9541c076-69cc-485d-b92f-9595b5f7cc4c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:41.050020 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9541c076-69cc-485d-b92f-9595b5f7cc4c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:41.125532 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-9541c076-69cc-485d-b92f-9595b5f7cc4c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:41.134468 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-9541c076-69cc-485d-b92f-9595b5f7cc4c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:41.136028 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-9541c076-69cc-485d-b92f-9595b5f7cc4c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:41.137199 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-9541c076-69cc-485d-b92f-9595b5f7cc4c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.099648 Jun 17 13:29:41.137754 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1458/2949] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:29:41 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:29:41.149351 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-27ffb722-de29-4aaa-a39a-2df2d9272994 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:41.157790 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-27ffb722-de29-4aaa-a39a-2df2d9272994 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.179554 Jun 17 13:29:41.158416 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1492/2950] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:29:40 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:29:42.057200 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-d4f196b9-36f0-4bdb-b178-b2671e559cec tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:29:42.058060 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-d4f196b9-36f0-4bdb-b178-b2671e559cec tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:29:42.068755 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d4f196b9-36f0-4bdb-b178-b2671e559cec tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:42.069452 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d4f196b9-36f0-4bdb-b178-b2671e559cec tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:42.070838 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d4f196b9-36f0-4bdb-b178-b2671e559cec tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:42.071555 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d4f196b9-36f0-4bdb-b178-b2671e559cec tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:42.141316 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-d4f196b9-36f0-4bdb-b178-b2671e559cec tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:42.154919 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-d4f196b9-36f0-4bdb-b178-b2671e559cec tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.104120 Jun 17 13:29:42.155776 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1459/2951] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:29:42 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:29:42.159188 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-00a69c78-ae48-4ac3-8f5e-7d93f77ca970 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:29:42.160126 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-00a69c78-ae48-4ac3-8f5e-7d93f77ca970 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:29:42.167692 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-00a69c78-ae48-4ac3-8f5e-7d93f77ca970 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:42.168139 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-00a69c78-ae48-4ac3-8f5e-7d93f77ca970 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:42.168949 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-00a69c78-ae48-4ac3-8f5e-7d93f77ca970 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:42.169404 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-00a69c78-ae48-4ac3-8f5e-7d93f77ca970 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:42.174845 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-5b9acf1a-f27a-4315-a3fe-99b30595f364 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:29:42.175450 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-5b9acf1a-f27a-4315-a3fe-99b30595f364 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:29:42.181651 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5b9acf1a-f27a-4315-a3fe-99b30595f364 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:42.182127 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5b9acf1a-f27a-4315-a3fe-99b30595f364 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:42.182868 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5b9acf1a-f27a-4315-a3fe-99b30595f364 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:42.183286 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5b9acf1a-f27a-4315-a3fe-99b30595f364 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:42.241558 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-00a69c78-ae48-4ac3-8f5e-7d93f77ca970 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:42.250548 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-00a69c78-ae48-4ac3-8f5e-7d93f77ca970 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:42.252044 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-00a69c78-ae48-4ac3-8f5e-7d93f77ca970 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:42.253183 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-00a69c78-ae48-4ac3-8f5e-7d93f77ca970 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.100258 Jun 17 13:29:42.253789 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1493/2952] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:29:42 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:29:42.329974 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-5b9acf1a-f27a-4315-a3fe-99b30595f364 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:42.338317 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-5b9acf1a-f27a-4315-a3fe-99b30595f364 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.167138 Jun 17 13:29:42.338851 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1460/2953] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:29:42 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:29:43.178931 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-f6ac6f6c-53d8-4d5a-9ce1-1eeec8f28f10 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:29:43.179887 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-f6ac6f6c-53d8-4d5a-9ce1-1eeec8f28f10 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:29:43.187382 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f6ac6f6c-53d8-4d5a-9ce1-1eeec8f28f10 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:43.187821 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f6ac6f6c-53d8-4d5a-9ce1-1eeec8f28f10 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:43.188571 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f6ac6f6c-53d8-4d5a-9ce1-1eeec8f28f10 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:43.188992 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f6ac6f6c-53d8-4d5a-9ce1-1eeec8f28f10 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:43.255621 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-f6ac6f6c-53d8-4d5a-9ce1-1eeec8f28f10 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:43.264254 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-f6ac6f6c-53d8-4d5a-9ce1-1eeec8f28f10 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.091801 Jun 17 13:29:43.264874 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1494/2954] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:29:43 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:29:43.272495 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-ccd72afb-eddc-4629-85da-4e3db00d4753 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:29:43.273146 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-ccd72afb-eddc-4629-85da-4e3db00d4753 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:29:43.280250 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ccd72afb-eddc-4629-85da-4e3db00d4753 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:43.280719 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ccd72afb-eddc-4629-85da-4e3db00d4753 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:43.281473 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ccd72afb-eddc-4629-85da-4e3db00d4753 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:43.281903 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ccd72afb-eddc-4629-85da-4e3db00d4753 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:43.348108 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-ccd72afb-eddc-4629-85da-4e3db00d4753 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:43.355997 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-6cf29ca1-551e-4a2a-acb8-0bf314292201 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:29:43.356614 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-6cf29ca1-551e-4a2a-acb8-0bf314292201 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:29:43.357757 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-ccd72afb-eddc-4629-85da-4e3db00d4753 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:43.359307 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-ccd72afb-eddc-4629-85da-4e3db00d4753 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:43.360451 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-ccd72afb-eddc-4629-85da-4e3db00d4753 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.091981 Jun 17 13:29:43.360997 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1461/2955] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:29:43 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:29:43.362742 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6cf29ca1-551e-4a2a-acb8-0bf314292201 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:43.363199 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6cf29ca1-551e-4a2a-acb8-0bf314292201 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:43.363964 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6cf29ca1-551e-4a2a-acb8-0bf314292201 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:43.364409 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6cf29ca1-551e-4a2a-acb8-0bf314292201 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:43.502869 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-6cf29ca1-551e-4a2a-acb8-0bf314292201 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:43.511923 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-6cf29ca1-551e-4a2a-acb8-0bf314292201 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.160328 Jun 17 13:29:43.512501 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1495/2956] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:29:43 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:29:44.286394 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-406621c9-0cc9-47a5-a2a4-93f54317ccc4 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:29:44.287248 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-406621c9-0cc9-47a5-a2a4-93f54317ccc4 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:29:44.295529 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-406621c9-0cc9-47a5-a2a4-93f54317ccc4 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:44.295977 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-406621c9-0cc9-47a5-a2a4-93f54317ccc4 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:44.296739 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-406621c9-0cc9-47a5-a2a4-93f54317ccc4 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:44.297171 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-406621c9-0cc9-47a5-a2a4-93f54317ccc4 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:44.367546 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-406621c9-0cc9-47a5-a2a4-93f54317ccc4 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:44.376240 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-406621c9-0cc9-47a5-a2a4-93f54317ccc4 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.096530 Jun 17 13:29:44.376769 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1462/2957] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:29:44 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:29:44.378917 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-8e27be87-6a05-47a8-b55b-f32858b48299 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:29:44.379536 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-8e27be87-6a05-47a8-b55b-f32858b48299 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:29:44.386689 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8e27be87-6a05-47a8-b55b-f32858b48299 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:44.387146 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8e27be87-6a05-47a8-b55b-f32858b48299 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:44.387946 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8e27be87-6a05-47a8-b55b-f32858b48299 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:44.388382 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8e27be87-6a05-47a8-b55b-f32858b48299 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:44.452550 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-8e27be87-6a05-47a8-b55b-f32858b48299 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:44.461001 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-8e27be87-6a05-47a8-b55b-f32858b48299 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:44.462590 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-8e27be87-6a05-47a8-b55b-f32858b48299 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:44.463920 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-8e27be87-6a05-47a8-b55b-f32858b48299 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.089060 Jun 17 13:29:44.464485 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1496/2958] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:29:44 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:29:44.530646 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-84f0fca8-affc-4c8e-badb-4297342eb1c4 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:29:44.531408 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-84f0fca8-affc-4c8e-badb-4297342eb1c4 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:29:44.539488 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-84f0fca8-affc-4c8e-badb-4297342eb1c4 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:44.540003 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-84f0fca8-affc-4c8e-badb-4297342eb1c4 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:44.541144 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-84f0fca8-affc-4c8e-badb-4297342eb1c4 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:44.541716 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-84f0fca8-affc-4c8e-badb-4297342eb1c4 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:44.679535 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-84f0fca8-affc-4c8e-badb-4297342eb1c4 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:44.687866 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-84f0fca8-affc-4c8e-badb-4297342eb1c4 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.162409 Jun 17 13:29:44.688425 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1463/2959] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:29:44 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:29:45.393972 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-040605de-5db1-4685-ad84-c80730074f28 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:29:45.394642 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-040605de-5db1-4685-ad84-c80730074f28 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:29:45.401542 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-040605de-5db1-4685-ad84-c80730074f28 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:45.401992 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-040605de-5db1-4685-ad84-c80730074f28 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:45.402994 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-040605de-5db1-4685-ad84-c80730074f28 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:45.403430 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-040605de-5db1-4685-ad84-c80730074f28 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:45.475276 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-040605de-5db1-4685-ad84-c80730074f28 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:45.482775 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-20507743-a235-4df5-9b7c-58564ae52e9f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:29:45.483466 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-20507743-a235-4df5-9b7c-58564ae52e9f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:29:45.483879 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-040605de-5db1-4685-ad84-c80730074f28 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.093774 Jun 17 13:29:45.484451 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1497/2960] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:29:45 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:29:45.490575 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-20507743-a235-4df5-9b7c-58564ae52e9f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:45.491049 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-20507743-a235-4df5-9b7c-58564ae52e9f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:45.491809 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-20507743-a235-4df5-9b7c-58564ae52e9f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:45.492238 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-20507743-a235-4df5-9b7c-58564ae52e9f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:45.554835 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-20507743-a235-4df5-9b7c-58564ae52e9f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:45.563813 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-20507743-a235-4df5-9b7c-58564ae52e9f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:45.565227 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-20507743-a235-4df5-9b7c-58564ae52e9f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:45.566397 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-20507743-a235-4df5-9b7c-58564ae52e9f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.088065 Jun 17 13:29:45.566954 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1464/2961] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:29:45 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:29:45.709738 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-44fc854a-b0af-4403-8b57-50e5b2c220af tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:29:45.710792 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-44fc854a-b0af-4403-8b57-50e5b2c220af tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:29:45.721085 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-44fc854a-b0af-4403-8b57-50e5b2c220af tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:45.721828 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-44fc854a-b0af-4403-8b57-50e5b2c220af tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:45.723144 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-44fc854a-b0af-4403-8b57-50e5b2c220af tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:45.723964 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-44fc854a-b0af-4403-8b57-50e5b2c220af tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:45.861444 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-44fc854a-b0af-4403-8b57-50e5b2c220af tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:45.874642 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-44fc854a-b0af-4403-8b57-50e5b2c220af tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.170987 Jun 17 13:29:45.875405 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1498/2962] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:29:45 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:29:46.504536 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-5ffd34c1-c881-457c-a9db-189fca658dd5 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:29:46.505576 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-5ffd34c1-c881-457c-a9db-189fca658dd5 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:29:46.509492 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_api:SELECT=78 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:29:46.515048 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5ffd34c1-c881-457c-a9db-189fca658dd5 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:46.515510 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5ffd34c1-c881-457c-a9db-189fca658dd5 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:46.516265 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5ffd34c1-c881-457c-a9db-189fca658dd5 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:46.516699 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5ffd34c1-c881-457c-a9db-189fca658dd5 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:46.584813 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-abcbfe1b-8367-4d57-86cb-6a8a1af2b713 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:29:46.585409 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-abcbfe1b-8367-4d57-86cb-6a8a1af2b713 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:29:46.590654 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-5ffd34c1-c881-457c-a9db-189fca658dd5 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:46.592236 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-abcbfe1b-8367-4d57-86cb-6a8a1af2b713 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:46.592688 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-abcbfe1b-8367-4d57-86cb-6a8a1af2b713 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:46.593445 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-abcbfe1b-8367-4d57-86cb-6a8a1af2b713 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:46.593882 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-abcbfe1b-8367-4d57-86cb-6a8a1af2b713 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:46.599209 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-5ffd34c1-c881-457c-a9db-189fca658dd5 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.101307 Jun 17 13:29:46.599779 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1465/2963] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:29:46 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:29:46.656936 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-abcbfe1b-8367-4d57-86cb-6a8a1af2b713 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:46.665331 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-abcbfe1b-8367-4d57-86cb-6a8a1af2b713 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:46.666891 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-abcbfe1b-8367-4d57-86cb-6a8a1af2b713 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:46.668017 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-abcbfe1b-8367-4d57-86cb-6a8a1af2b713 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.087242 Jun 17 13:29:46.668850 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1499/2964] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:29:46 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 13:29:46.899673 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-7ec6c7c7-0aa4-44a3-aed6-9caef9a9fdfc tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:29:46.900718 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-7ec6c7c7-0aa4-44a3-aed6-9caef9a9fdfc tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:29:46.907409 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7ec6c7c7-0aa4-44a3-aed6-9caef9a9fdfc tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:46.907857 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7ec6c7c7-0aa4-44a3-aed6-9caef9a9fdfc tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:46.908639 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7ec6c7c7-0aa4-44a3-aed6-9caef9a9fdfc tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:46.909069 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7ec6c7c7-0aa4-44a3-aed6-9caef9a9fdfc tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:47.055032 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-7ec6c7c7-0aa4-44a3-aed6-9caef9a9fdfc tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:47.067406 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-7ec6c7c7-0aa4-44a3-aed6-9caef9a9fdfc tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.174067 Jun 17 13:29:47.068190 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1466/2965] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:29:46 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:29:47.620223 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-65b23741-89a1-427e-a486-8e884f254fd9 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:29:47.620840 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-65b23741-89a1-427e-a486-8e884f254fd9 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:29:47.627825 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-65b23741-89a1-427e-a486-8e884f254fd9 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:47.628278 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-65b23741-89a1-427e-a486-8e884f254fd9 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:47.629033 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-65b23741-89a1-427e-a486-8e884f254fd9 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:47.629472 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-65b23741-89a1-427e-a486-8e884f254fd9 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:47.687054 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-3556ef25-903a-4de6-be2a-41f760c6fa45 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:29:47.687664 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-3556ef25-903a-4de6-be2a-41f760c6fa45 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:29:47.694367 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3556ef25-903a-4de6-be2a-41f760c6fa45 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:47.694828 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3556ef25-903a-4de6-be2a-41f760c6fa45 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:47.695620 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3556ef25-903a-4de6-be2a-41f760c6fa45 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:47.696046 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3556ef25-903a-4de6-be2a-41f760c6fa45 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:47.697855 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-65b23741-89a1-427e-a486-8e884f254fd9 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:47.706533 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-65b23741-89a1-427e-a486-8e884f254fd9 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.092978 Jun 17 13:29:47.707090 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1500/2966] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:29:47 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:29:47.764721 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-3556ef25-903a-4de6-be2a-41f760c6fa45 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:47.777171 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-3556ef25-903a-4de6-be2a-41f760c6fa45 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:47.779534 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-3556ef25-903a-4de6-be2a-41f760c6fa45 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:47.781198 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-3556ef25-903a-4de6-be2a-41f760c6fa45 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.097997 Jun 17 13:29:47.782054 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1467/2967] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:29:47 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:29:48.090513 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-0eca4770-ce61-4479-a6df-8717c1bae68f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:29:48.091585 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-0eca4770-ce61-4479-a6df-8717c1bae68f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:29:48.100130 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0eca4770-ce61-4479-a6df-8717c1bae68f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:48.100716 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0eca4770-ce61-4479-a6df-8717c1bae68f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:48.101885 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0eca4770-ce61-4479-a6df-8717c1bae68f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:48.102749 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0eca4770-ce61-4479-a6df-8717c1bae68f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:48.110740 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_cell1:SELECT=100 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:29:48.264448 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-0eca4770-ce61-4479-a6df-8717c1bae68f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:48.272555 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-0eca4770-ce61-4479-a6df-8717c1bae68f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.187534 Jun 17 13:29:48.273126 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1501/2968] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:29:48 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:29:48.729071 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-8e190579-9e83-4100-b8d6-26514f35f39d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:29:48.730045 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-8e190579-9e83-4100-b8d6-26514f35f39d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:29:48.737033 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8e190579-9e83-4100-b8d6-26514f35f39d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:48.737478 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8e190579-9e83-4100-b8d6-26514f35f39d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:48.738269 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8e190579-9e83-4100-b8d6-26514f35f39d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:48.738704 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8e190579-9e83-4100-b8d6-26514f35f39d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:48.799455 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-687b5a52-651b-4506-9c4a-9a49f5d2878a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:29:48.800050 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-687b5a52-651b-4506-9c4a-9a49f5d2878a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:29:48.804536 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-8e190579-9e83-4100-b8d6-26514f35f39d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:48.806871 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-687b5a52-651b-4506-9c4a-9a49f5d2878a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:48.807217 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-687b5a52-651b-4506-9c4a-9a49f5d2878a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:48.807946 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-687b5a52-651b-4506-9c4a-9a49f5d2878a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:48.808403 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-687b5a52-651b-4506-9c4a-9a49f5d2878a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:48.812697 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-8e190579-9e83-4100-b8d6-26514f35f39d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.089691 Jun 17 13:29:48.813268 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1468/2969] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:29:48 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:29:48.869882 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-687b5a52-651b-4506-9c4a-9a49f5d2878a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:48.879837 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-687b5a52-651b-4506-9c4a-9a49f5d2878a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:48.881323 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-687b5a52-651b-4506-9c4a-9a49f5d2878a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:48.882478 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-687b5a52-651b-4506-9c4a-9a49f5d2878a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.086890 Jun 17 13:29:48.883056 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1502/2970] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:29:48 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:29:49.292723 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-d3a29b31-6a66-4551-8324-dec58696289d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:29:49.293252 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-d3a29b31-6a66-4551-8324-dec58696289d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:29:49.300272 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d3a29b31-6a66-4551-8324-dec58696289d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:49.300704 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d3a29b31-6a66-4551-8324-dec58696289d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:49.301489 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d3a29b31-6a66-4551-8324-dec58696289d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:49.301925 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d3a29b31-6a66-4551-8324-dec58696289d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:49.447228 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-d3a29b31-6a66-4551-8324-dec58696289d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:49.455358 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-d3a29b31-6a66-4551-8324-dec58696289d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.168129 Jun 17 13:29:49.455932 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1469/2971] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:29:49 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:29:49.833614 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-d9d6843b-8bbc-4881-b9b6-483474758db1 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:29:49.834853 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-d9d6843b-8bbc-4881-b9b6-483474758db1 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:29:49.842752 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d9d6843b-8bbc-4881-b9b6-483474758db1 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:49.843177 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d9d6843b-8bbc-4881-b9b6-483474758db1 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:49.843925 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d9d6843b-8bbc-4881-b9b6-483474758db1 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:49.844362 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d9d6843b-8bbc-4881-b9b6-483474758db1 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:49.900545 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-2eb8ddb0-6ced-4828-a5df-05719fa7dae6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:29:49.901163 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-2eb8ddb0-6ced-4828-a5df-05719fa7dae6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:29:49.907194 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-d9d6843b-8bbc-4881-b9b6-483474758db1 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:49.907432 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2eb8ddb0-6ced-4828-a5df-05719fa7dae6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:49.907893 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2eb8ddb0-6ced-4828-a5df-05719fa7dae6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:49.908650 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2eb8ddb0-6ced-4828-a5df-05719fa7dae6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:49.909075 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2eb8ddb0-6ced-4828-a5df-05719fa7dae6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:49.915529 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-d9d6843b-8bbc-4881-b9b6-483474758db1 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.088337 Jun 17 13:29:49.916116 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1503/2972] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:29:49 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:29:49.971386 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-2eb8ddb0-6ced-4828-a5df-05719fa7dae6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:49.980554 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-2eb8ddb0-6ced-4828-a5df-05719fa7dae6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:49.982042 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-2eb8ddb0-6ced-4828-a5df-05719fa7dae6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:49.983204 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-2eb8ddb0-6ced-4828-a5df-05719fa7dae6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.086651 Jun 17 13:29:49.983761 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1470/2973] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:29:49 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 13:29:50.476554 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-17d5c09d-53a1-4aa9-8ed9-5097bc38951e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:29:50.477566 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-17d5c09d-53a1-4aa9-8ed9-5097bc38951e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:29:50.488300 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-17d5c09d-53a1-4aa9-8ed9-5097bc38951e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:50.489073 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-17d5c09d-53a1-4aa9-8ed9-5097bc38951e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:50.490376 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-17d5c09d-53a1-4aa9-8ed9-5097bc38951e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:50.491081 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-17d5c09d-53a1-4aa9-8ed9-5097bc38951e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:50.652088 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-17d5c09d-53a1-4aa9-8ed9-5097bc38951e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:50.660530 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-17d5c09d-53a1-4aa9-8ed9-5097bc38951e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.190406 Jun 17 13:29:50.661109 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1504/2974] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:29:50 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:29:50.937756 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-cd33a6e6-ae7a-4bf8-9245-69ce390c43b3 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:29:50.938777 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-cd33a6e6-ae7a-4bf8-9245-69ce390c43b3 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:29:50.948144 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cd33a6e6-ae7a-4bf8-9245-69ce390c43b3 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:50.948588 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cd33a6e6-ae7a-4bf8-9245-69ce390c43b3 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:50.949356 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cd33a6e6-ae7a-4bf8-9245-69ce390c43b3 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:50.949784 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cd33a6e6-ae7a-4bf8-9245-69ce390c43b3 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:51.004987 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-51e2c273-ef87-495b-baa3-487896beaa04 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:29:51.005593 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-51e2c273-ef87-495b-baa3-487896beaa04 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:29:51.012505 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-51e2c273-ef87-495b-baa3-487896beaa04 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:51.012955 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-51e2c273-ef87-495b-baa3-487896beaa04 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:51.013711 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-51e2c273-ef87-495b-baa3-487896beaa04 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:51.014172 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-51e2c273-ef87-495b-baa3-487896beaa04 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:51.020206 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-cd33a6e6-ae7a-4bf8-9245-69ce390c43b3 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:51.028280 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-cd33a6e6-ae7a-4bf8-9245-69ce390c43b3 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.097872 Jun 17 13:29:51.028854 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1471/2975] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:29:50 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:29:51.077346 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-51e2c273-ef87-495b-baa3-487896beaa04 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:51.086010 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-51e2c273-ef87-495b-baa3-487896beaa04 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:51.088194 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-51e2c273-ef87-495b-baa3-487896beaa04 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:51.089351 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-51e2c273-ef87-495b-baa3-487896beaa04 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.088280 Jun 17 13:29:51.089911 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1505/2976] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:29:50 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:29:51.680590 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-a2f7c585-be3b-4c4d-9736-7946c960ff89 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:29:51.681584 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-a2f7c585-be3b-4c4d-9736-7946c960ff89 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:29:51.690300 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a2f7c585-be3b-4c4d-9736-7946c960ff89 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:51.690908 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a2f7c585-be3b-4c4d-9736-7946c960ff89 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:51.691891 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a2f7c585-be3b-4c4d-9736-7946c960ff89 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:51.692580 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a2f7c585-be3b-4c4d-9736-7946c960ff89 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:51.828463 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-a2f7c585-be3b-4c4d-9736-7946c960ff89 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:51.836756 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-a2f7c585-be3b-4c4d-9736-7946c960ff89 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.161471 Jun 17 13:29:51.837317 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1472/2977] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:29:51 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:29:52.046966 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-e995437f-cb99-4edc-b6ad-8b86c95f7bb8 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:29:52.047681 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-e995437f-cb99-4edc-b6ad-8b86c95f7bb8 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:29:52.055246 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e995437f-cb99-4edc-b6ad-8b86c95f7bb8 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:52.055815 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e995437f-cb99-4edc-b6ad-8b86c95f7bb8 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:52.057063 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e995437f-cb99-4edc-b6ad-8b86c95f7bb8 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:52.057493 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e995437f-cb99-4edc-b6ad-8b86c95f7bb8 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:52.109814 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-714cf56a-c57e-4c78-9831-3d2caed76a7d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:29:52.110560 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-714cf56a-c57e-4c78-9831-3d2caed76a7d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:29:52.119923 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-714cf56a-c57e-4c78-9831-3d2caed76a7d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:52.120453 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-714cf56a-c57e-4c78-9831-3d2caed76a7d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:52.121287 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-714cf56a-c57e-4c78-9831-3d2caed76a7d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:52.121816 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-714cf56a-c57e-4c78-9831-3d2caed76a7d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:52.129105 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-e995437f-cb99-4edc-b6ad-8b86c95f7bb8 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:52.137123 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-e995437f-cb99-4edc-b6ad-8b86c95f7bb8 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.095261 Jun 17 13:29:52.137698 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1506/2978] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:29:52 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:29:52.187384 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-714cf56a-c57e-4c78-9831-3d2caed76a7d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:52.196130 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-714cf56a-c57e-4c78-9831-3d2caed76a7d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:52.198294 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-714cf56a-c57e-4c78-9831-3d2caed76a7d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:52.198896 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-714cf56a-c57e-4c78-9831-3d2caed76a7d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.094691 Jun 17 13:29:52.199313 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1473/2979] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:29:52 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:29:52.855727 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-b261dfb1-fa4f-4d48-83f8-7861210d3789 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:29:52.856306 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-b261dfb1-fa4f-4d48-83f8-7861210d3789 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:29:52.863571 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b261dfb1-fa4f-4d48-83f8-7861210d3789 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:52.864074 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b261dfb1-fa4f-4d48-83f8-7861210d3789 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:52.864906 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b261dfb1-fa4f-4d48-83f8-7861210d3789 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:52.865383 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b261dfb1-fa4f-4d48-83f8-7861210d3789 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:53.006285 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-b261dfb1-fa4f-4d48-83f8-7861210d3789 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:53.015715 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-b261dfb1-fa4f-4d48-83f8-7861210d3789 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.164777 Jun 17 13:29:53.016295 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1507/2980] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:29:52 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:29:53.158855 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-4190fa9f-b844-48a9-97ca-b6569e652a9d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:29:53.159862 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-4190fa9f-b844-48a9-97ca-b6569e652a9d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:29:53.169100 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4190fa9f-b844-48a9-97ca-b6569e652a9d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:53.169540 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4190fa9f-b844-48a9-97ca-b6569e652a9d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:53.170323 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4190fa9f-b844-48a9-97ca-b6569e652a9d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:53.170750 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4190fa9f-b844-48a9-97ca-b6569e652a9d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:53.188695 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=100 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:29:53.217145 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-06c89b61-9ac3-460f-a02e-c7d8085f5079 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:29:53.217760 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-06c89b61-9ac3-460f-a02e-c7d8085f5079 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:29:53.224453 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-06c89b61-9ac3-460f-a02e-c7d8085f5079 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:53.224895 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-06c89b61-9ac3-460f-a02e-c7d8085f5079 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:53.225642 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-06c89b61-9ac3-460f-a02e-c7d8085f5079 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:53.226039 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-06c89b61-9ac3-460f-a02e-c7d8085f5079 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:53.233465 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-4190fa9f-b844-48a9-97ca-b6569e652a9d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:53.241327 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-4190fa9f-b844-48a9-97ca-b6569e652a9d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.088932 Jun 17 13:29:53.242227 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1474/2981] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:29:53 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:29:53.292219 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-06c89b61-9ac3-460f-a02e-c7d8085f5079 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:53.300772 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-06c89b61-9ac3-460f-a02e-c7d8085f5079 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:53.302331 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-06c89b61-9ac3-460f-a02e-c7d8085f5079 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:53.303486 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-06c89b61-9ac3-460f-a02e-c7d8085f5079 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.090315 Jun 17 13:29:53.304070 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1508/2982] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:29:53 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:29:54.036819 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-26d270dd-0180-4935-9fc8-24d56ac74336 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:29:54.037810 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-26d270dd-0180-4935-9fc8-24d56ac74336 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:29:54.045393 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-26d270dd-0180-4935-9fc8-24d56ac74336 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:54.045843 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-26d270dd-0180-4935-9fc8-24d56ac74336 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:54.046637 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-26d270dd-0180-4935-9fc8-24d56ac74336 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:54.047086 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-26d270dd-0180-4935-9fc8-24d56ac74336 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:54.178665 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-26d270dd-0180-4935-9fc8-24d56ac74336 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:54.187408 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-26d270dd-0180-4935-9fc8-24d56ac74336 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.157038 Jun 17 13:29:54.187945 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1475/2983] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:29:54 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:29:54.263258 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-d192e375-6d0f-4cbb-adf8-8b1218fd642d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:29:54.264323 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-d192e375-6d0f-4cbb-adf8-8b1218fd642d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:29:54.275736 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d192e375-6d0f-4cbb-adf8-8b1218fd642d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:54.276196 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d192e375-6d0f-4cbb-adf8-8b1218fd642d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:54.276964 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d192e375-6d0f-4cbb-adf8-8b1218fd642d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:54.277402 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d192e375-6d0f-4cbb-adf8-8b1218fd642d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:54.322594 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-8dd76f26-a34c-4d8c-9f1e-3877810f0c63 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:29:54.323550 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-8dd76f26-a34c-4d8c-9f1e-3877810f0c63 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:29:54.332873 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8dd76f26-a34c-4d8c-9f1e-3877810f0c63 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:54.333556 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8dd76f26-a34c-4d8c-9f1e-3877810f0c63 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:54.334802 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8dd76f26-a34c-4d8c-9f1e-3877810f0c63 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:54.335534 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8dd76f26-a34c-4d8c-9f1e-3877810f0c63 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:54.347239 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-d192e375-6d0f-4cbb-adf8-8b1218fd642d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:54.356404 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-d192e375-6d0f-4cbb-adf8-8b1218fd642d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.099938 Jun 17 13:29:54.356977 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1509/2984] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:29:54 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:29:54.398774 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-8dd76f26-a34c-4d8c-9f1e-3877810f0c63 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:54.407801 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-8dd76f26-a34c-4d8c-9f1e-3877810f0c63 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:54.409305 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-8dd76f26-a34c-4d8c-9f1e-3877810f0c63 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:54.410488 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-8dd76f26-a34c-4d8c-9f1e-3877810f0c63 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.093182 Jun 17 13:29:54.411047 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1476/2985] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:29:54 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:29:55.208447 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-d53b2710-e933-483f-b60c-33826ddbb976 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:29:55.209445 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-d53b2710-e933-483f-b60c-33826ddbb976 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:29:55.217393 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d53b2710-e933-483f-b60c-33826ddbb976 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:55.217850 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d53b2710-e933-483f-b60c-33826ddbb976 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:55.218637 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d53b2710-e933-483f-b60c-33826ddbb976 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:55.219073 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d53b2710-e933-483f-b60c-33826ddbb976 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:55.361670 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-d53b2710-e933-483f-b60c-33826ddbb976 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:55.372484 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-d53b2710-e933-483f-b60c-33826ddbb976 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.170468 Jun 17 13:29:55.373065 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1510/2986] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:29:55 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:29:55.374339 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-e0fabecf-27b4-445c-923e-864607a4a865 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:29:55.374968 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-e0fabecf-27b4-445c-923e-864607a4a865 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:29:55.381652 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e0fabecf-27b4-445c-923e-864607a4a865 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:55.382107 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e0fabecf-27b4-445c-923e-864607a4a865 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:55.382875 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e0fabecf-27b4-445c-923e-864607a4a865 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:55.383309 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e0fabecf-27b4-445c-923e-864607a4a865 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:55.428922 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-13e50603-b122-49b4-a841-084df9572d0e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:29:55.429555 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-13e50603-b122-49b4-a841-084df9572d0e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:29:55.431589 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_api:SELECT=82 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:29:55.437737 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-13e50603-b122-49b4-a841-084df9572d0e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:55.438201 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-13e50603-b122-49b4-a841-084df9572d0e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:55.438992 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-13e50603-b122-49b4-a841-084df9572d0e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:55.439418 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-13e50603-b122-49b4-a841-084df9572d0e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:55.448420 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-e0fabecf-27b4-445c-923e-864607a4a865 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:55.456877 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-e0fabecf-27b4-445c-923e-864607a4a865 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.086301 Jun 17 13:29:55.457031 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1477/2987] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:29:55 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:29:55.503619 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-13e50603-b122-49b4-a841-084df9572d0e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:55.514205 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-13e50603-b122-49b4-a841-084df9572d0e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:55.515702 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-13e50603-b122-49b4-a841-084df9572d0e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:55.516844 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-13e50603-b122-49b4-a841-084df9572d0e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.091922 Jun 17 13:29:55.517444 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1511/2988] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:29:55 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:29:56.394901 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-604335ae-6065-4874-845f-58570f0709bd tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:29:56.395936 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-604335ae-6065-4874-845f-58570f0709bd tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:29:56.405095 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-604335ae-6065-4874-845f-58570f0709bd tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:56.405546 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-604335ae-6065-4874-845f-58570f0709bd tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:56.406360 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-604335ae-6065-4874-845f-58570f0709bd tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:56.406793 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-604335ae-6065-4874-845f-58570f0709bd tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:56.473512 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-71adac8c-b6a4-4c67-91c8-50daf53aa566 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:29:56.474166 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-71adac8c-b6a4-4c67-91c8-50daf53aa566 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:29:56.482001 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-71adac8c-b6a4-4c67-91c8-50daf53aa566 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:56.482504 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-71adac8c-b6a4-4c67-91c8-50daf53aa566 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:56.483263 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-71adac8c-b6a4-4c67-91c8-50daf53aa566 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:56.483703 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-71adac8c-b6a4-4c67-91c8-50daf53aa566 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:56.557888 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-71adac8c-b6a4-4c67-91c8-50daf53aa566 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:56.561751 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-604335ae-6065-4874-845f-58570f0709bd tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:56.566364 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-71adac8c-b6a4-4c67-91c8-50daf53aa566 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.096592 Jun 17 13:29:56.567094 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1512/2989] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:29:56 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 13:29:56.570469 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-604335ae-6065-4874-845f-58570f0709bd tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.182120 Jun 17 13:29:56.571284 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1478/2990] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:29:56 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:29:56.571446 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-e44ff271-f6eb-4e3c-a2c8-9843a038e3c4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:29:56.572098 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-e44ff271-f6eb-4e3c-a2c8-9843a038e3c4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:29:56.578174 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e44ff271-f6eb-4e3c-a2c8-9843a038e3c4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:56.578619 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e44ff271-f6eb-4e3c-a2c8-9843a038e3c4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:56.579368 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e44ff271-f6eb-4e3c-a2c8-9843a038e3c4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:56.579800 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e44ff271-f6eb-4e3c-a2c8-9843a038e3c4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:56.644854 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-e44ff271-f6eb-4e3c-a2c8-9843a038e3c4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:56.653399 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-e44ff271-f6eb-4e3c-a2c8-9843a038e3c4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:56.654927 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-e44ff271-f6eb-4e3c-a2c8-9843a038e3c4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:56.656032 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-e44ff271-f6eb-4e3c-a2c8-9843a038e3c4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.088260 Jun 17 13:29:56.656627 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1513/2991] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:29:56 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:29:57.589906 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-43e126f7-c166-48c2-9927-7684446bde1c tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:29:57.590837 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-43e126f7-c166-48c2-9927-7684446bde1c tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:29:57.591081 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-51e9df93-5bb7-4da4-8e30-e0ce30edb27a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:29:57.592117 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-51e9df93-5bb7-4da4-8e30-e0ce30edb27a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:29:57.600951 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-43e126f7-c166-48c2-9927-7684446bde1c tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:57.601698 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-43e126f7-c166-48c2-9927-7684446bde1c tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:57.603446 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-43e126f7-c166-48c2-9927-7684446bde1c tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:57.603623 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-51e9df93-5bb7-4da4-8e30-e0ce30edb27a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:57.603750 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-43e126f7-c166-48c2-9927-7684446bde1c tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:57.603857 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-51e9df93-5bb7-4da4-8e30-e0ce30edb27a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:57.604719 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-51e9df93-5bb7-4da4-8e30-e0ce30edb27a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:57.605154 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-51e9df93-5bb7-4da4-8e30-e0ce30edb27a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:57.688143 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-43e126f7-c166-48c2-9927-7684446bde1c tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:57.696219 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-43e126f7-c166-48c2-9927-7684446bde1c tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.114128 Jun 17 13:29:57.696903 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1479/2992] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:29:57 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:29:57.701509 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-0427fd06-cd55-40c9-bbd2-5aa00befcf76 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:29:57.702126 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-0427fd06-cd55-40c9-bbd2-5aa00befcf76 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:29:57.708310 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0427fd06-cd55-40c9-bbd2-5aa00befcf76 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:57.708749 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0427fd06-cd55-40c9-bbd2-5aa00befcf76 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:57.709494 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0427fd06-cd55-40c9-bbd2-5aa00befcf76 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:57.709918 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0427fd06-cd55-40c9-bbd2-5aa00befcf76 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:57.768532 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-51e9df93-5bb7-4da4-8e30-e0ce30edb27a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:57.776837 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-51e9df93-5bb7-4da4-8e30-e0ce30edb27a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.192033 Jun 17 13:29:57.777376 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1514/2993] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:29:57 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:29:57.784375 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-0427fd06-cd55-40c9-bbd2-5aa00befcf76 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:57.793438 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-0427fd06-cd55-40c9-bbd2-5aa00befcf76 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:57.794952 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-0427fd06-cd55-40c9-bbd2-5aa00befcf76 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:57.796087 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-0427fd06-cd55-40c9-bbd2-5aa00befcf76 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.098237 Jun 17 13:29:57.796611 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1480/2994] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:29:57 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:29:58.717832 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-6eb2459d-8dfb-404a-9144-1eb2b9bf0fdc tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:29:58.719010 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-6eb2459d-8dfb-404a-9144-1eb2b9bf0fdc tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:29:58.730617 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6eb2459d-8dfb-404a-9144-1eb2b9bf0fdc tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:58.731382 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6eb2459d-8dfb-404a-9144-1eb2b9bf0fdc tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:58.732682 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6eb2459d-8dfb-404a-9144-1eb2b9bf0fdc tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:58.733373 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6eb2459d-8dfb-404a-9144-1eb2b9bf0fdc tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:58.794069 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-7b69d880-f6d9-4d28-8df1-58e6202f20df tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:29:58.794766 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-7b69d880-f6d9-4d28-8df1-58e6202f20df tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:29:58.801661 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7b69d880-f6d9-4d28-8df1-58e6202f20df tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:58.802462 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7b69d880-f6d9-4d28-8df1-58e6202f20df tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:58.802870 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7b69d880-f6d9-4d28-8df1-58e6202f20df tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:58.803299 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7b69d880-f6d9-4d28-8df1-58e6202f20df tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:58.804358 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-6eb2459d-8dfb-404a-9144-1eb2b9bf0fdc tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:58.813403 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-6eb2459d-8dfb-404a-9144-1eb2b9bf0fdc tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.103068 Jun 17 13:29:58.814004 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1515/2995] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:29:58 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:29:58.818748 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-540effe3-a4da-44dd-bd4c-64849d8ff036 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:29:58.819346 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-540effe3-a4da-44dd-bd4c-64849d8ff036 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:29:58.825994 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-540effe3-a4da-44dd-bd4c-64849d8ff036 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:58.826476 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-540effe3-a4da-44dd-bd4c-64849d8ff036 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:58.827230 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-540effe3-a4da-44dd-bd4c-64849d8ff036 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:58.827670 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-540effe3-a4da-44dd-bd4c-64849d8ff036 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:58.899154 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-540effe3-a4da-44dd-bd4c-64849d8ff036 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:58.908070 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-540effe3-a4da-44dd-bd4c-64849d8ff036 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:58.909431 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-540effe3-a4da-44dd-bd4c-64849d8ff036 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:58.910567 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-540effe3-a4da-44dd-bd4c-64849d8ff036 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.095620 Jun 17 13:29:58.911117 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1516/2996] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:29:58 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:29:58.959732 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-7b69d880-f6d9-4d28-8df1-58e6202f20df tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:58.968305 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-7b69d880-f6d9-4d28-8df1-58e6202f20df tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.178160 Jun 17 13:29:58.968803 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1481/2997] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:29:58 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:29:59.834622 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-2c6c2bd1-84b8-47a0-a54f-10a999805a55 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:29:59.835563 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-2c6c2bd1-84b8-47a0-a54f-10a999805a55 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:29:59.846560 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2c6c2bd1-84b8-47a0-a54f-10a999805a55 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:59.847302 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2c6c2bd1-84b8-47a0-a54f-10a999805a55 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:59.848542 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2c6c2bd1-84b8-47a0-a54f-10a999805a55 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:59.849264 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2c6c2bd1-84b8-47a0-a54f-10a999805a55 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:59.912694 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-2c6c2bd1-84b8-47a0-a54f-10a999805a55 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:29:59.916255 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_cell1:SELECT=100 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:29:59.921338 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-2c6c2bd1-84b8-47a0-a54f-10a999805a55 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.093273 Jun 17 13:29:59.921918 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1517/2998] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:29:59 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:29:59.929139 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-310d494f-e964-4ab2-b588-e252d39d67ec tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:29:59.929791 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-310d494f-e964-4ab2-b588-e252d39d67ec tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:29:59.939638 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-310d494f-e964-4ab2-b588-e252d39d67ec tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:59.940277 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-310d494f-e964-4ab2-b588-e252d39d67ec tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:59.941397 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-310d494f-e964-4ab2-b588-e252d39d67ec tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:59.942012 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-310d494f-e964-4ab2-b588-e252d39d67ec tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:59.986809 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-c155c769-2c66-48cc-a43c-9f0e1b045e05 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:29:59.987417 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-c155c769-2c66-48cc-a43c-9f0e1b045e05 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:29:59.993861 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c155c769-2c66-48cc-a43c-9f0e1b045e05 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:59.994624 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c155c769-2c66-48cc-a43c-9f0e1b045e05 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:29:59.995111 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c155c769-2c66-48cc-a43c-9f0e1b045e05 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:29:59.995576 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c155c769-2c66-48cc-a43c-9f0e1b045e05 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:00.009499 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-310d494f-e964-4ab2-b588-e252d39d67ec tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:00.018458 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-310d494f-e964-4ab2-b588-e252d39d67ec tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:00.019966 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-310d494f-e964-4ab2-b588-e252d39d67ec tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:00.021175 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-310d494f-e964-4ab2-b588-e252d39d67ec tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.096010 Jun 17 13:30:00.021735 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1482/2999] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:29:59 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:30:00.131893 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-c155c769-2c66-48cc-a43c-9f0e1b045e05 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:00.140975 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-c155c769-2c66-48cc-a43c-9f0e1b045e05 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.159096 Jun 17 13:30:00.141560 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1518/3000] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:29:59 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 13:30:00.943423 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-413cdaa3-7753-4d12-9c64-d605e318ef89 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:30:00.944410 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-413cdaa3-7753-4d12-9c64-d605e318ef89 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:30:00.955475 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-413cdaa3-7753-4d12-9c64-d605e318ef89 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:00.956216 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-413cdaa3-7753-4d12-9c64-d605e318ef89 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:00.957471 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-413cdaa3-7753-4d12-9c64-d605e318ef89 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:00.958241 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-413cdaa3-7753-4d12-9c64-d605e318ef89 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:01.025405 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-413cdaa3-7753-4d12-9c64-d605e318ef89 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:01.035177 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-413cdaa3-7753-4d12-9c64-d605e318ef89 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.098279 Jun 17 13:30:01.035815 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1483/3001] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:30:00 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:30:01.040226 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-2e4f983f-31ce-49c4-a971-9362176a4eee tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:30:01.041161 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-2e4f983f-31ce-49c4-a971-9362176a4eee tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:30:01.047708 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2e4f983f-31ce-49c4-a971-9362176a4eee tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:01.048164 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2e4f983f-31ce-49c4-a971-9362176a4eee tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:01.048924 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2e4f983f-31ce-49c4-a971-9362176a4eee tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:01.049362 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2e4f983f-31ce-49c4-a971-9362176a4eee tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:01.120588 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-2e4f983f-31ce-49c4-a971-9362176a4eee tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:01.127225 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-2e4f983f-31ce-49c4-a971-9362176a4eee tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:01.128715 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-2e4f983f-31ce-49c4-a971-9362176a4eee tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:01.129861 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-2e4f983f-31ce-49c4-a971-9362176a4eee tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.094110 Jun 17 13:30:01.130469 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1519/3002] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:30:01 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:30:01.158409 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-f91959ab-c413-4451-8e28-07a2924f0cd3 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:30:01.159027 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-f91959ab-c413-4451-8e28-07a2924f0cd3 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:30:01.165164 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f91959ab-c413-4451-8e28-07a2924f0cd3 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:01.165615 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f91959ab-c413-4451-8e28-07a2924f0cd3 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:01.166388 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f91959ab-c413-4451-8e28-07a2924f0cd3 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:01.166822 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f91959ab-c413-4451-8e28-07a2924f0cd3 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:01.305184 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-f91959ab-c413-4451-8e28-07a2924f0cd3 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:01.313965 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-f91959ab-c413-4451-8e28-07a2924f0cd3 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.159440 Jun 17 13:30:01.314574 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1484/3003] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:30:01 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:30:02.053806 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-43ca3305-a459-4270-bcea-b7966e4474a6 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:30:02.054473 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-43ca3305-a459-4270-bcea-b7966e4474a6 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:30:02.061801 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-43ca3305-a459-4270-bcea-b7966e4474a6 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:02.062314 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-43ca3305-a459-4270-bcea-b7966e4474a6 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:02.063110 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-43ca3305-a459-4270-bcea-b7966e4474a6 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:02.063564 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-43ca3305-a459-4270-bcea-b7966e4474a6 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:02.129937 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-43ca3305-a459-4270-bcea-b7966e4474a6 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:02.138744 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-43ca3305-a459-4270-bcea-b7966e4474a6 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.088993 Jun 17 13:30:02.139332 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1520/3004] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:30:02 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:30:02.148360 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-e28822fd-4cec-4c80-b542-febdec8ef609 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:30:02.149063 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-e28822fd-4cec-4c80-b542-febdec8ef609 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:30:02.155929 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e28822fd-4cec-4c80-b542-febdec8ef609 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:02.156380 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e28822fd-4cec-4c80-b542-febdec8ef609 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:02.157131 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e28822fd-4cec-4c80-b542-febdec8ef609 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:02.157535 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e28822fd-4cec-4c80-b542-febdec8ef609 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:02.225165 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-e28822fd-4cec-4c80-b542-febdec8ef609 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:02.234994 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-e28822fd-4cec-4c80-b542-febdec8ef609 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:02.236506 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-e28822fd-4cec-4c80-b542-febdec8ef609 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:02.237664 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-e28822fd-4cec-4c80-b542-febdec8ef609 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.093415 Jun 17 13:30:02.238248 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1485/3005] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:30:02 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:30:02.332722 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-3a639c6e-66df-45d4-a320-f591cc8488e6 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:30:02.333460 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-3a639c6e-66df-45d4-a320-f591cc8488e6 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:30:02.341057 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-3a639c6e-66df-45d4-a320-f591cc8488e6 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:02.341634 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-3a639c6e-66df-45d4-a320-f591cc8488e6 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:02.342622 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-3a639c6e-66df-45d4-a320-f591cc8488e6 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:02.343204 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-3a639c6e-66df-45d4-a320-f591cc8488e6 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:02.494946 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-3a639c6e-66df-45d4-a320-f591cc8488e6 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:02.503150 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-3a639c6e-66df-45d4-a320-f591cc8488e6 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.174862 Jun 17 13:30:02.503681 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1521/3006] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:30:02 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:30:03.157376 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-50edf76e-0054-4aa6-8795-d9861e9feaa7 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:30:03.157903 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-50edf76e-0054-4aa6-8795-d9861e9feaa7 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:30:03.165209 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-50edf76e-0054-4aa6-8795-d9861e9feaa7 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:03.165673 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-50edf76e-0054-4aa6-8795-d9861e9feaa7 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:03.166732 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-50edf76e-0054-4aa6-8795-d9861e9feaa7 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:03.167161 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-50edf76e-0054-4aa6-8795-d9861e9feaa7 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:03.230747 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-50edf76e-0054-4aa6-8795-d9861e9feaa7 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:03.239065 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-50edf76e-0054-4aa6-8795-d9861e9feaa7 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.085712 Jun 17 13:30:03.239651 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1486/3007] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:30:03 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:30:03.256201 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-17857f76-dd11-4596-bcd2-3bd1266f2bf0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:30:03.256813 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-17857f76-dd11-4596-bcd2-3bd1266f2bf0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:30:03.264329 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-17857f76-dd11-4596-bcd2-3bd1266f2bf0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:03.264786 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-17857f76-dd11-4596-bcd2-3bd1266f2bf0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:03.265551 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-17857f76-dd11-4596-bcd2-3bd1266f2bf0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:03.265983 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-17857f76-dd11-4596-bcd2-3bd1266f2bf0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:03.329058 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-17857f76-dd11-4596-bcd2-3bd1266f2bf0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:03.338444 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-17857f76-dd11-4596-bcd2-3bd1266f2bf0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:03.339943 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-17857f76-dd11-4596-bcd2-3bd1266f2bf0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:03.341080 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-17857f76-dd11-4596-bcd2-3bd1266f2bf0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.088911 Jun 17 13:30:03.341641 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1522/3008] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:30:03 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:30:03.525012 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-320ef67a-b378-44c5-9417-4b88a7dca134 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:30:03.525679 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-320ef67a-b378-44c5-9417-4b88a7dca134 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:30:03.536054 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-320ef67a-b378-44c5-9417-4b88a7dca134 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:03.536860 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-320ef67a-b378-44c5-9417-4b88a7dca134 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:03.538154 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-320ef67a-b378-44c5-9417-4b88a7dca134 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:03.538871 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-320ef67a-b378-44c5-9417-4b88a7dca134 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:03.681447 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-320ef67a-b378-44c5-9417-4b88a7dca134 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:03.694412 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-320ef67a-b378-44c5-9417-4b88a7dca134 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.175806 Jun 17 13:30:03.695302 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1487/3009] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:30:03 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:30:04.260642 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-967298ff-0bf0-4f25-8059-af173a88adcc tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:30:04.261228 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-967298ff-0bf0-4f25-8059-af173a88adcc tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:30:04.268541 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-967298ff-0bf0-4f25-8059-af173a88adcc tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:04.268993 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-967298ff-0bf0-4f25-8059-af173a88adcc tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:04.269754 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-967298ff-0bf0-4f25-8059-af173a88adcc tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:04.270284 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-967298ff-0bf0-4f25-8059-af173a88adcc tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:04.334924 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-967298ff-0bf0-4f25-8059-af173a88adcc tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:04.343167 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-967298ff-0bf0-4f25-8059-af173a88adcc tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.088310 Jun 17 13:30:04.343740 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1523/3010] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:30:04 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:30:04.359984 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-f2ebbdef-0919-4b7e-8ff0-71b14418c5d5 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:30:04.360592 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-f2ebbdef-0919-4b7e-8ff0-71b14418c5d5 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:30:04.367500 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f2ebbdef-0919-4b7e-8ff0-71b14418c5d5 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:04.367953 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f2ebbdef-0919-4b7e-8ff0-71b14418c5d5 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:04.368786 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f2ebbdef-0919-4b7e-8ff0-71b14418c5d5 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:04.369326 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f2ebbdef-0919-4b7e-8ff0-71b14418c5d5 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:04.431611 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-f2ebbdef-0919-4b7e-8ff0-71b14418c5d5 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:04.440458 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-f2ebbdef-0919-4b7e-8ff0-71b14418c5d5 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:04.441941 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-f2ebbdef-0919-4b7e-8ff0-71b14418c5d5 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:04.443104 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-f2ebbdef-0919-4b7e-8ff0-71b14418c5d5 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.087052 Jun 17 13:30:04.443652 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1488/3011] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:30:04 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:30:04.714650 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-7cf04ceb-00b0-4cec-b2b6-abc9f651ec46 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:30:04.715262 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-7cf04ceb-00b0-4cec-b2b6-abc9f651ec46 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:30:04.721789 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7cf04ceb-00b0-4cec-b2b6-abc9f651ec46 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:04.722268 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7cf04ceb-00b0-4cec-b2b6-abc9f651ec46 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:04.723025 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7cf04ceb-00b0-4cec-b2b6-abc9f651ec46 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:04.723458 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7cf04ceb-00b0-4cec-b2b6-abc9f651ec46 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:04.861754 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-7cf04ceb-00b0-4cec-b2b6-abc9f651ec46 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:04.872397 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-7cf04ceb-00b0-4cec-b2b6-abc9f651ec46 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.163093 Jun 17 13:30:04.872975 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1524/3012] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:30:04 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:30:05.360814 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-0bd72e76-7c16-4dcf-8818-cc60d4b8143b tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:30:05.361429 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-0bd72e76-7c16-4dcf-8818-cc60d4b8143b tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:30:05.368232 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0bd72e76-7c16-4dcf-8818-cc60d4b8143b tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:05.368681 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0bd72e76-7c16-4dcf-8818-cc60d4b8143b tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:05.369612 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0bd72e76-7c16-4dcf-8818-cc60d4b8143b tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:05.370064 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0bd72e76-7c16-4dcf-8818-cc60d4b8143b tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:05.443777 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-0bd72e76-7c16-4dcf-8818-cc60d4b8143b tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:05.455280 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-0bd72e76-7c16-4dcf-8818-cc60d4b8143b tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.098484 Jun 17 13:30:05.455942 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1489/3013] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:30:05 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:30:05.461309 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-db879aec-cd46-498c-9bc4-910c52a965e1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:30:05.462039 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-db879aec-cd46-498c-9bc4-910c52a965e1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:30:05.469275 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-db879aec-cd46-498c-9bc4-910c52a965e1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:05.469758 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-db879aec-cd46-498c-9bc4-910c52a965e1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:05.470541 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-db879aec-cd46-498c-9bc4-910c52a965e1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:05.470978 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-db879aec-cd46-498c-9bc4-910c52a965e1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:05.540328 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-db879aec-cd46-498c-9bc4-910c52a965e1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:05.549090 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-db879aec-cd46-498c-9bc4-910c52a965e1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:05.550607 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-db879aec-cd46-498c-9bc4-910c52a965e1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:05.551741 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-db879aec-cd46-498c-9bc4-910c52a965e1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.094670 Jun 17 13:30:05.552457 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1525/3014] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:30:05 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 13:30:05.898714 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-0f5ff4ee-a659-4732-a1a0-2a5f0179fc01 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:30:05.899943 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-0f5ff4ee-a659-4732-a1a0-2a5f0179fc01 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:30:05.910623 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0f5ff4ee-a659-4732-a1a0-2a5f0179fc01 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:05.911378 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0f5ff4ee-a659-4732-a1a0-2a5f0179fc01 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:05.912632 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0f5ff4ee-a659-4732-a1a0-2a5f0179fc01 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:05.913358 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0f5ff4ee-a659-4732-a1a0-2a5f0179fc01 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:06.053781 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-0f5ff4ee-a659-4732-a1a0-2a5f0179fc01 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:06.062416 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-0f5ff4ee-a659-4732-a1a0-2a5f0179fc01 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.170179 Jun 17 13:30:06.062990 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1490/3015] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:30:05 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:30:06.489268 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-ec993f30-9705-4b5a-a427-e2e735bfec38 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:30:06.490402 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-ec993f30-9705-4b5a-a427-e2e735bfec38 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:30:06.499247 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ec993f30-9705-4b5a-a427-e2e735bfec38 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:06.499789 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ec993f30-9705-4b5a-a427-e2e735bfec38 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:06.500680 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ec993f30-9705-4b5a-a427-e2e735bfec38 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:06.501248 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ec993f30-9705-4b5a-a427-e2e735bfec38 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:06.566596 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-ec993f30-9705-4b5a-a427-e2e735bfec38 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:06.573407 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-39ad0534-8a0f-488b-abb7-dbc2d936db83 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:30:06.574119 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-39ad0534-8a0f-488b-abb7-dbc2d936db83 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:30:06.576341 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-ec993f30-9705-4b5a-a427-e2e735bfec38 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.106000 Jun 17 13:30:06.576898 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1526/3016] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:30:06 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:30:06.580984 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-39ad0534-8a0f-488b-abb7-dbc2d936db83 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:06.581512 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-39ad0534-8a0f-488b-abb7-dbc2d936db83 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:06.582378 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-39ad0534-8a0f-488b-abb7-dbc2d936db83 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:06.582899 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-39ad0534-8a0f-488b-abb7-dbc2d936db83 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:06.586969 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=100 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:30:06.644927 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-39ad0534-8a0f-488b-abb7-dbc2d936db83 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:06.653781 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-39ad0534-8a0f-488b-abb7-dbc2d936db83 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:06.655307 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-39ad0534-8a0f-488b-abb7-dbc2d936db83 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:06.656432 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-39ad0534-8a0f-488b-abb7-dbc2d936db83 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.089357 Jun 17 13:30:06.656984 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1491/3017] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:30:06 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:30:07.084197 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-5c5209a8-7220-400f-a333-52f745a8c216 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:30:07.085204 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-5c5209a8-7220-400f-a333-52f745a8c216 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:30:07.092909 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-5c5209a8-7220-400f-a333-52f745a8c216 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:07.093359 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-5c5209a8-7220-400f-a333-52f745a8c216 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:07.094129 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-5c5209a8-7220-400f-a333-52f745a8c216 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:07.094618 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-5c5209a8-7220-400f-a333-52f745a8c216 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:07.250633 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-5c5209a8-7220-400f-a333-52f745a8c216 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:07.259088 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-5c5209a8-7220-400f-a333-52f745a8c216 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.181501 Jun 17 13:30:07.259654 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1527/3018] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:30:07 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:30:07.597524 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-ea7ce357-994a-492a-a17f-02dc25e523ce tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:30:07.598536 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-ea7ce357-994a-492a-a17f-02dc25e523ce tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:30:07.607685 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ea7ce357-994a-492a-a17f-02dc25e523ce tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:07.608139 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ea7ce357-994a-492a-a17f-02dc25e523ce tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:07.608909 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ea7ce357-994a-492a-a17f-02dc25e523ce tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:07.609345 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ea7ce357-994a-492a-a17f-02dc25e523ce tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:07.674535 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-ea7ce357-994a-492a-a17f-02dc25e523ce tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:07.675142 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-029cf125-c3ba-4e3d-955d-81687d16b597 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:30:07.675957 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-029cf125-c3ba-4e3d-955d-81687d16b597 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:30:07.682843 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-029cf125-c3ba-4e3d-955d-81687d16b597 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:07.683286 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-029cf125-c3ba-4e3d-955d-81687d16b597 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:07.683575 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-ea7ce357-994a-492a-a17f-02dc25e523ce tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.092430 Jun 17 13:30:07.684070 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-029cf125-c3ba-4e3d-955d-81687d16b597 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:07.684190 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1492/3019] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:30:07 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:30:07.684526 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-029cf125-c3ba-4e3d-955d-81687d16b597 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:07.752747 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-029cf125-c3ba-4e3d-955d-81687d16b597 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:07.761449 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-029cf125-c3ba-4e3d-955d-81687d16b597 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:07.763000 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-029cf125-c3ba-4e3d-955d-81687d16b597 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:07.764147 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-029cf125-c3ba-4e3d-955d-81687d16b597 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.093084 Jun 17 13:30:07.764718 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1528/3020] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:30:07 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 13:30:08.276674 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-dc0ca599-fdf9-4f9f-b408-9a4cde8bdcbd tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:30:08.277228 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-dc0ca599-fdf9-4f9f-b408-9a4cde8bdcbd tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:30:08.283892 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dc0ca599-fdf9-4f9f-b408-9a4cde8bdcbd tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:08.284340 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dc0ca599-fdf9-4f9f-b408-9a4cde8bdcbd tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:08.285099 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dc0ca599-fdf9-4f9f-b408-9a4cde8bdcbd tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:08.285529 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dc0ca599-fdf9-4f9f-b408-9a4cde8bdcbd tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:08.420684 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-dc0ca599-fdf9-4f9f-b408-9a4cde8bdcbd tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:08.429202 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-dc0ca599-fdf9-4f9f-b408-9a4cde8bdcbd tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.156620 Jun 17 13:30:08.429789 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1493/3021] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:30:08 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:30:08.700812 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-899f7eb8-aeca-4b7f-93f3-501911853dc2 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:30:08.702118 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-899f7eb8-aeca-4b7f-93f3-501911853dc2 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:30:08.709029 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-899f7eb8-aeca-4b7f-93f3-501911853dc2 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:08.709485 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-899f7eb8-aeca-4b7f-93f3-501911853dc2 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:08.710277 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-899f7eb8-aeca-4b7f-93f3-501911853dc2 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:08.710714 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-899f7eb8-aeca-4b7f-93f3-501911853dc2 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:08.776757 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-899f7eb8-aeca-4b7f-93f3-501911853dc2 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:08.783480 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-0e3fd52f-cb7f-42e2-98b7-f82aa3fa2efe tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:30:08.784086 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-0e3fd52f-cb7f-42e2-98b7-f82aa3fa2efe tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:30:08.785355 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-899f7eb8-aeca-4b7f-93f3-501911853dc2 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.088528 Jun 17 13:30:08.785945 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1529/3022] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:30:08 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:30:08.790605 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0e3fd52f-cb7f-42e2-98b7-f82aa3fa2efe tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:08.791061 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0e3fd52f-cb7f-42e2-98b7-f82aa3fa2efe tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:08.791786 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0e3fd52f-cb7f-42e2-98b7-f82aa3fa2efe tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:08.792245 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0e3fd52f-cb7f-42e2-98b7-f82aa3fa2efe tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:08.856753 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-0e3fd52f-cb7f-42e2-98b7-f82aa3fa2efe tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:08.865622 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-0e3fd52f-cb7f-42e2-98b7-f82aa3fa2efe tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:08.867153 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-0e3fd52f-cb7f-42e2-98b7-f82aa3fa2efe tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:08.868370 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-0e3fd52f-cb7f-42e2-98b7-f82aa3fa2efe tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.089510 Jun 17 13:30:08.869177 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1494/3023] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:30:08 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 13:30:09.451308 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-bc43fd99-765c-4f54-ae34-91c4b11eae13 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:30:09.452291 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-bc43fd99-765c-4f54-ae34-91c4b11eae13 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:30:09.462594 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-bc43fd99-765c-4f54-ae34-91c4b11eae13 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:09.463052 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-bc43fd99-765c-4f54-ae34-91c4b11eae13 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:09.463819 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-bc43fd99-765c-4f54-ae34-91c4b11eae13 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:09.464264 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-bc43fd99-765c-4f54-ae34-91c4b11eae13 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:09.603576 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-bc43fd99-765c-4f54-ae34-91c4b11eae13 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:09.612251 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-bc43fd99-765c-4f54-ae34-91c4b11eae13 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.168128 Jun 17 13:30:09.612831 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1530/3024] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:30:09 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:30:09.806309 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-b084bee5-cbbb-439f-8035-020a2b8f3d1b tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:30:09.807361 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-b084bee5-cbbb-439f-8035-020a2b8f3d1b tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:30:09.818451 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b084bee5-cbbb-439f-8035-020a2b8f3d1b tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:09.819185 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b084bee5-cbbb-439f-8035-020a2b8f3d1b tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:09.820446 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b084bee5-cbbb-439f-8035-020a2b8f3d1b tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:09.821142 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b084bee5-cbbb-439f-8035-020a2b8f3d1b tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:09.887745 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-7a3638ee-70a7-4bac-ac2d-c7a3e3b392b4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:30:09.888358 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-7a3638ee-70a7-4bac-ac2d-c7a3e3b392b4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:30:09.895559 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7a3638ee-70a7-4bac-ac2d-c7a3e3b392b4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:09.895559 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7a3638ee-70a7-4bac-ac2d-c7a3e3b392b4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:09.896102 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7a3638ee-70a7-4bac-ac2d-c7a3e3b392b4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:09.896534 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7a3638ee-70a7-4bac-ac2d-c7a3e3b392b4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:09.897492 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-b084bee5-cbbb-439f-8035-020a2b8f3d1b tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:09.905668 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-b084bee5-cbbb-439f-8035-020a2b8f3d1b tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.106402 Jun 17 13:30:09.906295 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1495/3025] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:30:09 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:30:09.957836 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-7a3638ee-70a7-4bac-ac2d-c7a3e3b392b4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:09.966546 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-7a3638ee-70a7-4bac-ac2d-c7a3e3b392b4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:09.968031 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-7a3638ee-70a7-4bac-ac2d-c7a3e3b392b4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:09.969167 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-7a3638ee-70a7-4bac-ac2d-c7a3e3b392b4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.085644 Jun 17 13:30:09.969732 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1531/3026] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:30:09 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:30:10.632714 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-5ed99fdc-6da0-4732-a524-1c80d8b6a1ed tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:30:10.633576 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-5ed99fdc-6da0-4732-a524-1c80d8b6a1ed tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:30:10.640239 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5ed99fdc-6da0-4732-a524-1c80d8b6a1ed tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:10.640683 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5ed99fdc-6da0-4732-a524-1c80d8b6a1ed tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:10.641441 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5ed99fdc-6da0-4732-a524-1c80d8b6a1ed tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:10.641874 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5ed99fdc-6da0-4732-a524-1c80d8b6a1ed tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:10.778192 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-5ed99fdc-6da0-4732-a524-1c80d8b6a1ed tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:10.786582 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-5ed99fdc-6da0-4732-a524-1c80d8b6a1ed tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.160290 Jun 17 13:30:10.787162 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1496/3027] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:30:10 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:30:10.926029 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-fc321646-f651-46e9-9f4c-1272d9c25329 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:30:10.926972 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-fc321646-f651-46e9-9f4c-1272d9c25329 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:30:10.935883 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-fc321646-f651-46e9-9f4c-1272d9c25329 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:10.936337 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-fc321646-f651-46e9-9f4c-1272d9c25329 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:10.937089 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-fc321646-f651-46e9-9f4c-1272d9c25329 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:10.937525 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-fc321646-f651-46e9-9f4c-1272d9c25329 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:10.987978 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-049aff4b-76e3-49fc-981b-4892c69a0d35 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:30:10.988615 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-049aff4b-76e3-49fc-981b-4892c69a0d35 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:30:10.996219 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-049aff4b-76e3-49fc-981b-4892c69a0d35 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:10.996671 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-049aff4b-76e3-49fc-981b-4892c69a0d35 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:10.997434 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-049aff4b-76e3-49fc-981b-4892c69a0d35 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:10.997869 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-049aff4b-76e3-49fc-981b-4892c69a0d35 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:11.001019 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-fc321646-f651-46e9-9f4c-1272d9c25329 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:11.009064 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-fc321646-f651-46e9-9f4c-1272d9c25329 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.088807 Jun 17 13:30:11.010214 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1532/3028] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:30:10 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:30:11.064890 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-049aff4b-76e3-49fc-981b-4892c69a0d35 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:11.074441 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-049aff4b-76e3-49fc-981b-4892c69a0d35 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:11.075770 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-049aff4b-76e3-49fc-981b-4892c69a0d35 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:11.076878 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-049aff4b-76e3-49fc-981b-4892c69a0d35 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.092974 Jun 17 13:30:11.077405 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1497/3029] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:30:10 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:30:11.806555 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-c206042e-9d73-4c38-a830-fc43a5613a72 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:30:11.807420 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-c206042e-9d73-4c38-a830-fc43a5613a72 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:30:11.816459 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c206042e-9d73-4c38-a830-fc43a5613a72 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:11.817092 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c206042e-9d73-4c38-a830-fc43a5613a72 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:11.818147 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c206042e-9d73-4c38-a830-fc43a5613a72 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:11.818809 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c206042e-9d73-4c38-a830-fc43a5613a72 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:11.955571 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-c206042e-9d73-4c38-a830-fc43a5613a72 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:11.964186 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-c206042e-9d73-4c38-a830-fc43a5613a72 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.163391 Jun 17 13:30:11.964759 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1533/3030] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:30:11 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:30:12.095083 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-26380969-69d4-4156-a0d5-0e307790b308 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:30:12.095696 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-26380969-69d4-4156-a0d5-0e307790b308 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:30:12.101883 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-26380969-69d4-4156-a0d5-0e307790b308 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:12.102373 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-26380969-69d4-4156-a0d5-0e307790b308 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:12.103179 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-26380969-69d4-4156-a0d5-0e307790b308 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:12.103622 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-26380969-69d4-4156-a0d5-0e307790b308 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:12.122454 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_cell1:SELECT=100 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:30:12.130278 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-5d6e076d-61da-4958-9720-47b3d77999df tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:30:12.130885 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-5d6e076d-61da-4958-9720-47b3d77999df tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:30:12.137185 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5d6e076d-61da-4958-9720-47b3d77999df tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:12.137618 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5d6e076d-61da-4958-9720-47b3d77999df tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:12.138460 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5d6e076d-61da-4958-9720-47b3d77999df tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:12.138880 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5d6e076d-61da-4958-9720-47b3d77999df tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:12.169660 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-26380969-69d4-4156-a0d5-0e307790b308 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:12.178389 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-26380969-69d4-4156-a0d5-0e307790b308 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:12.179880 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-26380969-69d4-4156-a0d5-0e307790b308 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:12.181138 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-26380969-69d4-4156-a0d5-0e307790b308 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.089887 Jun 17 13:30:12.181729 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1534/3031] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:30:12 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:30:12.202351 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-5d6e076d-61da-4958-9720-47b3d77999df tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:12.210546 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-5d6e076d-61da-4958-9720-47b3d77999df tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 200 len: 1369 microversion: 2.1 time: 0.186512 Jun 17 13:30:12.211035 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1498/3032] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:30:12 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 1369 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:30:12.229929 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-b1109bb6-b017-4047-b6d6-58d4ebc80253 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '.version_select at 0x7f019018e4c0>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:30:12.258119 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-b1109bb6-b017-4047-b6d6-58d4ebc80253 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1301463028" status: 202 len: 0 microversion: 2.1 time: 0.034632 Jun 17 13:30:12.258715 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1535/3033] 10.222.0.48 () {58 vars in 1220 bytes} [Fri Jun 17 13:30:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1301463028 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 13:30:12.982584 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-c4bf9ebd-4e9c-47c5-b9bd-ba8845841e78 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:30:12.983200 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-c4bf9ebd-4e9c-47c5-b9bd-ba8845841e78 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:30:12.989562 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c4bf9ebd-4e9c-47c5-b9bd-ba8845841e78 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:12.990059 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c4bf9ebd-4e9c-47c5-b9bd-ba8845841e78 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:12.990858 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c4bf9ebd-4e9c-47c5-b9bd-ba8845841e78 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:12.991281 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c4bf9ebd-4e9c-47c5-b9bd-ba8845841e78 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:13.088509 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-3df9d730-419e-4e5e-a63d-9fd83e3e2a74 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Action: 'create', calling method: .version_select at 0x7f0190194430>, body: {"keypair": {"name": "tempest-keypair-1697365276", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD5wmQdCk9h5u21wE2fD4pCOkpIHBHIM9C2n/DCSm4B4DcxVkPqudaltzqG7qjhsBPXlGplUm+ngAKWeK7Fuk2LmihIll7cHwcV3rPAF0RzhLqBxY/4AJpHTohKstOTpQg=="}} {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:30:13.110203 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.quota [None req-3df9d730-419e-4e5e-a63d-9fd83e3e2a74 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Getting quotas for project 13a3f9864ad04941bc902febad84876d. Resources: {'key_pairs'} {{(pid=117659) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 13:30:13.114615 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.quota [None req-3df9d730-419e-4e5e-a63d-9fd83e3e2a74 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Getting quotas for user 8bfbd9324f8040c496a83eb599ca80c0 and project 13a3f9864ad04941bc902febad84876d. Resources: {'key_pairs'} {{(pid=117659) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 13:30:13.133067 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-c4bf9ebd-4e9c-47c5-b9bd-ba8845841e78 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:13.140023 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-3df9d730-419e-4e5e-a63d-9fd83e3e2a74 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.056077 Jun 17 13:30:13.140629 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1536/3034] 10.222.0.48 () {60 vars in 1158 bytes} [Fri Jun 17 13:30:13 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:30:13.143082 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-c4bf9ebd-4e9c-47c5-b9bd-ba8845841e78 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.165192 Jun 17 13:30:13.143647 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1499/3035] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:30:12 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:30:13.199681 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-38daa15c-e150-47ea-a86e-23bf806abb31 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:30:13.200306 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-38daa15c-e150-47ea-a86e-23bf806abb31 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:30:13.206484 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-38daa15c-e150-47ea-a86e-23bf806abb31 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:13.206933 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-38daa15c-e150-47ea-a86e-23bf806abb31 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:13.207693 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-38daa15c-e150-47ea-a86e-23bf806abb31 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:13.208129 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-38daa15c-e150-47ea-a86e-23bf806abb31 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:13.282698 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-38daa15c-e150-47ea-a86e-23bf806abb31 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:13.291636 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-38daa15c-e150-47ea-a86e-23bf806abb31 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:13.293134 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-38daa15c-e150-47ea-a86e-23bf806abb31 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:13.294429 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-38daa15c-e150-47ea-a86e-23bf806abb31 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.098775 Jun 17 13:30:13.294966 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1537/3036] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:30:13 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:30:14.161108 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-274b4344-2a3c-4d12-8e69-2314f366d95c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:30:14.161709 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-274b4344-2a3c-4d12-8e69-2314f366d95c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:30:14.169286 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-274b4344-2a3c-4d12-8e69-2314f366d95c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:14.169728 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-274b4344-2a3c-4d12-8e69-2314f366d95c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:14.170696 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-274b4344-2a3c-4d12-8e69-2314f366d95c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:14.171101 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-274b4344-2a3c-4d12-8e69-2314f366d95c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:14.312588 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-e7086336-92bb-44b4-9dc3-f27e0fe16807 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:30:14.313725 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-e7086336-92bb-44b4-9dc3-f27e0fe16807 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:30:14.323115 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e7086336-92bb-44b4-9dc3-f27e0fe16807 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:14.323957 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e7086336-92bb-44b4-9dc3-f27e0fe16807 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:14.324728 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e7086336-92bb-44b4-9dc3-f27e0fe16807 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:14.325238 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e7086336-92bb-44b4-9dc3-f27e0fe16807 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:14.409314 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-e7086336-92bb-44b4-9dc3-f27e0fe16807 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:14.424148 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-e7086336-92bb-44b4-9dc3-f27e0fe16807 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:14.425864 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-e7086336-92bb-44b4-9dc3-f27e0fe16807 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:14.427226 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-e7086336-92bb-44b4-9dc3-f27e0fe16807 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.119116 Jun 17 13:30:14.429207 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1538/3037] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:30:14 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:30:14.454995 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-96864e49-d1f4-4abf-a8e2-7f5ed89a4cd6 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-999826032", "imageRef": "ccec3e37-1df8-4f10-a8f6-f97dfac54cf5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8a7eabf9-ca7c-4c05-b72a-f274cf4b5749"}], "security_groups": [{"name": "tempest-securitygroup--1108011213"}], "key_name": "tempest-keypair-1697365276", "user_data": "}} {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:30:14.458437 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-274b4344-2a3c-4d12-8e69-2314f366d95c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:14.466544 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-274b4344-2a3c-4d12-8e69-2314f366d95c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.310167 Jun 17 13:30:14.476441 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1500/3038] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:30:14 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:30:14.678565 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.network.neutron [None req-96864e49-d1f4-4abf-a8e2-7f5ed89a4cd6 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] validate_networks() for [('8a7eabf9-ca7c-4c05-b72a-f274cf4b5749', None, None, None, None, None)] {{(pid=117659) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 17 13:30:15.357604 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.virt.hardware [None req-96864e49-d1f4-4abf-a8e2-7f5ed89a4cd6 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Flavor limits 0:0:0 {{(pid=117659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 17 13:30:15.358202 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.virt.hardware [None req-96864e49-d1f4-4abf-a8e2-7f5ed89a4cd6 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Image limits 0:0:0 {{(pid=117659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 17 13:30:15.358545 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.virt.hardware [None req-96864e49-d1f4-4abf-a8e2-7f5ed89a4cd6 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Flavor pref 0:0:0 {{(pid=117659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 17 13:30:15.358951 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.virt.hardware [None req-96864e49-d1f4-4abf-a8e2-7f5ed89a4cd6 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Image pref 0:0:0 {{(pid=117659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 17 13:30:15.359375 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.virt.hardware [None req-96864e49-d1f4-4abf-a8e2-7f5ed89a4cd6 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 17 13:30:15.369548 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-96864e49-d1f4-4abf-a8e2-7f5ed89a4cd6 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:15.370015 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-96864e49-d1f4-4abf-a8e2-7f5ed89a4cd6 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:15.370803 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-96864e49-d1f4-4abf-a8e2-7f5ed89a4cd6 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:15.371454 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-96864e49-d1f4-4abf-a8e2-7f5ed89a4cd6 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:15.388958 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.quota [None req-96864e49-d1f4-4abf-a8e2-7f5ed89a4cd6 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Getting quotas for project 13a3f9864ad04941bc902febad84876d. Resources: {'ram', 'cores', 'instances'} {{(pid=117659) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 13:30:15.393321 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.quota [None req-96864e49-d1f4-4abf-a8e2-7f5ed89a4cd6 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Getting quotas for user 8bfbd9324f8040c496a83eb599ca80c0 and project 13a3f9864ad04941bc902febad84876d. Resources: {'ram', 'cores', 'instances'} {{(pid=117659) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 13:30:15.405879 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-96864e49-d1f4-4abf-a8e2-7f5ed89a4cd6 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Going to run 1 instances... {{(pid=117659) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 17 13:30:15.408200 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-96864e49-d1f4-4abf-a8e2-7f5ed89a4cd6 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 26622189-19d7-4ce4-b2a8-8f50a6080307] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ccec3e37-1df8-4f10-a8f6-f97dfac54cf5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117659) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 17 13:30:15.447367 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-6a57c053-63b6-441e-8b3a-2832d1727f7c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:30:15.447984 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-6a57c053-63b6-441e-8b3a-2832d1727f7c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:30:15.454834 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6a57c053-63b6-441e-8b3a-2832d1727f7c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:15.455284 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6a57c053-63b6-441e-8b3a-2832d1727f7c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:15.456044 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6a57c053-63b6-441e-8b3a-2832d1727f7c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:15.456614 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6a57c053-63b6-441e-8b3a-2832d1727f7c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:15.465436 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-96864e49-d1f4-4abf-a8e2-7f5ed89a4cd6 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.014553 Jun 17 13:30:15.470787 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1539/3039] 10.222.0.48 () {60 vars in 1146 bytes} [Fri Jun 17 13:30:14 2022] POST /compute/v2.1/servers => generated 402 bytes in 1016 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 17 13:30:15.476389 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-f6c496c7-6308-4a65-859b-d682b4a6647e tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:30:15.477109 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-f6c496c7-6308-4a65-859b-d682b4a6647e tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 26622189-19d7-4ce4-b2a8-8f50a6080307] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:30:15.546624 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-f6c496c7-6308-4a65-859b-d682b4a6647e tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:15.554959 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-f6c496c7-6308-4a65-859b-d682b4a6647e tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/26622189-19d7-4ce4-b2a8-8f50a6080307" status: 200 len: 1237 microversion: 2.1 time: 0.082948 Jun 17 13:30:15.557116 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1540/3040] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:30:15 2022] GET /compute/v2.1/servers/26622189-19d7-4ce4-b2a8-8f50a6080307 => generated 1237 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:30:15.561791 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-de9c32ac-790e-4c18-9355-4cfe18eb3cb0 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:30:15.562725 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-de9c32ac-790e-4c18-9355-4cfe18eb3cb0 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:30:15.570055 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-de9c32ac-790e-4c18-9355-4cfe18eb3cb0 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:15.570600 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-de9c32ac-790e-4c18-9355-4cfe18eb3cb0 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:15.571966 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-de9c32ac-790e-4c18-9355-4cfe18eb3cb0 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:15.572615 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-de9c32ac-790e-4c18-9355-4cfe18eb3cb0 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:15.576441 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-6a57c053-63b6-441e-8b3a-2832d1727f7c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:15.587741 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-6a57c053-63b6-441e-8b3a-2832d1727f7c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:15.592236 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-6a57c053-63b6-441e-8b3a-2832d1727f7c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:15.593488 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-6a57c053-63b6-441e-8b3a-2832d1727f7c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.151184 Jun 17 13:30:15.594913 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1501/3041] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:30:15 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:30:15.706323 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-de9c32ac-790e-4c18-9355-4cfe18eb3cb0 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:15.714918 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-de9c32ac-790e-4c18-9355-4cfe18eb3cb0 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.156725 Jun 17 13:30:15.715523 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1541/3042] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:30:15 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:30:16.572755 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-25c95aac-2cb2-4d16-bb33-f9f4a9d3b014 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:30:16.573304 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-25c95aac-2cb2-4d16-bb33-f9f4a9d3b014 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 26622189-19d7-4ce4-b2a8-8f50a6080307] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:30:16.575610 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_api:SELECT=74 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:30:16.580961 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-25c95aac-2cb2-4d16-bb33-f9f4a9d3b014 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:16.581521 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-25c95aac-2cb2-4d16-bb33-f9f4a9d3b014 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:16.582430 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-25c95aac-2cb2-4d16-bb33-f9f4a9d3b014 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:16.582886 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-25c95aac-2cb2-4d16-bb33-f9f4a9d3b014 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:16.613057 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-347f1cdf-e10d-428d-b1a7-687b851c8b0d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:30:16.614406 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-347f1cdf-e10d-428d-b1a7-687b851c8b0d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:30:16.622232 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-347f1cdf-e10d-428d-b1a7-687b851c8b0d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:16.622684 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-347f1cdf-e10d-428d-b1a7-687b851c8b0d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:16.623766 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-347f1cdf-e10d-428d-b1a7-687b851c8b0d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:16.624409 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-347f1cdf-e10d-428d-b1a7-687b851c8b0d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:16.698555 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-25c95aac-2cb2-4d16-bb33-f9f4a9d3b014 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:16.706721 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-25c95aac-2cb2-4d16-bb33-f9f4a9d3b014 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/26622189-19d7-4ce4-b2a8-8f50a6080307" status: 200 len: 1297 microversion: 2.1 time: 0.138121 Jun 17 13:30:16.707395 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1502/3043] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:30:16 2022] GET /compute/v2.1/servers/26622189-19d7-4ce4-b2a8-8f50a6080307 => generated 1297 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:30:16.719206 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-347f1cdf-e10d-428d-b1a7-687b851c8b0d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:16.728652 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-347f1cdf-e10d-428d-b1a7-687b851c8b0d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:16.730830 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-347f1cdf-e10d-428d-b1a7-687b851c8b0d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:16.732104 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-b0ba9d6b-baba-4ca3-896f-d2f9e50f28b1 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:30:16.732354 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-347f1cdf-e10d-428d-b1a7-687b851c8b0d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.123093 Jun 17 13:30:16.732752 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-b0ba9d6b-baba-4ca3-896f-d2f9e50f28b1 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:30:16.739647 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b0ba9d6b-baba-4ca3-896f-d2f9e50f28b1 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:16.740088 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b0ba9d6b-baba-4ca3-896f-d2f9e50f28b1 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:16.740837 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b0ba9d6b-baba-4ca3-896f-d2f9e50f28b1 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:16.741262 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b0ba9d6b-baba-4ca3-896f-d2f9e50f28b1 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:16.744138 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1542/3044] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:30:16 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:30:16.970503 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-b0ba9d6b-baba-4ca3-896f-d2f9e50f28b1 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:16.980185 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-b0ba9d6b-baba-4ca3-896f-d2f9e50f28b1 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.252604 Jun 17 13:30:16.981012 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1503/3045] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:30:16 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 13:30:17.725149 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-c0fb8b03-18b3-4450-a09f-b4ee1de84f49 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:30:17.725664 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-c0fb8b03-18b3-4450-a09f-b4ee1de84f49 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 26622189-19d7-4ce4-b2a8-8f50a6080307] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:30:17.733225 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c0fb8b03-18b3-4450-a09f-b4ee1de84f49 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:17.733657 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c0fb8b03-18b3-4450-a09f-b4ee1de84f49 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:17.734458 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c0fb8b03-18b3-4450-a09f-b4ee1de84f49 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:17.734885 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c0fb8b03-18b3-4450-a09f-b4ee1de84f49 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:17.751433 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-2c9642a7-c8b9-4790-a084-4579039d2c39 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:30:17.752138 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-2c9642a7-c8b9-4790-a084-4579039d2c39 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:30:17.759390 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2c9642a7-c8b9-4790-a084-4579039d2c39 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:17.759849 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2c9642a7-c8b9-4790-a084-4579039d2c39 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:17.760619 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2c9642a7-c8b9-4790-a084-4579039d2c39 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:17.761062 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2c9642a7-c8b9-4790-a084-4579039d2c39 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:17.862892 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-2c9642a7-c8b9-4790-a084-4579039d2c39 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:17.872166 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-2c9642a7-c8b9-4790-a084-4579039d2c39 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:17.873635 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-2c9642a7-c8b9-4790-a084-4579039d2c39 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:17.874836 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-2c9642a7-c8b9-4790-a084-4579039d2c39 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.127382 Jun 17 13:30:17.875371 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1504/3046] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:30:17 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:30:17.970248 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-c0fb8b03-18b3-4450-a09f-b4ee1de84f49 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:17.978891 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-c0fb8b03-18b3-4450-a09f-b4ee1de84f49 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/26622189-19d7-4ce4-b2a8-8f50a6080307" status: 200 len: 1363 microversion: 2.1 time: 0.257784 Jun 17 13:30:17.980125 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1543/3047] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:30:17 2022] GET /compute/v2.1/servers/26622189-19d7-4ce4-b2a8-8f50a6080307 => generated 1363 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:30:17.996811 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-bbeaa793-df9b-4699-b1b8-091006e63532 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:30:17.997421 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-bbeaa793-df9b-4699-b1b8-091006e63532 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:30:18.003760 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bbeaa793-df9b-4699-b1b8-091006e63532 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:18.004169 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bbeaa793-df9b-4699-b1b8-091006e63532 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:18.005160 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bbeaa793-df9b-4699-b1b8-091006e63532 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:18.005589 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bbeaa793-df9b-4699-b1b8-091006e63532 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:18.209292 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-bbeaa793-df9b-4699-b1b8-091006e63532 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:18.217727 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-bbeaa793-df9b-4699-b1b8-091006e63532 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.224779 Jun 17 13:30:18.218299 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1505/3048] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:30:17 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:30:18.415758 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [req-f9e829fc-293a-47d2-afcf-c4b17026dd82 req-dd1b8663-f626-4009-b09b-c8f36486379b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26622189-19d7-4ce4-b2a8-8f50a6080307", "tag": "209cdeed-f97f-4f00-863c-3c79fed52166"}]} {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:30:18.424143 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [req-f9e829fc-293a-47d2-afcf-c4b17026dd82 req-dd1b8663-f626-4009-b09b-c8f36486379b service nova] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:18.424587 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [req-f9e829fc-293a-47d2-afcf-c4b17026dd82 req-dd1b8663-f626-4009-b09b-c8f36486379b service nova] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:18.436335 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.compute.server_external_events [req-f9e829fc-293a-47d2-afcf-c4b17026dd82 req-dd1b8663-f626-4009-b09b-c8f36486379b service nova] Creating event network-changed:209cdeed-f97f-4f00-863c-3c79fed52166 for instance 26622189-19d7-4ce4-b2a8-8f50a6080307 on hv-cinder-83754 Jun 17 13:30:18.442825 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [req-f9e829fc-293a-47d2-afcf-c4b17026dd82 req-dd1b8663-f626-4009-b09b-c8f36486379b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108627 Jun 17 13:30:18.443808 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1544/3049] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 13:30:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:30:18.893344 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-17175503-f689-48bd-a947-a0ac79c3bda1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:30:18.893946 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-17175503-f689-48bd-a947-a0ac79c3bda1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:30:18.901072 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-17175503-f689-48bd-a947-a0ac79c3bda1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:18.901509 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-17175503-f689-48bd-a947-a0ac79c3bda1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:18.902294 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-17175503-f689-48bd-a947-a0ac79c3bda1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:18.902720 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-17175503-f689-48bd-a947-a0ac79c3bda1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:18.965157 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-17175503-f689-48bd-a947-a0ac79c3bda1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:18.973692 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-17175503-f689-48bd-a947-a0ac79c3bda1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:18.975193 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-17175503-f689-48bd-a947-a0ac79c3bda1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:18.976319 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-17175503-f689-48bd-a947-a0ac79c3bda1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.087046 Jun 17 13:30:18.976867 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1506/3050] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:30:18 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:30:18.998138 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-606d7af4-e8dc-4720-90ea-bddd7b423ef6 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:30:18.998860 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-606d7af4-e8dc-4720-90ea-bddd7b423ef6 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 26622189-19d7-4ce4-b2a8-8f50a6080307] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:30:19.005249 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-606d7af4-e8dc-4720-90ea-bddd7b423ef6 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:19.005701 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-606d7af4-e8dc-4720-90ea-bddd7b423ef6 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:19.006483 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-606d7af4-e8dc-4720-90ea-bddd7b423ef6 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:19.006914 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-606d7af4-e8dc-4720-90ea-bddd7b423ef6 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:19.150979 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-606d7af4-e8dc-4720-90ea-bddd7b423ef6 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:19.162445 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-606d7af4-e8dc-4720-90ea-bddd7b423ef6 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/26622189-19d7-4ce4-b2a8-8f50a6080307" status: 200 len: 1363 microversion: 2.1 time: 0.169230 Jun 17 13:30:19.163017 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1545/3051] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:30:18 2022] GET /compute/v2.1/servers/26622189-19d7-4ce4-b2a8-8f50a6080307 => generated 1363 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:30:19.237452 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-bc9b3f67-8616-4b9b-b70c-8fed0753f079 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:30:19.238181 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-bc9b3f67-8616-4b9b-b70c-8fed0753f079 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:30:19.246685 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bc9b3f67-8616-4b9b-b70c-8fed0753f079 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:19.247109 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bc9b3f67-8616-4b9b-b70c-8fed0753f079 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:19.248075 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bc9b3f67-8616-4b9b-b70c-8fed0753f079 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:19.248510 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bc9b3f67-8616-4b9b-b70c-8fed0753f079 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:19.391713 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-bc9b3f67-8616-4b9b-b70c-8fed0753f079 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:19.396037 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=100 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:30:19.401849 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-bc9b3f67-8616-4b9b-b70c-8fed0753f079 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.170374 Jun 17 13:30:19.402413 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1507/3052] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:30:19 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:30:19.996153 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-f6ae475e-5b8e-4342-b7f0-91c36976100d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:30:19.996764 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-f6ae475e-5b8e-4342-b7f0-91c36976100d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:30:19.999249 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:30:20.004626 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f6ae475e-5b8e-4342-b7f0-91c36976100d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:20.005062 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f6ae475e-5b8e-4342-b7f0-91c36976100d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:20.005809 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f6ae475e-5b8e-4342-b7f0-91c36976100d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:20.006499 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f6ae475e-5b8e-4342-b7f0-91c36976100d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:20.073640 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-f6ae475e-5b8e-4342-b7f0-91c36976100d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:20.082486 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-f6ae475e-5b8e-4342-b7f0-91c36976100d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:20.083982 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-f6ae475e-5b8e-4342-b7f0-91c36976100d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:20.085127 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-f6ae475e-5b8e-4342-b7f0-91c36976100d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.093824 Jun 17 13:30:20.085688 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1546/3053] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:30:19 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:30:20.183544 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-1e269e93-36fb-46a4-b7df-29c89313f299 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:30:20.184579 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-1e269e93-36fb-46a4-b7df-29c89313f299 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 26622189-19d7-4ce4-b2a8-8f50a6080307] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:30:20.195179 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1e269e93-36fb-46a4-b7df-29c89313f299 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:20.195913 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1e269e93-36fb-46a4-b7df-29c89313f299 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:20.197000 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1e269e93-36fb-46a4-b7df-29c89313f299 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:20.197401 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1e269e93-36fb-46a4-b7df-29c89313f299 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:20.331960 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-1e269e93-36fb-46a4-b7df-29c89313f299 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:20.339739 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-1e269e93-36fb-46a4-b7df-29c89313f299 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/26622189-19d7-4ce4-b2a8-8f50a6080307" status: 200 len: 1363 microversion: 2.1 time: 0.163097 Jun 17 13:30:20.340268 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1508/3054] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:30:20 2022] GET /compute/v2.1/servers/26622189-19d7-4ce4-b2a8-8f50a6080307 => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:30:20.419278 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-18990895-f3ae-4d2f-a424-acba12007087 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:30:20.419886 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-18990895-f3ae-4d2f-a424-acba12007087 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:30:20.426848 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-18990895-f3ae-4d2f-a424-acba12007087 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:20.427299 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-18990895-f3ae-4d2f-a424-acba12007087 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:20.428049 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-18990895-f3ae-4d2f-a424-acba12007087 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:20.428479 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-18990895-f3ae-4d2f-a424-acba12007087 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:20.563646 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-18990895-f3ae-4d2f-a424-acba12007087 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:20.575883 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-18990895-f3ae-4d2f-a424-acba12007087 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.160368 Jun 17 13:30:20.576642 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1547/3055] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:30:20 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:30:21.105132 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-8bd50073-5b42-4dfe-9778-ef5a070e00e3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:30:21.105977 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-8bd50073-5b42-4dfe-9778-ef5a070e00e3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:30:21.113874 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8bd50073-5b42-4dfe-9778-ef5a070e00e3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:21.114355 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8bd50073-5b42-4dfe-9778-ef5a070e00e3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:21.115124 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8bd50073-5b42-4dfe-9778-ef5a070e00e3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:21.115559 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8bd50073-5b42-4dfe-9778-ef5a070e00e3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:21.190295 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-8bd50073-5b42-4dfe-9778-ef5a070e00e3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:21.202469 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-8bd50073-5b42-4dfe-9778-ef5a070e00e3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:21.204385 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-8bd50073-5b42-4dfe-9778-ef5a070e00e3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:21.206241 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-8bd50073-5b42-4dfe-9778-ef5a070e00e3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.106579 Jun 17 13:30:21.207400 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1509/3056] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:30:21 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:30:21.357392 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-c74786de-86e8-43fa-930f-fa6aba2123e1 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:30:21.357992 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-c74786de-86e8-43fa-930f-fa6aba2123e1 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 26622189-19d7-4ce4-b2a8-8f50a6080307] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:30:21.365155 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c74786de-86e8-43fa-930f-fa6aba2123e1 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:21.365620 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c74786de-86e8-43fa-930f-fa6aba2123e1 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:21.366444 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c74786de-86e8-43fa-930f-fa6aba2123e1 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:21.366906 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c74786de-86e8-43fa-930f-fa6aba2123e1 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:21.597536 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-d18692fe-3b87-443b-b6c3-0ee38ee16979 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:30:21.598147 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-d18692fe-3b87-443b-b6c3-0ee38ee16979 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:30:21.606080 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d18692fe-3b87-443b-b6c3-0ee38ee16979 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:21.606572 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d18692fe-3b87-443b-b6c3-0ee38ee16979 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:21.607348 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d18692fe-3b87-443b-b6c3-0ee38ee16979 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:21.607849 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d18692fe-3b87-443b-b6c3-0ee38ee16979 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:21.619819 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-c74786de-86e8-43fa-930f-fa6aba2123e1 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:21.628411 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-c74786de-86e8-43fa-930f-fa6aba2123e1 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/26622189-19d7-4ce4-b2a8-8f50a6080307" status: 200 len: 1363 microversion: 2.1 time: 0.275289 Jun 17 13:30:21.628887 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1548/3057] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:30:21 2022] GET /compute/v2.1/servers/26622189-19d7-4ce4-b2a8-8f50a6080307 => generated 1363 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 13:30:21.767350 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-d18692fe-3b87-443b-b6c3-0ee38ee16979 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:21.775592 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-d18692fe-3b87-443b-b6c3-0ee38ee16979 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.182323 Jun 17 13:30:21.776153 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1510/3058] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:30:21 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:30:22.225447 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-33ff9b39-2d85-4e66-a0c3-c210fc94bbf1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:30:22.226213 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-33ff9b39-2d85-4e66-a0c3-c210fc94bbf1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:30:22.233492 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-33ff9b39-2d85-4e66-a0c3-c210fc94bbf1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:22.234057 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-33ff9b39-2d85-4e66-a0c3-c210fc94bbf1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:22.234956 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-33ff9b39-2d85-4e66-a0c3-c210fc94bbf1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:22.235432 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-33ff9b39-2d85-4e66-a0c3-c210fc94bbf1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:22.302615 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-33ff9b39-2d85-4e66-a0c3-c210fc94bbf1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:22.312765 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-33ff9b39-2d85-4e66-a0c3-c210fc94bbf1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:22.314394 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-33ff9b39-2d85-4e66-a0c3-c210fc94bbf1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:22.315706 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-33ff9b39-2d85-4e66-a0c3-c210fc94bbf1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.094635 Jun 17 13:30:22.316354 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1549/3059] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:30:22 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:30:22.647438 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-8543cacf-5e13-43d7-a240-7cff3f037734 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:30:22.648241 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-8543cacf-5e13-43d7-a240-7cff3f037734 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 26622189-19d7-4ce4-b2a8-8f50a6080307] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:30:22.655935 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8543cacf-5e13-43d7-a240-7cff3f037734 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:22.656386 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8543cacf-5e13-43d7-a240-7cff3f037734 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:22.657137 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8543cacf-5e13-43d7-a240-7cff3f037734 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:22.657565 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8543cacf-5e13-43d7-a240-7cff3f037734 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:22.793752 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-8543cacf-5e13-43d7-a240-7cff3f037734 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:22.796685 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-149457e8-6a13-4c07-8f16-1a643af811d8 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:30:22.797295 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-149457e8-6a13-4c07-8f16-1a643af811d8 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:30:22.801837 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-8543cacf-5e13-43d7-a240-7cff3f037734 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/26622189-19d7-4ce4-b2a8-8f50a6080307" status: 200 len: 1363 microversion: 2.1 time: 0.159985 Jun 17 13:30:22.802480 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1511/3060] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:30:22 2022] GET /compute/v2.1/servers/26622189-19d7-4ce4-b2a8-8f50a6080307 => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:30:22.803899 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-149457e8-6a13-4c07-8f16-1a643af811d8 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:22.804349 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-149457e8-6a13-4c07-8f16-1a643af811d8 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:22.805096 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-149457e8-6a13-4c07-8f16-1a643af811d8 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:22.805680 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-149457e8-6a13-4c07-8f16-1a643af811d8 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:22.941341 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-149457e8-6a13-4c07-8f16-1a643af811d8 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:22.954375 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-149457e8-6a13-4c07-8f16-1a643af811d8 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.161177 Jun 17 13:30:22.955242 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1550/3061] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:30:22 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:30:23.337698 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-113b7616-d11e-4e34-99db-fea18c794e32 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:30:23.338731 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-113b7616-d11e-4e34-99db-fea18c794e32 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:30:23.348032 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-113b7616-d11e-4e34-99db-fea18c794e32 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:23.348557 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-113b7616-d11e-4e34-99db-fea18c794e32 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:23.349542 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-113b7616-d11e-4e34-99db-fea18c794e32 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:23.350171 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-113b7616-d11e-4e34-99db-fea18c794e32 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:23.417366 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-113b7616-d11e-4e34-99db-fea18c794e32 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:23.425894 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-113b7616-d11e-4e34-99db-fea18c794e32 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:23.427443 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-113b7616-d11e-4e34-99db-fea18c794e32 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:23.428603 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-113b7616-d11e-4e34-99db-fea18c794e32 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.096963 Jun 17 13:30:23.429088 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1512/3062] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:30:23 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:30:23.819187 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-f91a34dc-568f-4ab8-b1b8-5aad8e826744 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:30:23.819859 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-f91a34dc-568f-4ab8-b1b8-5aad8e826744 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 26622189-19d7-4ce4-b2a8-8f50a6080307] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:30:23.827438 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f91a34dc-568f-4ab8-b1b8-5aad8e826744 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:23.827893 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f91a34dc-568f-4ab8-b1b8-5aad8e826744 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:23.828766 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f91a34dc-568f-4ab8-b1b8-5aad8e826744 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:23.829204 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f91a34dc-568f-4ab8-b1b8-5aad8e826744 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:23.958198 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-f91a34dc-568f-4ab8-b1b8-5aad8e826744 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:23.966123 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-f91a34dc-568f-4ab8-b1b8-5aad8e826744 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/26622189-19d7-4ce4-b2a8-8f50a6080307" status: 200 len: 1363 microversion: 2.1 time: 0.150882 Jun 17 13:30:23.966740 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1551/3063] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:30:23 2022] GET /compute/v2.1/servers/26622189-19d7-4ce4-b2a8-8f50a6080307 => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:30:23.974025 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-823a7203-3789-489d-96cf-b8c47d43ebc8 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:30:23.974804 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-823a7203-3789-489d-96cf-b8c47d43ebc8 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:30:23.982015 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-823a7203-3789-489d-96cf-b8c47d43ebc8 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:23.982487 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-823a7203-3789-489d-96cf-b8c47d43ebc8 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:23.983240 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-823a7203-3789-489d-96cf-b8c47d43ebc8 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:23.983673 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-823a7203-3789-489d-96cf-b8c47d43ebc8 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:24.118842 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-823a7203-3789-489d-96cf-b8c47d43ebc8 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:24.126926 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-823a7203-3789-489d-96cf-b8c47d43ebc8 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.156715 Jun 17 13:30:24.127478 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1513/3064] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:30:23 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:30:24.448903 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-3de713eb-c332-4546-90c9-e93ce8c3471f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:30:24.449587 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-3de713eb-c332-4546-90c9-e93ce8c3471f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:30:24.456206 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3de713eb-c332-4546-90c9-e93ce8c3471f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:24.456642 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3de713eb-c332-4546-90c9-e93ce8c3471f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:24.457402 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3de713eb-c332-4546-90c9-e93ce8c3471f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:24.457946 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3de713eb-c332-4546-90c9-e93ce8c3471f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:24.528610 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-3de713eb-c332-4546-90c9-e93ce8c3471f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:24.537354 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-3de713eb-c332-4546-90c9-e93ce8c3471f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:24.539061 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-3de713eb-c332-4546-90c9-e93ce8c3471f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:24.540340 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-3de713eb-c332-4546-90c9-e93ce8c3471f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.097221 Jun 17 13:30:24.540887 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1514/3065] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:30:24 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:30:24.542214 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [req-5c0960dc-f5d1-4530-9e59-0f51e3814ed6 req-494cc838-8d46-4dcd-8233-d46f94aed9fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26622189-19d7-4ce4-b2a8-8f50a6080307", "name": "network-vif-plugged", "status": "completed", "tag": "209cdeed-f97f-4f00-863c-3c79fed52166"}]} {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:30:24.550626 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [req-5c0960dc-f5d1-4530-9e59-0f51e3814ed6 req-494cc838-8d46-4dcd-8233-d46f94aed9fe service nova] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:24.551067 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [req-5c0960dc-f5d1-4530-9e59-0f51e3814ed6 req-494cc838-8d46-4dcd-8233-d46f94aed9fe service nova] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:24.562508 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.compute.server_external_events [req-5c0960dc-f5d1-4530-9e59-0f51e3814ed6 req-494cc838-8d46-4dcd-8233-d46f94aed9fe service nova] Creating event network-vif-plugged:209cdeed-f97f-4f00-863c-3c79fed52166 for instance 26622189-19d7-4ce4-b2a8-8f50a6080307 on hv-cinder-83754 Jun 17 13:30:24.567535 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [req-5c0960dc-f5d1-4530-9e59-0f51e3814ed6 req-494cc838-8d46-4dcd-8233-d46f94aed9fe service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132619 Jun 17 13:30:24.568155 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1552/3066] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 13:30:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 13:30:24.984200 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-124af07b-16c2-48c0-9166-893bb421d9ea tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:30:24.984791 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-124af07b-16c2-48c0-9166-893bb421d9ea tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 26622189-19d7-4ce4-b2a8-8f50a6080307] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:30:24.991937 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-124af07b-16c2-48c0-9166-893bb421d9ea tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:24.992385 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-124af07b-16c2-48c0-9166-893bb421d9ea tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:24.993701 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-124af07b-16c2-48c0-9166-893bb421d9ea tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:24.994157 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-124af07b-16c2-48c0-9166-893bb421d9ea tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:25.137237 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-124af07b-16c2-48c0-9166-893bb421d9ea tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:25.144955 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-8a92629a-7005-4653-8069-a452f8b40427 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:30:25.145496 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-124af07b-16c2-48c0-9166-893bb421d9ea tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/26622189-19d7-4ce4-b2a8-8f50a6080307" status: 200 len: 1363 microversion: 2.1 time: 0.164881 Jun 17 13:30:25.145626 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-8a92629a-7005-4653-8069-a452f8b40427 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:30:25.145954 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1515/3067] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:30:24 2022] GET /compute/v2.1/servers/26622189-19d7-4ce4-b2a8-8f50a6080307 => generated 1363 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:30:25.152525 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8a92629a-7005-4653-8069-a452f8b40427 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:25.152978 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8a92629a-7005-4653-8069-a452f8b40427 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:25.153741 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8a92629a-7005-4653-8069-a452f8b40427 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:25.154202 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8a92629a-7005-4653-8069-a452f8b40427 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:25.290335 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-8a92629a-7005-4653-8069-a452f8b40427 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:25.298630 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-8a92629a-7005-4653-8069-a452f8b40427 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.158326 Jun 17 13:30:25.299235 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1553/3068] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:30:25 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:30:25.562663 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-fbf321d6-8c44-4862-90d1-fe9fa9af2321 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:30:25.563729 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-fbf321d6-8c44-4862-90d1-fe9fa9af2321 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:30:25.573761 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fbf321d6-8c44-4862-90d1-fe9fa9af2321 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:25.574243 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fbf321d6-8c44-4862-90d1-fe9fa9af2321 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:25.575010 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fbf321d6-8c44-4862-90d1-fe9fa9af2321 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:25.575440 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fbf321d6-8c44-4862-90d1-fe9fa9af2321 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:25.637468 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-fbf321d6-8c44-4862-90d1-fe9fa9af2321 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:25.646122 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-fbf321d6-8c44-4862-90d1-fe9fa9af2321 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:25.647619 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-fbf321d6-8c44-4862-90d1-fe9fa9af2321 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:25.648755 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-fbf321d6-8c44-4862-90d1-fe9fa9af2321 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.092761 Jun 17 13:30:25.649307 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1516/3069] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:30:25 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:30:26.162860 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-d33dae60-9c37-4989-bdd2-a148964879c1 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:30:26.163395 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-d33dae60-9c37-4989-bdd2-a148964879c1 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 26622189-19d7-4ce4-b2a8-8f50a6080307] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:30:26.165583 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_cell0:SELECT=2 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:30:26.166421 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_cell0:SELECT=12 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:30:26.173901 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d33dae60-9c37-4989-bdd2-a148964879c1 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:26.174473 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d33dae60-9c37-4989-bdd2-a148964879c1 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:26.175318 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d33dae60-9c37-4989-bdd2-a148964879c1 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:26.175887 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d33dae60-9c37-4989-bdd2-a148964879c1 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:26.310951 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-d33dae60-9c37-4989-bdd2-a148964879c1 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:26.316124 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-5c4fb9ad-7735-4005-b9e7-5be4b8066a94 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:30:26.316836 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-5c4fb9ad-7735-4005-b9e7-5be4b8066a94 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:30:26.318765 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-d33dae60-9c37-4989-bdd2-a148964879c1 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/26622189-19d7-4ce4-b2a8-8f50a6080307" status: 200 len: 1363 microversion: 2.1 time: 0.159947 Jun 17 13:30:26.319305 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1554/3070] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:30:26 2022] GET /compute/v2.1/servers/26622189-19d7-4ce4-b2a8-8f50a6080307 => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:30:26.323455 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5c4fb9ad-7735-4005-b9e7-5be4b8066a94 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:26.323900 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5c4fb9ad-7735-4005-b9e7-5be4b8066a94 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:26.324661 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5c4fb9ad-7735-4005-b9e7-5be4b8066a94 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:26.325093 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5c4fb9ad-7735-4005-b9e7-5be4b8066a94 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:26.456735 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-5c4fb9ad-7735-4005-b9e7-5be4b8066a94 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:26.465140 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-5c4fb9ad-7735-4005-b9e7-5be4b8066a94 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.152857 Jun 17 13:30:26.465758 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1517/3071] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:30:26 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:30:26.671446 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-ba030791-4659-4846-8f69-8d3f2a2215b6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:30:26.672488 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-ba030791-4659-4846-8f69-8d3f2a2215b6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:30:26.682877 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ba030791-4659-4846-8f69-8d3f2a2215b6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:26.684041 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ba030791-4659-4846-8f69-8d3f2a2215b6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:26.688304 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ba030791-4659-4846-8f69-8d3f2a2215b6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:26.688812 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ba030791-4659-4846-8f69-8d3f2a2215b6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:26.754228 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-ba030791-4659-4846-8f69-8d3f2a2215b6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:26.764531 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-ba030791-4659-4846-8f69-8d3f2a2215b6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:26.766142 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-ba030791-4659-4846-8f69-8d3f2a2215b6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:26.767279 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-ba030791-4659-4846-8f69-8d3f2a2215b6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.102900 Jun 17 13:30:26.767843 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1555/3072] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:30:26 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:30:27.340215 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-f394eb48-9b42-4417-bd3b-7119c6f364bb tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:30:27.340829 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-f394eb48-9b42-4417-bd3b-7119c6f364bb tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 26622189-19d7-4ce4-b2a8-8f50a6080307] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:30:27.348175 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f394eb48-9b42-4417-bd3b-7119c6f364bb tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:27.348613 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f394eb48-9b42-4417-bd3b-7119c6f364bb tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:27.349362 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f394eb48-9b42-4417-bd3b-7119c6f364bb tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:27.349788 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f394eb48-9b42-4417-bd3b-7119c6f364bb tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:27.483512 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-a675f2a7-91d6-48e9-89f9-04c15accb667 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:30:27.484380 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-a675f2a7-91d6-48e9-89f9-04c15accb667 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:30:27.485042 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-f394eb48-9b42-4417-bd3b-7119c6f364bb tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:27.491439 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a675f2a7-91d6-48e9-89f9-04c15accb667 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:27.491895 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a675f2a7-91d6-48e9-89f9-04c15accb667 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:27.492656 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a675f2a7-91d6-48e9-89f9-04c15accb667 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:27.492833 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-f394eb48-9b42-4417-bd3b-7119c6f364bb tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/26622189-19d7-4ce4-b2a8-8f50a6080307" status: 200 len: 1549 microversion: 2.1 time: 0.158438 Jun 17 13:30:27.493094 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a675f2a7-91d6-48e9-89f9-04c15accb667 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:27.493405 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1518/3073] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:30:27 2022] GET /compute/v2.1/servers/26622189-19d7-4ce4-b2a8-8f50a6080307 => generated 1549 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 13:30:27.497796 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_cell1:SELECT=100 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:30:27.509136 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-9284105c-85ac-4e26-a3e0-d7cbc93d8da6 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:30:27.509631 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-9284105c-85ac-4e26-a3e0-d7cbc93d8da6 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 26622189-19d7-4ce4-b2a8-8f50a6080307] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:30:27.516544 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9284105c-85ac-4e26-a3e0-d7cbc93d8da6 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:27.516994 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9284105c-85ac-4e26-a3e0-d7cbc93d8da6 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:27.517754 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9284105c-85ac-4e26-a3e0-d7cbc93d8da6 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:27.518216 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9284105c-85ac-4e26-a3e0-d7cbc93d8da6 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:27.630275 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-9284105c-85ac-4e26-a3e0-d7cbc93d8da6 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/26622189-19d7-4ce4-b2a8-8f50a6080307/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.124710 Jun 17 13:30:27.630847 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1519/3074] 10.222.0.48 () {58 vars in 1274 bytes} [Fri Jun 17 13:30:27 2022] GET /compute/v2.1/servers/26622189-19d7-4ce4-b2a8-8f50a6080307/os-interface => generated 284 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 13:30:27.662843 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-a675f2a7-91d6-48e9-89f9-04c15accb667 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:27.671160 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-a675f2a7-91d6-48e9-89f9-04c15accb667 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.192595 Jun 17 13:30:27.671735 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1556/3075] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:30:27 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:30:27.785492 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-8fd92d4c-b7fc-4034-9c52-834fcac1cdac tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:30:27.786183 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-8fd92d4c-b7fc-4034-9c52-834fcac1cdac tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:30:27.792604 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8fd92d4c-b7fc-4034-9c52-834fcac1cdac tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:27.793053 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8fd92d4c-b7fc-4034-9c52-834fcac1cdac tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:27.793822 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8fd92d4c-b7fc-4034-9c52-834fcac1cdac tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:27.794295 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8fd92d4c-b7fc-4034-9c52-834fcac1cdac tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:27.859473 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-8fd92d4c-b7fc-4034-9c52-834fcac1cdac tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:27.868302 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-8fd92d4c-b7fc-4034-9c52-834fcac1cdac tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:27.869816 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-8fd92d4c-b7fc-4034-9c52-834fcac1cdac tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:27.871244 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-8fd92d4c-b7fc-4034-9c52-834fcac1cdac tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.089809 Jun 17 13:30:27.871798 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1520/3076] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:30:27 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:30:28.654742 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [req-1f7cb152-c2b4-4373-af9b-d8b364dca6e0 req-537fd916-c5c8-48f7-aed7-8f6c4b3d85ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26622189-19d7-4ce4-b2a8-8f50a6080307", "tag": "209cdeed-f97f-4f00-863c-3c79fed52166"}]} {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:30:28.663651 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [req-1f7cb152-c2b4-4373-af9b-d8b364dca6e0 req-537fd916-c5c8-48f7-aed7-8f6c4b3d85ba service nova] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:28.664010 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [req-1f7cb152-c2b4-4373-af9b-d8b364dca6e0 req-537fd916-c5c8-48f7-aed7-8f6c4b3d85ba service nova] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:28.675994 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.compute.server_external_events [req-1f7cb152-c2b4-4373-af9b-d8b364dca6e0 req-537fd916-c5c8-48f7-aed7-8f6c4b3d85ba service nova] Creating event network-changed:209cdeed-f97f-4f00-863c-3c79fed52166 for instance 26622189-19d7-4ce4-b2a8-8f50a6080307 on hv-cinder-83754 Jun 17 13:30:28.681282 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [req-1f7cb152-c2b4-4373-af9b-d8b364dca6e0 req-537fd916-c5c8-48f7-aed7-8f6c4b3d85ba service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096127 Jun 17 13:30:28.682530 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1557/3077] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 13:30:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:30:28.689419 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-0fad15b4-f74d-49e0-a314-2530fefcbf7b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:30:28.690135 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-0fad15b4-f74d-49e0-a314-2530fefcbf7b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:30:28.696753 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0fad15b4-f74d-49e0-a314-2530fefcbf7b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:28.697196 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0fad15b4-f74d-49e0-a314-2530fefcbf7b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:28.698005 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0fad15b4-f74d-49e0-a314-2530fefcbf7b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:28.698453 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0fad15b4-f74d-49e0-a314-2530fefcbf7b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:28.890791 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-cf4d5676-ce4d-49e7-ade4-9a40399e2010 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:30:28.892295 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-cf4d5676-ce4d-49e7-ade4-9a40399e2010 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:30:28.898972 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-cf4d5676-ce4d-49e7-ade4-9a40399e2010 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:28.899550 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-cf4d5676-ce4d-49e7-ade4-9a40399e2010 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:28.900529 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-cf4d5676-ce4d-49e7-ade4-9a40399e2010 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:28.901128 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-cf4d5676-ce4d-49e7-ade4-9a40399e2010 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:28.939017 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-0fad15b4-f74d-49e0-a314-2530fefcbf7b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:28.952272 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-0fad15b4-f74d-49e0-a314-2530fefcbf7b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.266198 Jun 17 13:30:28.958137 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1521/3078] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:30:28 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:30:28.981007 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-cf4d5676-ce4d-49e7-ade4-9a40399e2010 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:28.989690 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-cf4d5676-ce4d-49e7-ade4-9a40399e2010 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:28.991348 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-cf4d5676-ce4d-49e7-ade4-9a40399e2010 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:28.992496 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-cf4d5676-ce4d-49e7-ade4-9a40399e2010 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.106902 Jun 17 13:30:28.993297 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1558/3079] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:30:28 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:30:29.968390 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-dc9f2f62-06a6-4bce-9df8-963336fc77f3 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:30:29.969036 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-dc9f2f62-06a6-4bce-9df8-963336fc77f3 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:30:29.976093 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dc9f2f62-06a6-4bce-9df8-963336fc77f3 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:29.976535 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dc9f2f62-06a6-4bce-9df8-963336fc77f3 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:29.977290 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dc9f2f62-06a6-4bce-9df8-963336fc77f3 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:29.977715 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dc9f2f62-06a6-4bce-9df8-963336fc77f3 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:30.012384 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-b55661b9-bf56-4af0-a429-415414f4b5f6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:30:30.013049 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-b55661b9-bf56-4af0-a429-415414f4b5f6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:30:30.023286 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b55661b9-bf56-4af0-a429-415414f4b5f6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:30.023732 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b55661b9-bf56-4af0-a429-415414f4b5f6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:30.024619 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b55661b9-bf56-4af0-a429-415414f4b5f6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:30.025067 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b55661b9-bf56-4af0-a429-415414f4b5f6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:30.108354 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-b55661b9-bf56-4af0-a429-415414f4b5f6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:30.119860 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-b55661b9-bf56-4af0-a429-415414f4b5f6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:30.121615 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-b55661b9-bf56-4af0-a429-415414f4b5f6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:30.122931 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-b55661b9-bf56-4af0-a429-415414f4b5f6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.116039 Jun 17 13:30:30.130746 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1559/3080] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:30:30 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 13:30:30.402401 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-dc9f2f62-06a6-4bce-9df8-963336fc77f3 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:30.411202 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-dc9f2f62-06a6-4bce-9df8-963336fc77f3 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.446858 Jun 17 13:30:30.411813 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1522/3081] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:30:29 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:30:31.141177 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-b59398ab-311d-405c-be5d-210fc27b6811 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:30:31.141877 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-b59398ab-311d-405c-be5d-210fc27b6811 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:30:31.148743 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b59398ab-311d-405c-be5d-210fc27b6811 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:31.149192 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b59398ab-311d-405c-be5d-210fc27b6811 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:31.149954 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b59398ab-311d-405c-be5d-210fc27b6811 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:31.150441 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b59398ab-311d-405c-be5d-210fc27b6811 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:31.218825 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-b59398ab-311d-405c-be5d-210fc27b6811 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:31.227852 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-b59398ab-311d-405c-be5d-210fc27b6811 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:31.230024 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-b59398ab-311d-405c-be5d-210fc27b6811 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:31.233645 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-b59398ab-311d-405c-be5d-210fc27b6811 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.096409 Jun 17 13:30:31.234299 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1560/3082] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:30:31 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:30:31.429197 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-c9cfc152-1df9-4393-80f7-430f7d927538 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:30:31.429845 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-c9cfc152-1df9-4393-80f7-430f7d927538 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:30:31.437304 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c9cfc152-1df9-4393-80f7-430f7d927538 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:31.437885 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c9cfc152-1df9-4393-80f7-430f7d927538 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:31.439068 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c9cfc152-1df9-4393-80f7-430f7d927538 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:31.439579 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c9cfc152-1df9-4393-80f7-430f7d927538 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:31.576416 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-c9cfc152-1df9-4393-80f7-430f7d927538 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:31.584876 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-c9cfc152-1df9-4393-80f7-430f7d927538 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.159875 Jun 17 13:30:31.585450 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1523/3083] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:30:31 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:30:32.252612 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-68b780d6-e9ab-4748-98ff-85ceb0ffd74a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:30:32.253204 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-68b780d6-e9ab-4748-98ff-85ceb0ffd74a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:30:32.260454 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-68b780d6-e9ab-4748-98ff-85ceb0ffd74a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:32.260901 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-68b780d6-e9ab-4748-98ff-85ceb0ffd74a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:32.261665 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-68b780d6-e9ab-4748-98ff-85ceb0ffd74a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:32.262187 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-68b780d6-e9ab-4748-98ff-85ceb0ffd74a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:32.328173 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-68b780d6-e9ab-4748-98ff-85ceb0ffd74a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:32.341885 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-68b780d6-e9ab-4748-98ff-85ceb0ffd74a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:32.343117 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-68b780d6-e9ab-4748-98ff-85ceb0ffd74a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:32.344495 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-68b780d6-e9ab-4748-98ff-85ceb0ffd74a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.095880 Jun 17 13:30:32.345373 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1561/3084] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:30:32 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:30:32.601844 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-d2efc424-3172-42e7-ad60-d8733ff89e2f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:30:32.602514 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-d2efc424-3172-42e7-ad60-d8733ff89e2f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:30:32.609599 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d2efc424-3172-42e7-ad60-d8733ff89e2f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:32.610047 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d2efc424-3172-42e7-ad60-d8733ff89e2f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:32.610840 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d2efc424-3172-42e7-ad60-d8733ff89e2f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:32.611273 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d2efc424-3172-42e7-ad60-d8733ff89e2f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:32.743134 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-d2efc424-3172-42e7-ad60-d8733ff89e2f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:32.747044 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=100 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:30:32.752174 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-d2efc424-3172-42e7-ad60-d8733ff89e2f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.154299 Jun 17 13:30:32.752746 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1524/3085] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:30:32 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:30:33.363357 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-6a9ddbc4-c288-4d0c-8df4-edea1476df1b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:30:33.363994 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-6a9ddbc4-c288-4d0c-8df4-edea1476df1b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:30:33.372245 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6a9ddbc4-c288-4d0c-8df4-edea1476df1b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:33.372689 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6a9ddbc4-c288-4d0c-8df4-edea1476df1b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:33.373606 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6a9ddbc4-c288-4d0c-8df4-edea1476df1b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:33.374241 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6a9ddbc4-c288-4d0c-8df4-edea1476df1b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:33.437124 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-6a9ddbc4-c288-4d0c-8df4-edea1476df1b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:33.445934 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-6a9ddbc4-c288-4d0c-8df4-edea1476df1b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:33.447449 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-6a9ddbc4-c288-4d0c-8df4-edea1476df1b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:33.448611 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-6a9ddbc4-c288-4d0c-8df4-edea1476df1b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.089218 Jun 17 13:30:33.449184 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1562/3086] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:30:33 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:30:33.769413 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-9d5cbecc-f8f9-4a3b-9299-63ad76188d9f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:30:33.770009 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-9d5cbecc-f8f9-4a3b-9299-63ad76188d9f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:30:33.777695 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9d5cbecc-f8f9-4a3b-9299-63ad76188d9f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:33.778228 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9d5cbecc-f8f9-4a3b-9299-63ad76188d9f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:33.779010 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9d5cbecc-f8f9-4a3b-9299-63ad76188d9f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:33.779448 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9d5cbecc-f8f9-4a3b-9299-63ad76188d9f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:33.920153 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-9d5cbecc-f8f9-4a3b-9299-63ad76188d9f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:33.928556 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-9d5cbecc-f8f9-4a3b-9299-63ad76188d9f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.163465 Jun 17 13:30:33.929127 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1525/3087] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:30:33 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:30:34.467167 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-1a87c931-6fef-4d92-9119-c0f2baeff32d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:30:34.467765 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-1a87c931-6fef-4d92-9119-c0f2baeff32d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:30:34.475027 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-1a87c931-6fef-4d92-9119-c0f2baeff32d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:34.475472 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-1a87c931-6fef-4d92-9119-c0f2baeff32d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:34.476239 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-1a87c931-6fef-4d92-9119-c0f2baeff32d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:34.476679 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-1a87c931-6fef-4d92-9119-c0f2baeff32d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:34.542995 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-1a87c931-6fef-4d92-9119-c0f2baeff32d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:34.552189 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-1a87c931-6fef-4d92-9119-c0f2baeff32d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:34.553661 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-1a87c931-6fef-4d92-9119-c0f2baeff32d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:34.554849 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-1a87c931-6fef-4d92-9119-c0f2baeff32d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.091785 Jun 17 13:30:34.555611 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1563/3088] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:30:34 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:30:34.944982 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-61f128ca-b7e6-4fc4-892b-1fe5e2efefaa tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:30:34.945578 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-61f128ca-b7e6-4fc4-892b-1fe5e2efefaa tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:30:34.952897 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-61f128ca-b7e6-4fc4-892b-1fe5e2efefaa tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:34.953300 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-61f128ca-b7e6-4fc4-892b-1fe5e2efefaa tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:34.954073 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-61f128ca-b7e6-4fc4-892b-1fe5e2efefaa tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:34.954567 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-61f128ca-b7e6-4fc4-892b-1fe5e2efefaa tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:35.089503 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-61f128ca-b7e6-4fc4-892b-1fe5e2efefaa tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:35.097782 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-61f128ca-b7e6-4fc4-892b-1fe5e2efefaa tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.156757 Jun 17 13:30:35.098515 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1526/3089] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:30:34 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:30:35.574464 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-fa7e936f-163a-447f-802d-b4a14c21b6e7 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:30:35.575102 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-fa7e936f-163a-447f-802d-b4a14c21b6e7 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:30:35.581866 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-fa7e936f-163a-447f-802d-b4a14c21b6e7 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:35.582344 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-fa7e936f-163a-447f-802d-b4a14c21b6e7 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:35.583105 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-fa7e936f-163a-447f-802d-b4a14c21b6e7 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:35.583538 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-fa7e936f-163a-447f-802d-b4a14c21b6e7 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:35.675068 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-fa7e936f-163a-447f-802d-b4a14c21b6e7 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:35.684224 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-fa7e936f-163a-447f-802d-b4a14c21b6e7 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:35.685708 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-fa7e936f-163a-447f-802d-b4a14c21b6e7 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:35.686893 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-fa7e936f-163a-447f-802d-b4a14c21b6e7 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.118007 Jun 17 13:30:35.687467 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1564/3090] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:30:35 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:30:36.116174 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-2e0b7ec8-3d2e-4ed3-968f-096ebd27e648 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:30:36.116712 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-2e0b7ec8-3d2e-4ed3-968f-096ebd27e648 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:30:36.123523 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2e0b7ec8-3d2e-4ed3-968f-096ebd27e648 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:36.123972 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2e0b7ec8-3d2e-4ed3-968f-096ebd27e648 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:36.124720 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2e0b7ec8-3d2e-4ed3-968f-096ebd27e648 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:36.125151 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2e0b7ec8-3d2e-4ed3-968f-096ebd27e648 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:36.267493 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-2e0b7ec8-3d2e-4ed3-968f-096ebd27e648 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:36.276284 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-2e0b7ec8-3d2e-4ed3-968f-096ebd27e648 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.163947 Jun 17 13:30:36.276857 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1527/3091] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:30:36 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:30:36.705045 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-7b48ee65-60d6-40e1-b6ab-3d65e56f03fb tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:30:36.705769 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-7b48ee65-60d6-40e1-b6ab-3d65e56f03fb tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:30:36.712651 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7b48ee65-60d6-40e1-b6ab-3d65e56f03fb tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:36.713235 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7b48ee65-60d6-40e1-b6ab-3d65e56f03fb tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:36.714320 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7b48ee65-60d6-40e1-b6ab-3d65e56f03fb tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:36.714855 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7b48ee65-60d6-40e1-b6ab-3d65e56f03fb tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:36.784578 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-7b48ee65-60d6-40e1-b6ab-3d65e56f03fb tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:36.793850 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-7b48ee65-60d6-40e1-b6ab-3d65e56f03fb tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:36.795414 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-7b48ee65-60d6-40e1-b6ab-3d65e56f03fb tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:36.796558 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-7b48ee65-60d6-40e1-b6ab-3d65e56f03fb tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.095672 Jun 17 13:30:36.807016 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1565/3092] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:30:36 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 13:30:37.293389 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-ff32b6ec-498e-4008-9d76-6de681ecb5d6 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:30:37.294114 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-ff32b6ec-498e-4008-9d76-6de681ecb5d6 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:30:37.301101 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ff32b6ec-498e-4008-9d76-6de681ecb5d6 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:37.301550 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ff32b6ec-498e-4008-9d76-6de681ecb5d6 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:37.302347 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ff32b6ec-498e-4008-9d76-6de681ecb5d6 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:37.302782 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ff32b6ec-498e-4008-9d76-6de681ecb5d6 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:37.437784 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-ff32b6ec-498e-4008-9d76-6de681ecb5d6 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:37.446000 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-ff32b6ec-498e-4008-9d76-6de681ecb5d6 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.156855 Jun 17 13:30:37.446606 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1528/3093] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:30:37 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:30:37.819094 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-6202f29a-18c5-4f4f-8dea-b390b0e2d4d0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:30:37.820114 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-6202f29a-18c5-4f4f-8dea-b390b0e2d4d0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:30:37.831522 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6202f29a-18c5-4f4f-8dea-b390b0e2d4d0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:37.832310 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6202f29a-18c5-4f4f-8dea-b390b0e2d4d0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:37.833606 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6202f29a-18c5-4f4f-8dea-b390b0e2d4d0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:37.834484 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6202f29a-18c5-4f4f-8dea-b390b0e2d4d0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:37.913032 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-6202f29a-18c5-4f4f-8dea-b390b0e2d4d0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:37.922289 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-6202f29a-18c5-4f4f-8dea-b390b0e2d4d0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:37.923799 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-6202f29a-18c5-4f4f-8dea-b390b0e2d4d0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:37.925062 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-6202f29a-18c5-4f4f-8dea-b390b0e2d4d0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.112653 Jun 17 13:30:37.925634 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1566/3094] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:30:37 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:30:38.466701 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-29c03309-28fa-45c2-9126-626306158bb1 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:30:38.467629 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-29c03309-28fa-45c2-9126-626306158bb1 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:30:38.478442 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-29c03309-28fa-45c2-9126-626306158bb1 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:38.479687 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-29c03309-28fa-45c2-9126-626306158bb1 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:38.480688 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-29c03309-28fa-45c2-9126-626306158bb1 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:38.481263 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-29c03309-28fa-45c2-9126-626306158bb1 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:38.619278 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-29c03309-28fa-45c2-9126-626306158bb1 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:38.627568 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-29c03309-28fa-45c2-9126-626306158bb1 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.166663 Jun 17 13:30:38.628343 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1529/3095] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:30:38 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:30:38.947290 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-00664c19-8426-4399-9ceb-5f281e86dcfd tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:30:38.948097 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-00664c19-8426-4399-9ceb-5f281e86dcfd tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:30:38.954773 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-00664c19-8426-4399-9ceb-5f281e86dcfd tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:38.955207 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-00664c19-8426-4399-9ceb-5f281e86dcfd tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:38.955949 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-00664c19-8426-4399-9ceb-5f281e86dcfd tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:38.956377 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-00664c19-8426-4399-9ceb-5f281e86dcfd tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:39.026151 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-00664c19-8426-4399-9ceb-5f281e86dcfd tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:39.035278 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-00664c19-8426-4399-9ceb-5f281e86dcfd tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:39.036781 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-00664c19-8426-4399-9ceb-5f281e86dcfd tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:39.037925 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-00664c19-8426-4399-9ceb-5f281e86dcfd tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.097251 Jun 17 13:30:39.038520 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1567/3096] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:30:38 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:30:39.648835 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-490c1462-0375-4c8d-baee-bd75972af52c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:30:39.649820 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-490c1462-0375-4c8d-baee-bd75972af52c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:30:39.661549 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-490c1462-0375-4c8d-baee-bd75972af52c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:39.662348 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-490c1462-0375-4c8d-baee-bd75972af52c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:39.663612 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-490c1462-0375-4c8d-baee-bd75972af52c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:39.664329 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-490c1462-0375-4c8d-baee-bd75972af52c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:39.814807 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-490c1462-0375-4c8d-baee-bd75972af52c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:39.823161 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-490c1462-0375-4c8d-baee-bd75972af52c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.180912 Jun 17 13:30:39.823725 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1530/3097] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:30:39 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:30:40.059189 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-9b33bbf7-cd6b-4d9c-a101-076c46facfd2 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:30:40.059794 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-9b33bbf7-cd6b-4d9c-a101-076c46facfd2 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:30:40.066582 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9b33bbf7-cd6b-4d9c-a101-076c46facfd2 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:40.067021 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9b33bbf7-cd6b-4d9c-a101-076c46facfd2 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:40.067764 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9b33bbf7-cd6b-4d9c-a101-076c46facfd2 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:40.068185 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9b33bbf7-cd6b-4d9c-a101-076c46facfd2 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:40.138886 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-9b33bbf7-cd6b-4d9c-a101-076c46facfd2 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:40.147742 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-9b33bbf7-cd6b-4d9c-a101-076c46facfd2 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:40.149237 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-9b33bbf7-cd6b-4d9c-a101-076c46facfd2 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:40.150573 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-9b33bbf7-cd6b-4d9c-a101-076c46facfd2 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.096439 Jun 17 13:30:40.151429 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1568/3098] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:30:40 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:30:40.842800 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-59a67484-15b4-4076-8760-3a2f65c6a529 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:30:40.843454 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-59a67484-15b4-4076-8760-3a2f65c6a529 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:30:40.850500 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-59a67484-15b4-4076-8760-3a2f65c6a529 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:40.851094 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-59a67484-15b4-4076-8760-3a2f65c6a529 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:40.852268 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-59a67484-15b4-4076-8760-3a2f65c6a529 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:40.852828 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-59a67484-15b4-4076-8760-3a2f65c6a529 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:40.995976 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-59a67484-15b4-4076-8760-3a2f65c6a529 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:41.008528 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-59a67484-15b4-4076-8760-3a2f65c6a529 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.170772 Jun 17 13:30:41.009318 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1531/3099] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:30:40 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:30:41.170580 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-7db4018c-cace-4043-b7e9-7bf9a0f2f20b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:30:41.171279 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-7db4018c-cace-4043-b7e9-7bf9a0f2f20b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:30:41.179498 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7db4018c-cace-4043-b7e9-7bf9a0f2f20b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:41.180018 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7db4018c-cace-4043-b7e9-7bf9a0f2f20b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:41.180892 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7db4018c-cace-4043-b7e9-7bf9a0f2f20b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:41.181394 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7db4018c-cace-4043-b7e9-7bf9a0f2f20b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:41.248343 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-7db4018c-cace-4043-b7e9-7bf9a0f2f20b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:41.256989 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-7db4018c-cace-4043-b7e9-7bf9a0f2f20b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:41.258530 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-7db4018c-cace-4043-b7e9-7bf9a0f2f20b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:41.259662 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-7db4018c-cace-4043-b7e9-7bf9a0f2f20b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.094046 Jun 17 13:30:41.260273 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1569/3100] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:30:41 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:30:42.035681 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-9d2f8641-fc5a-4980-9f61-32817cb59be1 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:30:42.036640 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-9d2f8641-fc5a-4980-9f61-32817cb59be1 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:30:42.045415 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9d2f8641-fc5a-4980-9f61-32817cb59be1 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:42.045860 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9d2f8641-fc5a-4980-9f61-32817cb59be1 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:42.046778 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9d2f8641-fc5a-4980-9f61-32817cb59be1 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:42.047106 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9d2f8641-fc5a-4980-9f61-32817cb59be1 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:42.185149 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-9d2f8641-fc5a-4980-9f61-32817cb59be1 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:42.197590 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-9d2f8641-fc5a-4980-9f61-32817cb59be1 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.168328 Jun 17 13:30:42.198471 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1532/3101] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:30:42 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:30:42.278169 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-be6d7042-e941-4bca-b4c6-b7f386d2e547 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:30:42.278798 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-be6d7042-e941-4bca-b4c6-b7f386d2e547 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:30:42.286013 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-be6d7042-e941-4bca-b4c6-b7f386d2e547 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:42.286458 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-be6d7042-e941-4bca-b4c6-b7f386d2e547 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:42.287194 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-be6d7042-e941-4bca-b4c6-b7f386d2e547 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:42.287633 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-be6d7042-e941-4bca-b4c6-b7f386d2e547 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:42.358456 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-be6d7042-e941-4bca-b4c6-b7f386d2e547 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:42.370907 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-be6d7042-e941-4bca-b4c6-b7f386d2e547 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:42.372405 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-be6d7042-e941-4bca-b4c6-b7f386d2e547 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:42.373551 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-be6d7042-e941-4bca-b4c6-b7f386d2e547 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.100031 Jun 17 13:30:42.374125 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1570/3102] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:30:42 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:30:43.224862 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-9684464f-cefa-4da7-a656-5348ceaf4f6e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:30:43.225814 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-9684464f-cefa-4da7-a656-5348ceaf4f6e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:30:43.234120 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9684464f-cefa-4da7-a656-5348ceaf4f6e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:43.234592 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9684464f-cefa-4da7-a656-5348ceaf4f6e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:43.235328 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9684464f-cefa-4da7-a656-5348ceaf4f6e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:43.235750 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9684464f-cefa-4da7-a656-5348ceaf4f6e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:43.373448 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-9684464f-cefa-4da7-a656-5348ceaf4f6e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:43.384804 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-9684464f-cefa-4da7-a656-5348ceaf4f6e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.166521 Jun 17 13:30:43.386682 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1533/3103] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:30:43 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:30:43.392045 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-5c85636c-7288-4708-8bd0-81a5e6fee538 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:30:43.392733 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-5c85636c-7288-4708-8bd0-81a5e6fee538 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:30:43.401681 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-5c85636c-7288-4708-8bd0-81a5e6fee538 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:43.402327 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-5c85636c-7288-4708-8bd0-81a5e6fee538 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:43.403452 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-5c85636c-7288-4708-8bd0-81a5e6fee538 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:43.404048 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-5c85636c-7288-4708-8bd0-81a5e6fee538 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:43.468979 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-5c85636c-7288-4708-8bd0-81a5e6fee538 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:43.477665 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-5c85636c-7288-4708-8bd0-81a5e6fee538 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:43.479545 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-5c85636c-7288-4708-8bd0-81a5e6fee538 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:43.480709 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-5c85636c-7288-4708-8bd0-81a5e6fee538 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.092599 Jun 17 13:30:43.481270 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1571/3104] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:30:43 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:30:44.404061 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-79234933-70f1-4398-940a-7b62921b3be1 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:30:44.404632 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-79234933-70f1-4398-940a-7b62921b3be1 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:30:44.411484 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-79234933-70f1-4398-940a-7b62921b3be1 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:44.411904 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-79234933-70f1-4398-940a-7b62921b3be1 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:44.412666 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-79234933-70f1-4398-940a-7b62921b3be1 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:44.413093 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-79234933-70f1-4398-940a-7b62921b3be1 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:44.505724 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-c2acd8c1-5be3-423e-8e87-71b9dc5416c4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:30:44.506306 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-c2acd8c1-5be3-423e-8e87-71b9dc5416c4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:30:44.513606 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c2acd8c1-5be3-423e-8e87-71b9dc5416c4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:44.514054 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c2acd8c1-5be3-423e-8e87-71b9dc5416c4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:44.514858 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c2acd8c1-5be3-423e-8e87-71b9dc5416c4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:44.515291 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c2acd8c1-5be3-423e-8e87-71b9dc5416c4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:44.551510 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-79234933-70f1-4398-940a-7b62921b3be1 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:44.559743 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-79234933-70f1-4398-940a-7b62921b3be1 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.160279 Jun 17 13:30:44.560313 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1534/3105] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:30:44 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:30:44.583319 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-c2acd8c1-5be3-423e-8e87-71b9dc5416c4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:44.592237 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-c2acd8c1-5be3-423e-8e87-71b9dc5416c4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:44.593727 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-c2acd8c1-5be3-423e-8e87-71b9dc5416c4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:44.594891 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-c2acd8c1-5be3-423e-8e87-71b9dc5416c4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.093134 Jun 17 13:30:44.595461 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1572/3106] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:30:44 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:30:45.579333 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-8180c580-74e9-4938-b113-ef471f9ccab6 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:30:45.580018 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-8180c580-74e9-4938-b113-ef471f9ccab6 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:30:45.589511 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8180c580-74e9-4938-b113-ef471f9ccab6 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:45.590135 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8180c580-74e9-4938-b113-ef471f9ccab6 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:45.591250 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8180c580-74e9-4938-b113-ef471f9ccab6 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:45.591846 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8180c580-74e9-4938-b113-ef471f9ccab6 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:45.614073 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-5631a377-f6f7-4ce0-a186-38015a4e0e67 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:30:45.614670 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-5631a377-f6f7-4ce0-a186-38015a4e0e67 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:30:45.621502 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-5631a377-f6f7-4ce0-a186-38015a4e0e67 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:45.621946 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-5631a377-f6f7-4ce0-a186-38015a4e0e67 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:45.622715 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-5631a377-f6f7-4ce0-a186-38015a4e0e67 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:45.623144 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-5631a377-f6f7-4ce0-a186-38015a4e0e67 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:45.644521 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_cell1:SELECT=100 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:30:45.693218 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-5631a377-f6f7-4ce0-a186-38015a4e0e67 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:45.702753 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-5631a377-f6f7-4ce0-a186-38015a4e0e67 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:45.704259 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-5631a377-f6f7-4ce0-a186-38015a4e0e67 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:45.705415 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-5631a377-f6f7-4ce0-a186-38015a4e0e67 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.095249 Jun 17 13:30:45.705990 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1573/3107] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:30:45 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:30:45.752669 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-8180c580-74e9-4938-b113-ef471f9ccab6 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:45.761158 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-8180c580-74e9-4938-b113-ef471f9ccab6 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.187329 Jun 17 13:30:45.761729 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1535/3108] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:30:45 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:30:46.726235 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-dbc4a13e-41b6-4b16-a1cf-7589c5ead5f8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:30:46.726845 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-dbc4a13e-41b6-4b16-a1cf-7589c5ead5f8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:30:46.738082 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-dbc4a13e-41b6-4b16-a1cf-7589c5ead5f8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:46.738727 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-dbc4a13e-41b6-4b16-a1cf-7589c5ead5f8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:46.739847 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-dbc4a13e-41b6-4b16-a1cf-7589c5ead5f8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:46.740439 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-dbc4a13e-41b6-4b16-a1cf-7589c5ead5f8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:46.778786 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-6cbc652c-223c-494e-988f-19913a6516d7 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:30:46.779465 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-6cbc652c-223c-494e-988f-19913a6516d7 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:30:46.781743 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_api:SELECT=68 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:30:46.787443 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6cbc652c-223c-494e-988f-19913a6516d7 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:46.787961 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6cbc652c-223c-494e-988f-19913a6516d7 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:46.788735 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6cbc652c-223c-494e-988f-19913a6516d7 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:46.789169 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6cbc652c-223c-494e-988f-19913a6516d7 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:46.806155 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-dbc4a13e-41b6-4b16-a1cf-7589c5ead5f8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:46.815168 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-dbc4a13e-41b6-4b16-a1cf-7589c5ead5f8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:46.816675 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-dbc4a13e-41b6-4b16-a1cf-7589c5ead5f8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:46.817830 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-dbc4a13e-41b6-4b16-a1cf-7589c5ead5f8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.097596 Jun 17 13:30:46.818430 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1574/3109] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:30:46 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:30:46.929860 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-6cbc652c-223c-494e-988f-19913a6516d7 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:46.939165 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-6cbc652c-223c-494e-988f-19913a6516d7 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.164492 Jun 17 13:30:46.939738 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1536/3110] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:30:46 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:30:47.840540 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-98ebc1e4-4e58-4e69-8149-184e93444e75 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:30:47.841484 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-98ebc1e4-4e58-4e69-8149-184e93444e75 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:30:47.852358 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-98ebc1e4-4e58-4e69-8149-184e93444e75 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:47.853128 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-98ebc1e4-4e58-4e69-8149-184e93444e75 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:47.854467 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-98ebc1e4-4e58-4e69-8149-184e93444e75 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:47.854929 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-98ebc1e4-4e58-4e69-8149-184e93444e75 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:47.929946 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-98ebc1e4-4e58-4e69-8149-184e93444e75 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:47.938732 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-98ebc1e4-4e58-4e69-8149-184e93444e75 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:47.940254 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-98ebc1e4-4e58-4e69-8149-184e93444e75 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:47.941397 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-98ebc1e4-4e58-4e69-8149-184e93444e75 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.107496 Jun 17 13:30:47.941952 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1575/3111] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:30:47 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:30:47.961987 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-dd8adc7d-ec5b-4c53-8f6a-c5b2c6c468c2 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:30:47.962628 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-dd8adc7d-ec5b-4c53-8f6a-c5b2c6c468c2 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:30:47.969539 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dd8adc7d-ec5b-4c53-8f6a-c5b2c6c468c2 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:47.969983 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dd8adc7d-ec5b-4c53-8f6a-c5b2c6c468c2 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:47.970803 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dd8adc7d-ec5b-4c53-8f6a-c5b2c6c468c2 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:47.971241 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dd8adc7d-ec5b-4c53-8f6a-c5b2c6c468c2 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:48.111262 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-dd8adc7d-ec5b-4c53-8f6a-c5b2c6c468c2 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:48.119897 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-dd8adc7d-ec5b-4c53-8f6a-c5b2c6c468c2 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.161900 Jun 17 13:30:48.120461 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1537/3112] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:30:47 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:30:48.964412 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-61c997e1-5714-42ff-848f-912eef840c4f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:30:48.965046 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-61c997e1-5714-42ff-848f-912eef840c4f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:30:48.973010 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-61c997e1-5714-42ff-848f-912eef840c4f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:48.973542 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-61c997e1-5714-42ff-848f-912eef840c4f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:48.974566 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-61c997e1-5714-42ff-848f-912eef840c4f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:48.975077 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-61c997e1-5714-42ff-848f-912eef840c4f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:49.042482 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-61c997e1-5714-42ff-848f-912eef840c4f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:49.055691 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-61c997e1-5714-42ff-848f-912eef840c4f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:49.057449 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-61c997e1-5714-42ff-848f-912eef840c4f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:49.058619 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-61c997e1-5714-42ff-848f-912eef840c4f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.100504 Jun 17 13:30:49.059169 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1576/3113] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:30:48 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:30:49.141018 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-3dacfa59-79a6-46bc-8854-6bbe0d3cadd6 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:30:49.142074 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-3dacfa59-79a6-46bc-8854-6bbe0d3cadd6 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:30:49.152578 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3dacfa59-79a6-46bc-8854-6bbe0d3cadd6 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:49.153026 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3dacfa59-79a6-46bc-8854-6bbe0d3cadd6 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:49.153817 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3dacfa59-79a6-46bc-8854-6bbe0d3cadd6 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:49.154289 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3dacfa59-79a6-46bc-8854-6bbe0d3cadd6 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:49.301442 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-3dacfa59-79a6-46bc-8854-6bbe0d3cadd6 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:49.313735 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-3dacfa59-79a6-46bc-8854-6bbe0d3cadd6 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.179114 Jun 17 13:30:49.314610 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1538/3114] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:30:49 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:30:50.077868 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-94a95e77-6d3f-4427-8aaa-584d0c0ff87c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:30:50.078493 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-94a95e77-6d3f-4427-8aaa-584d0c0ff87c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:30:50.080814 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_api:SELECT=62 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:30:50.086241 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-94a95e77-6d3f-4427-8aaa-584d0c0ff87c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:50.086688 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-94a95e77-6d3f-4427-8aaa-584d0c0ff87c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:50.087432 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-94a95e77-6d3f-4427-8aaa-584d0c0ff87c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:50.087933 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-94a95e77-6d3f-4427-8aaa-584d0c0ff87c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:50.155312 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-94a95e77-6d3f-4427-8aaa-584d0c0ff87c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:50.166577 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-94a95e77-6d3f-4427-8aaa-584d0c0ff87c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:50.168146 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-94a95e77-6d3f-4427-8aaa-584d0c0ff87c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:50.169282 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-94a95e77-6d3f-4427-8aaa-584d0c0ff87c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.095369 Jun 17 13:30:50.169844 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1577/3115] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:30:50 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:30:50.334160 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-ed377f7f-85e2-434f-8df8-acd2c159b82e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:30:50.334941 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-ed377f7f-85e2-434f-8df8-acd2c159b82e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:30:50.344101 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ed377f7f-85e2-434f-8df8-acd2c159b82e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:50.344666 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ed377f7f-85e2-434f-8df8-acd2c159b82e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:50.345711 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ed377f7f-85e2-434f-8df8-acd2c159b82e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:50.346270 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ed377f7f-85e2-434f-8df8-acd2c159b82e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:50.487244 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-ed377f7f-85e2-434f-8df8-acd2c159b82e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:50.495929 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-ed377f7f-85e2-434f-8df8-acd2c159b82e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.166191 Jun 17 13:30:50.496504 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1539/3116] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:30:50 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:30:51.191910 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-34c89c7a-988e-43e9-b537-d4443ef0868e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:30:51.192940 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-34c89c7a-988e-43e9-b537-d4443ef0868e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:30:51.204216 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-34c89c7a-988e-43e9-b537-d4443ef0868e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:51.204962 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-34c89c7a-988e-43e9-b537-d4443ef0868e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:51.206264 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-34c89c7a-988e-43e9-b537-d4443ef0868e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:51.206993 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-34c89c7a-988e-43e9-b537-d4443ef0868e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:51.276445 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-34c89c7a-988e-43e9-b537-d4443ef0868e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:51.285082 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-34c89c7a-988e-43e9-b537-d4443ef0868e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:51.286625 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-34c89c7a-988e-43e9-b537-d4443ef0868e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:51.287799 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-34c89c7a-988e-43e9-b537-d4443ef0868e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.102453 Jun 17 13:30:51.288360 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1578/3117] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:30:51 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:30:51.517894 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-a7938015-77be-42d7-89c6-a2509a7a60f9 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:30:51.518878 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-a7938015-77be-42d7-89c6-a2509a7a60f9 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:30:51.530005 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a7938015-77be-42d7-89c6-a2509a7a60f9 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:51.530797 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a7938015-77be-42d7-89c6-a2509a7a60f9 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:51.532055 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a7938015-77be-42d7-89c6-a2509a7a60f9 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:51.532768 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a7938015-77be-42d7-89c6-a2509a7a60f9 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:51.674734 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-a7938015-77be-42d7-89c6-a2509a7a60f9 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:51.687920 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-a7938015-77be-42d7-89c6-a2509a7a60f9 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.176281 Jun 17 13:30:51.688787 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1540/3118] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:30:51 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:30:52.312674 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-a481d410-e1e7-45ce-b3e7-53887ca18bda tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:30:52.313442 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-a481d410-e1e7-45ce-b3e7-53887ca18bda tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:30:52.324273 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a481d410-e1e7-45ce-b3e7-53887ca18bda tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:52.324725 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a481d410-e1e7-45ce-b3e7-53887ca18bda tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:52.325495 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a481d410-e1e7-45ce-b3e7-53887ca18bda tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:52.325932 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a481d410-e1e7-45ce-b3e7-53887ca18bda tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:52.392496 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-a481d410-e1e7-45ce-b3e7-53887ca18bda tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:52.405853 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-a481d410-e1e7-45ce-b3e7-53887ca18bda tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:52.408170 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-a481d410-e1e7-45ce-b3e7-53887ca18bda tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:52.409522 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-a481d410-e1e7-45ce-b3e7-53887ca18bda tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.104177 Jun 17 13:30:52.410350 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1579/3119] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:30:52 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:30:52.708091 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-3e9f6e16-c975-4c1e-a5e9-b17a141944d1 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:30:52.708862 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-3e9f6e16-c975-4c1e-a5e9-b17a141944d1 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:30:52.716834 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3e9f6e16-c975-4c1e-a5e9-b17a141944d1 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:52.717271 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3e9f6e16-c975-4c1e-a5e9-b17a141944d1 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:52.718014 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3e9f6e16-c975-4c1e-a5e9-b17a141944d1 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:52.718507 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3e9f6e16-c975-4c1e-a5e9-b17a141944d1 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:52.738517 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=100 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:30:52.859374 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-3e9f6e16-c975-4c1e-a5e9-b17a141944d1 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:52.870461 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-3e9f6e16-c975-4c1e-a5e9-b17a141944d1 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.167467 Jun 17 13:30:52.871025 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1541/3120] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:30:52 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:30:53.430191 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-b75292d5-6e96-4a7a-b817-da655650d2a6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:30:53.430734 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-b75292d5-6e96-4a7a-b817-da655650d2a6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:30:53.437975 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b75292d5-6e96-4a7a-b817-da655650d2a6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:53.438452 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b75292d5-6e96-4a7a-b817-da655650d2a6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:53.439213 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b75292d5-6e96-4a7a-b817-da655650d2a6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:53.439642 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b75292d5-6e96-4a7a-b817-da655650d2a6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:53.504154 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-b75292d5-6e96-4a7a-b817-da655650d2a6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:53.513231 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-b75292d5-6e96-4a7a-b817-da655650d2a6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:53.514775 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-b75292d5-6e96-4a7a-b817-da655650d2a6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:53.515946 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-b75292d5-6e96-4a7a-b817-da655650d2a6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.089871 Jun 17 13:30:53.516527 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1580/3121] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:30:53 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:30:53.896574 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-5b4c1349-1255-4f40-8fd8-e70e571ed9db tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:30:53.897491 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-5b4c1349-1255-4f40-8fd8-e70e571ed9db tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:30:53.908750 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5b4c1349-1255-4f40-8fd8-e70e571ed9db tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:53.909484 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5b4c1349-1255-4f40-8fd8-e70e571ed9db tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:53.910785 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5b4c1349-1255-4f40-8fd8-e70e571ed9db tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:53.911492 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5b4c1349-1255-4f40-8fd8-e70e571ed9db tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:54.052517 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-5b4c1349-1255-4f40-8fd8-e70e571ed9db tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:54.061373 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-5b4c1349-1255-4f40-8fd8-e70e571ed9db tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.171306 Jun 17 13:30:54.061906 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1542/3122] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:30:53 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:30:54.538726 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-f25cc370-a4e3-44fe-839e-bab426898e61 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:30:54.539686 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-f25cc370-a4e3-44fe-839e-bab426898e61 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:30:54.547284 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f25cc370-a4e3-44fe-839e-bab426898e61 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:54.547738 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f25cc370-a4e3-44fe-839e-bab426898e61 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:54.548500 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f25cc370-a4e3-44fe-839e-bab426898e61 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:54.548934 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f25cc370-a4e3-44fe-839e-bab426898e61 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:54.622296 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-f25cc370-a4e3-44fe-839e-bab426898e61 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:54.631366 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-f25cc370-a4e3-44fe-839e-bab426898e61 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:54.632848 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-f25cc370-a4e3-44fe-839e-bab426898e61 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:54.633997 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-f25cc370-a4e3-44fe-839e-bab426898e61 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.101816 Jun 17 13:30:54.634636 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1581/3123] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:30:54 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:30:55.079251 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-7bf83233-689e-4f63-9f10-af8bc725179f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:30:55.079890 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-7bf83233-689e-4f63-9f10-af8bc725179f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:30:55.087449 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7bf83233-689e-4f63-9f10-af8bc725179f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:55.088206 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7bf83233-689e-4f63-9f10-af8bc725179f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:55.088973 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7bf83233-689e-4f63-9f10-af8bc725179f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:55.089408 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7bf83233-689e-4f63-9f10-af8bc725179f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:55.221380 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-7bf83233-689e-4f63-9f10-af8bc725179f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:55.230126 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-7bf83233-689e-4f63-9f10-af8bc725179f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.155172 Jun 17 13:30:55.230710 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1543/3124] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:30:55 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:30:55.652540 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-1a8be59a-295f-4249-86c5-bb5518892ecd tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:30:55.653159 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-1a8be59a-295f-4249-86c5-bb5518892ecd tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:30:55.660260 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-1a8be59a-295f-4249-86c5-bb5518892ecd tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:55.660702 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-1a8be59a-295f-4249-86c5-bb5518892ecd tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:55.661442 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-1a8be59a-295f-4249-86c5-bb5518892ecd tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:55.661867 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-1a8be59a-295f-4249-86c5-bb5518892ecd tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:55.724338 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-1a8be59a-295f-4249-86c5-bb5518892ecd tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:55.733391 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-1a8be59a-295f-4249-86c5-bb5518892ecd tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:55.734908 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-1a8be59a-295f-4249-86c5-bb5518892ecd tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:55.736043 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-1a8be59a-295f-4249-86c5-bb5518892ecd tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.087549 Jun 17 13:30:55.736615 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1582/3125] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:30:55 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:30:56.251224 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-752b0751-9484-4d2f-b66d-9c127df1b00f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:30:56.252227 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-752b0751-9484-4d2f-b66d-9c127df1b00f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:30:56.262402 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-752b0751-9484-4d2f-b66d-9c127df1b00f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:56.262854 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-752b0751-9484-4d2f-b66d-9c127df1b00f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:56.263618 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-752b0751-9484-4d2f-b66d-9c127df1b00f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:56.264046 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-752b0751-9484-4d2f-b66d-9c127df1b00f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:56.399245 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-752b0751-9484-4d2f-b66d-9c127df1b00f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:56.407951 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-752b0751-9484-4d2f-b66d-9c127df1b00f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.163771 Jun 17 13:30:56.408509 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1544/3126] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:30:56 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:30:56.754505 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-c6be28fc-ff16-4578-9013-29cab86e0ba0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:30:56.755161 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-c6be28fc-ff16-4578-9013-29cab86e0ba0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:30:56.762189 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c6be28fc-ff16-4578-9013-29cab86e0ba0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:56.762636 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c6be28fc-ff16-4578-9013-29cab86e0ba0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:56.763387 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c6be28fc-ff16-4578-9013-29cab86e0ba0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:56.763820 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c6be28fc-ff16-4578-9013-29cab86e0ba0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:56.834856 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-c6be28fc-ff16-4578-9013-29cab86e0ba0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:56.848355 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-c6be28fc-ff16-4578-9013-29cab86e0ba0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:56.850358 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-c6be28fc-ff16-4578-9013-29cab86e0ba0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:56.852041 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-c6be28fc-ff16-4578-9013-29cab86e0ba0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.101377 Jun 17 13:30:56.852769 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1583/3127] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:30:56 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:30:57.426251 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-50e320cb-2c43-4c1a-8609-a8a668c365e6 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:30:57.426954 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-50e320cb-2c43-4c1a-8609-a8a668c365e6 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:30:57.434083 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-50e320cb-2c43-4c1a-8609-a8a668c365e6 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:57.434554 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-50e320cb-2c43-4c1a-8609-a8a668c365e6 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:57.435296 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-50e320cb-2c43-4c1a-8609-a8a668c365e6 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:57.435752 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-50e320cb-2c43-4c1a-8609-a8a668c365e6 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:57.580886 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-50e320cb-2c43-4c1a-8609-a8a668c365e6 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:57.593033 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-50e320cb-2c43-4c1a-8609-a8a668c365e6 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.170762 Jun 17 13:30:57.593787 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1545/3128] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:30:57 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:30:57.873601 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-2de2c9b1-3538-4230-9ed5-adf062399fec tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:30:57.874312 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-2de2c9b1-3538-4230-9ed5-adf062399fec tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:30:57.882450 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2de2c9b1-3538-4230-9ed5-adf062399fec tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:57.882968 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2de2c9b1-3538-4230-9ed5-adf062399fec tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:57.883840 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2de2c9b1-3538-4230-9ed5-adf062399fec tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:57.884340 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2de2c9b1-3538-4230-9ed5-adf062399fec tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:57.955964 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-2de2c9b1-3538-4230-9ed5-adf062399fec tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:57.965157 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-2de2c9b1-3538-4230-9ed5-adf062399fec tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:57.966671 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-2de2c9b1-3538-4230-9ed5-adf062399fec tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:57.967807 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-2de2c9b1-3538-4230-9ed5-adf062399fec tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.099220 Jun 17 13:30:57.968361 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1584/3129] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:30:57 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:30:58.614960 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-31d7e70e-53cd-4718-a66d-9a616c67175d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:30:58.615837 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-31d7e70e-53cd-4718-a66d-9a616c67175d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:30:58.628026 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-31d7e70e-53cd-4718-a66d-9a616c67175d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:58.628749 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-31d7e70e-53cd-4718-a66d-9a616c67175d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:58.630004 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-31d7e70e-53cd-4718-a66d-9a616c67175d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:58.630772 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-31d7e70e-53cd-4718-a66d-9a616c67175d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:58.776769 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-31d7e70e-53cd-4718-a66d-9a616c67175d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:58.789473 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-31d7e70e-53cd-4718-a66d-9a616c67175d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.180927 Jun 17 13:30:58.790309 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1546/3130] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:30:58 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:30:58.989677 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-9e3d8945-c7c2-4fb2-ae60-9144ee4b0ca8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:30:58.990662 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-9e3d8945-c7c2-4fb2-ae60-9144ee4b0ca8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:30:58.999055 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9e3d8945-c7c2-4fb2-ae60-9144ee4b0ca8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:58.999540 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9e3d8945-c7c2-4fb2-ae60-9144ee4b0ca8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:59.000270 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9e3d8945-c7c2-4fb2-ae60-9144ee4b0ca8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:59.000742 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9e3d8945-c7c2-4fb2-ae60-9144ee4b0ca8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:59.071095 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-9e3d8945-c7c2-4fb2-ae60-9144ee4b0ca8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:59.080090 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-9e3d8945-c7c2-4fb2-ae60-9144ee4b0ca8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:59.081613 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-9e3d8945-c7c2-4fb2-ae60-9144ee4b0ca8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:59.082803 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-9e3d8945-c7c2-4fb2-ae60-9144ee4b0ca8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.099790 Jun 17 13:30:59.083361 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1585/3131] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:30:58 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:30:59.810030 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-86d942dc-a997-4248-932a-2e0cc8d85a68 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:30:59.810672 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-86d942dc-a997-4248-932a-2e0cc8d85a68 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:30:59.820465 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-86d942dc-a997-4248-932a-2e0cc8d85a68 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:59.821073 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-86d942dc-a997-4248-932a-2e0cc8d85a68 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:59.822271 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-86d942dc-a997-4248-932a-2e0cc8d85a68 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:30:59.822831 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-86d942dc-a997-4248-932a-2e0cc8d85a68 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:30:59.967026 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-86d942dc-a997-4248-932a-2e0cc8d85a68 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:30:59.975411 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-86d942dc-a997-4248-932a-2e0cc8d85a68 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.171198 Jun 17 13:30:59.975993 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1547/3132] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:30:59 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:31:00.102133 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-bba7ccf1-e56f-4182-a2eb-2874e23a286d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:31:00.102832 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-bba7ccf1-e56f-4182-a2eb-2874e23a286d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:31:00.110886 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-bba7ccf1-e56f-4182-a2eb-2874e23a286d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:00.111442 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-bba7ccf1-e56f-4182-a2eb-2874e23a286d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:00.112271 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-bba7ccf1-e56f-4182-a2eb-2874e23a286d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:00.112731 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-bba7ccf1-e56f-4182-a2eb-2874e23a286d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:00.180260 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-bba7ccf1-e56f-4182-a2eb-2874e23a286d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:00.189303 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-bba7ccf1-e56f-4182-a2eb-2874e23a286d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:00.190836 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-bba7ccf1-e56f-4182-a2eb-2874e23a286d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:00.192008 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-bba7ccf1-e56f-4182-a2eb-2874e23a286d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.094030 Jun 17 13:31:00.192586 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1586/3133] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:31:00 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:31:00.997134 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-201cc371-4060-47b6-b54f-5c8010d9bbf6 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:31:00.998164 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-201cc371-4060-47b6-b54f-5c8010d9bbf6 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:31:01.009230 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-201cc371-4060-47b6-b54f-5c8010d9bbf6 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:01.010360 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-201cc371-4060-47b6-b54f-5c8010d9bbf6 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:01.011157 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-201cc371-4060-47b6-b54f-5c8010d9bbf6 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:01.011587 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-201cc371-4060-47b6-b54f-5c8010d9bbf6 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:01.155603 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-201cc371-4060-47b6-b54f-5c8010d9bbf6 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:01.164202 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-201cc371-4060-47b6-b54f-5c8010d9bbf6 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.173967 Jun 17 13:31:01.164776 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1548/3134] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:31:00 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:31:01.210475 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-6f3c9753-c673-4900-8c2f-00e38a2912e9 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:31:01.211083 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-6f3c9753-c673-4900-8c2f-00e38a2912e9 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:31:01.218394 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6f3c9753-c673-4900-8c2f-00e38a2912e9 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:01.218844 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6f3c9753-c673-4900-8c2f-00e38a2912e9 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:01.219597 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6f3c9753-c673-4900-8c2f-00e38a2912e9 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:01.220028 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6f3c9753-c673-4900-8c2f-00e38a2912e9 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:01.285147 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-6f3c9753-c673-4900-8c2f-00e38a2912e9 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:01.293858 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-6f3c9753-c673-4900-8c2f-00e38a2912e9 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:01.295393 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-6f3c9753-c673-4900-8c2f-00e38a2912e9 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:01.296535 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-6f3c9753-c673-4900-8c2f-00e38a2912e9 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.089954 Jun 17 13:31:01.297100 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1587/3135] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:31:01 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:31:02.184312 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-06395861-9caa-465e-b492-e3714448942b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:31:02.185117 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-06395861-9caa-465e-b492-e3714448942b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:31:02.194293 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-06395861-9caa-465e-b492-e3714448942b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:02.194892 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-06395861-9caa-465e-b492-e3714448942b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:02.195903 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-06395861-9caa-465e-b492-e3714448942b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:02.196483 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-06395861-9caa-465e-b492-e3714448942b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:02.315565 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-0c2afc9e-f146-4ec3-99e7-0e8f72b3ed09 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:31:02.316199 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-0c2afc9e-f146-4ec3-99e7-0e8f72b3ed09 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:31:02.323396 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0c2afc9e-f146-4ec3-99e7-0e8f72b3ed09 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:02.323838 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0c2afc9e-f146-4ec3-99e7-0e8f72b3ed09 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:02.324593 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0c2afc9e-f146-4ec3-99e7-0e8f72b3ed09 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:02.325021 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0c2afc9e-f146-4ec3-99e7-0e8f72b3ed09 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:02.339069 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-06395861-9caa-465e-b492-e3714448942b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:02.347462 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-06395861-9caa-465e-b492-e3714448942b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.169193 Jun 17 13:31:02.348033 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1549/3136] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:31:02 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:31:02.388560 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-0c2afc9e-f146-4ec3-99e7-0e8f72b3ed09 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:02.397781 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-0c2afc9e-f146-4ec3-99e7-0e8f72b3ed09 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:02.399330 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-0c2afc9e-f146-4ec3-99e7-0e8f72b3ed09 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:02.400444 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-0c2afc9e-f146-4ec3-99e7-0e8f72b3ed09 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.088885 Jun 17 13:31:02.401004 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1588/3137] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:31:02 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:31:03.365282 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-24833373-4d34-4e6f-bf60-715fee0a2efe tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:31:03.365971 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-24833373-4d34-4e6f-bf60-715fee0a2efe tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:31:03.373075 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-24833373-4d34-4e6f-bf60-715fee0a2efe tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:03.373522 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-24833373-4d34-4e6f-bf60-715fee0a2efe tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:03.374326 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-24833373-4d34-4e6f-bf60-715fee0a2efe tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:03.374762 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-24833373-4d34-4e6f-bf60-715fee0a2efe tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:03.424665 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-5f40892c-ddcc-46d0-991e-5ea4f596e2b7 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:31:03.425261 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-5f40892c-ddcc-46d0-991e-5ea4f596e2b7 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:31:03.432882 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-5f40892c-ddcc-46d0-991e-5ea4f596e2b7 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:03.433348 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-5f40892c-ddcc-46d0-991e-5ea4f596e2b7 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:03.434120 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-5f40892c-ddcc-46d0-991e-5ea4f596e2b7 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:03.434577 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-5f40892c-ddcc-46d0-991e-5ea4f596e2b7 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:03.511966 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-5f40892c-ddcc-46d0-991e-5ea4f596e2b7 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:03.520681 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-5f40892c-ddcc-46d0-991e-5ea4f596e2b7 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:03.522418 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-5f40892c-ddcc-46d0-991e-5ea4f596e2b7 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:03.523572 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-5f40892c-ddcc-46d0-991e-5ea4f596e2b7 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.102802 Jun 17 13:31:03.524145 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1589/3138] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:31:03 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:31:03.541843 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-24833373-4d34-4e6f-bf60-715fee0a2efe tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:03.549956 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-24833373-4d34-4e6f-bf60-715fee0a2efe tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.188603 Jun 17 13:31:03.550553 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1550/3139] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:31:03 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:31:04.546922 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-01ebfefb-ecd7-4b23-9f4f-c619ec17d4b7 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:31:04.548023 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-01ebfefb-ecd7-4b23-9f4f-c619ec17d4b7 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:31:04.558686 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-01ebfefb-ecd7-4b23-9f4f-c619ec17d4b7 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:04.559325 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-01ebfefb-ecd7-4b23-9f4f-c619ec17d4b7 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:04.560390 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-01ebfefb-ecd7-4b23-9f4f-c619ec17d4b7 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:04.561001 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-01ebfefb-ecd7-4b23-9f4f-c619ec17d4b7 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:04.566850 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_cell1:SELECT=100 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:31:04.569642 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-92b3d11b-8b40-4e39-aa77-3c85861c9836 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:31:04.570378 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-92b3d11b-8b40-4e39-aa77-3c85861c9836 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:31:04.578041 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-92b3d11b-8b40-4e39-aa77-3c85861c9836 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:04.578509 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-92b3d11b-8b40-4e39-aa77-3c85861c9836 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:04.579294 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-92b3d11b-8b40-4e39-aa77-3c85861c9836 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:04.579724 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-92b3d11b-8b40-4e39-aa77-3c85861c9836 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:04.635816 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-01ebfefb-ecd7-4b23-9f4f-c619ec17d4b7 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:04.644743 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-01ebfefb-ecd7-4b23-9f4f-c619ec17d4b7 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:04.646254 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-01ebfefb-ecd7-4b23-9f4f-c619ec17d4b7 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:04.647398 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-01ebfefb-ecd7-4b23-9f4f-c619ec17d4b7 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.107204 Jun 17 13:31:04.647956 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1590/3140] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:31:04 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:31:04.732583 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-92b3d11b-8b40-4e39-aa77-3c85861c9836 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:04.744518 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-92b3d11b-8b40-4e39-aa77-3c85861c9836 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.180404 Jun 17 13:31:04.745094 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1551/3141] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:31:04 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:31:05.669418 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-f718047b-123a-45eb-91d7-fd2ba4d91bdd tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:31:05.670604 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-f718047b-123a-45eb-91d7-fd2ba4d91bdd tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:31:05.682456 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f718047b-123a-45eb-91d7-fd2ba4d91bdd tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:05.682841 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f718047b-123a-45eb-91d7-fd2ba4d91bdd tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:05.683608 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f718047b-123a-45eb-91d7-fd2ba4d91bdd tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:05.684047 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f718047b-123a-45eb-91d7-fd2ba4d91bdd tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:05.748812 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-f718047b-123a-45eb-91d7-fd2ba4d91bdd tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:05.761546 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-f718047b-123a-45eb-91d7-fd2ba4d91bdd tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:05.762608 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-018a2a3d-b991-4931-89d2-31df7c655d91 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:31:05.763106 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-f718047b-123a-45eb-91d7-fd2ba4d91bdd tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:05.763240 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-018a2a3d-b991-4931-89d2-31df7c655d91 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:31:05.764217 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-f718047b-123a-45eb-91d7-fd2ba4d91bdd tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.101898 Jun 17 13:31:05.764951 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1591/3142] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:31:05 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:31:05.770242 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-018a2a3d-b991-4931-89d2-31df7c655d91 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:05.770695 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-018a2a3d-b991-4931-89d2-31df7c655d91 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:05.771464 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-018a2a3d-b991-4931-89d2-31df7c655d91 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:05.771906 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-018a2a3d-b991-4931-89d2-31df7c655d91 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:05.911148 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-018a2a3d-b991-4931-89d2-31df7c655d91 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:05.921011 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-018a2a3d-b991-4931-89d2-31df7c655d91 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.163299 Jun 17 13:31:05.921566 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1552/3143] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:31:05 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:31:06.784515 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-135299a5-31aa-4001-9402-9864c70a30c8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:31:06.785285 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-135299a5-31aa-4001-9402-9864c70a30c8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:31:06.797012 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-135299a5-31aa-4001-9402-9864c70a30c8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:06.797465 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-135299a5-31aa-4001-9402-9864c70a30c8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:06.799116 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-135299a5-31aa-4001-9402-9864c70a30c8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:06.799557 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-135299a5-31aa-4001-9402-9864c70a30c8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:06.870978 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-135299a5-31aa-4001-9402-9864c70a30c8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:06.879713 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-135299a5-31aa-4001-9402-9864c70a30c8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:06.881201 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-135299a5-31aa-4001-9402-9864c70a30c8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:06.882374 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-135299a5-31aa-4001-9402-9864c70a30c8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.102766 Jun 17 13:31:06.882961 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1592/3144] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:31:06 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:31:06.941689 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-70fbc737-3eda-4ebd-b016-dd477f6ee545 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:31:06.942769 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-70fbc737-3eda-4ebd-b016-dd477f6ee545 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:31:06.953699 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-70fbc737-3eda-4ebd-b016-dd477f6ee545 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:06.954524 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-70fbc737-3eda-4ebd-b016-dd477f6ee545 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:06.955759 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-70fbc737-3eda-4ebd-b016-dd477f6ee545 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:06.956477 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-70fbc737-3eda-4ebd-b016-dd477f6ee545 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:07.096479 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-70fbc737-3eda-4ebd-b016-dd477f6ee545 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:07.109791 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-70fbc737-3eda-4ebd-b016-dd477f6ee545 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.174250 Jun 17 13:31:07.110667 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1553/3145] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:31:06 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:31:07.902398 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-de477969-f263-4f7a-806e-150d1b6550ae tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:31:07.903031 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-de477969-f263-4f7a-806e-150d1b6550ae tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:31:07.910351 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-de477969-f263-4f7a-806e-150d1b6550ae tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:07.910804 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-de477969-f263-4f7a-806e-150d1b6550ae tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:07.911563 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-de477969-f263-4f7a-806e-150d1b6550ae tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:07.912001 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-de477969-f263-4f7a-806e-150d1b6550ae tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:07.986241 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-de477969-f263-4f7a-806e-150d1b6550ae tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:07.995651 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-de477969-f263-4f7a-806e-150d1b6550ae tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:07.997148 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-de477969-f263-4f7a-806e-150d1b6550ae tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:07.998334 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-de477969-f263-4f7a-806e-150d1b6550ae tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.100503 Jun 17 13:31:07.998899 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1593/3146] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:31:07 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:31:08.127734 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-5248e7fe-5d1b-4ad0-97ef-80991547a43c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:31:08.128331 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-5248e7fe-5d1b-4ad0-97ef-80991547a43c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:31:08.135379 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5248e7fe-5d1b-4ad0-97ef-80991547a43c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:08.135839 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5248e7fe-5d1b-4ad0-97ef-80991547a43c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:08.136582 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5248e7fe-5d1b-4ad0-97ef-80991547a43c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:08.137010 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5248e7fe-5d1b-4ad0-97ef-80991547a43c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:08.270463 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-5248e7fe-5d1b-4ad0-97ef-80991547a43c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:08.279491 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-5248e7fe-5d1b-4ad0-97ef-80991547a43c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.155680 Jun 17 13:31:08.280061 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1554/3147] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:31:08 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:31:09.020697 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-50a31442-789f-46f2-b0a6-0ea57ec1db2e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:31:09.021698 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-50a31442-789f-46f2-b0a6-0ea57ec1db2e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:31:09.031882 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-50a31442-789f-46f2-b0a6-0ea57ec1db2e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:09.032621 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-50a31442-789f-46f2-b0a6-0ea57ec1db2e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:09.033853 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-50a31442-789f-46f2-b0a6-0ea57ec1db2e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:09.034619 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-50a31442-789f-46f2-b0a6-0ea57ec1db2e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:09.101897 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-50a31442-789f-46f2-b0a6-0ea57ec1db2e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:09.111629 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-50a31442-789f-46f2-b0a6-0ea57ec1db2e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:09.113167 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-50a31442-789f-46f2-b0a6-0ea57ec1db2e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:09.114364 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-50a31442-789f-46f2-b0a6-0ea57ec1db2e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.100371 Jun 17 13:31:09.114926 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1594/3148] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:31:09 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:31:09.297243 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-ad43c9aa-a6b1-4460-b414-89d8eeeeb70b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:31:09.297826 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-ad43c9aa-a6b1-4460-b414-89d8eeeeb70b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:31:09.305414 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ad43c9aa-a6b1-4460-b414-89d8eeeeb70b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:09.305890 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ad43c9aa-a6b1-4460-b414-89d8eeeeb70b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:09.306931 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ad43c9aa-a6b1-4460-b414-89d8eeeeb70b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:09.307398 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ad43c9aa-a6b1-4460-b414-89d8eeeeb70b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:09.454681 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-ad43c9aa-a6b1-4460-b414-89d8eeeeb70b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:09.463291 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-ad43c9aa-a6b1-4460-b414-89d8eeeeb70b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.170408 Jun 17 13:31:09.463864 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1555/3149] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:31:09 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:31:10.137631 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-9c266715-f0ad-4b78-9ef5-dff76fbdc0d3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:31:10.138671 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-9c266715-f0ad-4b78-9ef5-dff76fbdc0d3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:31:10.150670 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9c266715-f0ad-4b78-9ef5-dff76fbdc0d3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:10.151140 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9c266715-f0ad-4b78-9ef5-dff76fbdc0d3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:10.151931 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9c266715-f0ad-4b78-9ef5-dff76fbdc0d3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:10.152362 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9c266715-f0ad-4b78-9ef5-dff76fbdc0d3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:10.215195 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-9c266715-f0ad-4b78-9ef5-dff76fbdc0d3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:10.224407 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-9c266715-f0ad-4b78-9ef5-dff76fbdc0d3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:10.225905 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-9c266715-f0ad-4b78-9ef5-dff76fbdc0d3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:10.227074 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-9c266715-f0ad-4b78-9ef5-dff76fbdc0d3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.096624 Jun 17 13:31:10.227643 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1595/3150] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:31:10 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:31:10.485068 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-bc627a89-2bec-47c4-aae3-01e2e274e2af tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:31:10.485992 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-bc627a89-2bec-47c4-aae3-01e2e274e2af tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:31:10.496973 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bc627a89-2bec-47c4-aae3-01e2e274e2af tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:10.497716 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bc627a89-2bec-47c4-aae3-01e2e274e2af tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:10.499023 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bc627a89-2bec-47c4-aae3-01e2e274e2af tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:10.499738 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bc627a89-2bec-47c4-aae3-01e2e274e2af tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:10.640519 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-bc627a89-2bec-47c4-aae3-01e2e274e2af tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:10.650804 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-bc627a89-2bec-47c4-aae3-01e2e274e2af tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.172920 Jun 17 13:31:10.651417 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1556/3151] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:31:10 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:31:11.251021 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-e2a9f106-3d87-4302-934b-905c3fa7e46c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:31:11.252485 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-e2a9f106-3d87-4302-934b-905c3fa7e46c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:31:11.261890 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e2a9f106-3d87-4302-934b-905c3fa7e46c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:11.262376 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e2a9f106-3d87-4302-934b-905c3fa7e46c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:11.263138 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e2a9f106-3d87-4302-934b-905c3fa7e46c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:11.263571 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e2a9f106-3d87-4302-934b-905c3fa7e46c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:11.333945 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-e2a9f106-3d87-4302-934b-905c3fa7e46c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:11.343299 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-e2a9f106-3d87-4302-934b-905c3fa7e46c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:11.344792 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-e2a9f106-3d87-4302-934b-905c3fa7e46c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:11.345941 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-e2a9f106-3d87-4302-934b-905c3fa7e46c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.102843 Jun 17 13:31:11.346539 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1596/3152] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:31:11 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:31:11.669203 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-102cbff3-4ebb-4f87-b517-95ab9977a451 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:31:11.669853 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-102cbff3-4ebb-4f87-b517-95ab9977a451 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:31:11.678935 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-102cbff3-4ebb-4f87-b517-95ab9977a451 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:11.679653 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-102cbff3-4ebb-4f87-b517-95ab9977a451 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:11.680857 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-102cbff3-4ebb-4f87-b517-95ab9977a451 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:11.681482 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-102cbff3-4ebb-4f87-b517-95ab9977a451 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:11.809828 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-102cbff3-4ebb-4f87-b517-95ab9977a451 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:11.817946 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-102cbff3-4ebb-4f87-b517-95ab9977a451 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.153201 Jun 17 13:31:11.818547 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1557/3153] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:31:11 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:31:12.369353 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-74779237-3333-4a4f-9e98-c64971e103dc tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:31:12.370253 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-74779237-3333-4a4f-9e98-c64971e103dc tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:31:12.380822 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-74779237-3333-4a4f-9e98-c64971e103dc tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:12.381553 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-74779237-3333-4a4f-9e98-c64971e103dc tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:12.382831 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-74779237-3333-4a4f-9e98-c64971e103dc tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:12.383545 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-74779237-3333-4a4f-9e98-c64971e103dc tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:12.451190 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-74779237-3333-4a4f-9e98-c64971e103dc tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:12.463917 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-74779237-3333-4a4f-9e98-c64971e103dc tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:12.466162 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-74779237-3333-4a4f-9e98-c64971e103dc tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:12.467844 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-74779237-3333-4a4f-9e98-c64971e103dc tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.105476 Jun 17 13:31:12.468530 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1597/3154] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:31:12 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:31:12.839185 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-58bb7fab-57ed-4850-9529-d65c5223c5dc tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:31:12.839924 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-58bb7fab-57ed-4850-9529-d65c5223c5dc tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:31:12.847918 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-58bb7fab-57ed-4850-9529-d65c5223c5dc tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:12.848445 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-58bb7fab-57ed-4850-9529-d65c5223c5dc tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:12.849331 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-58bb7fab-57ed-4850-9529-d65c5223c5dc tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:12.849839 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-58bb7fab-57ed-4850-9529-d65c5223c5dc tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:12.854938 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=100 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:31:12.989016 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-58bb7fab-57ed-4850-9529-d65c5223c5dc tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:12.999588 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-58bb7fab-57ed-4850-9529-d65c5223c5dc tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.166128 Jun 17 13:31:13.000385 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1558/3155] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:31:12 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:31:13.494446 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-578d24f9-8bec-474c-b1e5-653fbf46c8e1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:31:13.495155 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-578d24f9-8bec-474c-b1e5-653fbf46c8e1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:31:13.503351 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-578d24f9-8bec-474c-b1e5-653fbf46c8e1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:13.503874 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-578d24f9-8bec-474c-b1e5-653fbf46c8e1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:13.504746 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-578d24f9-8bec-474c-b1e5-653fbf46c8e1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:13.505252 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-578d24f9-8bec-474c-b1e5-653fbf46c8e1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:13.576131 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-578d24f9-8bec-474c-b1e5-653fbf46c8e1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:13.584832 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-578d24f9-8bec-474c-b1e5-653fbf46c8e1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:13.586371 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-578d24f9-8bec-474c-b1e5-653fbf46c8e1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:13.587564 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-578d24f9-8bec-474c-b1e5-653fbf46c8e1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.099704 Jun 17 13:31:13.588159 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1598/3156] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:31:13 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:31:14.020931 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-a0e9e733-d4dc-4487-8099-d20bb523fe3f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:31:14.021875 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-a0e9e733-d4dc-4487-8099-d20bb523fe3f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:31:14.030052 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a0e9e733-d4dc-4487-8099-d20bb523fe3f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:14.030526 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a0e9e733-d4dc-4487-8099-d20bb523fe3f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:14.031273 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a0e9e733-d4dc-4487-8099-d20bb523fe3f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:14.031701 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a0e9e733-d4dc-4487-8099-d20bb523fe3f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:14.167263 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-a0e9e733-d4dc-4487-8099-d20bb523fe3f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:14.175897 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-a0e9e733-d4dc-4487-8099-d20bb523fe3f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.161548 Jun 17 13:31:14.176474 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1559/3157] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:31:14 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:31:14.616624 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-dc60b3b1-110c-487d-8f5b-32e1d17d89d8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:31:14.617505 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-dc60b3b1-110c-487d-8f5b-32e1d17d89d8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:31:14.628913 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-dc60b3b1-110c-487d-8f5b-32e1d17d89d8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:14.629666 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-dc60b3b1-110c-487d-8f5b-32e1d17d89d8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:14.630985 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-dc60b3b1-110c-487d-8f5b-32e1d17d89d8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:14.631752 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-dc60b3b1-110c-487d-8f5b-32e1d17d89d8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:14.707423 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-dc60b3b1-110c-487d-8f5b-32e1d17d89d8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:14.716406 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-dc60b3b1-110c-487d-8f5b-32e1d17d89d8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:14.717895 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-dc60b3b1-110c-487d-8f5b-32e1d17d89d8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:14.719065 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-dc60b3b1-110c-487d-8f5b-32e1d17d89d8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.109214 Jun 17 13:31:14.719631 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1599/3158] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:31:14 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:31:15.206153 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-d1eb5b93-3718-422b-bb6d-51a89d6ebf73 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:31:15.206153 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-d1eb5b93-3718-422b-bb6d-51a89d6ebf73 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:31:15.207587 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d1eb5b93-3718-422b-bb6d-51a89d6ebf73 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:15.208145 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d1eb5b93-3718-422b-bb6d-51a89d6ebf73 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:15.209116 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d1eb5b93-3718-422b-bb6d-51a89d6ebf73 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:15.209644 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d1eb5b93-3718-422b-bb6d-51a89d6ebf73 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:15.346171 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-d1eb5b93-3718-422b-bb6d-51a89d6ebf73 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:15.355687 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-d1eb5b93-3718-422b-bb6d-51a89d6ebf73 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.164135 Jun 17 13:31:15.356235 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1560/3159] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:31:15 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:31:15.736956 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-0e799cc7-c664-4ad2-b533-cbce983fd247 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:31:15.737592 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-0e799cc7-c664-4ad2-b533-cbce983fd247 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:31:15.744529 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0e799cc7-c664-4ad2-b533-cbce983fd247 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:15.744973 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0e799cc7-c664-4ad2-b533-cbce983fd247 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:15.745715 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0e799cc7-c664-4ad2-b533-cbce983fd247 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:15.746168 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0e799cc7-c664-4ad2-b533-cbce983fd247 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:15.817128 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-0e799cc7-c664-4ad2-b533-cbce983fd247 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:15.826426 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-0e799cc7-c664-4ad2-b533-cbce983fd247 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:15.827918 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-0e799cc7-c664-4ad2-b533-cbce983fd247 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:15.829056 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-0e799cc7-c664-4ad2-b533-cbce983fd247 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.096012 Jun 17 13:31:15.829614 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1600/3160] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:31:15 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:31:16.376510 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-48075025-7f69-4a82-b6e9-d4042f1b5279 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:31:16.377518 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-48075025-7f69-4a82-b6e9-d4042f1b5279 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:31:16.388831 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-48075025-7f69-4a82-b6e9-d4042f1b5279 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:16.389530 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-48075025-7f69-4a82-b6e9-d4042f1b5279 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:16.390873 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-48075025-7f69-4a82-b6e9-d4042f1b5279 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:16.391589 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-48075025-7f69-4a82-b6e9-d4042f1b5279 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:16.527245 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-48075025-7f69-4a82-b6e9-d4042f1b5279 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:16.535262 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-48075025-7f69-4a82-b6e9-d4042f1b5279 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.165477 Jun 17 13:31:16.535831 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1561/3161] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:31:16 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:31:16.851687 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-0d34d787-1c8d-43b6-ab95-5d658872751b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:31:16.852728 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-0d34d787-1c8d-43b6-ab95-5d658872751b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:31:16.860251 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0d34d787-1c8d-43b6-ab95-5d658872751b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:16.860696 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0d34d787-1c8d-43b6-ab95-5d658872751b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:16.861446 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0d34d787-1c8d-43b6-ab95-5d658872751b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:16.861871 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0d34d787-1c8d-43b6-ab95-5d658872751b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:16.930932 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-0d34d787-1c8d-43b6-ab95-5d658872751b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:16.940010 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-0d34d787-1c8d-43b6-ab95-5d658872751b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:16.941437 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-0d34d787-1c8d-43b6-ab95-5d658872751b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:16.942638 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-0d34d787-1c8d-43b6-ab95-5d658872751b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.097563 Jun 17 13:31:16.943201 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1601/3162] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:31:16 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:31:17.553172 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-fef4a5d6-a103-423c-85fc-d7b3b1a306d4 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:31:17.553784 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-fef4a5d6-a103-423c-85fc-d7b3b1a306d4 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:31:17.556467 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_api:SELECT=52 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:31:17.562037 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fef4a5d6-a103-423c-85fc-d7b3b1a306d4 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:17.562500 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fef4a5d6-a103-423c-85fc-d7b3b1a306d4 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:17.563266 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fef4a5d6-a103-423c-85fc-d7b3b1a306d4 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:17.563703 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fef4a5d6-a103-423c-85fc-d7b3b1a306d4 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:17.703104 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-fef4a5d6-a103-423c-85fc-d7b3b1a306d4 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:17.711272 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-fef4a5d6-a103-423c-85fc-d7b3b1a306d4 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.162061 Jun 17 13:31:17.711877 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1562/3163] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:31:17 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:31:17.968132 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-16a34fbf-af86-4b54-867c-157ee1391ea3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:31:17.969643 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-16a34fbf-af86-4b54-867c-157ee1391ea3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:31:17.980179 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-16a34fbf-af86-4b54-867c-157ee1391ea3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:17.980656 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-16a34fbf-af86-4b54-867c-157ee1391ea3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:17.981424 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-16a34fbf-af86-4b54-867c-157ee1391ea3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:17.981860 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-16a34fbf-af86-4b54-867c-157ee1391ea3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:18.055393 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-16a34fbf-af86-4b54-867c-157ee1391ea3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:18.064505 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-16a34fbf-af86-4b54-867c-157ee1391ea3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:18.066029 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-16a34fbf-af86-4b54-867c-157ee1391ea3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:18.067174 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-16a34fbf-af86-4b54-867c-157ee1391ea3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.108574 Jun 17 13:31:18.067720 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1602/3164] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:31:17 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:31:18.737907 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-b24e03da-9226-4605-b78b-3c5b1c1c7183 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:31:18.738943 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-b24e03da-9226-4605-b78b-3c5b1c1c7183 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:31:18.750298 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b24e03da-9226-4605-b78b-3c5b1c1c7183 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:18.751049 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b24e03da-9226-4605-b78b-3c5b1c1c7183 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:18.752308 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b24e03da-9226-4605-b78b-3c5b1c1c7183 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:18.753034 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b24e03da-9226-4605-b78b-3c5b1c1c7183 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:18.899513 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-b24e03da-9226-4605-b78b-3c5b1c1c7183 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:18.908482 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-b24e03da-9226-4605-b78b-3c5b1c1c7183 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.177037 Jun 17 13:31:18.909053 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1563/3165] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:31:18 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:31:19.089464 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-6b6573c5-f10f-40cb-bb39-519f0a8488ba tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:31:19.090044 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-6b6573c5-f10f-40cb-bb39-519f0a8488ba tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:31:19.097432 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6b6573c5-f10f-40cb-bb39-519f0a8488ba tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:19.097910 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6b6573c5-f10f-40cb-bb39-519f0a8488ba tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:19.098749 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6b6573c5-f10f-40cb-bb39-519f0a8488ba tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:19.099208 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6b6573c5-f10f-40cb-bb39-519f0a8488ba tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:19.177214 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-6b6573c5-f10f-40cb-bb39-519f0a8488ba tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:19.186128 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-6b6573c5-f10f-40cb-bb39-519f0a8488ba tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:19.187626 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-6b6573c5-f10f-40cb-bb39-519f0a8488ba tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:19.188773 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-6b6573c5-f10f-40cb-bb39-519f0a8488ba tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.105345 Jun 17 13:31:19.189341 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1603/3166] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:31:19 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:31:19.929822 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-85a3d130-4658-4ba1-910a-f18b15466298 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:31:19.930874 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-85a3d130-4658-4ba1-910a-f18b15466298 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:31:19.938036 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-85a3d130-4658-4ba1-910a-f18b15466298 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:19.938517 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-85a3d130-4658-4ba1-910a-f18b15466298 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:19.939288 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-85a3d130-4658-4ba1-910a-f18b15466298 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:19.939722 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-85a3d130-4658-4ba1-910a-f18b15466298 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:20.074786 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-85a3d130-4658-4ba1-910a-f18b15466298 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:20.082892 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-85a3d130-4658-4ba1-910a-f18b15466298 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.159642 Jun 17 13:31:20.083461 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1564/3167] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:31:19 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:31:20.211083 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-412672de-43e0-42bb-bf85-0a2ae87c9b0f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:31:20.211789 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-412672de-43e0-42bb-bf85-0a2ae87c9b0f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:31:20.216189 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_api:SELECT=54 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:31:20.224494 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-412672de-43e0-42bb-bf85-0a2ae87c9b0f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:20.225194 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-412672de-43e0-42bb-bf85-0a2ae87c9b0f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:20.226476 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-412672de-43e0-42bb-bf85-0a2ae87c9b0f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:20.227165 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-412672de-43e0-42bb-bf85-0a2ae87c9b0f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:20.300898 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-412672de-43e0-42bb-bf85-0a2ae87c9b0f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:20.310361 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-412672de-43e0-42bb-bf85-0a2ae87c9b0f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:20.311931 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-412672de-43e0-42bb-bf85-0a2ae87c9b0f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:20.312993 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-412672de-43e0-42bb-bf85-0a2ae87c9b0f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.108471 Jun 17 13:31:20.313555 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1604/3168] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:31:20 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:31:21.100953 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-01b7e7a0-4f4f-4f69-9c0f-f9d987bab60a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:31:21.101571 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-01b7e7a0-4f4f-4f69-9c0f-f9d987bab60a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:31:21.109307 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-01b7e7a0-4f4f-4f69-9c0f-f9d987bab60a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:21.109753 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-01b7e7a0-4f4f-4f69-9c0f-f9d987bab60a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:21.110528 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-01b7e7a0-4f4f-4f69-9c0f-f9d987bab60a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:21.110956 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-01b7e7a0-4f4f-4f69-9c0f-f9d987bab60a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:21.252792 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-01b7e7a0-4f4f-4f69-9c0f-f9d987bab60a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:21.264937 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-01b7e7a0-4f4f-4f69-9c0f-f9d987bab60a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.167675 Jun 17 13:31:21.265784 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1565/3169] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:31:21 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:31:21.335117 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-3e6f1ae0-9188-4760-8d2f-59d8143da451 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:31:21.336177 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-3e6f1ae0-9188-4760-8d2f-59d8143da451 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:31:21.343931 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-3e6f1ae0-9188-4760-8d2f-59d8143da451 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:21.344382 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-3e6f1ae0-9188-4760-8d2f-59d8143da451 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:21.345143 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-3e6f1ae0-9188-4760-8d2f-59d8143da451 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:21.345580 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-3e6f1ae0-9188-4760-8d2f-59d8143da451 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:21.409366 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-3e6f1ae0-9188-4760-8d2f-59d8143da451 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:21.418649 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-3e6f1ae0-9188-4760-8d2f-59d8143da451 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:21.420147 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-3e6f1ae0-9188-4760-8d2f-59d8143da451 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:21.421294 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-3e6f1ae0-9188-4760-8d2f-59d8143da451 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.092221 Jun 17 13:31:21.421857 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1605/3170] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:31:21 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:31:22.286348 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-5275faf2-909a-4db3-af05-8fab02aed627 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:31:22.286954 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-5275faf2-909a-4db3-af05-8fab02aed627 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:31:22.293706 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5275faf2-909a-4db3-af05-8fab02aed627 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:22.294173 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5275faf2-909a-4db3-af05-8fab02aed627 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:22.294919 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5275faf2-909a-4db3-af05-8fab02aed627 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:22.295346 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5275faf2-909a-4db3-af05-8fab02aed627 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:22.438274 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-5275faf2-909a-4db3-af05-8fab02aed627 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:22.439740 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-809ada32-5ca0-49d3-b7c7-13ee99f4e643 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:31:22.440376 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-809ada32-5ca0-49d3-b7c7-13ee99f4e643 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:31:22.446358 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-5275faf2-909a-4db3-af05-8fab02aed627 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.163929 Jun 17 13:31:22.447012 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1566/3171] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:31:22 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:31:22.447389 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-809ada32-5ca0-49d3-b7c7-13ee99f4e643 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:22.447914 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-809ada32-5ca0-49d3-b7c7-13ee99f4e643 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:22.448735 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-809ada32-5ca0-49d3-b7c7-13ee99f4e643 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:22.449167 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-809ada32-5ca0-49d3-b7c7-13ee99f4e643 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:22.517674 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-809ada32-5ca0-49d3-b7c7-13ee99f4e643 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:22.522015 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_cell1:SELECT=100 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:31:22.530239 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-809ada32-5ca0-49d3-b7c7-13ee99f4e643 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:22.532406 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-809ada32-5ca0-49d3-b7c7-13ee99f4e643 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:22.534385 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-809ada32-5ca0-49d3-b7c7-13ee99f4e643 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.098258 Jun 17 13:31:22.535207 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1606/3172] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:31:22 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:31:23.464550 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-61b9e39c-fb68-4219-a9f3-fda346c0a227 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:31:23.465434 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-61b9e39c-fb68-4219-a9f3-fda346c0a227 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:31:23.472337 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-61b9e39c-fb68-4219-a9f3-fda346c0a227 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:23.472834 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-61b9e39c-fb68-4219-a9f3-fda346c0a227 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:23.474234 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-61b9e39c-fb68-4219-a9f3-fda346c0a227 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:23.474674 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-61b9e39c-fb68-4219-a9f3-fda346c0a227 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:23.558697 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-19953710-617f-44e6-92aa-db4ee00ca99d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:31:23.559696 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-19953710-617f-44e6-92aa-db4ee00ca99d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:31:23.567152 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-19953710-617f-44e6-92aa-db4ee00ca99d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:23.567671 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-19953710-617f-44e6-92aa-db4ee00ca99d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:23.568447 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-19953710-617f-44e6-92aa-db4ee00ca99d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:23.568890 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-19953710-617f-44e6-92aa-db4ee00ca99d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:23.626190 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-61b9e39c-fb68-4219-a9f3-fda346c0a227 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:23.640602 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-61b9e39c-fb68-4219-a9f3-fda346c0a227 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.180312 Jun 17 13:31:23.641184 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1567/3173] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:31:23 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:31:23.659672 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-19953710-617f-44e6-92aa-db4ee00ca99d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:23.668740 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-19953710-617f-44e6-92aa-db4ee00ca99d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:23.670250 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-19953710-617f-44e6-92aa-db4ee00ca99d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:23.671407 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-19953710-617f-44e6-92aa-db4ee00ca99d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.119838 Jun 17 13:31:23.671986 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1607/3174] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:31:23 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:31:24.664526 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-2889373a-6ba1-4b4a-b5a8-f3bab79e5aef tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:31:24.665559 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-2889373a-6ba1-4b4a-b5a8-f3bab79e5aef tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:31:24.672448 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2889373a-6ba1-4b4a-b5a8-f3bab79e5aef tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:24.672893 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2889373a-6ba1-4b4a-b5a8-f3bab79e5aef tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:24.673646 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2889373a-6ba1-4b4a-b5a8-f3bab79e5aef tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:24.674079 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2889373a-6ba1-4b4a-b5a8-f3bab79e5aef tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:24.692357 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-ea8f6887-4cfe-4392-9188-360c935e238a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:31:24.692976 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-ea8f6887-4cfe-4392-9188-360c935e238a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:31:24.700031 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ea8f6887-4cfe-4392-9188-360c935e238a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:24.700574 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ea8f6887-4cfe-4392-9188-360c935e238a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:24.701351 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ea8f6887-4cfe-4392-9188-360c935e238a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:24.701791 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ea8f6887-4cfe-4392-9188-360c935e238a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:24.773266 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-ea8f6887-4cfe-4392-9188-360c935e238a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:24.782261 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-ea8f6887-4cfe-4392-9188-360c935e238a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:24.783713 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-ea8f6887-4cfe-4392-9188-360c935e238a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:24.784862 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-ea8f6887-4cfe-4392-9188-360c935e238a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.096471 Jun 17 13:31:24.785447 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1608/3175] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:31:24 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:31:24.828018 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-2889373a-6ba1-4b4a-b5a8-f3bab79e5aef tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:24.836247 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-2889373a-6ba1-4b4a-b5a8-f3bab79e5aef tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.178312 Jun 17 13:31:24.836816 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1568/3176] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:31:24 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:31:25.807403 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-66158ec1-1daa-4ff9-a670-ad8f1bd068c6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:31:25.808207 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-66158ec1-1daa-4ff9-a670-ad8f1bd068c6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:31:25.815775 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-66158ec1-1daa-4ff9-a670-ad8f1bd068c6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:25.816261 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-66158ec1-1daa-4ff9-a670-ad8f1bd068c6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:25.817055 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-66158ec1-1daa-4ff9-a670-ad8f1bd068c6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:25.817518 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-66158ec1-1daa-4ff9-a670-ad8f1bd068c6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:25.853279 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-9f4889ee-4cc0-433c-b87e-432abaa77ce6 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:31:25.853877 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-9f4889ee-4cc0-433c-b87e-432abaa77ce6 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:31:25.861008 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9f4889ee-4cc0-433c-b87e-432abaa77ce6 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:25.861455 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9f4889ee-4cc0-433c-b87e-432abaa77ce6 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:25.862298 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9f4889ee-4cc0-433c-b87e-432abaa77ce6 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:25.862763 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9f4889ee-4cc0-433c-b87e-432abaa77ce6 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:25.888143 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-66158ec1-1daa-4ff9-a670-ad8f1bd068c6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:25.897019 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-66158ec1-1daa-4ff9-a670-ad8f1bd068c6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:25.898654 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-66158ec1-1daa-4ff9-a670-ad8f1bd068c6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:25.899796 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-66158ec1-1daa-4ff9-a670-ad8f1bd068c6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.098966 Jun 17 13:31:25.900321 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1609/3177] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:31:25 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:31:25.998461 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-9f4889ee-4cc0-433c-b87e-432abaa77ce6 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:26.006664 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-9f4889ee-4cc0-433c-b87e-432abaa77ce6 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.157361 Jun 17 13:31:26.007236 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1569/3178] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:31:25 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:31:26.921500 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-472997fb-bdb1-4645-8077-a1cb15530da6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:31:26.922586 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-472997fb-bdb1-4645-8077-a1cb15530da6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:31:26.933656 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-472997fb-bdb1-4645-8077-a1cb15530da6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:26.934395 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-472997fb-bdb1-4645-8077-a1cb15530da6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:26.935617 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-472997fb-bdb1-4645-8077-a1cb15530da6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:26.936329 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-472997fb-bdb1-4645-8077-a1cb15530da6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:27.003008 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-472997fb-bdb1-4645-8077-a1cb15530da6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:27.012103 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-472997fb-bdb1-4645-8077-a1cb15530da6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:27.013579 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-472997fb-bdb1-4645-8077-a1cb15530da6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:27.014731 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-472997fb-bdb1-4645-8077-a1cb15530da6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.099923 Jun 17 13:31:27.015275 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1610/3179] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:31:26 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:31:27.024788 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-57c81519-d83f-4857-ab6a-d08ab406ebb9 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:31:27.025407 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-57c81519-d83f-4857-ab6a-d08ab406ebb9 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:31:27.032941 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-57c81519-d83f-4857-ab6a-d08ab406ebb9 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:27.033393 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-57c81519-d83f-4857-ab6a-d08ab406ebb9 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:27.034196 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-57c81519-d83f-4857-ab6a-d08ab406ebb9 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:27.034635 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-57c81519-d83f-4857-ab6a-d08ab406ebb9 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:27.167362 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-57c81519-d83f-4857-ab6a-d08ab406ebb9 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:27.175970 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-57c81519-d83f-4857-ab6a-d08ab406ebb9 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.155023 Jun 17 13:31:27.176546 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1570/3180] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:31:27 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:31:28.038153 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-eeb0094a-b554-4a47-89ab-2cd60a4c453a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:31:28.039210 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-eeb0094a-b554-4a47-89ab-2cd60a4c453a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:31:28.050227 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-eeb0094a-b554-4a47-89ab-2cd60a4c453a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:28.050980 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-eeb0094a-b554-4a47-89ab-2cd60a4c453a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:28.052221 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-eeb0094a-b554-4a47-89ab-2cd60a4c453a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:28.052944 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-eeb0094a-b554-4a47-89ab-2cd60a4c453a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:28.118011 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-eeb0094a-b554-4a47-89ab-2cd60a4c453a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:28.127211 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-eeb0094a-b554-4a47-89ab-2cd60a4c453a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:28.128697 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-eeb0094a-b554-4a47-89ab-2cd60a4c453a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:28.129834 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-eeb0094a-b554-4a47-89ab-2cd60a4c453a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.098183 Jun 17 13:31:28.130460 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1611/3181] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:31:28 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:31:28.193261 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-274e0486-d97d-4706-a098-a7bb109ccc40 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:31:28.193846 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-274e0486-d97d-4706-a098-a7bb109ccc40 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:31:28.200869 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-274e0486-d97d-4706-a098-a7bb109ccc40 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:28.201311 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-274e0486-d97d-4706-a098-a7bb109ccc40 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:28.202064 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-274e0486-d97d-4706-a098-a7bb109ccc40 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:28.202519 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-274e0486-d97d-4706-a098-a7bb109ccc40 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:28.341447 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-274e0486-d97d-4706-a098-a7bb109ccc40 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:28.349688 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-274e0486-d97d-4706-a098-a7bb109ccc40 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.160354 Jun 17 13:31:28.350311 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1571/3182] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:31:28 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:31:29.148218 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-e7ee188f-a322-4779-ac54-9bfaf5da9c59 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:31:29.148931 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-e7ee188f-a322-4779-ac54-9bfaf5da9c59 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:31:29.157665 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e7ee188f-a322-4779-ac54-9bfaf5da9c59 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:29.158460 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e7ee188f-a322-4779-ac54-9bfaf5da9c59 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:29.159625 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e7ee188f-a322-4779-ac54-9bfaf5da9c59 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:29.160339 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e7ee188f-a322-4779-ac54-9bfaf5da9c59 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:29.227214 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-e7ee188f-a322-4779-ac54-9bfaf5da9c59 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:29.237111 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-e7ee188f-a322-4779-ac54-9bfaf5da9c59 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:29.238644 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-e7ee188f-a322-4779-ac54-9bfaf5da9c59 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:29.239797 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-e7ee188f-a322-4779-ac54-9bfaf5da9c59 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.095714 Jun 17 13:31:29.240399 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1612/3183] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:31:29 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:31:29.371126 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-8281c84c-f1b1-4b93-948b-febcb3664982 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:31:29.371748 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-8281c84c-f1b1-4b93-948b-febcb3664982 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:31:29.378714 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8281c84c-f1b1-4b93-948b-febcb3664982 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:29.379162 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8281c84c-f1b1-4b93-948b-febcb3664982 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:29.379918 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8281c84c-f1b1-4b93-948b-febcb3664982 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:29.380347 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8281c84c-f1b1-4b93-948b-febcb3664982 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:29.513305 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-8281c84c-f1b1-4b93-948b-febcb3664982 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:29.521558 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-8281c84c-f1b1-4b93-948b-febcb3664982 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.156440 Jun 17 13:31:29.522127 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1572/3184] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:31:29 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:31:30.262641 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-4a2c135b-6072-4bfb-abb5-4995e474151a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:31:30.263591 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-4a2c135b-6072-4bfb-abb5-4995e474151a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:31:30.274476 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4a2c135b-6072-4bfb-abb5-4995e474151a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:30.275241 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4a2c135b-6072-4bfb-abb5-4995e474151a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:30.276558 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4a2c135b-6072-4bfb-abb5-4995e474151a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:30.276992 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4a2c135b-6072-4bfb-abb5-4995e474151a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:30.349158 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-4a2c135b-6072-4bfb-abb5-4995e474151a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:30.358544 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-4a2c135b-6072-4bfb-abb5-4995e474151a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:30.360070 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-4a2c135b-6072-4bfb-abb5-4995e474151a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:30.361196 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-4a2c135b-6072-4bfb-abb5-4995e474151a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.105113 Jun 17 13:31:30.361760 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1613/3185] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:31:30 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:31:30.542456 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-f5649781-5987-4336-aa10-d6c6db96fcca tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:31:30.543130 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-f5649781-5987-4336-aa10-d6c6db96fcca tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:31:30.550946 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f5649781-5987-4336-aa10-d6c6db96fcca tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:30.551465 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f5649781-5987-4336-aa10-d6c6db96fcca tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:30.552353 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f5649781-5987-4336-aa10-d6c6db96fcca tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:30.552858 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f5649781-5987-4336-aa10-d6c6db96fcca tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:30.687976 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-f5649781-5987-4336-aa10-d6c6db96fcca tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:30.696125 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-f5649781-5987-4336-aa10-d6c6db96fcca tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.160036 Jun 17 13:31:30.696744 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1573/3186] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:31:30 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:31:31.384325 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-07ce4665-0284-4fa5-b922-4afdf95f6bb6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:31:31.385318 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-07ce4665-0284-4fa5-b922-4afdf95f6bb6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:31:31.392949 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-07ce4665-0284-4fa5-b922-4afdf95f6bb6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:31.393428 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-07ce4665-0284-4fa5-b922-4afdf95f6bb6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:31.394217 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-07ce4665-0284-4fa5-b922-4afdf95f6bb6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:31.394651 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-07ce4665-0284-4fa5-b922-4afdf95f6bb6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:31.457973 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-07ce4665-0284-4fa5-b922-4afdf95f6bb6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:31.466695 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-07ce4665-0284-4fa5-b922-4afdf95f6bb6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:31.468180 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-07ce4665-0284-4fa5-b922-4afdf95f6bb6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:31.469307 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-07ce4665-0284-4fa5-b922-4afdf95f6bb6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.091483 Jun 17 13:31:31.469910 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1614/3187] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:31:31 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:31:31.716617 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-b28477e3-eb78-4cd7-841e-b88f42d44dfc tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:31:31.717282 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-b28477e3-eb78-4cd7-841e-b88f42d44dfc tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:31:31.724913 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b28477e3-eb78-4cd7-841e-b88f42d44dfc tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:31.725404 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b28477e3-eb78-4cd7-841e-b88f42d44dfc tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:31.726284 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b28477e3-eb78-4cd7-841e-b88f42d44dfc tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:31.726769 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b28477e3-eb78-4cd7-841e-b88f42d44dfc tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:31.868529 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-b28477e3-eb78-4cd7-841e-b88f42d44dfc tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:31.872090 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=100 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:31:31.877621 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-b28477e3-eb78-4cd7-841e-b88f42d44dfc tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.166644 Jun 17 13:31:31.878222 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1574/3188] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:31:31 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:31:32.493132 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-a2369965-62be-4adc-81e2-22d77925020f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:31:32.494083 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-a2369965-62be-4adc-81e2-22d77925020f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:31:32.501844 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a2369965-62be-4adc-81e2-22d77925020f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:32.502349 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a2369965-62be-4adc-81e2-22d77925020f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:32.503090 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a2369965-62be-4adc-81e2-22d77925020f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:32.503527 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a2369965-62be-4adc-81e2-22d77925020f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:32.572744 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-a2369965-62be-4adc-81e2-22d77925020f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:32.582001 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-a2369965-62be-4adc-81e2-22d77925020f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:32.583818 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-a2369965-62be-4adc-81e2-22d77925020f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:32.585153 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-a2369965-62be-4adc-81e2-22d77925020f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.098733 Jun 17 13:31:32.585897 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1615/3189] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:31:32 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:31:32.899592 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-9d5699b7-d58a-4f44-81f6-fa3ff53bbb2b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:31:32.900527 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-9d5699b7-d58a-4f44-81f6-fa3ff53bbb2b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:31:32.911414 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9d5699b7-d58a-4f44-81f6-fa3ff53bbb2b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:32.912146 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9d5699b7-d58a-4f44-81f6-fa3ff53bbb2b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:32.913378 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9d5699b7-d58a-4f44-81f6-fa3ff53bbb2b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:32.914123 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9d5699b7-d58a-4f44-81f6-fa3ff53bbb2b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:33.048650 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-9d5699b7-d58a-4f44-81f6-fa3ff53bbb2b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:33.061110 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-9d5699b7-d58a-4f44-81f6-fa3ff53bbb2b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.167958 Jun 17 13:31:33.061795 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1575/3190] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:31:32 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:31:33.365346 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-8dc06bd6-bc12-47b7-8a9a-5bf5c8c196ce tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:31:33.365841 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-8dc06bd6-bc12-47b7-8a9a-5bf5c8c196ce tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 26622189-19d7-4ce4-b2a8-8f50a6080307] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:31:33.372489 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8dc06bd6-bc12-47b7-8a9a-5bf5c8c196ce tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:33.372937 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8dc06bd6-bc12-47b7-8a9a-5bf5c8c196ce tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:33.373696 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8dc06bd6-bc12-47b7-8a9a-5bf5c8c196ce tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:33.374122 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8dc06bd6-bc12-47b7-8a9a-5bf5c8c196ce tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:33.397617 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-8dc06bd6-bc12-47b7-8a9a-5bf5c8c196ce tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/26622189-19d7-4ce4-b2a8-8f50a6080307/ips" status: 200 len: 146 microversion: 2.1 time: 0.036214 Jun 17 13:31:33.398220 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1616/3191] 10.222.0.48 () {58 vars in 1247 bytes} [Fri Jun 17 13:31:33 2022] GET /compute/v2.1/servers/26622189-19d7-4ce4-b2a8-8f50a6080307/ips => generated 146 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:31:33.605311 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-13a1171a-ec0f-4df3-9092-fa21a9a7afaf tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:31:33.605855 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-13a1171a-ec0f-4df3-9092-fa21a9a7afaf tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:31:33.612457 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-13a1171a-ec0f-4df3-9092-fa21a9a7afaf tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:33.612900 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-13a1171a-ec0f-4df3-9092-fa21a9a7afaf tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:33.613647 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-13a1171a-ec0f-4df3-9092-fa21a9a7afaf tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:33.614076 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-13a1171a-ec0f-4df3-9092-fa21a9a7afaf tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:33.677736 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-13a1171a-ec0f-4df3-9092-fa21a9a7afaf tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:33.686705 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-13a1171a-ec0f-4df3-9092-fa21a9a7afaf tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:33.688184 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-13a1171a-ec0f-4df3-9092-fa21a9a7afaf tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:33.689311 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-13a1171a-ec0f-4df3-9092-fa21a9a7afaf tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.088976 Jun 17 13:31:33.689873 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1576/3192] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:31:33 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:31:34.082506 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-8c39d6ed-d440-45ef-828d-29ad7be7ed54 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:31:34.083485 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-8c39d6ed-d440-45ef-828d-29ad7be7ed54 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:31:34.093233 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8c39d6ed-d440-45ef-828d-29ad7be7ed54 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:34.093690 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8c39d6ed-d440-45ef-828d-29ad7be7ed54 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:34.094502 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8c39d6ed-d440-45ef-828d-29ad7be7ed54 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:34.094937 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8c39d6ed-d440-45ef-828d-29ad7be7ed54 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:34.239696 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-8c39d6ed-d440-45ef-828d-29ad7be7ed54 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:34.252502 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-8c39d6ed-d440-45ef-828d-29ad7be7ed54 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.176119 Jun 17 13:31:34.253380 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1617/3193] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:31:34 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:31:34.711161 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-061cfedc-4ebb-44eb-b7ae-eaa90442f8d9 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:31:34.712125 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-061cfedc-4ebb-44eb-b7ae-eaa90442f8d9 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:31:34.720752 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-061cfedc-4ebb-44eb-b7ae-eaa90442f8d9 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:34.721201 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-061cfedc-4ebb-44eb-b7ae-eaa90442f8d9 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:34.721957 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-061cfedc-4ebb-44eb-b7ae-eaa90442f8d9 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:34.722432 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-061cfedc-4ebb-44eb-b7ae-eaa90442f8d9 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:34.793067 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-061cfedc-4ebb-44eb-b7ae-eaa90442f8d9 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:34.801944 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-061cfedc-4ebb-44eb-b7ae-eaa90442f8d9 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:34.803488 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-061cfedc-4ebb-44eb-b7ae-eaa90442f8d9 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:34.804635 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-061cfedc-4ebb-44eb-b7ae-eaa90442f8d9 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.100081 Jun 17 13:31:34.805197 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1577/3194] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:31:34 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:31:35.270512 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-36d961a9-eadd-4f63-bd54-1757098436af tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:31:35.271137 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-36d961a9-eadd-4f63-bd54-1757098436af tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:31:35.278249 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-36d961a9-eadd-4f63-bd54-1757098436af tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:35.278697 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-36d961a9-eadd-4f63-bd54-1757098436af tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:35.279454 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-36d961a9-eadd-4f63-bd54-1757098436af tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:35.279879 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-36d961a9-eadd-4f63-bd54-1757098436af tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:35.417249 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-36d961a9-eadd-4f63-bd54-1757098436af tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:35.425673 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-36d961a9-eadd-4f63-bd54-1757098436af tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.159185 Jun 17 13:31:35.426268 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1618/3195] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:31:35 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:31:35.826967 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-0028dffd-ddbe-4bc0-95d9-66b84a411188 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:31:35.827695 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-0028dffd-ddbe-4bc0-95d9-66b84a411188 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:31:35.836558 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0028dffd-ddbe-4bc0-95d9-66b84a411188 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:35.837148 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0028dffd-ddbe-4bc0-95d9-66b84a411188 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:35.838138 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0028dffd-ddbe-4bc0-95d9-66b84a411188 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:35.838739 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0028dffd-ddbe-4bc0-95d9-66b84a411188 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:35.905472 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-0028dffd-ddbe-4bc0-95d9-66b84a411188 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:35.918439 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-0028dffd-ddbe-4bc0-95d9-66b84a411188 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:35.919892 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-0028dffd-ddbe-4bc0-95d9-66b84a411188 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:35.921014 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-0028dffd-ddbe-4bc0-95d9-66b84a411188 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.100378 Jun 17 13:31:35.921543 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1578/3196] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:31:35 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:31:36.442119 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-603558ad-d3ee-4fc6-96e9-d9b54d4e5c0d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:31:36.442767 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-603558ad-d3ee-4fc6-96e9-d9b54d4e5c0d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:31:36.449738 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-603558ad-d3ee-4fc6-96e9-d9b54d4e5c0d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:36.450214 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-603558ad-d3ee-4fc6-96e9-d9b54d4e5c0d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:36.450950 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-603558ad-d3ee-4fc6-96e9-d9b54d4e5c0d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:36.451384 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-603558ad-d3ee-4fc6-96e9-d9b54d4e5c0d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:36.647709 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-603558ad-d3ee-4fc6-96e9-d9b54d4e5c0d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:36.656171 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-603558ad-d3ee-4fc6-96e9-d9b54d4e5c0d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.217924 Jun 17 13:31:36.656833 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1619/3197] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:31:36 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:31:36.939930 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-36bfc470-ea47-4e7f-9f07-0f6d5923f126 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:31:36.940577 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-36bfc470-ea47-4e7f-9f07-0f6d5923f126 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:31:36.947850 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-36bfc470-ea47-4e7f-9f07-0f6d5923f126 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:36.948300 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-36bfc470-ea47-4e7f-9f07-0f6d5923f126 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:36.949275 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-36bfc470-ea47-4e7f-9f07-0f6d5923f126 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:36.949788 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-36bfc470-ea47-4e7f-9f07-0f6d5923f126 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:37.043821 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-36bfc470-ea47-4e7f-9f07-0f6d5923f126 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:37.052677 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-36bfc470-ea47-4e7f-9f07-0f6d5923f126 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:37.054196 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-36bfc470-ea47-4e7f-9f07-0f6d5923f126 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:37.055328 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-36bfc470-ea47-4e7f-9f07-0f6d5923f126 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.119450 Jun 17 13:31:37.056099 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1579/3198] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:31:36 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:31:37.675383 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-62aa298c-063a-43c6-a3d6-c2848fdd56b4 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:31:37.676081 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-62aa298c-063a-43c6-a3d6-c2848fdd56b4 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:31:37.685717 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-62aa298c-063a-43c6-a3d6-c2848fdd56b4 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:37.686192 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-62aa298c-063a-43c6-a3d6-c2848fdd56b4 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:37.686990 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-62aa298c-063a-43c6-a3d6-c2848fdd56b4 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:37.687436 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-62aa298c-063a-43c6-a3d6-c2848fdd56b4 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:37.823864 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-62aa298c-063a-43c6-a3d6-c2848fdd56b4 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:37.832560 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-62aa298c-063a-43c6-a3d6-c2848fdd56b4 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.162934 Jun 17 13:31:37.833447 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1620/3199] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:31:37 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:31:38.073893 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-67b9b122-db3d-4383-a1ec-b408a1cece5e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:31:38.074573 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-67b9b122-db3d-4383-a1ec-b408a1cece5e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:31:38.081754 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-67b9b122-db3d-4383-a1ec-b408a1cece5e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:38.082354 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-67b9b122-db3d-4383-a1ec-b408a1cece5e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:38.083148 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-67b9b122-db3d-4383-a1ec-b408a1cece5e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:38.083617 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-67b9b122-db3d-4383-a1ec-b408a1cece5e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:38.157457 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-67b9b122-db3d-4383-a1ec-b408a1cece5e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:38.166457 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-67b9b122-db3d-4383-a1ec-b408a1cece5e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:38.168485 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-67b9b122-db3d-4383-a1ec-b408a1cece5e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:38.169631 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-67b9b122-db3d-4383-a1ec-b408a1cece5e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.099827 Jun 17 13:31:38.170248 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1580/3200] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:31:38 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:31:38.853725 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-633ee432-8c16-48ff-b1ea-41a1e795a87c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:31:38.855604 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-633ee432-8c16-48ff-b1ea-41a1e795a87c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:31:38.861772 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-633ee432-8c16-48ff-b1ea-41a1e795a87c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:38.862252 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-633ee432-8c16-48ff-b1ea-41a1e795a87c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:38.863003 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-633ee432-8c16-48ff-b1ea-41a1e795a87c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:38.863435 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-633ee432-8c16-48ff-b1ea-41a1e795a87c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:39.011244 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-633ee432-8c16-48ff-b1ea-41a1e795a87c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:39.019972 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-633ee432-8c16-48ff-b1ea-41a1e795a87c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.172793 Jun 17 13:31:39.020552 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1621/3201] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:31:38 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:31:39.192791 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-b1c01c63-6553-4bf5-a8c5-89b01dc1277a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:31:39.193819 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-b1c01c63-6553-4bf5-a8c5-89b01dc1277a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:31:39.204886 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b1c01c63-6553-4bf5-a8c5-89b01dc1277a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:39.205640 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b1c01c63-6553-4bf5-a8c5-89b01dc1277a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:39.206936 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b1c01c63-6553-4bf5-a8c5-89b01dc1277a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:39.207664 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b1c01c63-6553-4bf5-a8c5-89b01dc1277a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:39.274964 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-b1c01c63-6553-4bf5-a8c5-89b01dc1277a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:39.284129 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-b1c01c63-6553-4bf5-a8c5-89b01dc1277a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:39.285627 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-b1c01c63-6553-4bf5-a8c5-89b01dc1277a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:39.286802 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-b1c01c63-6553-4bf5-a8c5-89b01dc1277a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.100608 Jun 17 13:31:39.287395 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1581/3202] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:31:39 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:31:40.044687 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-8820ee9c-1a79-449f-bcf6-788e3709b982 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:31:40.045337 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-8820ee9c-1a79-449f-bcf6-788e3709b982 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:31:40.054995 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8820ee9c-1a79-449f-bcf6-788e3709b982 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:40.055598 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8820ee9c-1a79-449f-bcf6-788e3709b982 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:40.056677 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8820ee9c-1a79-449f-bcf6-788e3709b982 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:40.057266 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8820ee9c-1a79-449f-bcf6-788e3709b982 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:40.195153 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-8820ee9c-1a79-449f-bcf6-788e3709b982 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:40.206981 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-8820ee9c-1a79-449f-bcf6-788e3709b982 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.167689 Jun 17 13:31:40.207836 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1622/3203] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:31:40 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:31:40.307358 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-5b02978a-70d2-4570-b68b-2151de77711b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:31:40.308024 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-5b02978a-70d2-4570-b68b-2151de77711b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:31:40.316444 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5b02978a-70d2-4570-b68b-2151de77711b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:40.317089 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5b02978a-70d2-4570-b68b-2151de77711b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:40.318344 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5b02978a-70d2-4570-b68b-2151de77711b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:40.318967 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5b02978a-70d2-4570-b68b-2151de77711b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:40.384537 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-5b02978a-70d2-4570-b68b-2151de77711b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:40.393798 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-5b02978a-70d2-4570-b68b-2151de77711b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:40.395339 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-5b02978a-70d2-4570-b68b-2151de77711b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:40.396471 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-5b02978a-70d2-4570-b68b-2151de77711b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.094935 Jun 17 13:31:40.397038 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1582/3204] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:31:40 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:31:41.230934 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-4615ff1c-cdf1-4037-bd4c-05a211bd47ff tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:31:41.231661 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-4615ff1c-cdf1-4037-bd4c-05a211bd47ff tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:31:41.239601 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4615ff1c-cdf1-4037-bd4c-05a211bd47ff tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:41.240127 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4615ff1c-cdf1-4037-bd4c-05a211bd47ff tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:41.241012 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4615ff1c-cdf1-4037-bd4c-05a211bd47ff tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:41.241527 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4615ff1c-cdf1-4037-bd4c-05a211bd47ff tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:41.380743 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-4615ff1c-cdf1-4037-bd4c-05a211bd47ff tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:41.385332 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_cell1:SELECT=100 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:31:41.391178 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-4615ff1c-cdf1-4037-bd4c-05a211bd47ff tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.166989 Jun 17 13:31:41.391955 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1623/3205] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:31:41 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:31:41.414816 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-c9c28767-248f-4fa1-8858-8e380bc5e253 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:31:41.415427 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-c9c28767-248f-4fa1-8858-8e380bc5e253 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:31:41.423037 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c9c28767-248f-4fa1-8858-8e380bc5e253 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:41.423476 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c9c28767-248f-4fa1-8858-8e380bc5e253 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:41.424222 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c9c28767-248f-4fa1-8858-8e380bc5e253 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:41.424646 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c9c28767-248f-4fa1-8858-8e380bc5e253 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:41.489770 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-c9c28767-248f-4fa1-8858-8e380bc5e253 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:41.498857 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-c9c28767-248f-4fa1-8858-8e380bc5e253 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:41.500322 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-c9c28767-248f-4fa1-8858-8e380bc5e253 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:41.501443 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-c9c28767-248f-4fa1-8858-8e380bc5e253 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.090528 Jun 17 13:31:41.502025 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1583/3206] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:31:41 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:31:42.412121 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-7a837b46-79ec-4f7c-9521-7d337db4240b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:31:42.412737 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-7a837b46-79ec-4f7c-9521-7d337db4240b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:31:42.420725 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7a837b46-79ec-4f7c-9521-7d337db4240b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:42.421222 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7a837b46-79ec-4f7c-9521-7d337db4240b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:42.422045 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7a837b46-79ec-4f7c-9521-7d337db4240b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:42.422564 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7a837b46-79ec-4f7c-9521-7d337db4240b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:42.525860 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-b1080efc-873e-491b-acfd-5713017d881f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:31:42.526699 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-b1080efc-873e-491b-acfd-5713017d881f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:31:42.533722 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b1080efc-873e-491b-acfd-5713017d881f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:42.534203 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b1080efc-873e-491b-acfd-5713017d881f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:42.534976 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b1080efc-873e-491b-acfd-5713017d881f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:42.535413 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b1080efc-873e-491b-acfd-5713017d881f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:42.552174 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-7a837b46-79ec-4f7c-9521-7d337db4240b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:42.560798 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-7a837b46-79ec-4f7c-9521-7d337db4240b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.152930 Jun 17 13:31:42.561341 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1624/3207] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:31:42 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:31:42.598366 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-b1080efc-873e-491b-acfd-5713017d881f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:42.608558 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-b1080efc-873e-491b-acfd-5713017d881f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:42.610260 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-b1080efc-873e-491b-acfd-5713017d881f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:42.611425 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-b1080efc-873e-491b-acfd-5713017d881f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.089846 Jun 17 13:31:42.611997 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1584/3208] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:31:42 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:31:43.581705 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-50db51c9-9522-475e-9af0-f43ffdcee733 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:31:43.582660 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-50db51c9-9522-475e-9af0-f43ffdcee733 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:31:43.593779 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-50db51c9-9522-475e-9af0-f43ffdcee733 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:43.594581 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-50db51c9-9522-475e-9af0-f43ffdcee733 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:43.595811 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-50db51c9-9522-475e-9af0-f43ffdcee733 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:43.596522 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-50db51c9-9522-475e-9af0-f43ffdcee733 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:43.630607 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-dfd87907-72b6-4488-b63d-4f83e5ae38ef tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:31:43.631236 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-dfd87907-72b6-4488-b63d-4f83e5ae38ef tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:31:43.638449 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dfd87907-72b6-4488-b63d-4f83e5ae38ef tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:43.638891 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dfd87907-72b6-4488-b63d-4f83e5ae38ef tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:43.639654 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dfd87907-72b6-4488-b63d-4f83e5ae38ef tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:43.640085 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dfd87907-72b6-4488-b63d-4f83e5ae38ef tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:43.718237 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-dfd87907-72b6-4488-b63d-4f83e5ae38ef tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:43.727098 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-dfd87907-72b6-4488-b63d-4f83e5ae38ef tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:43.728595 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-dfd87907-72b6-4488-b63d-4f83e5ae38ef tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:43.730690 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-dfd87907-72b6-4488-b63d-4f83e5ae38ef tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.103622 Jun 17 13:31:43.731281 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1585/3209] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:31:43 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:31:43.757434 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-50db51c9-9522-475e-9af0-f43ffdcee733 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:43.769270 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-50db51c9-9522-475e-9af0-f43ffdcee733 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.193959 Jun 17 13:31:43.770119 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1625/3210] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:31:43 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:31:44.753786 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-06efbfe2-b875-46e2-83c5-6e4948125ade tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:31:44.754925 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-06efbfe2-b875-46e2-83c5-6e4948125ade tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:31:44.764339 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-06efbfe2-b875-46e2-83c5-6e4948125ade tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:44.764784 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-06efbfe2-b875-46e2-83c5-6e4948125ade tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:44.765545 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-06efbfe2-b875-46e2-83c5-6e4948125ade tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:44.765974 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-06efbfe2-b875-46e2-83c5-6e4948125ade tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:44.788847 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-a86ad491-e349-496e-87a8-68f8ef416926 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:31:44.789447 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-a86ad491-e349-496e-87a8-68f8ef416926 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:31:44.796445 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a86ad491-e349-496e-87a8-68f8ef416926 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:44.796892 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a86ad491-e349-496e-87a8-68f8ef416926 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:44.797652 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a86ad491-e349-496e-87a8-68f8ef416926 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:44.798076 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a86ad491-e349-496e-87a8-68f8ef416926 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:44.828030 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-06efbfe2-b875-46e2-83c5-6e4948125ade tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:44.836847 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-06efbfe2-b875-46e2-83c5-6e4948125ade tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:44.838408 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-06efbfe2-b875-46e2-83c5-6e4948125ade tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:44.839587 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-06efbfe2-b875-46e2-83c5-6e4948125ade tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.092307 Jun 17 13:31:44.840153 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1586/3211] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:31:44 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:31:44.929915 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-a86ad491-e349-496e-87a8-68f8ef416926 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:44.938111 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-a86ad491-e349-496e-87a8-68f8ef416926 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.153139 Jun 17 13:31:44.938655 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1626/3212] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:31:44 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:31:45.861500 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-7cb8467d-becd-4f83-a231-be5791a351e3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:31:45.862598 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-7cb8467d-becd-4f83-a231-be5791a351e3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:31:45.872457 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7cb8467d-becd-4f83-a231-be5791a351e3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:45.872907 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7cb8467d-becd-4f83-a231-be5791a351e3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:45.873669 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7cb8467d-becd-4f83-a231-be5791a351e3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:45.874124 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7cb8467d-becd-4f83-a231-be5791a351e3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:45.940873 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-7cb8467d-becd-4f83-a231-be5791a351e3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:45.949502 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-7cb8467d-becd-4f83-a231-be5791a351e3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:45.951435 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-7cb8467d-becd-4f83-a231-be5791a351e3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:45.952606 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-7cb8467d-becd-4f83-a231-be5791a351e3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.098173 Jun 17 13:31:45.953919 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1587/3213] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:31:45 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:31:45.955281 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-4cc08115-0ecf-4317-a510-a871fc6ab06a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:31:45.956513 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-4cc08115-0ecf-4317-a510-a871fc6ab06a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:31:45.963327 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4cc08115-0ecf-4317-a510-a871fc6ab06a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:45.963798 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4cc08115-0ecf-4317-a510-a871fc6ab06a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:45.964600 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4cc08115-0ecf-4317-a510-a871fc6ab06a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:45.965466 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4cc08115-0ecf-4317-a510-a871fc6ab06a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:46.111808 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-4cc08115-0ecf-4317-a510-a871fc6ab06a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:46.119866 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-4cc08115-0ecf-4317-a510-a871fc6ab06a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.168494 Jun 17 13:31:46.120547 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1627/3214] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:31:45 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 13:31:46.975098 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-42da2596-d303-428d-a9ed-ec9829dbf8ab tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:31:46.976070 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-42da2596-d303-428d-a9ed-ec9829dbf8ab tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:31:46.985180 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-42da2596-d303-428d-a9ed-ec9829dbf8ab tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:46.985633 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-42da2596-d303-428d-a9ed-ec9829dbf8ab tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:46.986428 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-42da2596-d303-428d-a9ed-ec9829dbf8ab tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:46.986866 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-42da2596-d303-428d-a9ed-ec9829dbf8ab tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:47.055983 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-42da2596-d303-428d-a9ed-ec9829dbf8ab tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:47.065562 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-42da2596-d303-428d-a9ed-ec9829dbf8ab tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:47.067096 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-42da2596-d303-428d-a9ed-ec9829dbf8ab tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:47.068240 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-42da2596-d303-428d-a9ed-ec9829dbf8ab tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.099712 Jun 17 13:31:47.068799 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1588/3215] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:31:46 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:31:47.137085 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-c89409da-02b5-43d6-b2d3-8b7e1e061c3f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:31:47.137672 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-c89409da-02b5-43d6-b2d3-8b7e1e061c3f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:31:47.144744 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c89409da-02b5-43d6-b2d3-8b7e1e061c3f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:47.145192 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c89409da-02b5-43d6-b2d3-8b7e1e061c3f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:47.145960 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c89409da-02b5-43d6-b2d3-8b7e1e061c3f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:47.146429 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c89409da-02b5-43d6-b2d3-8b7e1e061c3f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:47.285721 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-c89409da-02b5-43d6-b2d3-8b7e1e061c3f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:47.294262 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-c89409da-02b5-43d6-b2d3-8b7e1e061c3f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.161221 Jun 17 13:31:47.294869 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1628/3216] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:31:47 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:31:48.092107 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-4d468932-feb3-43c9-8e2d-d35ba5e95d49 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:31:48.093107 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-4d468932-feb3-43c9-8e2d-d35ba5e95d49 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:31:48.096722 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_api:SELECT=54 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:31:48.105890 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4d468932-feb3-43c9-8e2d-d35ba5e95d49 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:48.106476 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4d468932-feb3-43c9-8e2d-d35ba5e95d49 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:48.107233 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4d468932-feb3-43c9-8e2d-d35ba5e95d49 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:48.107662 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4d468932-feb3-43c9-8e2d-d35ba5e95d49 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:48.179217 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-4d468932-feb3-43c9-8e2d-d35ba5e95d49 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:48.189581 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-4d468932-feb3-43c9-8e2d-d35ba5e95d49 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:48.191661 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-4d468932-feb3-43c9-8e2d-d35ba5e95d49 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:48.192974 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-4d468932-feb3-43c9-8e2d-d35ba5e95d49 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.107451 Jun 17 13:31:48.193700 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1589/3217] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:31:48 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:31:48.314358 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-edc7379b-a649-4e97-a901-db089173d5df tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:31:48.322872 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-edc7379b-a649-4e97-a901-db089173d5df tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:31:48.332386 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-edc7379b-a649-4e97-a901-db089173d5df tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:48.332992 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-edc7379b-a649-4e97-a901-db089173d5df tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:48.333949 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-edc7379b-a649-4e97-a901-db089173d5df tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:48.334639 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-edc7379b-a649-4e97-a901-db089173d5df tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:48.468049 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-edc7379b-a649-4e97-a901-db089173d5df tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:48.476150 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-edc7379b-a649-4e97-a901-db089173d5df tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.166925 Jun 17 13:31:48.476705 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1629/3218] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:31:48 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:31:49.215176 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-b547e3c0-9290-4ae3-b4d8-4a873ce793b2 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:31:49.215833 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-b547e3c0-9290-4ae3-b4d8-4a873ce793b2 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:31:49.223161 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b547e3c0-9290-4ae3-b4d8-4a873ce793b2 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:49.223632 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b547e3c0-9290-4ae3-b4d8-4a873ce793b2 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:49.224428 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b547e3c0-9290-4ae3-b4d8-4a873ce793b2 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:49.224884 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b547e3c0-9290-4ae3-b4d8-4a873ce793b2 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:49.289543 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-b547e3c0-9290-4ae3-b4d8-4a873ce793b2 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:49.298842 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-b547e3c0-9290-4ae3-b4d8-4a873ce793b2 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:49.300318 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-b547e3c0-9290-4ae3-b4d8-4a873ce793b2 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:49.301449 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-b547e3c0-9290-4ae3-b4d8-4a873ce793b2 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.092624 Jun 17 13:31:49.302007 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1590/3219] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:31:49 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:31:49.498258 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-58b0c9e2-45a5-42af-bb9f-89d8a77b2679 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:31:49.499258 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-58b0c9e2-45a5-42af-bb9f-89d8a77b2679 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:31:49.509808 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-58b0c9e2-45a5-42af-bb9f-89d8a77b2679 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:49.510605 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-58b0c9e2-45a5-42af-bb9f-89d8a77b2679 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:49.511845 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-58b0c9e2-45a5-42af-bb9f-89d8a77b2679 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:49.512275 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-58b0c9e2-45a5-42af-bb9f-89d8a77b2679 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:49.657774 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-58b0c9e2-45a5-42af-bb9f-89d8a77b2679 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:49.665730 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-58b0c9e2-45a5-42af-bb9f-89d8a77b2679 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.174389 Jun 17 13:31:49.666322 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1630/3220] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:31:49 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:31:50.323678 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-6d38dfd0-7613-4e04-a635-4e09d077fb3a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:31:50.324466 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-6d38dfd0-7613-4e04-a635-4e09d077fb3a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:31:50.331121 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6d38dfd0-7613-4e04-a635-4e09d077fb3a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:50.331556 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6d38dfd0-7613-4e04-a635-4e09d077fb3a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:50.332320 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6d38dfd0-7613-4e04-a635-4e09d077fb3a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:50.332752 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6d38dfd0-7613-4e04-a635-4e09d077fb3a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:50.350807 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=100 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:31:50.398466 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-6d38dfd0-7613-4e04-a635-4e09d077fb3a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:50.408730 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-6d38dfd0-7613-4e04-a635-4e09d077fb3a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:50.410252 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-6d38dfd0-7613-4e04-a635-4e09d077fb3a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:50.411394 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-6d38dfd0-7613-4e04-a635-4e09d077fb3a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.094306 Jun 17 13:31:50.411952 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1591/3221] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:31:50 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:31:50.687283 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-98a13179-5956-46d7-b387-0ed142e38d0d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:31:50.688277 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-98a13179-5956-46d7-b387-0ed142e38d0d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:31:50.691853 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_api:SELECT=54 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:31:50.701475 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-98a13179-5956-46d7-b387-0ed142e38d0d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:50.702272 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-98a13179-5956-46d7-b387-0ed142e38d0d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:50.703535 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-98a13179-5956-46d7-b387-0ed142e38d0d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:50.704280 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-98a13179-5956-46d7-b387-0ed142e38d0d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:50.853254 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-98a13179-5956-46d7-b387-0ed142e38d0d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:50.862120 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-98a13179-5956-46d7-b387-0ed142e38d0d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.181298 Jun 17 13:31:50.862725 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1631/3222] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:31:50 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:31:51.430822 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-4bcd0b6e-59f4-4600-95bf-94f6c8669f29 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:31:51.431493 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-4bcd0b6e-59f4-4600-95bf-94f6c8669f29 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:31:51.439576 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4bcd0b6e-59f4-4600-95bf-94f6c8669f29 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:51.440095 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4bcd0b6e-59f4-4600-95bf-94f6c8669f29 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:51.440973 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4bcd0b6e-59f4-4600-95bf-94f6c8669f29 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:51.441474 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4bcd0b6e-59f4-4600-95bf-94f6c8669f29 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:51.507753 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-4bcd0b6e-59f4-4600-95bf-94f6c8669f29 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:51.520811 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-4bcd0b6e-59f4-4600-95bf-94f6c8669f29 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:51.522901 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-4bcd0b6e-59f4-4600-95bf-94f6c8669f29 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:51.524624 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-4bcd0b6e-59f4-4600-95bf-94f6c8669f29 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.098191 Jun 17 13:31:51.525394 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1592/3223] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:31:51 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:31:51.883145 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-61c35868-0852-43fa-a740-2367f8214284 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:31:51.883798 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-61c35868-0852-43fa-a740-2367f8214284 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:31:51.891916 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-61c35868-0852-43fa-a740-2367f8214284 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:51.892359 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-61c35868-0852-43fa-a740-2367f8214284 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:51.893104 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-61c35868-0852-43fa-a740-2367f8214284 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:51.893533 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-61c35868-0852-43fa-a740-2367f8214284 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:52.027491 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-61c35868-0852-43fa-a740-2367f8214284 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:52.039564 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-61c35868-0852-43fa-a740-2367f8214284 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.162540 Jun 17 13:31:52.040362 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1632/3224] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:31:51 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:31:52.544211 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-d33959b2-5001-4dd0-9ff7-d0e33c984b6c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:31:52.544780 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-d33959b2-5001-4dd0-9ff7-d0e33c984b6c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:31:52.551993 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d33959b2-5001-4dd0-9ff7-d0e33c984b6c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:52.552573 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d33959b2-5001-4dd0-9ff7-d0e33c984b6c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:52.553351 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d33959b2-5001-4dd0-9ff7-d0e33c984b6c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:52.553805 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d33959b2-5001-4dd0-9ff7-d0e33c984b6c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:52.623172 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-d33959b2-5001-4dd0-9ff7-d0e33c984b6c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:52.631830 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-d33959b2-5001-4dd0-9ff7-d0e33c984b6c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:52.633331 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-d33959b2-5001-4dd0-9ff7-d0e33c984b6c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:52.634505 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-d33959b2-5001-4dd0-9ff7-d0e33c984b6c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.094841 Jun 17 13:31:52.635072 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1593/3225] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:31:52 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:31:53.061232 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-0f076607-188e-4257-93d9-49267786920a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:31:53.061971 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-0f076607-188e-4257-93d9-49267786920a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:31:53.070489 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0f076607-188e-4257-93d9-49267786920a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:53.071054 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0f076607-188e-4257-93d9-49267786920a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:53.072007 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0f076607-188e-4257-93d9-49267786920a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:53.072732 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0f076607-188e-4257-93d9-49267786920a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:53.218112 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-0f076607-188e-4257-93d9-49267786920a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:53.226119 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-0f076607-188e-4257-93d9-49267786920a tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.171044 Jun 17 13:31:53.226695 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1633/3226] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:31:53 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:31:53.662786 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-670a0a2d-def8-4729-af94-e4ab239486ca tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:31:53.663781 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-670a0a2d-def8-4729-af94-e4ab239486ca tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:31:53.672523 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-670a0a2d-def8-4729-af94-e4ab239486ca tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:53.672972 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-670a0a2d-def8-4729-af94-e4ab239486ca tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:53.673733 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-670a0a2d-def8-4729-af94-e4ab239486ca tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:53.674177 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-670a0a2d-def8-4729-af94-e4ab239486ca tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:53.750362 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-670a0a2d-def8-4729-af94-e4ab239486ca tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:53.763267 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-670a0a2d-def8-4729-af94-e4ab239486ca tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:53.765270 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-670a0a2d-def8-4729-af94-e4ab239486ca tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:53.767224 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-670a0a2d-def8-4729-af94-e4ab239486ca tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.110727 Jun 17 13:31:53.767922 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1594/3227] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:31:53 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:31:54.247299 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-e279631b-cbba-45d3-8416-e82d51b551f7 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:31:54.248263 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-e279631b-cbba-45d3-8416-e82d51b551f7 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:31:54.258338 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e279631b-cbba-45d3-8416-e82d51b551f7 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:54.259012 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e279631b-cbba-45d3-8416-e82d51b551f7 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:54.260150 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e279631b-cbba-45d3-8416-e82d51b551f7 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:54.261136 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e279631b-cbba-45d3-8416-e82d51b551f7 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:54.401213 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-e279631b-cbba-45d3-8416-e82d51b551f7 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:54.410043 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-e279631b-cbba-45d3-8416-e82d51b551f7 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.169284 Jun 17 13:31:54.410637 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1634/3228] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:31:54 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:31:54.787873 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-61dd3e32-43c7-4db4-a3f6-256ae33982dc tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:31:54.788611 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-61dd3e32-43c7-4db4-a3f6-256ae33982dc tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:31:54.797226 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-61dd3e32-43c7-4db4-a3f6-256ae33982dc tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:54.797777 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-61dd3e32-43c7-4db4-a3f6-256ae33982dc tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:54.798764 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-61dd3e32-43c7-4db4-a3f6-256ae33982dc tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:54.799297 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-61dd3e32-43c7-4db4-a3f6-256ae33982dc tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:54.866186 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-61dd3e32-43c7-4db4-a3f6-256ae33982dc tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:54.875602 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-61dd3e32-43c7-4db4-a3f6-256ae33982dc tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:54.877830 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-61dd3e32-43c7-4db4-a3f6-256ae33982dc tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:54.879205 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-61dd3e32-43c7-4db4-a3f6-256ae33982dc tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.096088 Jun 17 13:31:54.880006 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1595/3229] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:31:54 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:31:55.428044 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-733fe924-e732-4e78-b5ef-d0daf169df61 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:31:55.428810 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-733fe924-e732-4e78-b5ef-d0daf169df61 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:31:55.436667 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-733fe924-e732-4e78-b5ef-d0daf169df61 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:55.437168 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-733fe924-e732-4e78-b5ef-d0daf169df61 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:55.437931 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-733fe924-e732-4e78-b5ef-d0daf169df61 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:55.438408 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-733fe924-e732-4e78-b5ef-d0daf169df61 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:55.592288 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-733fe924-e732-4e78-b5ef-d0daf169df61 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:55.601103 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-733fe924-e732-4e78-b5ef-d0daf169df61 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.176955 Jun 17 13:31:55.601701 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1635/3230] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:31:55 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:31:55.900674 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-f895878f-40e0-4a6a-ad84-7cb712083dce tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:31:55.902379 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-f895878f-40e0-4a6a-ad84-7cb712083dce tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:31:55.912724 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f895878f-40e0-4a6a-ad84-7cb712083dce tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:55.913411 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f895878f-40e0-4a6a-ad84-7cb712083dce tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:55.914614 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f895878f-40e0-4a6a-ad84-7cb712083dce tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:55.915334 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f895878f-40e0-4a6a-ad84-7cb712083dce tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:55.985675 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-f895878f-40e0-4a6a-ad84-7cb712083dce tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:55.994315 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-f895878f-40e0-4a6a-ad84-7cb712083dce tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:55.996292 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-f895878f-40e0-4a6a-ad84-7cb712083dce tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:55.997428 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-f895878f-40e0-4a6a-ad84-7cb712083dce tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.102973 Jun 17 13:31:55.998014 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1596/3231] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:31:55 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:31:56.625712 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-76b66778-5d8f-4817-88b0-ad1b58846ff6 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:31:56.626725 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-76b66778-5d8f-4817-88b0-ad1b58846ff6 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:31:56.637186 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-76b66778-5d8f-4817-88b0-ad1b58846ff6 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:56.637631 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-76b66778-5d8f-4817-88b0-ad1b58846ff6 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:56.638418 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-76b66778-5d8f-4817-88b0-ad1b58846ff6 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:56.638900 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-76b66778-5d8f-4817-88b0-ad1b58846ff6 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:56.771555 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-76b66778-5d8f-4817-88b0-ad1b58846ff6 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:56.782019 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-76b66778-5d8f-4817-88b0-ad1b58846ff6 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.162983 Jun 17 13:31:56.782644 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1636/3232] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:31:56 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:31:57.020011 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-f39ad038-fa34-422e-a577-8478ab9a0670 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:31:57.020931 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-f39ad038-fa34-422e-a577-8478ab9a0670 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:31:57.030560 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f39ad038-fa34-422e-a577-8478ab9a0670 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:57.031009 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f39ad038-fa34-422e-a577-8478ab9a0670 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:57.031765 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f39ad038-fa34-422e-a577-8478ab9a0670 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:57.032201 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f39ad038-fa34-422e-a577-8478ab9a0670 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:57.094486 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-f39ad038-fa34-422e-a577-8478ab9a0670 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:57.103090 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-f39ad038-fa34-422e-a577-8478ab9a0670 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:57.104888 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-f39ad038-fa34-422e-a577-8478ab9a0670 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:57.106064 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-f39ad038-fa34-422e-a577-8478ab9a0670 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.092845 Jun 17 13:31:57.106639 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1597/3233] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:31:57 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:31:57.808472 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-7197537e-a086-4db4-b624-f1ba62d3190c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:31:57.809353 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-7197537e-a086-4db4-b624-f1ba62d3190c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:31:57.817914 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7197537e-a086-4db4-b624-f1ba62d3190c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:57.818515 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7197537e-a086-4db4-b624-f1ba62d3190c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:57.819469 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7197537e-a086-4db4-b624-f1ba62d3190c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:57.820013 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7197537e-a086-4db4-b624-f1ba62d3190c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:57.962056 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-7197537e-a086-4db4-b624-f1ba62d3190c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:57.974341 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-7197537e-a086-4db4-b624-f1ba62d3190c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.172320 Jun 17 13:31:57.975046 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1637/3234] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:31:57 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:31:58.126150 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-adbded42-ac09-4d07-bfc0-243476b0d2bf tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:31:58.126929 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-adbded42-ac09-4d07-bfc0-243476b0d2bf tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:31:58.135067 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-adbded42-ac09-4d07-bfc0-243476b0d2bf tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:58.135598 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-adbded42-ac09-4d07-bfc0-243476b0d2bf tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:58.136779 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-adbded42-ac09-4d07-bfc0-243476b0d2bf tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:58.137220 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-adbded42-ac09-4d07-bfc0-243476b0d2bf tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:58.204083 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-adbded42-ac09-4d07-bfc0-243476b0d2bf tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:58.213270 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-adbded42-ac09-4d07-bfc0-243476b0d2bf tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:58.215189 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-adbded42-ac09-4d07-bfc0-243476b0d2bf tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:58.216246 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-adbded42-ac09-4d07-bfc0-243476b0d2bf tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.095386 Jun 17 13:31:58.216829 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1598/3235] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:31:58 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:31:58.996454 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-801c94dd-5cd2-4c2f-be48-835266e3a9c8 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:31:58.997050 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-801c94dd-5cd2-4c2f-be48-835266e3a9c8 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:31:59.004151 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-801c94dd-5cd2-4c2f-be48-835266e3a9c8 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:59.004600 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-801c94dd-5cd2-4c2f-be48-835266e3a9c8 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:59.005362 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-801c94dd-5cd2-4c2f-be48-835266e3a9c8 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:59.005796 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-801c94dd-5cd2-4c2f-be48-835266e3a9c8 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:59.145355 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-801c94dd-5cd2-4c2f-be48-835266e3a9c8 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:59.153822 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-801c94dd-5cd2-4c2f-be48-835266e3a9c8 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.163633 Jun 17 13:31:59.154414 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1638/3236] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:31:58 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:31:59.238963 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-91883b85-4145-475a-9954-1fc25e6ffd09 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:31:59.239980 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-91883b85-4145-475a-9954-1fc25e6ffd09 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:31:59.253771 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-91883b85-4145-475a-9954-1fc25e6ffd09 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:59.254392 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-91883b85-4145-475a-9954-1fc25e6ffd09 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:59.255245 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-91883b85-4145-475a-9954-1fc25e6ffd09 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:31:59.255703 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-91883b85-4145-475a-9954-1fc25e6ffd09 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:31:59.332176 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-91883b85-4145-475a-9954-1fc25e6ffd09 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:59.341557 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-91883b85-4145-475a-9954-1fc25e6ffd09 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:59.343082 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-91883b85-4145-475a-9954-1fc25e6ffd09 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:31:59.344221 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-91883b85-4145-475a-9954-1fc25e6ffd09 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.111981 Jun 17 13:31:59.344816 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1599/3237] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:31:59 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:32:00.178918 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-8d902e6e-21f9-4124-8a8a-52c44551f7fe tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:32:00.179769 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-8d902e6e-21f9-4124-8a8a-52c44551f7fe tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:32:00.189958 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8d902e6e-21f9-4124-8a8a-52c44551f7fe tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:32:00.190637 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8d902e6e-21f9-4124-8a8a-52c44551f7fe tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:32:00.191838 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8d902e6e-21f9-4124-8a8a-52c44551f7fe tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:32:00.192416 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8d902e6e-21f9-4124-8a8a-52c44551f7fe tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:32:00.330194 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-8d902e6e-21f9-4124-8a8a-52c44551f7fe tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:32:00.338801 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-8d902e6e-21f9-4124-8a8a-52c44551f7fe tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.165684 Jun 17 13:32:00.339407 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1639/3238] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:32:00 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:32:00.362346 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-d50aeff0-8f1f-47a2-bd86-c406c02d6689 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:32:00.362882 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-d50aeff0-8f1f-47a2-bd86-c406c02d6689 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:32:00.369966 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d50aeff0-8f1f-47a2-bd86-c406c02d6689 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:32:00.370426 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d50aeff0-8f1f-47a2-bd86-c406c02d6689 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:32:00.371215 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d50aeff0-8f1f-47a2-bd86-c406c02d6689 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:32:00.371684 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d50aeff0-8f1f-47a2-bd86-c406c02d6689 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:32:00.435487 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-d50aeff0-8f1f-47a2-bd86-c406c02d6689 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:32:00.444429 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-d50aeff0-8f1f-47a2-bd86-c406c02d6689 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:32:00.445897 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-d50aeff0-8f1f-47a2-bd86-c406c02d6689 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:32:00.447088 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-d50aeff0-8f1f-47a2-bd86-c406c02d6689 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.088763 Jun 17 13:32:00.447646 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1600/3239] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:32:00 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:32:01.361390 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-d3279f92-baa0-4ead-a1a0-10425fc0d53b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:32:01.362470 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-d3279f92-baa0-4ead-a1a0-10425fc0d53b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:32:01.372960 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d3279f92-baa0-4ead-a1a0-10425fc0d53b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:32:01.373417 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d3279f92-baa0-4ead-a1a0-10425fc0d53b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:32:01.374215 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d3279f92-baa0-4ead-a1a0-10425fc0d53b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:32:01.374648 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d3279f92-baa0-4ead-a1a0-10425fc0d53b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:32:01.395650 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_cell1:SELECT=100 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:32:01.465582 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-76210b17-c1dc-4b6a-9031-e6a126f2d8fb tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:32:01.466220 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-76210b17-c1dc-4b6a-9031-e6a126f2d8fb tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:32:01.473253 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-76210b17-c1dc-4b6a-9031-e6a126f2d8fb tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:32:01.473705 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-76210b17-c1dc-4b6a-9031-e6a126f2d8fb tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:32:01.474532 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-76210b17-c1dc-4b6a-9031-e6a126f2d8fb tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:32:01.474963 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-76210b17-c1dc-4b6a-9031-e6a126f2d8fb tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:32:01.528687 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-d3279f92-baa0-4ead-a1a0-10425fc0d53b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:32:01.536663 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-d3279f92-baa0-4ead-a1a0-10425fc0d53b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.182851 Jun 17 13:32:01.537278 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1640/3240] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:32:01 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:32:01.544515 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-76210b17-c1dc-4b6a-9031-e6a126f2d8fb tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:32:01.556386 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-76210b17-c1dc-4b6a-9031-e6a126f2d8fb tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:32:01.558544 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-76210b17-c1dc-4b6a-9031-e6a126f2d8fb tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:32:01.559799 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-76210b17-c1dc-4b6a-9031-e6a126f2d8fb tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.098392 Jun 17 13:32:01.560396 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1601/3241] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:32:01 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:32:02.557826 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-db45312f-51bc-4070-b625-f5bb6d46b50c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:32:02.559219 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-db45312f-51bc-4070-b625-f5bb6d46b50c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:32:02.565924 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-db45312f-51bc-4070-b625-f5bb6d46b50c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:32:02.566406 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-db45312f-51bc-4070-b625-f5bb6d46b50c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:32:02.567155 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-db45312f-51bc-4070-b625-f5bb6d46b50c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:32:02.567590 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-db45312f-51bc-4070-b625-f5bb6d46b50c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:32:02.577100 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-266d3e13-bc42-48e6-a2c1-12c10c935ad5 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:32:02.577673 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-266d3e13-bc42-48e6-a2c1-12c10c935ad5 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:32:02.584752 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-266d3e13-bc42-48e6-a2c1-12c10c935ad5 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:32:02.585195 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-266d3e13-bc42-48e6-a2c1-12c10c935ad5 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:32:02.585954 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-266d3e13-bc42-48e6-a2c1-12c10c935ad5 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:32:02.586428 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-266d3e13-bc42-48e6-a2c1-12c10c935ad5 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:32:02.666213 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-266d3e13-bc42-48e6-a2c1-12c10c935ad5 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:32:02.676330 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-266d3e13-bc42-48e6-a2c1-12c10c935ad5 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:32:02.677353 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-266d3e13-bc42-48e6-a2c1-12c10c935ad5 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:32:02.678532 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-266d3e13-bc42-48e6-a2c1-12c10c935ad5 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.105598 Jun 17 13:32:02.679100 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1602/3242] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:32:02 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:32:02.725406 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-db45312f-51bc-4070-b625-f5bb6d46b50c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:32:02.734268 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-db45312f-51bc-4070-b625-f5bb6d46b50c tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.183151 Jun 17 13:32:02.734845 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1641/3243] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:32:02 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:32:03.701110 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-a5140848-acea-4088-bf1f-8adad0c4d4e9 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:32:03.701959 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-a5140848-acea-4088-bf1f-8adad0c4d4e9 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:32:03.712625 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a5140848-acea-4088-bf1f-8adad0c4d4e9 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:32:03.713298 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a5140848-acea-4088-bf1f-8adad0c4d4e9 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:32:03.714950 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a5140848-acea-4088-bf1f-8adad0c4d4e9 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:32:03.716222 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a5140848-acea-4088-bf1f-8adad0c4d4e9 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:32:03.751359 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-1a5c3e38-6bae-4ac9-ba7c-14a01197e0ce tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:32:03.752095 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-1a5c3e38-6bae-4ac9-ba7c-14a01197e0ce tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:32:03.761846 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-1a5c3e38-6bae-4ac9-ba7c-14a01197e0ce tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:32:03.762345 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-1a5c3e38-6bae-4ac9-ba7c-14a01197e0ce tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:32:03.763118 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-1a5c3e38-6bae-4ac9-ba7c-14a01197e0ce tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:32:03.763554 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-1a5c3e38-6bae-4ac9-ba7c-14a01197e0ce tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:32:03.791865 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-a5140848-acea-4088-bf1f-8adad0c4d4e9 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:32:03.801150 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-a5140848-acea-4088-bf1f-8adad0c4d4e9 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:32:03.802758 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-a5140848-acea-4088-bf1f-8adad0c4d4e9 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:32:03.803896 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-a5140848-acea-4088-bf1f-8adad0c4d4e9 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.109489 Jun 17 13:32:03.804688 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1603/3244] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:32:03 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:32:03.895048 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-1a5c3e38-6bae-4ac9-ba7c-14a01197e0ce tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:32:03.905946 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-1a5c3e38-6bae-4ac9-ba7c-14a01197e0ce tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.158410 Jun 17 13:32:03.906555 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1642/3245] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:32:03 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:32:04.825690 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-890d874d-584a-408b-850a-275c60c8d981 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:32:04.826675 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-890d874d-584a-408b-850a-275c60c8d981 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:32:04.837689 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-890d874d-584a-408b-850a-275c60c8d981 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:32:04.838465 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-890d874d-584a-408b-850a-275c60c8d981 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:32:04.839795 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-890d874d-584a-408b-850a-275c60c8d981 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:32:04.840247 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-890d874d-584a-408b-850a-275c60c8d981 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:32:04.902237 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-890d874d-584a-408b-850a-275c60c8d981 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:32:04.910813 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-890d874d-584a-408b-850a-275c60c8d981 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:32:04.912315 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-890d874d-584a-408b-850a-275c60c8d981 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:32:04.913447 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-890d874d-584a-408b-850a-275c60c8d981 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.094382 Jun 17 13:32:04.913993 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1604/3246] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:32:04 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:32:04.923634 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-0fb6f170-6d32-4ebd-b057-ad382397eddf tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:32:04.924246 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-0fb6f170-6d32-4ebd-b057-ad382397eddf tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:32:04.930978 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0fb6f170-6d32-4ebd-b057-ad382397eddf tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:32:04.931428 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0fb6f170-6d32-4ebd-b057-ad382397eddf tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:32:04.932183 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0fb6f170-6d32-4ebd-b057-ad382397eddf tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:32:04.932652 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0fb6f170-6d32-4ebd-b057-ad382397eddf tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:32:05.077018 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-0fb6f170-6d32-4ebd-b057-ad382397eddf tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:32:05.085285 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-0fb6f170-6d32-4ebd-b057-ad382397eddf tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.165527 Jun 17 13:32:05.085856 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1643/3247] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:32:04 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:32:05.934637 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-805b92ba-e2c5-4409-a838-5593605ec5d7 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:32:05.935406 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-805b92ba-e2c5-4409-a838-5593605ec5d7 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:32:05.944353 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-805b92ba-e2c5-4409-a838-5593605ec5d7 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:32:05.945153 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-805b92ba-e2c5-4409-a838-5593605ec5d7 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:32:05.945963 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-805b92ba-e2c5-4409-a838-5593605ec5d7 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:32:05.946574 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-805b92ba-e2c5-4409-a838-5593605ec5d7 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:32:06.014572 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-805b92ba-e2c5-4409-a838-5593605ec5d7 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:32:06.023313 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-805b92ba-e2c5-4409-a838-5593605ec5d7 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:32:06.024802 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-805b92ba-e2c5-4409-a838-5593605ec5d7 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:32:06.025948 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-805b92ba-e2c5-4409-a838-5593605ec5d7 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.096639 Jun 17 13:32:06.026537 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1605/3248] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:32:05 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:32:06.106751 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-e9c7108d-dbdf-49d0-9a78-ba3501029859 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:32:06.107366 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-e9c7108d-dbdf-49d0-9a78-ba3501029859 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:32:06.114392 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e9c7108d-dbdf-49d0-9a78-ba3501029859 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:32:06.114819 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e9c7108d-dbdf-49d0-9a78-ba3501029859 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:32:06.115571 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e9c7108d-dbdf-49d0-9a78-ba3501029859 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:32:06.116004 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e9c7108d-dbdf-49d0-9a78-ba3501029859 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:32:06.271136 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-e9c7108d-dbdf-49d0-9a78-ba3501029859 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:32:06.279674 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-e9c7108d-dbdf-49d0-9a78-ba3501029859 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.179513 Jun 17 13:32:06.280219 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1644/3249] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:32:06 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:32:07.049743 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-023c5393-b46e-4291-a394-0bc8e2fcb277 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:32:07.050815 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-023c5393-b46e-4291-a394-0bc8e2fcb277 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:32:07.063223 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-023c5393-b46e-4291-a394-0bc8e2fcb277 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:32:07.063972 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-023c5393-b46e-4291-a394-0bc8e2fcb277 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:32:07.065303 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-023c5393-b46e-4291-a394-0bc8e2fcb277 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:32:07.066033 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-023c5393-b46e-4291-a394-0bc8e2fcb277 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:32:07.143540 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-023c5393-b46e-4291-a394-0bc8e2fcb277 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:32:07.156749 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-023c5393-b46e-4291-a394-0bc8e2fcb277 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:32:07.159167 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-023c5393-b46e-4291-a394-0bc8e2fcb277 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:32:07.160872 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-023c5393-b46e-4291-a394-0bc8e2fcb277 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.118684 Jun 17 13:32:07.161586 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1606/3250] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:32:07 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:32:07.301455 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-a583e040-c067-4f49-b9f1-b875c06bd33e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:32:07.302363 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-a583e040-c067-4f49-b9f1-b875c06bd33e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:32:07.312394 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a583e040-c067-4f49-b9f1-b875c06bd33e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:32:07.312847 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a583e040-c067-4f49-b9f1-b875c06bd33e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:32:07.314109 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a583e040-c067-4f49-b9f1-b875c06bd33e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:32:07.314109 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a583e040-c067-4f49-b9f1-b875c06bd33e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:32:07.446546 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-a583e040-c067-4f49-b9f1-b875c06bd33e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:32:07.458477 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-a583e040-c067-4f49-b9f1-b875c06bd33e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.163664 Jun 17 13:32:07.459314 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1645/3251] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:32:07 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:32:08.183663 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-8f1535b0-3d4a-4f8f-86e8-a6d295f0c5b2 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:32:08.184424 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-8f1535b0-3d4a-4f8f-86e8-a6d295f0c5b2 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:32:08.192501 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8f1535b0-3d4a-4f8f-86e8-a6d295f0c5b2 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:32:08.192976 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8f1535b0-3d4a-4f8f-86e8-a6d295f0c5b2 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:32:08.193759 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8f1535b0-3d4a-4f8f-86e8-a6d295f0c5b2 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:32:08.194259 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8f1535b0-3d4a-4f8f-86e8-a6d295f0c5b2 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:32:08.265278 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-8f1535b0-3d4a-4f8f-86e8-a6d295f0c5b2 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:32:08.274114 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-8f1535b0-3d4a-4f8f-86e8-a6d295f0c5b2 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:32:08.275635 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-8f1535b0-3d4a-4f8f-86e8-a6d295f0c5b2 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:32:08.276784 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-8f1535b0-3d4a-4f8f-86e8-a6d295f0c5b2 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.098100 Jun 17 13:32:08.277347 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1607/3252] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:32:08 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:32:08.482622 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-d7446c24-9b98-41f0-8379-10e5bdd87871 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:32:08.483505 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-d7446c24-9b98-41f0-8379-10e5bdd87871 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:32:08.490837 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d7446c24-9b98-41f0-8379-10e5bdd87871 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:32:08.491313 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d7446c24-9b98-41f0-8379-10e5bdd87871 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:32:08.492109 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d7446c24-9b98-41f0-8379-10e5bdd87871 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:32:08.492567 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d7446c24-9b98-41f0-8379-10e5bdd87871 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:32:08.654475 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-d7446c24-9b98-41f0-8379-10e5bdd87871 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:32:08.663162 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-d7446c24-9b98-41f0-8379-10e5bdd87871 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.186913 Jun 17 13:32:08.663743 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1646/3253] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:32:08 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:32:09.303408 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-cb669e10-9bce-4231-9b98-c1aa0ae7c35b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:32:09.304155 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-cb669e10-9bce-4231-9b98-c1aa0ae7c35b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:32:09.313806 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cb669e10-9bce-4231-9b98-c1aa0ae7c35b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:32:09.315079 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cb669e10-9bce-4231-9b98-c1aa0ae7c35b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:32:09.315695 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cb669e10-9bce-4231-9b98-c1aa0ae7c35b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:32:09.316390 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cb669e10-9bce-4231-9b98-c1aa0ae7c35b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:32:09.323346 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=100 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:32:09.401995 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-cb669e10-9bce-4231-9b98-c1aa0ae7c35b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:32:09.412186 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-cb669e10-9bce-4231-9b98-c1aa0ae7c35b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:32:09.414576 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-cb669e10-9bce-4231-9b98-c1aa0ae7c35b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:32:09.415809 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-cb669e10-9bce-4231-9b98-c1aa0ae7c35b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.117707 Jun 17 13:32:09.416374 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1608/3254] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:32:09 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:32:09.685654 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-288ed17a-f0cd-4896-9988-d29518eac84e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:32:09.686284 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-288ed17a-f0cd-4896-9988-d29518eac84e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:32:09.693057 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-288ed17a-f0cd-4896-9988-d29518eac84e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:32:09.693585 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-288ed17a-f0cd-4896-9988-d29518eac84e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:32:09.694363 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-288ed17a-f0cd-4896-9988-d29518eac84e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:32:09.694828 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-288ed17a-f0cd-4896-9988-d29518eac84e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:32:09.836965 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-288ed17a-f0cd-4896-9988-d29518eac84e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:32:09.845693 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-288ed17a-f0cd-4896-9988-d29518eac84e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.167442 Jun 17 13:32:09.846322 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1647/3255] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:32:09 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:32:10.437831 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-6373c394-c3bd-4afd-aa9e-956cddde24c8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:32:10.438522 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-6373c394-c3bd-4afd-aa9e-956cddde24c8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:32:10.446500 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6373c394-c3bd-4afd-aa9e-956cddde24c8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:32:10.447017 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6373c394-c3bd-4afd-aa9e-956cddde24c8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:32:10.447906 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6373c394-c3bd-4afd-aa9e-956cddde24c8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:32:10.448451 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6373c394-c3bd-4afd-aa9e-956cddde24c8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:32:10.515777 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-6373c394-c3bd-4afd-aa9e-956cddde24c8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:32:10.524701 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-6373c394-c3bd-4afd-aa9e-956cddde24c8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:32:10.526205 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-6373c394-c3bd-4afd-aa9e-956cddde24c8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:32:10.527334 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-6373c394-c3bd-4afd-aa9e-956cddde24c8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.095421 Jun 17 13:32:10.527886 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1609/3256] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:32:10 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:32:10.865371 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-535b9062-6c90-4cc6-9bf8-8d0eef94937b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:32:10.866130 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-535b9062-6c90-4cc6-9bf8-8d0eef94937b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:32:10.875684 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-535b9062-6c90-4cc6-9bf8-8d0eef94937b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:32:10.876299 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-535b9062-6c90-4cc6-9bf8-8d0eef94937b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:32:10.877298 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-535b9062-6c90-4cc6-9bf8-8d0eef94937b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:32:10.877886 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-535b9062-6c90-4cc6-9bf8-8d0eef94937b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:32:11.012769 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-535b9062-6c90-4cc6-9bf8-8d0eef94937b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:32:11.021997 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-535b9062-6c90-4cc6-9bf8-8d0eef94937b tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.161840 Jun 17 13:32:11.022593 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1648/3257] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:32:10 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:32:11.549743 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-ef26ba0f-031e-4860-8312-32b537854f1c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:32:11.550876 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-ef26ba0f-031e-4860-8312-32b537854f1c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:32:11.562160 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ef26ba0f-031e-4860-8312-32b537854f1c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:32:11.562899 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ef26ba0f-031e-4860-8312-32b537854f1c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:32:11.564140 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ef26ba0f-031e-4860-8312-32b537854f1c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:32:11.564842 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ef26ba0f-031e-4860-8312-32b537854f1c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:32:11.631491 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-ef26ba0f-031e-4860-8312-32b537854f1c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:32:11.640140 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-ef26ba0f-031e-4860-8312-32b537854f1c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:32:11.641605 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-ef26ba0f-031e-4860-8312-32b537854f1c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:32:11.642781 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-ef26ba0f-031e-4860-8312-32b537854f1c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.099745 Jun 17 13:32:11.643344 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1610/3258] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:32:11 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:32:12.044345 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-fab771af-32d5-49a3-9cc2-c60d0dedfa53 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:32:12.045496 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-fab771af-32d5-49a3-9cc2-c60d0dedfa53 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:32:12.056676 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-fab771af-32d5-49a3-9cc2-c60d0dedfa53 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:32:12.057418 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-fab771af-32d5-49a3-9cc2-c60d0dedfa53 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:32:12.058729 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-fab771af-32d5-49a3-9cc2-c60d0dedfa53 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:32:12.059458 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-fab771af-32d5-49a3-9cc2-c60d0dedfa53 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:32:12.198959 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-fab771af-32d5-49a3-9cc2-c60d0dedfa53 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:32:12.207929 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-fab771af-32d5-49a3-9cc2-c60d0dedfa53 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.170500 Jun 17 13:32:12.208537 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1649/3259] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:32:12 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:32:12.661105 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-526f81f4-5db6-4c1e-a1f0-28428705c79a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:32:12.661718 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-526f81f4-5db6-4c1e-a1f0-28428705c79a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:32:12.668646 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-526f81f4-5db6-4c1e-a1f0-28428705c79a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:32:12.669571 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-526f81f4-5db6-4c1e-a1f0-28428705c79a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:32:12.670114 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-526f81f4-5db6-4c1e-a1f0-28428705c79a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:32:12.670583 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-526f81f4-5db6-4c1e-a1f0-28428705c79a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:32:12.736887 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-526f81f4-5db6-4c1e-a1f0-28428705c79a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:32:12.745810 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-526f81f4-5db6-4c1e-a1f0-28428705c79a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:32:12.747366 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-526f81f4-5db6-4c1e-a1f0-28428705c79a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:32:12.748510 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-526f81f4-5db6-4c1e-a1f0-28428705c79a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.091362 Jun 17 13:32:12.749064 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1611/3260] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:32:12 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:32:13.229083 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-c2df3adb-a760-40d0-a518-39a87078a98f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:32:13.230498 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-c2df3adb-a760-40d0-a518-39a87078a98f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:32:13.238124 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c2df3adb-a760-40d0-a518-39a87078a98f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:32:13.238590 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c2df3adb-a760-40d0-a518-39a87078a98f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:32:13.239348 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c2df3adb-a760-40d0-a518-39a87078a98f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:32:13.239788 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c2df3adb-a760-40d0-a518-39a87078a98f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:32:13.383741 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-c2df3adb-a760-40d0-a518-39a87078a98f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:32:13.393070 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-c2df3adb-a760-40d0-a518-39a87078a98f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.170065 Jun 17 13:32:13.393839 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1650/3261] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:32:13 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:32:13.768507 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-072ab46c-62bd-4922-94ea-4b7303780de8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:32:13.769171 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-072ab46c-62bd-4922-94ea-4b7303780de8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:32:13.776932 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-072ab46c-62bd-4922-94ea-4b7303780de8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:32:13.777435 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-072ab46c-62bd-4922-94ea-4b7303780de8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:32:13.778350 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-072ab46c-62bd-4922-94ea-4b7303780de8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:32:13.778799 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-072ab46c-62bd-4922-94ea-4b7303780de8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:32:13.852271 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-072ab46c-62bd-4922-94ea-4b7303780de8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:32:13.862781 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-072ab46c-62bd-4922-94ea-4b7303780de8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:32:13.864275 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-072ab46c-62bd-4922-94ea-4b7303780de8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:32:13.865415 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-072ab46c-62bd-4922-94ea-4b7303780de8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 200 len: 1444 microversion: 2.20 time: 0.101325 Jun 17 13:32:13.865970 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1612/3262] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:32:13 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 1444 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:32:13.885819 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-5fd8b40d-245a-4af7-8962-44cbef704800 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '.version_select at 0x7f01947eaca0>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:32:13.906699 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-5fd8b40d-245a-4af7-8962-44cbef704800 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-976867919" status: 204 len: 0 microversion: 2.20 time: 0.026960 Jun 17 13:32:13.907273 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1651/3263] 10.222.0.48 () {60 vars in 1258 bytes} [Fri Jun 17 13:32:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-976867919 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 17 13:32:14.412995 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-0ea574d7-7f46-4f83-9408-456815356458 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:32:14.413605 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-0ea574d7-7f46-4f83-9408-456815356458 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:32:14.420485 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0ea574d7-7f46-4f83-9408-456815356458 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:32:14.420952 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0ea574d7-7f46-4f83-9408-456815356458 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:32:14.421712 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0ea574d7-7f46-4f83-9408-456815356458 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:32:14.422163 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0ea574d7-7f46-4f83-9408-456815356458 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:32:14.624709 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-0ea574d7-7f46-4f83-9408-456815356458 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:32:14.632956 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-0ea574d7-7f46-4f83-9408-456815356458 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.223965 Jun 17 13:32:14.633715 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1613/3264] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:32:14 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:32:14.800351 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-97d35b77-bca4-4d66-ae71-dca89d836f43 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Action: 'create', calling method: .version_select at 0x7f0190063160>, body: {"keypair": {"name": "tempest-keypair-920926838", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM6FYuPHf5hbIq8U3atWr09gCptpR4n8vaGLAfKOZpHSURdhDhZfGxQZ1ieFz0UYuTzAkH6JTWaDmY1fja5jKds+M5Wp37PHTTsRBaDhAlENmKUyYxHAEV6rvvtlsGGxig=="}} {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:32:14.816717 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.quota [None req-97d35b77-bca4-4d66-ae71-dca89d836f43 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Getting quotas for project c777f8f104af4d37a3b89ff9a57d2218. Resources: {'key_pairs'} {{(pid=117659) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 13:32:14.821340 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.quota [None req-97d35b77-bca4-4d66-ae71-dca89d836f43 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Getting quotas for user 847c39439e874e68b72e07c311a53bec and project c777f8f104af4d37a3b89ff9a57d2218. Resources: {'key_pairs'} {{(pid=117659) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 13:32:14.847011 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-97d35b77-bca4-4d66-ae71-dca89d836f43 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.050684 Jun 17 13:32:14.847597 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1652/3265] 10.222.0.48 () {62 vars in 1199 bytes} [Fri Jun 17 13:32:14 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 52 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 17 13:32:15.650126 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-461f1486-4118-48d2-be6d-6289ed7a1b16 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:32:15.650837 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-461f1486-4118-48d2-be6d-6289ed7a1b16 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 29d26a8a-a734-4531-b9ee-04506c852fe2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:32:15.657976 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-461f1486-4118-48d2-be6d-6289ed7a1b16 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:32:15.658728 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-461f1486-4118-48d2-be6d-6289ed7a1b16 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:32:15.659726 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-461f1486-4118-48d2-be6d-6289ed7a1b16 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:32:15.660237 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-461f1486-4118-48d2-be6d-6289ed7a1b16 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:32:15.880548 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-461f1486-4118-48d2-be6d-6289ed7a1b16 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:32:15.890027 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-461f1486-4118-48d2-be6d-6289ed7a1b16 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2" status: 200 len: 1735 microversion: 2.1 time: 0.244302 Jun 17 13:32:15.901599 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1614/3266] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:32:15 2022] GET /compute/v2.1/servers/29d26a8a-a734-4531-b9ee-04506c852fe2 => generated 1735 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:32:15.908380 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-8fa22bba-1c12-4fe0-b4ee-a4df4e613ad9 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '.version_select at 0x7f01947dad30>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:32:15.937592 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-8fa22bba-1c12-4fe0-b4ee-a4df4e613ad9 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1288020396" status: 202 len: 0 microversion: 2.1 time: 0.034794 Jun 17 13:32:15.938459 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1653/3267] 10.222.0.48 () {58 vars in 1220 bytes} [Fri Jun 17 13:32:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1288020396 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 17 13:32:16.320935 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-f30d24c5-8594-4cef-bee1-2517f1b083b0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-195436553", "imageRef": "ccec3e37-1df8-4f10-a8f6-f97dfac54cf5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4ea46af5-e03e-4c99-82a1-0dfaa30ad227"}], "security_groups": [{"name": "tempest-securitygroup--661287949"}], "key_name": "tempest-keypair-920926838", "user_data": "}} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:32:16.437372 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.network.neutron [None req-f30d24c5-8594-4cef-bee1-2517f1b083b0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] validate_networks() for [('4ea46af5-e03e-4c99-82a1-0dfaa30ad227', None, None, None, None, None)] {{(pid=117660) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 17 13:32:17.144130 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.virt.hardware [None req-f30d24c5-8594-4cef-bee1-2517f1b083b0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Flavor limits 0:0:0 {{(pid=117660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 17 13:32:17.144736 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.virt.hardware [None req-f30d24c5-8594-4cef-bee1-2517f1b083b0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Image limits 0:0:0 {{(pid=117660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 17 13:32:17.154532 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.virt.hardware [None req-f30d24c5-8594-4cef-bee1-2517f1b083b0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Flavor pref 0:0:0 {{(pid=117660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 17 13:32:17.155089 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.virt.hardware [None req-f30d24c5-8594-4cef-bee1-2517f1b083b0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Image pref 0:0:0 {{(pid=117660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 17 13:32:17.155580 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.virt.hardware [None req-f30d24c5-8594-4cef-bee1-2517f1b083b0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 17 13:32:17.165443 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f30d24c5-8594-4cef-bee1-2517f1b083b0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:32:17.166505 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f30d24c5-8594-4cef-bee1-2517f1b083b0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:32:17.167000 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f30d24c5-8594-4cef-bee1-2517f1b083b0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:32:17.167542 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f30d24c5-8594-4cef-bee1-2517f1b083b0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:32:17.179470 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [req-285d5a20-06e7-4f5d-867d-b9de4dffd4d8 req-48cb02bc-4d35-455e-b9c5-a1ee7da5a38d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29d26a8a-a734-4531-b9ee-04506c852fe2", "tag": "4ae50ebd-a268-4596-8c67-1e7de84bfb9e"}]} {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:32:17.187674 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.quota [None req-f30d24c5-8594-4cef-bee1-2517f1b083b0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Getting quotas for project c777f8f104af4d37a3b89ff9a57d2218. Resources: {'ram', 'cores', 'instances'} {{(pid=117660) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 13:32:17.189039 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [req-285d5a20-06e7-4f5d-867d-b9de4dffd4d8 req-48cb02bc-4d35-455e-b9c5-a1ee7da5a38d service nova] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:32:17.189461 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [req-285d5a20-06e7-4f5d-867d-b9de4dffd4d8 req-48cb02bc-4d35-455e-b9c5-a1ee7da5a38d service nova] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:32:17.192171 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.quota [None req-f30d24c5-8594-4cef-bee1-2517f1b083b0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Getting quotas for user 847c39439e874e68b72e07c311a53bec and project c777f8f104af4d37a3b89ff9a57d2218. Resources: {'ram', 'cores', 'instances'} {{(pid=117660) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 13:32:17.200743 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.compute.server_external_events [req-285d5a20-06e7-4f5d-867d-b9de4dffd4d8 req-48cb02bc-4d35-455e-b9c5-a1ee7da5a38d service nova] Creating event network-changed:4ae50ebd-a268-4596-8c67-1e7de84bfb9e for instance 29d26a8a-a734-4531-b9ee-04506c852fe2 on hv-cinder-83754 Jun 17 13:32:17.203323 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-f30d24c5-8594-4cef-bee1-2517f1b083b0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Going to run 1 instances... {{(pid=117660) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 17 13:32:17.205585 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-f30d24c5-8594-4cef-bee1-2517f1b083b0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: 53ede50e-496d-480c-b292-30e95344eaac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ccec3e37-1df8-4f10-a8f6-f97dfac54cf5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117660) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 17 13:32:17.206494 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [req-285d5a20-06e7-4f5d-867d-b9de4dffd4d8 req-48cb02bc-4d35-455e-b9c5-a1ee7da5a38d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031834 Jun 17 13:32:17.207085 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1654/3268] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 13:32:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:32:17.259864 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR oslo.messaging._drivers.impl_rabbit [None req-f30d24c5-8594-4cef-bee1-2517f1b083b0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [39cba728-b8f6-4b52-a19c-1524d3196f1d] AMQP server on 10.222.0.48:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 17 13:32:18.269052 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO oslo.messaging._drivers.impl_rabbit [None req-f30d24c5-8594-4cef-bee1-2517f1b083b0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [39cba728-b8f6-4b52-a19c-1524d3196f1d] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 42878. Jun 17 13:32:18.273193 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-f30d24c5-8594-4cef-bee1-2517f1b083b0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.956647 Jun 17 13:32:18.273843 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1615/3269] 10.222.0.48 () {62 vars in 1187 bytes} [Fri Jun 17 13:32:16 2022] POST /compute/v2.1/servers => generated 401 bytes in 1958 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 17 13:32:18.284629 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-71ebea23-2afb-4338-a7d9-afc96eff4f03 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:32:18.285319 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-71ebea23-2afb-4338-a7d9-afc96eff4f03 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: 53ede50e-496d-480c-b292-30e95344eaac] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:32:18.352716 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-71ebea23-2afb-4338-a7d9-afc96eff4f03 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:32:18.360455 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-71ebea23-2afb-4338-a7d9-afc96eff4f03 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:32:18.361923 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-71ebea23-2afb-4338-a7d9-afc96eff4f03 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:32:18.363064 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-71ebea23-2afb-4338-a7d9-afc96eff4f03 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/53ede50e-496d-480c-b292-30e95344eaac" status: 200 len: 1280 microversion: 2.20 time: 0.082842 Jun 17 13:32:18.363622 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1655/3270] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:32:18 2022] GET /compute/v2.1/servers/53ede50e-496d-480c-b292-30e95344eaac => generated 1280 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:32:18.891813 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 13:32:18.892226 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Fri Jun 17 13:32:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 17 13:32:19.381491 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-9a7fb434-fcfd-477b-9488-4d1033b0cad3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:32:19.382121 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-9a7fb434-fcfd-477b-9488-4d1033b0cad3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: 53ede50e-496d-480c-b292-30e95344eaac] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:32:19.384783 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=3 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:32:19.441546 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-9a7fb434-fcfd-477b-9488-4d1033b0cad3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:32:19.448918 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-9a7fb434-fcfd-477b-9488-4d1033b0cad3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:32:19.450850 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-9a7fb434-fcfd-477b-9488-4d1033b0cad3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:32:19.451977 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-9a7fb434-fcfd-477b-9488-4d1033b0cad3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/53ede50e-496d-480c-b292-30e95344eaac" status: 200 len: 1280 microversion: 2.20 time: 0.074962 Jun 17 13:32:19.452508 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1616/3271] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:32:19 2022] GET /compute/v2.1/servers/53ede50e-496d-480c-b292-30e95344eaac => generated 1280 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:32:20.470864 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-b549c91d-67ca-4be4-9c19-31c3465a375a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:32:20.471626 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-b549c91d-67ca-4be4-9c19-31c3465a375a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: 53ede50e-496d-480c-b292-30e95344eaac] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:32:20.529560 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-b549c91d-67ca-4be4-9c19-31c3465a375a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:32:20.537996 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-b549c91d-67ca-4be4-9c19-31c3465a375a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:32:20.539537 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-b549c91d-67ca-4be4-9c19-31c3465a375a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:32:20.540644 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-b549c91d-67ca-4be4-9c19-31c3465a375a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/53ede50e-496d-480c-b292-30e95344eaac" status: 200 len: 1280 microversion: 2.20 time: 0.074232 Jun 17 13:32:20.541197 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1656/3272] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:32:20 2022] GET /compute/v2.1/servers/53ede50e-496d-480c-b292-30e95344eaac => generated 1280 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:32:21.562127 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-d03f188a-d2ef-487a-814e-c4f94e03fcbd tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:32:21.562719 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-d03f188a-d2ef-487a-814e-c4f94e03fcbd tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: 53ede50e-496d-480c-b292-30e95344eaac] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:32:21.619313 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-d03f188a-d2ef-487a-814e-c4f94e03fcbd tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:32:21.627636 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-d03f188a-d2ef-487a-814e-c4f94e03fcbd tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:32:21.629135 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-d03f188a-d2ef-487a-814e-c4f94e03fcbd tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:32:21.630373 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-d03f188a-d2ef-487a-814e-c4f94e03fcbd tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/53ede50e-496d-480c-b292-30e95344eaac" status: 200 len: 1280 microversion: 2.20 time: 0.073705 Jun 17 13:32:21.630931 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1617/3273] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:32:21 2022] GET /compute/v2.1/servers/53ede50e-496d-480c-b292-30e95344eaac => generated 1280 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:32:22.648915 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-8505f15c-94cd-4098-a9fd-23b847fc7d26 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:32:22.649555 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-8505f15c-94cd-4098-a9fd-23b847fc7d26 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: 53ede50e-496d-480c-b292-30e95344eaac] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:32:22.652015 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_api:SELECT=67,nova_api:DELETE=2,nova_api:INSERT=1 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:32:22.658522 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8505f15c-94cd-4098-a9fd-23b847fc7d26 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:32:22.658973 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8505f15c-94cd-4098-a9fd-23b847fc7d26 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:32:22.659734 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8505f15c-94cd-4098-a9fd-23b847fc7d26 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:32:22.660173 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8505f15c-94cd-4098-a9fd-23b847fc7d26 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:32:22.727442 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-8505f15c-94cd-4098-a9fd-23b847fc7d26 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:32:22.737813 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-8505f15c-94cd-4098-a9fd-23b847fc7d26 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:32:22.739357 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-8505f15c-94cd-4098-a9fd-23b847fc7d26 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:32:22.740494 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-8505f15c-94cd-4098-a9fd-23b847fc7d26 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/53ede50e-496d-480c-b292-30e95344eaac" status: 200 len: 1284 microversion: 2.20 time: 0.095569 Jun 17 13:32:22.741200 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1657/3274] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:32:22 2022] GET /compute/v2.1/servers/53ede50e-496d-480c-b292-30e95344eaac => generated 1284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:32:23.760464 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-dd5954ab-00a4-4842-94d1-b8252b55d836 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:32:23.761456 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-dd5954ab-00a4-4842-94d1-b8252b55d836 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: 53ede50e-496d-480c-b292-30e95344eaac] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:32:23.772004 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dd5954ab-00a4-4842-94d1-b8252b55d836 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:32:23.772603 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dd5954ab-00a4-4842-94d1-b8252b55d836 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:32:23.773761 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dd5954ab-00a4-4842-94d1-b8252b55d836 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:32:23.774301 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dd5954ab-00a4-4842-94d1-b8252b55d836 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:32:23.881737 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-dd5954ab-00a4-4842-94d1-b8252b55d836 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:32:23.891814 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-dd5954ab-00a4-4842-94d1-b8252b55d836 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:32:23.894717 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-dd5954ab-00a4-4842-94d1-b8252b55d836 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:32:23.896411 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-dd5954ab-00a4-4842-94d1-b8252b55d836 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/53ede50e-496d-480c-b292-30e95344eaac" status: 200 len: 1338 microversion: 2.20 time: 0.140013 Jun 17 13:32:23.897191 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1618/3275] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:32:23 2022] GET /compute/v2.1/servers/53ede50e-496d-480c-b292-30e95344eaac => generated 1338 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:32:24.920311 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-20671b9b-26fd-4577-b1f4-ea1ed54d9f08 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:32:24.921308 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-20671b9b-26fd-4577-b1f4-ea1ed54d9f08 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: 53ede50e-496d-480c-b292-30e95344eaac] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:32:24.930316 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-20671b9b-26fd-4577-b1f4-ea1ed54d9f08 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:32:24.930765 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-20671b9b-26fd-4577-b1f4-ea1ed54d9f08 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:32:24.931528 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-20671b9b-26fd-4577-b1f4-ea1ed54d9f08 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:32:24.931959 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-20671b9b-26fd-4577-b1f4-ea1ed54d9f08 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:32:25.127273 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [req-e07e3f39-eadf-4add-800a-668704c7bb0b req-27efe3f1-b09b-461a-b517-b8640d681cb7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53ede50e-496d-480c-b292-30e95344eaac", "tag": "18820e99-834c-4f86-aa42-a4db70cd683d"}]} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:32:25.145688 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-e07e3f39-eadf-4add-800a-668704c7bb0b req-27efe3f1-b09b-461a-b517-b8640d681cb7 service nova] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:32:25.146136 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-e07e3f39-eadf-4add-800a-668704c7bb0b req-27efe3f1-b09b-461a-b517-b8640d681cb7 service nova] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:32:25.159787 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-20671b9b-26fd-4577-b1f4-ea1ed54d9f08 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:32:25.160067 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.compute.server_external_events [req-e07e3f39-eadf-4add-800a-668704c7bb0b req-27efe3f1-b09b-461a-b517-b8640d681cb7 service nova] Creating event network-changed:18820e99-834c-4f86-aa42-a4db70cd683d for instance 53ede50e-496d-480c-b292-30e95344eaac on hv-cinder-83754 Jun 17 13:32:25.163781 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR oslo.messaging._drivers.impl_rabbit [req-e07e3f39-eadf-4add-800a-668704c7bb0b req-27efe3f1-b09b-461a-b517-b8640d681cb7 service nova] [f206ef45-fff7-4ad7-a7d2-38e33720ebac] AMQP server on 10.222.0.48:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 17 13:32:25.172429 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-20671b9b-26fd-4577-b1f4-ea1ed54d9f08 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:32:25.174959 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-20671b9b-26fd-4577-b1f4-ea1ed54d9f08 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:32:25.176340 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-20671b9b-26fd-4577-b1f4-ea1ed54d9f08 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/53ede50e-496d-480c-b292-30e95344eaac" status: 200 len: 1405 microversion: 2.20 time: 0.263257 Jun 17 13:32:25.178154 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1658/3276] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:32:24 2022] GET /compute/v2.1/servers/53ede50e-496d-480c-b292-30e95344eaac => generated 1405 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:32:26.172349 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO oslo.messaging._drivers.impl_rabbit [req-e07e3f39-eadf-4add-800a-668704c7bb0b req-27efe3f1-b09b-461a-b517-b8640d681cb7 service nova] [f206ef45-fff7-4ad7-a7d2-38e33720ebac] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 42918. Jun 17 13:32:26.176120 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [req-e07e3f39-eadf-4add-800a-668704c7bb0b req-27efe3f1-b09b-461a-b517-b8640d681cb7 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.052542 Jun 17 13:32:26.176895 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1619/3277] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 13:32:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:32:26.194854 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-b6a5b236-800b-42c0-a2d6-5e213bfbca42 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:32:26.195490 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-b6a5b236-800b-42c0-a2d6-5e213bfbca42 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: 53ede50e-496d-480c-b292-30e95344eaac] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:32:26.202874 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b6a5b236-800b-42c0-a2d6-5e213bfbca42 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:32:26.203320 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b6a5b236-800b-42c0-a2d6-5e213bfbca42 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:32:26.204063 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b6a5b236-800b-42c0-a2d6-5e213bfbca42 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:32:26.204488 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b6a5b236-800b-42c0-a2d6-5e213bfbca42 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:32:26.341027 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-b6a5b236-800b-42c0-a2d6-5e213bfbca42 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:32:26.349439 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-b6a5b236-800b-42c0-a2d6-5e213bfbca42 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:32:26.350979 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-b6a5b236-800b-42c0-a2d6-5e213bfbca42 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:32:26.352083 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-b6a5b236-800b-42c0-a2d6-5e213bfbca42 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/53ede50e-496d-480c-b292-30e95344eaac" status: 200 len: 1405 microversion: 2.20 time: 0.161191 Jun 17 13:32:26.352652 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1659/3278] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:32:26 2022] GET /compute/v2.1/servers/53ede50e-496d-480c-b292-30e95344eaac => generated 1405 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:32:27.370900 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell0:SELECT=2 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:32:27.379040 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-6fad1bb1-50f9-4cc9-87e8-78530180ec0b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:32:27.380216 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-6fad1bb1-50f9-4cc9-87e8-78530180ec0b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: 53ede50e-496d-480c-b292-30e95344eaac] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:32:27.390258 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6fad1bb1-50f9-4cc9-87e8-78530180ec0b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:32:27.390706 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6fad1bb1-50f9-4cc9-87e8-78530180ec0b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:32:27.391479 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6fad1bb1-50f9-4cc9-87e8-78530180ec0b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:32:27.391919 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6fad1bb1-50f9-4cc9-87e8-78530180ec0b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:32:27.544070 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-6fad1bb1-50f9-4cc9-87e8-78530180ec0b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:32:27.557291 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-6fad1bb1-50f9-4cc9-87e8-78530180ec0b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:32:27.559638 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-6fad1bb1-50f9-4cc9-87e8-78530180ec0b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:32:27.560753 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-6fad1bb1-50f9-4cc9-87e8-78530180ec0b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/53ede50e-496d-480c-b292-30e95344eaac" status: 200 len: 1405 microversion: 2.20 time: 0.192420 Jun 17 13:32:27.561287 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1620/3279] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:32:27 2022] GET /compute/v2.1/servers/53ede50e-496d-480c-b292-30e95344eaac => generated 1405 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:32:28.579567 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-60d9dbd8-2c10-48b9-a4ed-7161bc8354a4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:32:28.580146 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-60d9dbd8-2c10-48b9-a4ed-7161bc8354a4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: 53ede50e-496d-480c-b292-30e95344eaac] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:32:28.586791 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-60d9dbd8-2c10-48b9-a4ed-7161bc8354a4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:32:28.587247 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-60d9dbd8-2c10-48b9-a4ed-7161bc8354a4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:32:28.588007 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-60d9dbd8-2c10-48b9-a4ed-7161bc8354a4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:32:28.588444 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-60d9dbd8-2c10-48b9-a4ed-7161bc8354a4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:32:28.740382 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-60d9dbd8-2c10-48b9-a4ed-7161bc8354a4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:32:28.748886 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-60d9dbd8-2c10-48b9-a4ed-7161bc8354a4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:32:28.750432 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-60d9dbd8-2c10-48b9-a4ed-7161bc8354a4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:32:28.751545 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-60d9dbd8-2c10-48b9-a4ed-7161bc8354a4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/53ede50e-496d-480c-b292-30e95344eaac" status: 200 len: 1405 microversion: 2.20 time: 0.176426 Jun 17 13:32:28.752110 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1660/3280] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:32:28 2022] GET /compute/v2.1/servers/53ede50e-496d-480c-b292-30e95344eaac => generated 1405 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:32:29.635549 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 13:32:29.636242 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Fri Jun 17 13:32:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 17 13:32:29.770688 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-cbd12ab0-8744-45fd-8f87-bad7f29b5425 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:32:29.771320 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-cbd12ab0-8744-45fd-8f87-bad7f29b5425 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: 53ede50e-496d-480c-b292-30e95344eaac] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:32:29.779793 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cbd12ab0-8744-45fd-8f87-bad7f29b5425 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:32:29.780243 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cbd12ab0-8744-45fd-8f87-bad7f29b5425 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:32:29.781014 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cbd12ab0-8744-45fd-8f87-bad7f29b5425 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:32:29.781454 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cbd12ab0-8744-45fd-8f87-bad7f29b5425 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:32:29.916614 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-cbd12ab0-8744-45fd-8f87-bad7f29b5425 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:32:29.925590 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-cbd12ab0-8744-45fd-8f87-bad7f29b5425 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:32:29.927200 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-cbd12ab0-8744-45fd-8f87-bad7f29b5425 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:32:29.928343 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-cbd12ab0-8744-45fd-8f87-bad7f29b5425 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/53ede50e-496d-480c-b292-30e95344eaac" status: 200 len: 1405 microversion: 2.20 time: 0.162154 Jun 17 13:32:29.928906 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1621/3281] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:32:29 2022] GET /compute/v2.1/servers/53ede50e-496d-480c-b292-30e95344eaac => generated 1405 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:32:30.952329 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-ba736899-363a-484e-80a9-6b3f8aaf8289 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:32:30.953022 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-ba736899-363a-484e-80a9-6b3f8aaf8289 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: 53ede50e-496d-480c-b292-30e95344eaac] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:32:30.955745 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_cell0:SELECT=8 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:32:30.961838 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ba736899-363a-484e-80a9-6b3f8aaf8289 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:32:30.962368 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ba736899-363a-484e-80a9-6b3f8aaf8289 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:32:30.963218 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ba736899-363a-484e-80a9-6b3f8aaf8289 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:32:30.963701 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ba736899-363a-484e-80a9-6b3f8aaf8289 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:32:31.105625 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-ba736899-363a-484e-80a9-6b3f8aaf8289 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:32:31.113919 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-ba736899-363a-484e-80a9-6b3f8aaf8289 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:32:31.115525 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-ba736899-363a-484e-80a9-6b3f8aaf8289 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:32:31.116651 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-ba736899-363a-484e-80a9-6b3f8aaf8289 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/53ede50e-496d-480c-b292-30e95344eaac" status: 200 len: 1405 microversion: 2.20 time: 0.171255 Jun 17 13:32:31.117217 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1661/3282] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:32:30 2022] GET /compute/v2.1/servers/53ede50e-496d-480c-b292-30e95344eaac => generated 1405 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:32:31.135699 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [req-d442818a-2e4e-42b0-a6b7-c3cbb05263c5 req-0af0c3a7-aefc-4dbc-ae7d-d195cc22f7bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53ede50e-496d-480c-b292-30e95344eaac", "name": "network-vif-plugged", "status": "completed", "tag": "18820e99-834c-4f86-aa42-a4db70cd683d"}]} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:32:31.144871 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-d442818a-2e4e-42b0-a6b7-c3cbb05263c5 req-0af0c3a7-aefc-4dbc-ae7d-d195cc22f7bf service nova] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:32:31.145312 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-d442818a-2e4e-42b0-a6b7-c3cbb05263c5 req-0af0c3a7-aefc-4dbc-ae7d-d195cc22f7bf service nova] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:32:31.157553 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.compute.server_external_events [req-d442818a-2e4e-42b0-a6b7-c3cbb05263c5 req-0af0c3a7-aefc-4dbc-ae7d-d195cc22f7bf service nova] Creating event network-vif-plugged:18820e99-834c-4f86-aa42-a4db70cd683d for instance 53ede50e-496d-480c-b292-30e95344eaac on hv-cinder-83754 Jun 17 13:32:31.162605 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [req-d442818a-2e4e-42b0-a6b7-c3cbb05263c5 req-0af0c3a7-aefc-4dbc-ae7d-d195cc22f7bf service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030610 Jun 17 13:32:31.163192 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1622/3283] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 13:32:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 13:32:32.135558 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-f5787898-5f99-4c75-ad27-c86fac0f6b12 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:32:32.136147 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-f5787898-5f99-4c75-ad27-c86fac0f6b12 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: 53ede50e-496d-480c-b292-30e95344eaac] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:32:32.143774 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f5787898-5f99-4c75-ad27-c86fac0f6b12 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:32:32.144222 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f5787898-5f99-4c75-ad27-c86fac0f6b12 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:32:32.144978 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f5787898-5f99-4c75-ad27-c86fac0f6b12 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:32:32.145410 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f5787898-5f99-4c75-ad27-c86fac0f6b12 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:32:32.147972 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_cell1:SELECT=95 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:32:32.292909 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-f5787898-5f99-4c75-ad27-c86fac0f6b12 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:32:32.305075 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-f5787898-5f99-4c75-ad27-c86fac0f6b12 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:32:32.306687 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-f5787898-5f99-4c75-ad27-c86fac0f6b12 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:32:32.307804 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-f5787898-5f99-4c75-ad27-c86fac0f6b12 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/53ede50e-496d-480c-b292-30e95344eaac" status: 200 len: 1405 microversion: 2.20 time: 0.176289 Jun 17 13:32:32.308439 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1662/3284] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:32:32 2022] GET /compute/v2.1/servers/53ede50e-496d-480c-b292-30e95344eaac => generated 1405 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:32:33.328125 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell0:SELECT=10 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:32:33.332850 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-dcfcc8bd-3694-4cbf-b89c-a6d399eeadfd tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:32:33.333573 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-dcfcc8bd-3694-4cbf-b89c-a6d399eeadfd tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: 53ede50e-496d-480c-b292-30e95344eaac] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:32:33.341265 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dcfcc8bd-3694-4cbf-b89c-a6d399eeadfd tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:32:33.342186 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dcfcc8bd-3694-4cbf-b89c-a6d399eeadfd tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:32:33.342958 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dcfcc8bd-3694-4cbf-b89c-a6d399eeadfd tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:32:33.343401 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dcfcc8bd-3694-4cbf-b89c-a6d399eeadfd tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:32:33.481906 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-dcfcc8bd-3694-4cbf-b89c-a6d399eeadfd tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:32:33.490035 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-dcfcc8bd-3694-4cbf-b89c-a6d399eeadfd tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:32:33.491564 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-dcfcc8bd-3694-4cbf-b89c-a6d399eeadfd tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:32:33.492717 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-dcfcc8bd-3694-4cbf-b89c-a6d399eeadfd tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/53ede50e-496d-480c-b292-30e95344eaac" status: 200 len: 1598 microversion: 2.20 time: 0.165596 Jun 17 13:32:33.493361 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1623/3285] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:32:33 2022] GET /compute/v2.1/servers/53ede50e-496d-480c-b292-30e95344eaac => generated 1598 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:32:33.510928 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-c9bb3153-762f-49c7-8102-8392e344a09d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:32:33.511414 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-c9bb3153-762f-49c7-8102-8392e344a09d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: 53ede50e-496d-480c-b292-30e95344eaac] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:32:33.518426 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c9bb3153-762f-49c7-8102-8392e344a09d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:32:33.518868 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c9bb3153-762f-49c7-8102-8392e344a09d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:32:33.519635 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c9bb3153-762f-49c7-8102-8392e344a09d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:32:33.520062 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c9bb3153-762f-49c7-8102-8392e344a09d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:32:33.596876 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-c9bb3153-762f-49c7-8102-8392e344a09d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/53ede50e-496d-480c-b292-30e95344eaac/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.090050 Jun 17 13:32:33.597459 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1663/3286] 10.222.0.48 () {60 vars in 1315 bytes} [Fri Jun 17 13:32:33 2022] GET /compute/v2.1/servers/53ede50e-496d-480c-b292-30e95344eaac/os-interface => generated 285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:32:34.566793 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [req-25dc51b6-6041-4929-a792-f102d26aecfa req-4d304634-7e8e-434e-b3fc-473e3b6a82df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53ede50e-496d-480c-b292-30e95344eaac", "tag": "18820e99-834c-4f86-aa42-a4db70cd683d"}]} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:32:34.575898 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-25dc51b6-6041-4929-a792-f102d26aecfa req-4d304634-7e8e-434e-b3fc-473e3b6a82df service nova] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:32:34.576345 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-25dc51b6-6041-4929-a792-f102d26aecfa req-4d304634-7e8e-434e-b3fc-473e3b6a82df service nova] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:32:34.587433 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.compute.server_external_events [req-25dc51b6-6041-4929-a792-f102d26aecfa req-4d304634-7e8e-434e-b3fc-473e3b6a82df service nova] Creating event network-changed:18820e99-834c-4f86-aa42-a4db70cd683d for instance 53ede50e-496d-480c-b292-30e95344eaac on hv-cinder-83754 Jun 17 13:32:34.592572 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [req-25dc51b6-6041-4929-a792-f102d26aecfa req-4d304634-7e8e-434e-b3fc-473e3b6a82df service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029548 Jun 17 13:32:34.593246 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1624/3287] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 13:32:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:33:49.597461 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_api:SELECT=13 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:33:49.598602 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_cell1:SELECT=9 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:33:49.607260 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-173de98b-77b4-4e66-8765-b9514e398152 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:33:49.608067 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-173de98b-77b4-4e66-8765-b9514e398152 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: 53ede50e-496d-480c-b292-30e95344eaac] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:33:49.618927 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-173de98b-77b4-4e66-8765-b9514e398152 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:33:49.620099 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-173de98b-77b4-4e66-8765-b9514e398152 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:33:49.620589 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-173de98b-77b4-4e66-8765-b9514e398152 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:33:49.621046 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-173de98b-77b4-4e66-8765-b9514e398152 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:33:49.645974 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-173de98b-77b4-4e66-8765-b9514e398152 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/53ede50e-496d-480c-b292-30e95344eaac/ips" status: 200 len: 153 microversion: 2.20 time: 0.051961 Jun 17 13:33:49.646610 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1664/3288] 10.222.0.48 () {60 vars in 1288 bytes} [Fri Jun 17 13:33:49 2022] GET /compute/v2.1/servers/53ede50e-496d-480c-b292-30e95344eaac/ips => generated 153 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:34:18.849466 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR oslo.messaging._drivers.impl_rabbit [-] [58e789ef-cefe-40cb-9dfb-02eb38ec7927] AMQP server on 10.222.0.48:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 17 13:34:18.850913 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_api:SELECT=21 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:34:18.852041 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=72 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:34:18.857771 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-1aa55d64-74bc-4d8c-bf6a-2af0513713f7 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f7eaf148-2814-43d9-bada-db0f8f5a5900"}} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:34:18.859924 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-1aa55d64-74bc-4d8c-bf6a-2af0513713f7 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 26622189-19d7-4ce4-b2a8-8f50a6080307] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:34:18.878138 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1aa55d64-74bc-4d8c-bf6a-2af0513713f7 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:34:18.878593 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1aa55d64-74bc-4d8c-bf6a-2af0513713f7 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:34:18.879362 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1aa55d64-74bc-4d8c-bf6a-2af0513713f7 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:34:18.879789 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1aa55d64-74bc-4d8c-bf6a-2af0513713f7 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:34:19.111318 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-3d24ebc9-e2a5-4c13-b03e-3762e71680d6 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1588030635", "imageRef": "ccec3e37-1df8-4f10-a8f6-f97dfac54cf5", "flavorRef": "452", "networks": [{"uuid": "7821939d-09ca-4e1f-a339-e6b4f8ca98fb"}]}} {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:34:19.118247 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_api:SELECT=2 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:34:19.119086 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_cell1:SELECT=4 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:34:19.175306 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.network.neutron [None req-3d24ebc9-e2a5-4c13-b03e-3762e71680d6 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] validate_networks() for [('7821939d-09ca-4e1f-a339-e6b4f8ca98fb', None, None, None, None, None)] {{(pid=117659) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 17 13:34:19.817611 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.virt.hardware [None req-3d24ebc9-e2a5-4c13-b03e-3762e71680d6 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Flavor limits 0:0:0 {{(pid=117659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 17 13:34:19.818025 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.virt.hardware [None req-3d24ebc9-e2a5-4c13-b03e-3762e71680d6 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Image limits 0:0:0 {{(pid=117659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 17 13:34:19.818624 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.virt.hardware [None req-3d24ebc9-e2a5-4c13-b03e-3762e71680d6 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Flavor pref 0:0:0 {{(pid=117659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 17 13:34:19.819027 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.virt.hardware [None req-3d24ebc9-e2a5-4c13-b03e-3762e71680d6 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Image pref 0:0:0 {{(pid=117659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 17 13:34:19.819429 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.virt.hardware [None req-3d24ebc9-e2a5-4c13-b03e-3762e71680d6 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 17 13:34:19.828947 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-3d24ebc9-e2a5-4c13-b03e-3762e71680d6 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:34:19.829387 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-3d24ebc9-e2a5-4c13-b03e-3762e71680d6 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:34:19.830203 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-3d24ebc9-e2a5-4c13-b03e-3762e71680d6 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:34:19.830631 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-3d24ebc9-e2a5-4c13-b03e-3762e71680d6 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:34:19.847752 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.quota [None req-3d24ebc9-e2a5-4c13-b03e-3762e71680d6 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Getting quotas for project 834ac53907e54975851947e5f653c688. Resources: {'ram', 'cores', 'instances'} {{(pid=117659) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 13:34:19.852089 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.quota [None req-3d24ebc9-e2a5-4c13-b03e-3762e71680d6 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Getting quotas for user c6bc5146c28948c5859cd9eb3d09e0cf and project 834ac53907e54975851947e5f653c688. Resources: {'ram', 'cores', 'instances'} {{(pid=117659) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 13:34:19.859454 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO oslo.messaging._drivers.impl_rabbit [-] [58e789ef-cefe-40cb-9dfb-02eb38ec7927] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 43030. Jun 17 13:34:19.864748 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-3d24ebc9-e2a5-4c13-b03e-3762e71680d6 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Going to run 1 instances... {{(pid=117659) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 17 13:34:19.867091 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-3d24ebc9-e2a5-4c13-b03e-3762e71680d6 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 4d474404-89d1-4844-bf86-75f6464a1a6f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ccec3e37-1df8-4f10-a8f6-f97dfac54cf5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117659) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 17 13:34:19.913659 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-3d24ebc9-e2a5-4c13-b03e-3762e71680d6 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.806256 Jun 17 13:34:19.914349 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1665/3289] 10.222.0.48 () {60 vars in 1146 bytes} [Fri Jun 17 13:34:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 808 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 17 13:34:19.926947 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-ef5f0021-03c5-41d2-ac16-2fa407448d4e tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:34:19.928272 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-ef5f0021-03c5-41d2-ac16-2fa407448d4e tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 4d474404-89d1-4844-bf86-75f6464a1a6f] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:34:20.025286 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-ef5f0021-03c5-41d2-ac16-2fa407448d4e tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:34:20.037885 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-ef5f0021-03c5-41d2-ac16-2fa407448d4e tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/4d474404-89d1-4844-bf86-75f6464a1a6f" status: 200 len: 1219 microversion: 2.1 time: 0.116900 Jun 17 13:34:20.046628 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1666/3290] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:34:19 2022] GET /compute/v2.1/servers/4d474404-89d1-4844-bf86-75f6464a1a6f => generated 1219 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 13:34:20.073439 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-1aa55d64-74bc-4d8c-bf6a-2af0513713f7 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "POST /compute/v2.1/servers/26622189-19d7-4ce4-b2a8-8f50a6080307/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.227020 Jun 17 13:34:20.074062 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1625/3291] 10.222.0.48 () {60 vars in 1322 bytes} [Fri Jun 17 13:34:18 2022] POST /compute/v2.1/servers/26622189-19d7-4ce4-b2a8-8f50a6080307/os-volume_attachments => generated 194 bytes in 1230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:34:20.678510 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-1dd9b05e-1736-4e13-9704-e753336aeadb tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:34:20.679466 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-1dd9b05e-1736-4e13-9704-e753336aeadb tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: 53ede50e-496d-480c-b292-30e95344eaac] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:34:20.848631 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-1dd9b05e-1736-4e13-9704-e753336aeadb tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:34:20.848986 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-1dd9b05e-1736-4e13-9704-e753336aeadb tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:34:20.849780 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-1dd9b05e-1736-4e13-9704-e753336aeadb tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:34:20.850239 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-1dd9b05e-1736-4e13-9704-e753336aeadb tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:34:20.875378 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.objects.instance [None req-1dd9b05e-1736-4e13-9704-e753336aeadb tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lazy-loading 'flavor' on Instance uuid 53ede50e-496d-480c-b292-30e95344eaac {{(pid=117659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 13:34:21.059303 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-165af9c3-4901-4363-b109-065829314ef9 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:34:21.060218 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-165af9c3-4901-4363-b109-065829314ef9 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 4d474404-89d1-4844-bf86-75f6464a1a6f] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:34:21.071132 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-165af9c3-4901-4363-b109-065829314ef9 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:34:21.071485 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-165af9c3-4901-4363-b109-065829314ef9 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:34:21.072225 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-165af9c3-4901-4363-b109-065829314ef9 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:34:21.072892 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-165af9c3-4901-4363-b109-065829314ef9 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:34:21.183178 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-1dd9b05e-1736-4e13-9704-e753336aeadb tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "POST /compute/v2.1/servers/53ede50e-496d-480c-b292-30e95344eaac/action" status: 202 len: 0 microversion: 2.20 time: 0.511220 Jun 17 13:34:21.183975 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1667/3292] 10.222.0.48 () {62 vars in 1318 bytes} [Fri Jun 17 13:34:20 2022] POST /compute/v2.1/servers/53ede50e-496d-480c-b292-30e95344eaac/action => generated 0 bytes in 513 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 17 13:34:21.202343 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-5c4c9717-7109-4966-8071-8d829572fbb3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:34:21.203876 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-5c4c9717-7109-4966-8071-8d829572fbb3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: 53ede50e-496d-480c-b292-30e95344eaac] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:34:21.211036 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-5c4c9717-7109-4966-8071-8d829572fbb3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:34:21.211478 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-5c4c9717-7109-4966-8071-8d829572fbb3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:34:21.212271 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-5c4c9717-7109-4966-8071-8d829572fbb3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:34:21.212715 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-5c4c9717-7109-4966-8071-8d829572fbb3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:34:21.230493 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-165af9c3-4901-4363-b109-065829314ef9 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:34:21.238889 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-165af9c3-4901-4363-b109-065829314ef9 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/4d474404-89d1-4844-bf86-75f6464a1a6f" status: 200 len: 1215 microversion: 2.1 time: 0.184771 Jun 17 13:34:21.239460 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1626/3293] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:34:21 2022] GET /compute/v2.1/servers/4d474404-89d1-4844-bf86-75f6464a1a6f => generated 1215 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:34:21.444337 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-5c4c9717-7109-4966-8071-8d829572fbb3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:34:21.452821 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-5c4c9717-7109-4966-8071-8d829572fbb3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:34:21.454624 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-5c4c9717-7109-4966-8071-8d829572fbb3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:34:21.455817 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-5c4c9717-7109-4966-8071-8d829572fbb3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/53ede50e-496d-480c-b292-30e95344eaac" status: 200 len: 1723 microversion: 2.20 time: 0.266605 Jun 17 13:34:21.456670 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1668/3294] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:34:21 2022] GET /compute/v2.1/servers/53ede50e-496d-480c-b292-30e95344eaac => generated 1723 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:34:21.725567 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [req-7e220517-98b2-4d08-89fd-bd6db32975f9 req-23795176-ad05-4839-a032-4d4194a9940f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a408151-81c8-4490-9190-5e4fa2d98e8a", "name": "network-vif-deleted", "tag": "78029a46-f1c7-4b92-ba08-7045080d5b08"}]} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:34:21.734849 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-7e220517-98b2-4d08-89fd-bd6db32975f9 req-23795176-ad05-4839-a032-4d4194a9940f service nova] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:34:21.735289 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-7e220517-98b2-4d08-89fd-bd6db32975f9 req-23795176-ad05-4839-a032-4d4194a9940f service nova] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:34:21.746575 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.compute.server_external_events [req-7e220517-98b2-4d08-89fd-bd6db32975f9 req-23795176-ad05-4839-a032-4d4194a9940f service nova] Creating event network-vif-deleted:78029a46-f1c7-4b92-ba08-7045080d5b08 for instance 8a408151-81c8-4490-9190-5e4fa2d98e8a on hv-cinder-83754 Jun 17 13:34:21.751475 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [req-7e220517-98b2-4d08-89fd-bd6db32975f9 req-23795176-ad05-4839-a032-4d4194a9940f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029665 Jun 17 13:34:21.752037 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1627/3295] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 13:34:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 13:34:22.258333 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-a8051249-3c89-4d2f-80b2-737025bf0558 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:34:22.259752 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-a8051249-3c89-4d2f-80b2-737025bf0558 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 4d474404-89d1-4844-bf86-75f6464a1a6f] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:34:22.270960 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a8051249-3c89-4d2f-80b2-737025bf0558 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:34:22.275488 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a8051249-3c89-4d2f-80b2-737025bf0558 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:34:22.277292 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a8051249-3c89-4d2f-80b2-737025bf0558 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:34:22.278147 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a8051249-3c89-4d2f-80b2-737025bf0558 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:34:22.348573 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-a8051249-3c89-4d2f-80b2-737025bf0558 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:34:22.356889 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-a8051249-3c89-4d2f-80b2-737025bf0558 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/4d474404-89d1-4844-bf86-75f6464a1a6f" status: 200 len: 1277 microversion: 2.1 time: 0.103557 Jun 17 13:34:22.357459 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1669/3296] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:34:22 2022] GET /compute/v2.1/servers/4d474404-89d1-4844-bf86-75f6464a1a6f => generated 1277 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:34:22.481690 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-b4999d88-98de-4fc1-be00-f6f0ebc9e2f6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:34:22.482992 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-b4999d88-98de-4fc1-be00-f6f0ebc9e2f6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: 53ede50e-496d-480c-b292-30e95344eaac] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:34:22.493299 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b4999d88-98de-4fc1-be00-f6f0ebc9e2f6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:34:22.494078 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b4999d88-98de-4fc1-be00-f6f0ebc9e2f6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:34:22.494906 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b4999d88-98de-4fc1-be00-f6f0ebc9e2f6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:34:22.495334 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b4999d88-98de-4fc1-be00-f6f0ebc9e2f6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:34:22.661502 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-b4999d88-98de-4fc1-be00-f6f0ebc9e2f6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:34:22.670516 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-b4999d88-98de-4fc1-be00-f6f0ebc9e2f6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:34:22.672012 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-b4999d88-98de-4fc1-be00-f6f0ebc9e2f6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:34:22.673174 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-b4999d88-98de-4fc1-be00-f6f0ebc9e2f6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/53ede50e-496d-480c-b292-30e95344eaac" status: 200 len: 1723 microversion: 2.20 time: 0.200626 Jun 17 13:34:22.673750 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1628/3297] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:34:22 2022] GET /compute/v2.1/servers/53ede50e-496d-480c-b292-30e95344eaac => generated 1723 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:34:23.373831 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-2f685ddb-39e6-4e4d-a75c-e2c037c31e9a tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:34:23.374459 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-2f685ddb-39e6-4e4d-a75c-e2c037c31e9a tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 4d474404-89d1-4844-bf86-75f6464a1a6f] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:34:23.381341 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2f685ddb-39e6-4e4d-a75c-e2c037c31e9a tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:34:23.381790 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2f685ddb-39e6-4e4d-a75c-e2c037c31e9a tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:34:23.382585 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2f685ddb-39e6-4e4d-a75c-e2c037c31e9a tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:34:23.383016 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2f685ddb-39e6-4e4d-a75c-e2c037c31e9a tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:34:23.546884 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-2f685ddb-39e6-4e4d-a75c-e2c037c31e9a tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:34:23.554718 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-2f685ddb-39e6-4e4d-a75c-e2c037c31e9a tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/4d474404-89d1-4844-bf86-75f6464a1a6f" status: 200 len: 1319 microversion: 2.1 time: 0.184574 Jun 17 13:34:23.555204 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1670/3298] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:34:23 2022] GET /compute/v2.1/servers/4d474404-89d1-4844-bf86-75f6464a1a6f => generated 1319 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:34:23.691863 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-db39a75b-b12a-48b8-aa0f-3d64fd3a9336 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:34:23.692509 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-db39a75b-b12a-48b8-aa0f-3d64fd3a9336 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: 53ede50e-496d-480c-b292-30e95344eaac] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:34:23.699720 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-db39a75b-b12a-48b8-aa0f-3d64fd3a9336 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:34:23.700162 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-db39a75b-b12a-48b8-aa0f-3d64fd3a9336 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:34:23.700917 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-db39a75b-b12a-48b8-aa0f-3d64fd3a9336 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:34:23.701412 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-db39a75b-b12a-48b8-aa0f-3d64fd3a9336 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:34:23.908951 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-db39a75b-b12a-48b8-aa0f-3d64fd3a9336 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:34:23.918361 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-db39a75b-b12a-48b8-aa0f-3d64fd3a9336 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:34:23.919858 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-db39a75b-b12a-48b8-aa0f-3d64fd3a9336 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:34:23.921026 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-db39a75b-b12a-48b8-aa0f-3d64fd3a9336 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/53ede50e-496d-480c-b292-30e95344eaac" status: 200 len: 1723 microversion: 2.20 time: 0.233114 Jun 17 13:34:23.921578 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1629/3299] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:34:23 2022] GET /compute/v2.1/servers/53ede50e-496d-480c-b292-30e95344eaac => generated 1723 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 13:34:24.237667 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [req-1fc04a38-63b0-46fc-ac80-dd2ecbd1438d req-14564993-8053-42f2-b17f-99dc55374b69 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d474404-89d1-4844-bf86-75f6464a1a6f", "tag": "14412039-68b6-47ce-95ff-e28cd44b9489"}]} {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:34:24.250353 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [req-1fc04a38-63b0-46fc-ac80-dd2ecbd1438d req-14564993-8053-42f2-b17f-99dc55374b69 service nova] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:34:24.250785 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [req-1fc04a38-63b0-46fc-ac80-dd2ecbd1438d req-14564993-8053-42f2-b17f-99dc55374b69 service nova] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:34:24.272713 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.compute.server_external_events [req-1fc04a38-63b0-46fc-ac80-dd2ecbd1438d req-14564993-8053-42f2-b17f-99dc55374b69 service nova] Creating event network-changed:14412039-68b6-47ce-95ff-e28cd44b9489 for instance 4d474404-89d1-4844-bf86-75f6464a1a6f on hv-cinder-83754 Jun 17 13:34:24.279013 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [req-1fc04a38-63b0-46fc-ac80-dd2ecbd1438d req-14564993-8053-42f2-b17f-99dc55374b69 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044931 Jun 17 13:34:24.279706 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1671/3300] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 13:34:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:34:24.571580 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-15873580-10b0-4952-8ed7-38e15fdb604a tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:34:24.572583 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-15873580-10b0-4952-8ed7-38e15fdb604a tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 4d474404-89d1-4844-bf86-75f6464a1a6f] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:34:24.578875 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-15873580-10b0-4952-8ed7-38e15fdb604a tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:34:24.579313 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-15873580-10b0-4952-8ed7-38e15fdb604a tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:34:24.580064 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-15873580-10b0-4952-8ed7-38e15fdb604a tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:34:24.580485 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-15873580-10b0-4952-8ed7-38e15fdb604a tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:34:24.620865 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [req-70fdc051-d000-4dab-94de-3a0ab865066e req-d2bb4f82-9ef6-4987-bb9e-010de82545ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a983e3a-9451-4a00-b4f3-b6b2e5a003d6", "name": "network-vif-deleted", "tag": "bf2b4bfb-50d4-45f0-8273-ccfa08843494"}]} {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:34:24.630751 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [req-70fdc051-d000-4dab-94de-3a0ab865066e req-d2bb4f82-9ef6-4987-bb9e-010de82545ba service nova] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:34:24.631306 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [req-70fdc051-d000-4dab-94de-3a0ab865066e req-d2bb4f82-9ef6-4987-bb9e-010de82545ba service nova] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:34:24.658865 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.compute.server_external_events [req-70fdc051-d000-4dab-94de-3a0ab865066e req-d2bb4f82-9ef6-4987-bb9e-010de82545ba service nova] Creating event network-vif-deleted:bf2b4bfb-50d4-45f0-8273-ccfa08843494 for instance 0a983e3a-9451-4a00-b4f3-b6b2e5a003d6 on hv-cinder-83754 Jun 17 13:34:24.663983 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [req-70fdc051-d000-4dab-94de-3a0ab865066e req-d2bb4f82-9ef6-4987-bb9e-010de82545ba service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047698 Jun 17 13:34:24.664581 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1672/3301] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 13:34:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 13:34:24.721570 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-15873580-10b0-4952-8ed7-38e15fdb604a tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:34:24.729999 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-15873580-10b0-4952-8ed7-38e15fdb604a tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/4d474404-89d1-4844-bf86-75f6464a1a6f" status: 200 len: 1319 microversion: 2.1 time: 0.161907 Jun 17 13:34:24.730836 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1630/3302] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:34:24 2022] GET /compute/v2.1/servers/4d474404-89d1-4844-bf86-75f6464a1a6f => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:34:24.940073 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-ca3de400-bc03-4e9d-aa29-88b771954931 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:34:24.940769 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-ca3de400-bc03-4e9d-aa29-88b771954931 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: 53ede50e-496d-480c-b292-30e95344eaac] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:34:24.948275 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ca3de400-bc03-4e9d-aa29-88b771954931 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:34:24.948726 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ca3de400-bc03-4e9d-aa29-88b771954931 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:34:24.949495 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ca3de400-bc03-4e9d-aa29-88b771954931 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:34:24.949948 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ca3de400-bc03-4e9d-aa29-88b771954931 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:34:25.092029 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-ca3de400-bc03-4e9d-aa29-88b771954931 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:34:25.100322 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-ca3de400-bc03-4e9d-aa29-88b771954931 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:34:25.101815 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-ca3de400-bc03-4e9d-aa29-88b771954931 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:34:25.103060 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-ca3de400-bc03-4e9d-aa29-88b771954931 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/53ede50e-496d-480c-b292-30e95344eaac" status: 200 len: 1723 microversion: 2.20 time: 0.167277 Jun 17 13:34:25.103917 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1673/3303] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:34:24 2022] GET /compute/v2.1/servers/53ede50e-496d-480c-b292-30e95344eaac => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:34:25.751260 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-ff631efd-dfd2-488f-a989-f708ef13c259 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:34:25.752208 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-ff631efd-dfd2-488f-a989-f708ef13c259 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 4d474404-89d1-4844-bf86-75f6464a1a6f] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:34:25.762003 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ff631efd-dfd2-488f-a989-f708ef13c259 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:34:25.762484 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ff631efd-dfd2-488f-a989-f708ef13c259 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:34:25.763242 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ff631efd-dfd2-488f-a989-f708ef13c259 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:34:25.763672 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ff631efd-dfd2-488f-a989-f708ef13c259 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:34:25.911125 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-ff631efd-dfd2-488f-a989-f708ef13c259 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:34:25.919413 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-ff631efd-dfd2-488f-a989-f708ef13c259 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/4d474404-89d1-4844-bf86-75f6464a1a6f" status: 200 len: 1319 microversion: 2.1 time: 0.174709 Jun 17 13:34:25.920017 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1631/3304] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:34:25 2022] GET /compute/v2.1/servers/4d474404-89d1-4844-bf86-75f6464a1a6f => generated 1319 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:34:26.125408 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-11f05ff6-abe7-47a9-b3cf-be436d948133 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:34:26.126686 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-11f05ff6-abe7-47a9-b3cf-be436d948133 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: 53ede50e-496d-480c-b292-30e95344eaac] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:34:26.138427 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-11f05ff6-abe7-47a9-b3cf-be436d948133 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:34:26.139247 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-11f05ff6-abe7-47a9-b3cf-be436d948133 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:34:26.140507 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-11f05ff6-abe7-47a9-b3cf-be436d948133 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:34:26.141233 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-11f05ff6-abe7-47a9-b3cf-be436d948133 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:34:26.277155 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-11f05ff6-abe7-47a9-b3cf-be436d948133 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:34:26.288272 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-11f05ff6-abe7-47a9-b3cf-be436d948133 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:34:26.290441 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-11f05ff6-abe7-47a9-b3cf-be436d948133 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:34:26.291924 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-11f05ff6-abe7-47a9-b3cf-be436d948133 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/53ede50e-496d-480c-b292-30e95344eaac" status: 200 len: 1723 microversion: 2.20 time: 0.173338 Jun 17 13:34:26.292734 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1674/3305] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:34:26 2022] GET /compute/v2.1/servers/53ede50e-496d-480c-b292-30e95344eaac => generated 1723 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:34:26.936847 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-eefe973f-ce91-4a28-88fd-0a23afaa7497 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:34:26.937472 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-eefe973f-ce91-4a28-88fd-0a23afaa7497 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 4d474404-89d1-4844-bf86-75f6464a1a6f] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:34:26.944593 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-eefe973f-ce91-4a28-88fd-0a23afaa7497 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:34:26.945092 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-eefe973f-ce91-4a28-88fd-0a23afaa7497 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:34:26.945926 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-eefe973f-ce91-4a28-88fd-0a23afaa7497 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:34:26.946389 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-eefe973f-ce91-4a28-88fd-0a23afaa7497 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:34:27.093583 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-eefe973f-ce91-4a28-88fd-0a23afaa7497 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:34:27.101397 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-eefe973f-ce91-4a28-88fd-0a23afaa7497 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/4d474404-89d1-4844-bf86-75f6464a1a6f" status: 200 len: 1319 microversion: 2.1 time: 0.168448 Jun 17 13:34:27.101953 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1632/3306] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:34:26 2022] GET /compute/v2.1/servers/4d474404-89d1-4844-bf86-75f6464a1a6f => generated 1319 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:34:27.311193 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-e5f6f07e-3dd7-4c77-b086-fde4152d7674 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:34:27.311870 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-e5f6f07e-3dd7-4c77-b086-fde4152d7674 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: 53ede50e-496d-480c-b292-30e95344eaac] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:34:27.318945 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e5f6f07e-3dd7-4c77-b086-fde4152d7674 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:34:27.319391 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e5f6f07e-3dd7-4c77-b086-fde4152d7674 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:34:27.320149 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e5f6f07e-3dd7-4c77-b086-fde4152d7674 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:34:27.320580 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e5f6f07e-3dd7-4c77-b086-fde4152d7674 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:34:27.479985 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-e5f6f07e-3dd7-4c77-b086-fde4152d7674 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:34:27.491930 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-e5f6f07e-3dd7-4c77-b086-fde4152d7674 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:34:27.494579 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-e5f6f07e-3dd7-4c77-b086-fde4152d7674 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:34:27.496212 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-e5f6f07e-3dd7-4c77-b086-fde4152d7674 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/53ede50e-496d-480c-b292-30e95344eaac" status: 200 len: 1723 microversion: 2.20 time: 0.189038 Jun 17 13:34:27.496847 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1675/3307] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:34:27 2022] GET /compute/v2.1/servers/53ede50e-496d-480c-b292-30e95344eaac => generated 1723 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:34:27.760703 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [req-184ae23e-b401-414f-8358-23943ee96427 req-ef8a64eb-d627-4628-8219-627e337867ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29d26a8a-a734-4531-b9ee-04506c852fe2", "name": "network-vif-unplugged", "status": "completed", "tag": "4ae50ebd-a268-4596-8c67-1e7de84bfb9e"}]} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:34:27.769256 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-184ae23e-b401-414f-8358-23943ee96427 req-ef8a64eb-d627-4628-8219-627e337867ce service nova] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:34:27.769658 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-184ae23e-b401-414f-8358-23943ee96427 req-ef8a64eb-d627-4628-8219-627e337867ce service nova] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:34:27.781489 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.compute.server_external_events [req-184ae23e-b401-414f-8358-23943ee96427 req-ef8a64eb-d627-4628-8219-627e337867ce service nova] Creating event network-vif-unplugged:4ae50ebd-a268-4596-8c67-1e7de84bfb9e for instance 29d26a8a-a734-4531-b9ee-04506c852fe2 on hv-cinder-83754 Jun 17 13:34:27.786607 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [req-184ae23e-b401-414f-8358-23943ee96427 req-ef8a64eb-d627-4628-8219-627e337867ce service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029651 Jun 17 13:34:27.787202 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1633/3308] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 13:34:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:34:28.122232 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-30a283cd-b5e4-48ae-971b-e253edf001bc tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:34:28.123485 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-30a283cd-b5e4-48ae-971b-e253edf001bc tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 4d474404-89d1-4844-bf86-75f6464a1a6f] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:34:28.129326 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-30a283cd-b5e4-48ae-971b-e253edf001bc tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:34:28.129839 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-30a283cd-b5e4-48ae-971b-e253edf001bc tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:34:28.130638 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-30a283cd-b5e4-48ae-971b-e253edf001bc tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:34:28.131328 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-30a283cd-b5e4-48ae-971b-e253edf001bc tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:34:28.372413 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-30a283cd-b5e4-48ae-971b-e253edf001bc tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:34:28.380380 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-30a283cd-b5e4-48ae-971b-e253edf001bc tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/4d474404-89d1-4844-bf86-75f6464a1a6f" status: 200 len: 1319 microversion: 2.1 time: 0.262079 Jun 17 13:34:28.381052 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1676/3309] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:34:28 2022] GET /compute/v2.1/servers/4d474404-89d1-4844-bf86-75f6464a1a6f => generated 1319 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:34:28.408171 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [req-fc281af4-1203-42f7-bf76-f1b67faecdc5 req-9050ac9e-732b-4a0d-9614-bf3fa8ff5228 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29d26a8a-a734-4531-b9ee-04506c852fe2", "name": "network-vif-deleted", "tag": "4ae50ebd-a268-4596-8c67-1e7de84bfb9e"}]} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:34:28.417548 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-fc281af4-1203-42f7-bf76-f1b67faecdc5 req-9050ac9e-732b-4a0d-9614-bf3fa8ff5228 service nova] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:34:28.418168 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-fc281af4-1203-42f7-bf76-f1b67faecdc5 req-9050ac9e-732b-4a0d-9614-bf3fa8ff5228 service nova] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:34:28.437852 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.compute.server_external_events [req-fc281af4-1203-42f7-bf76-f1b67faecdc5 req-9050ac9e-732b-4a0d-9614-bf3fa8ff5228 service nova] Creating event network-vif-deleted:4ae50ebd-a268-4596-8c67-1e7de84bfb9e for instance 29d26a8a-a734-4531-b9ee-04506c852fe2 on hv-cinder-83754 Jun 17 13:34:28.444494 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [req-fc281af4-1203-42f7-bf76-f1b67faecdc5 req-9050ac9e-732b-4a0d-9614-bf3fa8ff5228 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039491 Jun 17 13:34:28.445387 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1634/3310] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 13:34:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:34:28.517116 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-c2573dab-0d1c-4799-bb47-1d30d1ae1a54 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:34:28.517711 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-c2573dab-0d1c-4799-bb47-1d30d1ae1a54 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: 53ede50e-496d-480c-b292-30e95344eaac] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:34:28.523675 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c2573dab-0d1c-4799-bb47-1d30d1ae1a54 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:34:28.524104 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c2573dab-0d1c-4799-bb47-1d30d1ae1a54 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:34:28.524941 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c2573dab-0d1c-4799-bb47-1d30d1ae1a54 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:34:28.525476 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c2573dab-0d1c-4799-bb47-1d30d1ae1a54 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:34:28.672536 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-c2573dab-0d1c-4799-bb47-1d30d1ae1a54 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:34:28.684111 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-c2573dab-0d1c-4799-bb47-1d30d1ae1a54 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:34:28.685604 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-c2573dab-0d1c-4799-bb47-1d30d1ae1a54 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:34:28.686793 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-c2573dab-0d1c-4799-bb47-1d30d1ae1a54 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/53ede50e-496d-480c-b292-30e95344eaac" status: 200 len: 1723 microversion: 2.20 time: 0.173850 Jun 17 13:34:28.687346 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1677/3311] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:34:28 2022] GET /compute/v2.1/servers/53ede50e-496d-480c-b292-30e95344eaac => generated 1723 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:34:29.402058 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-5942e603-f34a-48ef-a8ea-56fa04c11faa tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:34:29.402791 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-5942e603-f34a-48ef-a8ea-56fa04c11faa tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 4d474404-89d1-4844-bf86-75f6464a1a6f] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:34:29.409990 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5942e603-f34a-48ef-a8ea-56fa04c11faa tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:34:29.410625 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5942e603-f34a-48ef-a8ea-56fa04c11faa tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:34:29.411218 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5942e603-f34a-48ef-a8ea-56fa04c11faa tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:34:29.411682 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5942e603-f34a-48ef-a8ea-56fa04c11faa tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:34:29.549935 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-5942e603-f34a-48ef-a8ea-56fa04c11faa tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:34:29.558462 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-5942e603-f34a-48ef-a8ea-56fa04c11faa tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/4d474404-89d1-4844-bf86-75f6464a1a6f" status: 200 len: 1319 microversion: 2.1 time: 0.163229 Jun 17 13:34:29.559165 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1635/3312] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:34:29 2022] GET /compute/v2.1/servers/4d474404-89d1-4844-bf86-75f6464a1a6f => generated 1319 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:34:29.704825 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-6415946f-dd2c-4b07-bb70-186c6862f0d0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:34:29.705462 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-6415946f-dd2c-4b07-bb70-186c6862f0d0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: 53ede50e-496d-480c-b292-30e95344eaac] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:34:29.712858 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6415946f-dd2c-4b07-bb70-186c6862f0d0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:34:29.713312 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6415946f-dd2c-4b07-bb70-186c6862f0d0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:34:29.714083 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6415946f-dd2c-4b07-bb70-186c6862f0d0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:34:29.714643 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6415946f-dd2c-4b07-bb70-186c6862f0d0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:34:29.837486 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_cell0:SELECT=2 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:34:29.850108 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-6415946f-dd2c-4b07-bb70-186c6862f0d0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:34:29.858642 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-6415946f-dd2c-4b07-bb70-186c6862f0d0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:34:29.860128 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-6415946f-dd2c-4b07-bb70-186c6862f0d0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:34:29.861282 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-6415946f-dd2c-4b07-bb70-186c6862f0d0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/53ede50e-496d-480c-b292-30e95344eaac" status: 200 len: 1723 microversion: 2.20 time: 0.160409 Jun 17 13:34:29.861810 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1678/3313] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:34:29 2022] GET /compute/v2.1/servers/53ede50e-496d-480c-b292-30e95344eaac => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:34:30.575491 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-9bfa1652-0d4a-47dd-90ad-df32d78badb9 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:34:30.576143 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-9bfa1652-0d4a-47dd-90ad-df32d78badb9 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 4d474404-89d1-4844-bf86-75f6464a1a6f] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:34:30.583306 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9bfa1652-0d4a-47dd-90ad-df32d78badb9 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:34:30.583820 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9bfa1652-0d4a-47dd-90ad-df32d78badb9 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:34:30.584616 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9bfa1652-0d4a-47dd-90ad-df32d78badb9 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:34:30.585045 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9bfa1652-0d4a-47dd-90ad-df32d78badb9 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:34:30.724742 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-9bfa1652-0d4a-47dd-90ad-df32d78badb9 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:34:30.733734 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-9bfa1652-0d4a-47dd-90ad-df32d78badb9 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/4d474404-89d1-4844-bf86-75f6464a1a6f" status: 200 len: 1319 microversion: 2.1 time: 0.162646 Jun 17 13:34:30.734339 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1636/3314] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:34:30 2022] GET /compute/v2.1/servers/4d474404-89d1-4844-bf86-75f6464a1a6f => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:34:30.883507 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-e681dbbe-ab83-4c25-874d-5dd7b473efad tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:34:30.885440 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-e681dbbe-ab83-4c25-874d-5dd7b473efad tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: 53ede50e-496d-480c-b292-30e95344eaac] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:34:30.888479 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_cell0:SELECT=8 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:34:30.898656 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e681dbbe-ab83-4c25-874d-5dd7b473efad tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:34:30.899400 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e681dbbe-ab83-4c25-874d-5dd7b473efad tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:34:30.900417 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e681dbbe-ab83-4c25-874d-5dd7b473efad tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:34:30.900888 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e681dbbe-ab83-4c25-874d-5dd7b473efad tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:34:31.044571 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-e681dbbe-ab83-4c25-874d-5dd7b473efad tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:34:31.057201 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-e681dbbe-ab83-4c25-874d-5dd7b473efad tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:34:31.065466 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-e681dbbe-ab83-4c25-874d-5dd7b473efad tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:34:31.067309 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-e681dbbe-ab83-4c25-874d-5dd7b473efad tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/53ede50e-496d-480c-b292-30e95344eaac" status: 200 len: 1723 microversion: 2.20 time: 0.190276 Jun 17 13:34:31.068077 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1679/3315] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:34:30 2022] GET /compute/v2.1/servers/53ede50e-496d-480c-b292-30e95344eaac => generated 1723 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:34:31.678452 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [req-9daac3dc-0f13-493b-9885-fa7ff5cea5ac req-d0c7d086-7aa4-46a7-ad3c-65e3eaa9c1b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d474404-89d1-4844-bf86-75f6464a1a6f", "name": "network-vif-plugged", "status": "completed", "tag": "14412039-68b6-47ce-95ff-e28cd44b9489"}]} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:34:31.688301 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-9daac3dc-0f13-493b-9885-fa7ff5cea5ac req-d0c7d086-7aa4-46a7-ad3c-65e3eaa9c1b2 service nova] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:34:31.688735 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-9daac3dc-0f13-493b-9885-fa7ff5cea5ac req-d0c7d086-7aa4-46a7-ad3c-65e3eaa9c1b2 service nova] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:34:31.701258 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.compute.server_external_events [req-9daac3dc-0f13-493b-9885-fa7ff5cea5ac req-d0c7d086-7aa4-46a7-ad3c-65e3eaa9c1b2 service nova] Creating event network-vif-plugged:14412039-68b6-47ce-95ff-e28cd44b9489 for instance 4d474404-89d1-4844-bf86-75f6464a1a6f on hv-cinder-83754 Jun 17 13:34:31.706470 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [req-9daac3dc-0f13-493b-9885-fa7ff5cea5ac req-d0c7d086-7aa4-46a7-ad3c-65e3eaa9c1b2 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031682 Jun 17 13:34:31.707297 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1637/3316] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 13:34:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:34:31.750950 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-c92b261f-0931-4b13-8f0d-c37290b14372 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:34:31.751588 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-c92b261f-0931-4b13-8f0d-c37290b14372 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 4d474404-89d1-4844-bf86-75f6464a1a6f] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:34:31.757889 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c92b261f-0931-4b13-8f0d-c37290b14372 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:34:31.758325 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c92b261f-0931-4b13-8f0d-c37290b14372 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:34:31.759549 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c92b261f-0931-4b13-8f0d-c37290b14372 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:34:31.759549 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c92b261f-0931-4b13-8f0d-c37290b14372 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:34:31.891569 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-05849709-f37f-482d-b519-5462caa80a0d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:34:31.892824 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-05849709-f37f-482d-b519-5462caa80a0d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 26622189-19d7-4ce4-b2a8-8f50a6080307] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:34:31.897171 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-c92b261f-0931-4b13-8f0d-c37290b14372 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:34:31.899384 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-05849709-f37f-482d-b519-5462caa80a0d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:34:31.899942 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-05849709-f37f-482d-b519-5462caa80a0d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:34:31.900808 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-05849709-f37f-482d-b519-5462caa80a0d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:34:31.901389 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-05849709-f37f-482d-b519-5462caa80a0d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:34:31.905053 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-c92b261f-0931-4b13-8f0d-c37290b14372 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/4d474404-89d1-4844-bf86-75f6464a1a6f" status: 200 len: 1319 microversion: 2.1 time: 0.158015 Jun 17 13:34:31.905622 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1680/3317] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:34:31 2022] GET /compute/v2.1/servers/4d474404-89d1-4844-bf86-75f6464a1a6f => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:34:31.932724 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-05849709-f37f-482d-b519-5462caa80a0d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/26622189-19d7-4ce4-b2a8-8f50a6080307/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046279 Jun 17 13:34:31.933388 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1638/3318] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:34:31 2022] GET /compute/v2.1/servers/26622189-19d7-4ce4-b2a8-8f50a6080307/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 13:34:31.943168 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-2c2d5cd7-4e71-4bff-9d62-cf207f6667e4 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:34:31.943662 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-2c2d5cd7-4e71-4bff-9d62-cf207f6667e4 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 26622189-19d7-4ce4-b2a8-8f50a6080307] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:34:31.949805 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2c2d5cd7-4e71-4bff-9d62-cf207f6667e4 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:34:31.950299 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2c2d5cd7-4e71-4bff-9d62-cf207f6667e4 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:34:31.951064 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2c2d5cd7-4e71-4bff-9d62-cf207f6667e4 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:34:31.951499 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2c2d5cd7-4e71-4bff-9d62-cf207f6667e4 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:34:31.980263 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-2c2d5cd7-4e71-4bff-9d62-cf207f6667e4 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/26622189-19d7-4ce4-b2a8-8f50a6080307/os-volume_attachments/f7eaf148-2814-43d9-bada-db0f8f5a5900" status: 200 len: 194 microversion: 2.1 time: 0.040720 Jun 17 13:34:31.980858 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1681/3319] 10.222.0.48 () {58 vars in 1412 bytes} [Fri Jun 17 13:34:31 2022] GET /compute/v2.1/servers/26622189-19d7-4ce4-b2a8-8f50a6080307/os-volume_attachments/f7eaf148-2814-43d9-bada-db0f8f5a5900 => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:34:32.085558 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-f94a6a12-ae7e-40b4-950c-22528808c2fd tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:34:32.086184 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-f94a6a12-ae7e-40b4-950c-22528808c2fd tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: 53ede50e-496d-480c-b292-30e95344eaac] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:34:32.092431 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f94a6a12-ae7e-40b4-950c-22528808c2fd tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:34:32.092878 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f94a6a12-ae7e-40b4-950c-22528808c2fd tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:34:32.093638 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f94a6a12-ae7e-40b4-950c-22528808c2fd tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:34:32.094071 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f94a6a12-ae7e-40b4-950c-22528808c2fd tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:34:32.239053 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-f94a6a12-ae7e-40b4-950c-22528808c2fd tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:34:32.247793 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-f94a6a12-ae7e-40b4-950c-22528808c2fd tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:34:32.249279 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-f94a6a12-ae7e-40b4-950c-22528808c2fd tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:34:32.250581 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-f94a6a12-ae7e-40b4-950c-22528808c2fd tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/53ede50e-496d-480c-b292-30e95344eaac" status: 200 len: 1723 microversion: 2.20 time: 0.168973 Jun 17 13:34:32.251133 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1639/3320] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:34:32 2022] GET /compute/v2.1/servers/53ede50e-496d-480c-b292-30e95344eaac => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:34:32.926285 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-f7a62925-15da-47e6-aa4f-e375df3c89a3 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:34:32.927329 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-f7a62925-15da-47e6-aa4f-e375df3c89a3 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 4d474404-89d1-4844-bf86-75f6464a1a6f] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:34:32.936563 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f7a62925-15da-47e6-aa4f-e375df3c89a3 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:34:32.937012 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f7a62925-15da-47e6-aa4f-e375df3c89a3 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:34:32.937782 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f7a62925-15da-47e6-aa4f-e375df3c89a3 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:34:32.938259 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f7a62925-15da-47e6-aa4f-e375df3c89a3 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:34:32.957766 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:34:33.077479 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-f7a62925-15da-47e6-aa4f-e375df3c89a3 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:34:33.085225 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-f7a62925-15da-47e6-aa4f-e375df3c89a3 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/4d474404-89d1-4844-bf86-75f6464a1a6f" status: 200 len: 1319 microversion: 2.1 time: 0.165631 Jun 17 13:34:33.085768 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1682/3321] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:34:32 2022] GET /compute/v2.1/servers/4d474404-89d1-4844-bf86-75f6464a1a6f => generated 1319 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:34:33.271883 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-f48e217a-881a-4162-a605-a31e4a11d00d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:34:33.273741 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-f48e217a-881a-4162-a605-a31e4a11d00d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: 53ede50e-496d-480c-b292-30e95344eaac] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:34:33.284737 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f48e217a-881a-4162-a605-a31e4a11d00d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:34:33.285451 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f48e217a-881a-4162-a605-a31e4a11d00d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:34:33.286786 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f48e217a-881a-4162-a605-a31e4a11d00d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:34:33.287736 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f48e217a-881a-4162-a605-a31e4a11d00d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:34:33.334304 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-2e1c9bad-0f1f-494a-bddc-a17d9c326f92 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "da02cb65-a3b7-45c9-8717-19e5d09e7d30"}} {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:34:33.335732 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-2e1c9bad-0f1f-494a-bddc-a17d9c326f92 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 26622189-19d7-4ce4-b2a8-8f50a6080307] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:34:33.342160 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2e1c9bad-0f1f-494a-bddc-a17d9c326f92 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:34:33.342669 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2e1c9bad-0f1f-494a-bddc-a17d9c326f92 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:34:33.343577 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2e1c9bad-0f1f-494a-bddc-a17d9c326f92 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:34:33.344013 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2e1c9bad-0f1f-494a-bddc-a17d9c326f92 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:34:33.442692 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-f48e217a-881a-4162-a605-a31e4a11d00d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:34:33.456785 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-f48e217a-881a-4162-a605-a31e4a11d00d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:34:33.458529 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-f48e217a-881a-4162-a605-a31e4a11d00d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:34:33.459794 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-f48e217a-881a-4162-a605-a31e4a11d00d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/53ede50e-496d-480c-b292-30e95344eaac" status: 200 len: 1723 microversion: 2.20 time: 0.193016 Jun 17 13:34:33.460363 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1640/3322] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:34:33 2022] GET /compute/v2.1/servers/53ede50e-496d-480c-b292-30e95344eaac => generated 1723 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:34:33.726458 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-2e1c9bad-0f1f-494a-bddc-a17d9c326f92 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "POST /compute/v2.1/servers/26622189-19d7-4ce4-b2a8-8f50a6080307/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.395659 Jun 17 13:34:33.727080 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1683/3323] 10.222.0.48 () {60 vars in 1322 bytes} [Fri Jun 17 13:34:33 2022] POST /compute/v2.1/servers/26622189-19d7-4ce4-b2a8-8f50a6080307/os-volume_attachments => generated 194 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 13:34:34.106065 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-d90bd49e-dbd3-41e8-8070-644ad81527eb tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:34:34.106874 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-d90bd49e-dbd3-41e8-8070-644ad81527eb tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 4d474404-89d1-4844-bf86-75f6464a1a6f] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:34:34.114353 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d90bd49e-dbd3-41e8-8070-644ad81527eb tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:34:34.114874 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d90bd49e-dbd3-41e8-8070-644ad81527eb tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:34:34.115765 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d90bd49e-dbd3-41e8-8070-644ad81527eb tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:34:34.116276 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d90bd49e-dbd3-41e8-8070-644ad81527eb tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:34:34.257068 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-d90bd49e-dbd3-41e8-8070-644ad81527eb tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:34:34.266392 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-d90bd49e-dbd3-41e8-8070-644ad81527eb tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/4d474404-89d1-4844-bf86-75f6464a1a6f" status: 200 len: 1508 microversion: 2.1 time: 0.166105 Jun 17 13:34:34.266959 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1641/3324] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:34:34 2022] GET /compute/v2.1/servers/4d474404-89d1-4844-bf86-75f6464a1a6f => generated 1508 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:34:34.284467 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-5c87b324-65dd-47ab-a2af-52fe6396b3c2 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e8603f2b-6569-4e8e-b17f-5c92b4b7bc2a", "device": "/dev/sdb"}} {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:34:34.286311 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-5c87b324-65dd-47ab-a2af-52fe6396b3c2 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 4d474404-89d1-4844-bf86-75f6464a1a6f] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:34:34.293318 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-5c87b324-65dd-47ab-a2af-52fe6396b3c2 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:34:34.293770 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-5c87b324-65dd-47ab-a2af-52fe6396b3c2 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:34:34.294557 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-5c87b324-65dd-47ab-a2af-52fe6396b3c2 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:34:34.294990 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-5c87b324-65dd-47ab-a2af-52fe6396b3c2 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:34:34.480357 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-cb95cbbd-ef2e-4707-bf1f-a2af5ab0f1b2 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:34:34.480959 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-cb95cbbd-ef2e-4707-bf1f-a2af5ab0f1b2 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: 53ede50e-496d-480c-b292-30e95344eaac] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:34:34.491340 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cb95cbbd-ef2e-4707-bf1f-a2af5ab0f1b2 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:34:34.491890 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cb95cbbd-ef2e-4707-bf1f-a2af5ab0f1b2 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:34:34.492924 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cb95cbbd-ef2e-4707-bf1f-a2af5ab0f1b2 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:34:34.493755 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cb95cbbd-ef2e-4707-bf1f-a2af5ab0f1b2 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:34:34.636407 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-5c87b324-65dd-47ab-a2af-52fe6396b3c2 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "POST /compute/v2.1/servers/4d474404-89d1-4844-bf86-75f6464a1a6f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.356352 Jun 17 13:34:34.637022 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1684/3325] 10.222.0.48 () {60 vars in 1322 bytes} [Fri Jun 17 13:34:34 2022] POST /compute/v2.1/servers/4d474404-89d1-4844-bf86-75f6464a1a6f/os-volume_attachments => generated 194 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:34:34.641345 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-cb95cbbd-ef2e-4707-bf1f-a2af5ab0f1b2 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:34:34.645118 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:34:34.650656 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-cb95cbbd-ef2e-4707-bf1f-a2af5ab0f1b2 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:34:34.652040 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-cb95cbbd-ef2e-4707-bf1f-a2af5ab0f1b2 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:34:34.653283 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-cb95cbbd-ef2e-4707-bf1f-a2af5ab0f1b2 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/53ede50e-496d-480c-b292-30e95344eaac" status: 200 len: 1744 microversion: 2.20 time: 0.178221 Jun 17 13:34:34.654024 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1642/3326] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:34:34 2022] GET /compute/v2.1/servers/53ede50e-496d-480c-b292-30e95344eaac => generated 1744 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:34:35.673616 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-a87c1b62-93c8-4042-b0b7-20b863258694 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:34:35.674361 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-a87c1b62-93c8-4042-b0b7-20b863258694 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: 53ede50e-496d-480c-b292-30e95344eaac] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:34:35.680846 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a87c1b62-93c8-4042-b0b7-20b863258694 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:34:35.681951 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a87c1b62-93c8-4042-b0b7-20b863258694 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:34:35.682756 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a87c1b62-93c8-4042-b0b7-20b863258694 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:34:35.683197 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a87c1b62-93c8-4042-b0b7-20b863258694 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:34:35.833642 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-a87c1b62-93c8-4042-b0b7-20b863258694 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:34:35.842868 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-a87c1b62-93c8-4042-b0b7-20b863258694 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:34:35.844379 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-a87c1b62-93c8-4042-b0b7-20b863258694 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:34:35.845554 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-a87c1b62-93c8-4042-b0b7-20b863258694 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/53ede50e-496d-480c-b292-30e95344eaac" status: 200 len: 1744 microversion: 2.20 time: 0.176902 Jun 17 13:34:35.846531 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1685/3327] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:34:35 2022] GET /compute/v2.1/servers/53ede50e-496d-480c-b292-30e95344eaac => generated 1744 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:34:36.865633 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-6ebb145b-19fe-4a6b-a225-21ccdae2e693 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:34:36.866293 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-6ebb145b-19fe-4a6b-a225-21ccdae2e693 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: 53ede50e-496d-480c-b292-30e95344eaac] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:34:36.874225 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6ebb145b-19fe-4a6b-a225-21ccdae2e693 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:34:36.874711 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6ebb145b-19fe-4a6b-a225-21ccdae2e693 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:34:36.875471 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6ebb145b-19fe-4a6b-a225-21ccdae2e693 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:34:36.875900 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6ebb145b-19fe-4a6b-a225-21ccdae2e693 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:34:37.007309 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-6ebb145b-19fe-4a6b-a225-21ccdae2e693 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:34:37.015855 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-6ebb145b-19fe-4a6b-a225-21ccdae2e693 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:34:37.017328 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-6ebb145b-19fe-4a6b-a225-21ccdae2e693 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:34:37.018576 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-6ebb145b-19fe-4a6b-a225-21ccdae2e693 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/53ede50e-496d-480c-b292-30e95344eaac" status: 200 len: 1744 microversion: 2.20 time: 0.157110 Jun 17 13:34:37.019036 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1643/3328] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:34:36 2022] GET /compute/v2.1/servers/53ede50e-496d-480c-b292-30e95344eaac => generated 1744 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:34:37.702988 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [req-0885c23f-97fa-4f1e-bd27-6ec8af69bdfd req-5ca25a7f-6521-414b-90fb-13637f2c8f89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53ede50e-496d-480c-b292-30e95344eaac", "name": "network-vif-plugged", "status": "completed", "tag": "18820e99-834c-4f86-aa42-a4db70cd683d"}]} {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:34:37.712244 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [req-0885c23f-97fa-4f1e-bd27-6ec8af69bdfd req-5ca25a7f-6521-414b-90fb-13637f2c8f89 service nova] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:34:37.712757 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [req-0885c23f-97fa-4f1e-bd27-6ec8af69bdfd req-5ca25a7f-6521-414b-90fb-13637f2c8f89 service nova] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:34:37.726208 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.compute.server_external_events [req-0885c23f-97fa-4f1e-bd27-6ec8af69bdfd req-5ca25a7f-6521-414b-90fb-13637f2c8f89 service nova] Creating event network-vif-plugged:18820e99-834c-4f86-aa42-a4db70cd683d for instance 53ede50e-496d-480c-b292-30e95344eaac on hv-cinder-83754 Jun 17 13:34:37.731694 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [req-0885c23f-97fa-4f1e-bd27-6ec8af69bdfd req-5ca25a7f-6521-414b-90fb-13637f2c8f89 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032486 Jun 17 13:34:37.732251 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1686/3329] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 13:34:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:34:38.047751 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-b15c2626-af09-471b-90a1-02e0e31a7cf0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:34:38.048701 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-b15c2626-af09-471b-90a1-02e0e31a7cf0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: 53ede50e-496d-480c-b292-30e95344eaac] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:34:38.057953 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b15c2626-af09-471b-90a1-02e0e31a7cf0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:34:38.058426 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b15c2626-af09-471b-90a1-02e0e31a7cf0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:34:38.059179 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b15c2626-af09-471b-90a1-02e0e31a7cf0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:34:38.059605 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b15c2626-af09-471b-90a1-02e0e31a7cf0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:34:38.193723 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-b15c2626-af09-471b-90a1-02e0e31a7cf0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:34:38.204011 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-b15c2626-af09-471b-90a1-02e0e31a7cf0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:34:38.206460 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-b15c2626-af09-471b-90a1-02e0e31a7cf0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:34:38.208206 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-b15c2626-af09-471b-90a1-02e0e31a7cf0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/53ede50e-496d-480c-b292-30e95344eaac" status: 200 len: 1744 microversion: 2.20 time: 0.167636 Jun 17 13:34:38.209023 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1644/3330] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:34:38 2022] GET /compute/v2.1/servers/53ede50e-496d-480c-b292-30e95344eaac => generated 1744 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:34:39.231801 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-49ed09e2-dd8b-416c-82d7-3fc74e4e57bf tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:34:39.232419 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-49ed09e2-dd8b-416c-82d7-3fc74e4e57bf tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: 53ede50e-496d-480c-b292-30e95344eaac] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:34:39.239694 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-49ed09e2-dd8b-416c-82d7-3fc74e4e57bf tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:34:39.240203 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-49ed09e2-dd8b-416c-82d7-3fc74e4e57bf tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:34:39.241032 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-49ed09e2-dd8b-416c-82d7-3fc74e4e57bf tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:34:39.241506 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-49ed09e2-dd8b-416c-82d7-3fc74e4e57bf tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:34:39.376851 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-49ed09e2-dd8b-416c-82d7-3fc74e4e57bf tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:34:39.385591 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-49ed09e2-dd8b-416c-82d7-3fc74e4e57bf tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:34:39.387134 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-49ed09e2-dd8b-416c-82d7-3fc74e4e57bf tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:34:39.388305 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-49ed09e2-dd8b-416c-82d7-3fc74e4e57bf tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/53ede50e-496d-480c-b292-30e95344eaac" status: 200 len: 1744 microversion: 2.20 time: 0.163390 Jun 17 13:34:39.388864 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1687/3331] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:34:39 2022] GET /compute/v2.1/servers/53ede50e-496d-480c-b292-30e95344eaac => generated 1744 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:34:40.407985 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-123a7057-2919-4fe8-a853-06fc163bc395 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:34:40.409479 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-123a7057-2919-4fe8-a853-06fc163bc395 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: 53ede50e-496d-480c-b292-30e95344eaac] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:34:40.416995 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-123a7057-2919-4fe8-a853-06fc163bc395 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:34:40.417535 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-123a7057-2919-4fe8-a853-06fc163bc395 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:34:40.418409 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-123a7057-2919-4fe8-a853-06fc163bc395 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:34:40.419149 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-123a7057-2919-4fe8-a853-06fc163bc395 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:34:40.571521 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-123a7057-2919-4fe8-a853-06fc163bc395 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:34:40.580692 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-123a7057-2919-4fe8-a853-06fc163bc395 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:34:40.582214 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-123a7057-2919-4fe8-a853-06fc163bc395 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:34:40.583626 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-123a7057-2919-4fe8-a853-06fc163bc395 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/53ede50e-496d-480c-b292-30e95344eaac" status: 200 len: 1739 microversion: 2.20 time: 0.180026 Jun 17 13:34:40.584422 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1645/3332] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:34:40 2022] GET /compute/v2.1/servers/53ede50e-496d-480c-b292-30e95344eaac => generated 1739 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:34:41.604128 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-ed6ceb00-fd2b-4cc0-8521-4d4cf2fb4963 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:34:41.605254 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-ed6ceb00-fd2b-4cc0-8521-4d4cf2fb4963 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: 53ede50e-496d-480c-b292-30e95344eaac] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:34:41.619064 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ed6ceb00-fd2b-4cc0-8521-4d4cf2fb4963 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:34:41.620085 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ed6ceb00-fd2b-4cc0-8521-4d4cf2fb4963 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:34:41.621013 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ed6ceb00-fd2b-4cc0-8521-4d4cf2fb4963 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:34:41.621626 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ed6ceb00-fd2b-4cc0-8521-4d4cf2fb4963 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:34:41.881943 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-ed6ceb00-fd2b-4cc0-8521-4d4cf2fb4963 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:34:41.891448 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-ed6ceb00-fd2b-4cc0-8521-4d4cf2fb4963 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:34:41.893707 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-ed6ceb00-fd2b-4cc0-8521-4d4cf2fb4963 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:34:41.895396 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-ed6ceb00-fd2b-4cc0-8521-4d4cf2fb4963 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/53ede50e-496d-480c-b292-30e95344eaac" status: 200 len: 1739 microversion: 2.20 time: 0.295845 Jun 17 13:34:41.907853 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1688/3333] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:34:41 2022] GET /compute/v2.1/servers/53ede50e-496d-480c-b292-30e95344eaac => generated 1739 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:34:42.358555 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-11ada5ed-3283-43e3-8e5b-cfb40fe7bbac tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:34:42.359703 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-11ada5ed-3283-43e3-8e5b-cfb40fe7bbac tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 26622189-19d7-4ce4-b2a8-8f50a6080307] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:34:42.368393 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-11ada5ed-3283-43e3-8e5b-cfb40fe7bbac tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:34:42.368904 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-11ada5ed-3283-43e3-8e5b-cfb40fe7bbac tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:34:42.369826 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-11ada5ed-3283-43e3-8e5b-cfb40fe7bbac tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:34:42.370835 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-11ada5ed-3283-43e3-8e5b-cfb40fe7bbac tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:34:42.409493 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-11ada5ed-3283-43e3-8e5b-cfb40fe7bbac tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/26622189-19d7-4ce4-b2a8-8f50a6080307/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.059001 Jun 17 13:34:42.410540 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1646/3334] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:34:42 2022] GET /compute/v2.1/servers/26622189-19d7-4ce4-b2a8-8f50a6080307/os-volume_attachments => generated 371 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:34:42.554186 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-92141210-fbd2-497c-847d-40544cfd1bd7 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:34:42.555001 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-92141210-fbd2-497c-847d-40544cfd1bd7 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 26622189-19d7-4ce4-b2a8-8f50a6080307] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:34:42.561890 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-92141210-fbd2-497c-847d-40544cfd1bd7 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:34:42.562596 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-92141210-fbd2-497c-847d-40544cfd1bd7 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:34:42.563705 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-92141210-fbd2-497c-847d-40544cfd1bd7 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:34:42.564386 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-92141210-fbd2-497c-847d-40544cfd1bd7 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:34:42.600899 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-92141210-fbd2-497c-847d-40544cfd1bd7 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/26622189-19d7-4ce4-b2a8-8f50a6080307/os-volume_attachments/f7eaf148-2814-43d9-bada-db0f8f5a5900" status: 200 len: 194 microversion: 2.1 time: 0.051531 Jun 17 13:34:42.601631 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1689/3335] 10.222.0.48 () {58 vars in 1412 bytes} [Fri Jun 17 13:34:42 2022] GET /compute/v2.1/servers/26622189-19d7-4ce4-b2a8-8f50a6080307/os-volume_attachments/f7eaf148-2814-43d9-bada-db0f8f5a5900 => generated 194 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:34:42.614738 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-1cf05981-8ffa-4b90-a348-ba0c9cd62c01 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:34:42.615546 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-1cf05981-8ffa-4b90-a348-ba0c9cd62c01 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 26622189-19d7-4ce4-b2a8-8f50a6080307] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:34:42.623740 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1cf05981-8ffa-4b90-a348-ba0c9cd62c01 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:34:42.624625 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1cf05981-8ffa-4b90-a348-ba0c9cd62c01 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:34:42.625675 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1cf05981-8ffa-4b90-a348-ba0c9cd62c01 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:34:42.626439 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1cf05981-8ffa-4b90-a348-ba0c9cd62c01 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:34:42.740027 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.objects.instance [None req-1cf05981-8ffa-4b90-a348-ba0c9cd62c01 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lazy-loading 'services' on Instance uuid 26622189-19d7-4ce4-b2a8-8f50a6080307 {{(pid=117660) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 13:34:42.823753 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-1cf05981-8ffa-4b90-a348-ba0c9cd62c01 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "DELETE /compute/v2.1/servers/26622189-19d7-4ce4-b2a8-8f50a6080307/os-volume_attachments/f7eaf148-2814-43d9-bada-db0f8f5a5900" status: 202 len: 0 microversion: 2.1 time: 0.212839 Jun 17 13:34:42.832573 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1647/3336] 10.222.0.48 () {58 vars in 1415 bytes} [Fri Jun 17 13:34:42 2022] DELETE /compute/v2.1/servers/26622189-19d7-4ce4-b2a8-8f50a6080307/os-volume_attachments/f7eaf148-2814-43d9-bada-db0f8f5a5900 => generated 0 bytes in 223 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 13:34:42.914520 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-ea6cc7cd-85a1-4db9-92a3-a64085325add tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:34:42.915288 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-ea6cc7cd-85a1-4db9-92a3-a64085325add tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: 53ede50e-496d-480c-b292-30e95344eaac] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:34:42.922149 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ea6cc7cd-85a1-4db9-92a3-a64085325add tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:34:42.922536 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ea6cc7cd-85a1-4db9-92a3-a64085325add tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:34:42.923310 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ea6cc7cd-85a1-4db9-92a3-a64085325add tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:34:42.923746 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ea6cc7cd-85a1-4db9-92a3-a64085325add tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:34:43.095758 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-ea6cc7cd-85a1-4db9-92a3-a64085325add tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:34:43.105980 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-ea6cc7cd-85a1-4db9-92a3-a64085325add tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:34:43.106951 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-ea6cc7cd-85a1-4db9-92a3-a64085325add tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:34:43.108322 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-ea6cc7cd-85a1-4db9-92a3-a64085325add tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/53ede50e-496d-480c-b292-30e95344eaac" status: 200 len: 1739 microversion: 2.20 time: 0.198010 Jun 17 13:34:43.109051 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1690/3337] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:34:42 2022] GET /compute/v2.1/servers/53ede50e-496d-480c-b292-30e95344eaac => generated 1739 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:34:44.128232 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-52e7b446-5493-4f36-a042-d796658436e1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:34:44.129679 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-52e7b446-5493-4f36-a042-d796658436e1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: 53ede50e-496d-480c-b292-30e95344eaac] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:34:44.136684 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-52e7b446-5493-4f36-a042-d796658436e1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:34:44.137135 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-52e7b446-5493-4f36-a042-d796658436e1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:34:44.137900 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-52e7b446-5493-4f36-a042-d796658436e1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:34:44.138367 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-52e7b446-5493-4f36-a042-d796658436e1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:34:44.558827 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-52e7b446-5493-4f36-a042-d796658436e1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:34:44.567453 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-52e7b446-5493-4f36-a042-d796658436e1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:34:44.569225 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-52e7b446-5493-4f36-a042-d796658436e1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:34:44.570413 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-52e7b446-5493-4f36-a042-d796658436e1 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/53ede50e-496d-480c-b292-30e95344eaac" status: 200 len: 1739 microversion: 2.20 time: 0.446981 Jun 17 13:34:44.570959 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1648/3338] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:34:44 2022] GET /compute/v2.1/servers/53ede50e-496d-480c-b292-30e95344eaac => generated 1739 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:34:45.592605 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-f28dd916-ff71-4e27-9e05-d28d26ff6f68 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:34:45.594110 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-f28dd916-ff71-4e27-9e05-d28d26ff6f68 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: 53ede50e-496d-480c-b292-30e95344eaac] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:34:45.602280 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f28dd916-ff71-4e27-9e05-d28d26ff6f68 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:34:45.602783 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f28dd916-ff71-4e27-9e05-d28d26ff6f68 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:34:45.603684 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f28dd916-ff71-4e27-9e05-d28d26ff6f68 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:34:45.604116 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f28dd916-ff71-4e27-9e05-d28d26ff6f68 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:34:45.762210 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-f28dd916-ff71-4e27-9e05-d28d26ff6f68 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:34:45.772392 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-f28dd916-ff71-4e27-9e05-d28d26ff6f68 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:34:45.774340 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-f28dd916-ff71-4e27-9e05-d28d26ff6f68 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:34:45.776228 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-f28dd916-ff71-4e27-9e05-d28d26ff6f68 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/53ede50e-496d-480c-b292-30e95344eaac" status: 200 len: 1739 microversion: 2.20 time: 0.188395 Jun 17 13:34:45.776979 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1691/3339] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:34:45 2022] GET /compute/v2.1/servers/53ede50e-496d-480c-b292-30e95344eaac => generated 1739 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:34:46.795872 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-d28adcd3-bde6-4e8f-834d-2b88e61a6b79 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:34:46.797676 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-d28adcd3-bde6-4e8f-834d-2b88e61a6b79 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: 53ede50e-496d-480c-b292-30e95344eaac] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:34:46.804841 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d28adcd3-bde6-4e8f-834d-2b88e61a6b79 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:34:46.805482 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d28adcd3-bde6-4e8f-834d-2b88e61a6b79 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:34:46.806448 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d28adcd3-bde6-4e8f-834d-2b88e61a6b79 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:34:46.807080 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d28adcd3-bde6-4e8f-834d-2b88e61a6b79 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:34:46.946474 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-d28adcd3-bde6-4e8f-834d-2b88e61a6b79 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:34:46.956550 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-d28adcd3-bde6-4e8f-834d-2b88e61a6b79 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:34:46.958056 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-d28adcd3-bde6-4e8f-834d-2b88e61a6b79 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:34:46.959281 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-d28adcd3-bde6-4e8f-834d-2b88e61a6b79 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/53ede50e-496d-480c-b292-30e95344eaac" status: 200 len: 1739 microversion: 2.20 time: 0.167665 Jun 17 13:34:46.969997 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1649/3340] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:34:46 2022] GET /compute/v2.1/servers/53ede50e-496d-480c-b292-30e95344eaac => generated 1739 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:34:47.977091 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-b94185e2-cad6-4989-b0d9-ed652a7876c7 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:34:47.978556 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-b94185e2-cad6-4989-b0d9-ed652a7876c7 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: 53ede50e-496d-480c-b292-30e95344eaac] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:34:47.985305 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b94185e2-cad6-4989-b0d9-ed652a7876c7 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:34:47.985911 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b94185e2-cad6-4989-b0d9-ed652a7876c7 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:34:47.986918 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b94185e2-cad6-4989-b0d9-ed652a7876c7 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:34:47.987346 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b94185e2-cad6-4989-b0d9-ed652a7876c7 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:34:48.134770 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-b94185e2-cad6-4989-b0d9-ed652a7876c7 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:34:48.145912 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-b94185e2-cad6-4989-b0d9-ed652a7876c7 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:34:48.148069 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-b94185e2-cad6-4989-b0d9-ed652a7876c7 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:34:48.149317 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-b94185e2-cad6-4989-b0d9-ed652a7876c7 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/53ede50e-496d-480c-b292-30e95344eaac" status: 200 len: 1739 microversion: 2.20 time: 0.176360 Jun 17 13:34:48.161348 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1692/3341] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:34:47 2022] GET /compute/v2.1/servers/53ede50e-496d-480c-b292-30e95344eaac => generated 1739 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:34:49.169458 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-adf9bc8c-ead9-4225-875b-414b62fa1edf tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:34:49.170929 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-adf9bc8c-ead9-4225-875b-414b62fa1edf tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: 53ede50e-496d-480c-b292-30e95344eaac] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:34:49.175355 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_api:SELECT=51 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:34:49.180248 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-adf9bc8c-ead9-4225-875b-414b62fa1edf tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:34:49.180868 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-adf9bc8c-ead9-4225-875b-414b62fa1edf tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:34:49.181654 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-adf9bc8c-ead9-4225-875b-414b62fa1edf tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:34:49.182081 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-adf9bc8c-ead9-4225-875b-414b62fa1edf tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:34:49.334986 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-adf9bc8c-ead9-4225-875b-414b62fa1edf tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:34:49.344887 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-adf9bc8c-ead9-4225-875b-414b62fa1edf tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:34:49.346402 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-adf9bc8c-ead9-4225-875b-414b62fa1edf tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:34:49.347570 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-adf9bc8c-ead9-4225-875b-414b62fa1edf tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/53ede50e-496d-480c-b292-30e95344eaac" status: 200 len: 1739 microversion: 2.20 time: 0.182914 Jun 17 13:34:49.348156 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1650/3342] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:34:49 2022] GET /compute/v2.1/servers/53ede50e-496d-480c-b292-30e95344eaac => generated 1739 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:34:50.366987 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-dd5c4cc2-69d5-4d4e-b311-06cac5913a8f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:34:50.367575 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-dd5c4cc2-69d5-4d4e-b311-06cac5913a8f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: 53ede50e-496d-480c-b292-30e95344eaac] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:34:50.370151 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=3 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:34:50.375566 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-dd5c4cc2-69d5-4d4e-b311-06cac5913a8f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:34:50.376040 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-dd5c4cc2-69d5-4d4e-b311-06cac5913a8f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:34:50.376791 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-dd5c4cc2-69d5-4d4e-b311-06cac5913a8f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:34:50.377215 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-dd5c4cc2-69d5-4d4e-b311-06cac5913a8f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:34:50.411018 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-30aed0a9-2210-4850-86a8-ea64f8f21c51 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:34:50.411603 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-30aed0a9-2210-4850-86a8-ea64f8f21c51 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 26622189-19d7-4ce4-b2a8-8f50a6080307] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:34:50.418253 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-30aed0a9-2210-4850-86a8-ea64f8f21c51 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:34:50.418704 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-30aed0a9-2210-4850-86a8-ea64f8f21c51 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:34:50.419468 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-30aed0a9-2210-4850-86a8-ea64f8f21c51 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:34:50.419872 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-30aed0a9-2210-4850-86a8-ea64f8f21c51 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:34:50.449557 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-30aed0a9-2210-4850-86a8-ea64f8f21c51 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/26622189-19d7-4ce4-b2a8-8f50a6080307/os-volume_attachments/da02cb65-a3b7-45c9-8717-19e5d09e7d30" status: 200 len: 194 microversion: 2.1 time: 0.042574 Jun 17 13:34:50.450079 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1651/3343] 10.222.0.48 () {58 vars in 1412 bytes} [Fri Jun 17 13:34:50 2022] GET /compute/v2.1/servers/26622189-19d7-4ce4-b2a8-8f50a6080307/os-volume_attachments/da02cb65-a3b7-45c9-8717-19e5d09e7d30 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:34:50.459718 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-09a7a531-c3b4-4fd6-8707-93d02044733d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:34:50.460056 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-09a7a531-c3b4-4fd6-8707-93d02044733d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 26622189-19d7-4ce4-b2a8-8f50a6080307] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:34:50.466212 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-09a7a531-c3b4-4fd6-8707-93d02044733d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:34:50.466660 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-09a7a531-c3b4-4fd6-8707-93d02044733d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:34:50.467404 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-09a7a531-c3b4-4fd6-8707-93d02044733d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:34:50.467839 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-09a7a531-c3b4-4fd6-8707-93d02044733d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:34:50.514324 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-dd5c4cc2-69d5-4d4e-b311-06cac5913a8f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:34:50.522270 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-dd5c4cc2-69d5-4d4e-b311-06cac5913a8f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:34:50.523737 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-dd5c4cc2-69d5-4d4e-b311-06cac5913a8f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:34:50.524921 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-dd5c4cc2-69d5-4d4e-b311-06cac5913a8f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/53ede50e-496d-480c-b292-30e95344eaac" status: 200 len: 1721 microversion: 2.20 time: 0.161833 Jun 17 13:34:50.525474 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1693/3344] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:34:50 2022] GET /compute/v2.1/servers/53ede50e-496d-480c-b292-30e95344eaac => generated 1721 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:34:50.553446 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.objects.instance [None req-09a7a531-c3b4-4fd6-8707-93d02044733d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lazy-loading 'services' on Instance uuid 26622189-19d7-4ce4-b2a8-8f50a6080307 {{(pid=117660) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 13:34:50.630529 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-09a7a531-c3b4-4fd6-8707-93d02044733d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "DELETE /compute/v2.1/servers/26622189-19d7-4ce4-b2a8-8f50a6080307/os-volume_attachments/da02cb65-a3b7-45c9-8717-19e5d09e7d30" status: 202 len: 0 microversion: 2.1 time: 0.174443 Jun 17 13:34:50.631149 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1652/3345] 10.222.0.48 () {58 vars in 1415 bytes} [Fri Jun 17 13:34:50 2022] DELETE /compute/v2.1/servers/26622189-19d7-4ce4-b2a8-8f50a6080307/os-volume_attachments/da02cb65-a3b7-45c9-8717-19e5d09e7d30 => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 17 13:34:51.547932 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-3c3411c0-c2de-407f-bac8-63d33ece7642 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:34:51.548992 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-3c3411c0-c2de-407f-bac8-63d33ece7642 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: 53ede50e-496d-480c-b292-30e95344eaac] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:34:51.558617 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-3c3411c0-c2de-407f-bac8-63d33ece7642 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:34:51.559075 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-3c3411c0-c2de-407f-bac8-63d33ece7642 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:34:51.559834 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-3c3411c0-c2de-407f-bac8-63d33ece7642 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:34:51.560276 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-3c3411c0-c2de-407f-bac8-63d33ece7642 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:34:51.726532 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-3c3411c0-c2de-407f-bac8-63d33ece7642 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:34:51.736311 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-3c3411c0-c2de-407f-bac8-63d33ece7642 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:34:51.737916 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-3c3411c0-c2de-407f-bac8-63d33ece7642 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:34:51.739558 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-3c3411c0-c2de-407f-bac8-63d33ece7642 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/53ede50e-496d-480c-b292-30e95344eaac" status: 200 len: 1721 microversion: 2.20 time: 0.198393 Jun 17 13:34:51.742746 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1694/3346] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:34:51 2022] GET /compute/v2.1/servers/53ede50e-496d-480c-b292-30e95344eaac => generated 1721 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:34:52.761556 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-e3c090ad-abbd-46bc-b9c6-fc802f601ea8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:34:52.762239 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-e3c090ad-abbd-46bc-b9c6-fc802f601ea8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: 53ede50e-496d-480c-b292-30e95344eaac] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:34:52.768803 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e3c090ad-abbd-46bc-b9c6-fc802f601ea8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:34:52.769252 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e3c090ad-abbd-46bc-b9c6-fc802f601ea8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:34:52.770019 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e3c090ad-abbd-46bc-b9c6-fc802f601ea8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:34:52.770497 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e3c090ad-abbd-46bc-b9c6-fc802f601ea8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:34:52.902315 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-e3c090ad-abbd-46bc-b9c6-fc802f601ea8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:34:52.910617 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-e3c090ad-abbd-46bc-b9c6-fc802f601ea8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:34:52.912126 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-e3c090ad-abbd-46bc-b9c6-fc802f601ea8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:34:52.913294 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-e3c090ad-abbd-46bc-b9c6-fc802f601ea8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/53ede50e-496d-480c-b292-30e95344eaac" status: 200 len: 1721 microversion: 2.20 time: 0.157761 Jun 17 13:34:52.913856 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1653/3347] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:34:52 2022] GET /compute/v2.1/servers/53ede50e-496d-480c-b292-30e95344eaac => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:34:53.931926 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-5bd83fc4-a6c5-42db-9be2-8f95b1a2f2e6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:34:53.932504 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-5bd83fc4-a6c5-42db-9be2-8f95b1a2f2e6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: 53ede50e-496d-480c-b292-30e95344eaac] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:34:53.939241 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-5bd83fc4-a6c5-42db-9be2-8f95b1a2f2e6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:34:53.939692 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-5bd83fc4-a6c5-42db-9be2-8f95b1a2f2e6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:34:53.940441 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-5bd83fc4-a6c5-42db-9be2-8f95b1a2f2e6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:34:53.940872 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-5bd83fc4-a6c5-42db-9be2-8f95b1a2f2e6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:34:54.083986 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-5bd83fc4-a6c5-42db-9be2-8f95b1a2f2e6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:34:54.092657 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-5bd83fc4-a6c5-42db-9be2-8f95b1a2f2e6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:34:54.094182 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-5bd83fc4-a6c5-42db-9be2-8f95b1a2f2e6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:34:54.095341 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-5bd83fc4-a6c5-42db-9be2-8f95b1a2f2e6 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/53ede50e-496d-480c-b292-30e95344eaac" status: 200 len: 1721 microversion: 2.20 time: 0.167612 Jun 17 13:34:54.095895 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1695/3348] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:34:53 2022] GET /compute/v2.1/servers/53ede50e-496d-480c-b292-30e95344eaac => generated 1721 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:34:54.873476 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [req-d172a2ba-4374-416a-ab14-010648e54da6 req-e4a8f353-1e4d-4e5e-b20e-3570262be8db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53ede50e-496d-480c-b292-30e95344eaac", "name": "network-vif-unplugged", "status": "completed", "tag": "18820e99-834c-4f86-aa42-a4db70cd683d"}]} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:34:54.882418 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-d172a2ba-4374-416a-ab14-010648e54da6 req-e4a8f353-1e4d-4e5e-b20e-3570262be8db service nova] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:34:54.882875 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-d172a2ba-4374-416a-ab14-010648e54da6 req-e4a8f353-1e4d-4e5e-b20e-3570262be8db service nova] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:34:54.896498 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.compute.server_external_events [req-d172a2ba-4374-416a-ab14-010648e54da6 req-e4a8f353-1e4d-4e5e-b20e-3570262be8db service nova] Creating event network-vif-unplugged:18820e99-834c-4f86-aa42-a4db70cd683d for instance 53ede50e-496d-480c-b292-30e95344eaac on hv-cinder-83754 Jun 17 13:34:54.901843 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [req-d172a2ba-4374-416a-ab14-010648e54da6 req-e4a8f353-1e4d-4e5e-b20e-3570262be8db service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031911 Jun 17 13:34:54.902748 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1654/3349] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 13:34:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:34:55.114341 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-c12bb3fa-8538-451a-9b43-90a8f5f20768 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:34:55.114966 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-c12bb3fa-8538-451a-9b43-90a8f5f20768 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: 53ede50e-496d-480c-b292-30e95344eaac] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:34:55.121927 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c12bb3fa-8538-451a-9b43-90a8f5f20768 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:34:55.122410 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c12bb3fa-8538-451a-9b43-90a8f5f20768 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:34:55.123175 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c12bb3fa-8538-451a-9b43-90a8f5f20768 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:34:55.123610 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c12bb3fa-8538-451a-9b43-90a8f5f20768 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:34:55.260778 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-c12bb3fa-8538-451a-9b43-90a8f5f20768 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:34:55.268728 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-c12bb3fa-8538-451a-9b43-90a8f5f20768 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:34:55.270255 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-c12bb3fa-8538-451a-9b43-90a8f5f20768 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:34:55.271426 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-c12bb3fa-8538-451a-9b43-90a8f5f20768 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/53ede50e-496d-480c-b292-30e95344eaac" status: 200 len: 1721 microversion: 2.20 time: 0.161095 Jun 17 13:34:55.271991 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1696/3350] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:34:55 2022] GET /compute/v2.1/servers/53ede50e-496d-480c-b292-30e95344eaac => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:34:56.070343 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-93843fe0-72a2-4c0d-adba-6b5ea32d48be tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:34:56.071744 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-93843fe0-72a2-4c0d-adba-6b5ea32d48be tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 26622189-19d7-4ce4-b2a8-8f50a6080307] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:34:56.078000 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-93843fe0-72a2-4c0d-adba-6b5ea32d48be tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:34:56.078562 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-93843fe0-72a2-4c0d-adba-6b5ea32d48be tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:34:56.079408 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-93843fe0-72a2-4c0d-adba-6b5ea32d48be tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:34:56.079840 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-93843fe0-72a2-4c0d-adba-6b5ea32d48be tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:34:56.108685 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-93843fe0-72a2-4c0d-adba-6b5ea32d48be tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/26622189-19d7-4ce4-b2a8-8f50a6080307/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043044 Jun 17 13:34:56.109320 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1655/3351] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:34:56 2022] GET /compute/v2.1/servers/26622189-19d7-4ce4-b2a8-8f50a6080307/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:34:56.290753 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-2c36c5b2-bf26-4ced-88b8-bd7ef24c36ab tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:34:56.291356 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-2c36c5b2-bf26-4ced-88b8-bd7ef24c36ab tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: 53ede50e-496d-480c-b292-30e95344eaac] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:34:56.298558 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2c36c5b2-bf26-4ced-88b8-bd7ef24c36ab tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:34:56.299016 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2c36c5b2-bf26-4ced-88b8-bd7ef24c36ab tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:34:56.299780 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2c36c5b2-bf26-4ced-88b8-bd7ef24c36ab tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:34:56.300221 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2c36c5b2-bf26-4ced-88b8-bd7ef24c36ab tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:34:56.304221 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:34:56.444066 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-2c36c5b2-bf26-4ced-88b8-bd7ef24c36ab tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:34:56.452548 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-2c36c5b2-bf26-4ced-88b8-bd7ef24c36ab tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:34:56.454142 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-2c36c5b2-bf26-4ced-88b8-bd7ef24c36ab tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:34:56.455236 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-2c36c5b2-bf26-4ced-88b8-bd7ef24c36ab tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/53ede50e-496d-480c-b292-30e95344eaac" status: 200 len: 1721 microversion: 2.20 time: 0.168582 Jun 17 13:34:56.455802 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1697/3352] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:34:56 2022] GET /compute/v2.1/servers/53ede50e-496d-480c-b292-30e95344eaac => generated 1721 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:34:57.122279 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-1e92487e-29d3-49af-9e19-06ac7e0d7eef tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:34:57.123199 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-1e92487e-29d3-49af-9e19-06ac7e0d7eef tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 26622189-19d7-4ce4-b2a8-8f50a6080307] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:34:57.130453 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1e92487e-29d3-49af-9e19-06ac7e0d7eef tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:34:57.130896 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1e92487e-29d3-49af-9e19-06ac7e0d7eef tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:34:57.131649 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1e92487e-29d3-49af-9e19-06ac7e0d7eef tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:34:57.132110 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1e92487e-29d3-49af-9e19-06ac7e0d7eef tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:34:57.163089 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-1e92487e-29d3-49af-9e19-06ac7e0d7eef tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/26622189-19d7-4ce4-b2a8-8f50a6080307/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045179 Jun 17 13:34:57.163633 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1656/3353] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:34:57 2022] GET /compute/v2.1/servers/26622189-19d7-4ce4-b2a8-8f50a6080307/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:34:57.484380 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-101faec1-d55a-434e-ae12-76e797c75a81 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:34:57.485304 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-101faec1-d55a-434e-ae12-76e797c75a81 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: 53ede50e-496d-480c-b292-30e95344eaac] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:34:57.496181 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-101faec1-d55a-434e-ae12-76e797c75a81 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:34:57.496918 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-101faec1-d55a-434e-ae12-76e797c75a81 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:34:57.498156 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-101faec1-d55a-434e-ae12-76e797c75a81 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:34:57.498909 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-101faec1-d55a-434e-ae12-76e797c75a81 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:34:57.644423 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-101faec1-d55a-434e-ae12-76e797c75a81 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:34:57.652625 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-101faec1-d55a-434e-ae12-76e797c75a81 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:34:57.654126 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-101faec1-d55a-434e-ae12-76e797c75a81 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:34:57.655296 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-101faec1-d55a-434e-ae12-76e797c75a81 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/53ede50e-496d-480c-b292-30e95344eaac" status: 200 len: 1721 microversion: 2.20 time: 0.177890 Jun 17 13:34:57.655858 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1698/3354] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:34:57 2022] GET /compute/v2.1/servers/53ede50e-496d-480c-b292-30e95344eaac => generated 1721 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:34:58.175552 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-c4332d83-fbe1-4baf-9f08-150bd61c177c tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:34:58.176482 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-c4332d83-fbe1-4baf-9f08-150bd61c177c tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 26622189-19d7-4ce4-b2a8-8f50a6080307] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:34:58.183130 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c4332d83-fbe1-4baf-9f08-150bd61c177c tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:34:58.183581 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c4332d83-fbe1-4baf-9f08-150bd61c177c tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:34:58.184345 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c4332d83-fbe1-4baf-9f08-150bd61c177c tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:34:58.184787 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c4332d83-fbe1-4baf-9f08-150bd61c177c tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:34:58.214385 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-c4332d83-fbe1-4baf-9f08-150bd61c177c tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/26622189-19d7-4ce4-b2a8-8f50a6080307/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042737 Jun 17 13:34:58.214944 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1657/3355] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:34:58 2022] GET /compute/v2.1/servers/26622189-19d7-4ce4-b2a8-8f50a6080307/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:34:58.676889 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-725c971d-892e-4e5f-a87a-458ba9da264c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:34:58.677858 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-725c971d-892e-4e5f-a87a-458ba9da264c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: 53ede50e-496d-480c-b292-30e95344eaac] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:34:58.689310 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-725c971d-892e-4e5f-a87a-458ba9da264c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:34:58.690061 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-725c971d-892e-4e5f-a87a-458ba9da264c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:34:58.691364 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-725c971d-892e-4e5f-a87a-458ba9da264c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:34:58.692094 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-725c971d-892e-4e5f-a87a-458ba9da264c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:34:58.838564 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-725c971d-892e-4e5f-a87a-458ba9da264c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:34:58.851203 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-725c971d-892e-4e5f-a87a-458ba9da264c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:34:58.853185 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-725c971d-892e-4e5f-a87a-458ba9da264c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:34:58.854407 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-725c971d-892e-4e5f-a87a-458ba9da264c tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/53ede50e-496d-480c-b292-30e95344eaac" status: 200 len: 1721 microversion: 2.20 time: 0.184129 Jun 17 13:34:58.855269 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1699/3356] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:34:58 2022] GET /compute/v2.1/servers/53ede50e-496d-480c-b292-30e95344eaac => generated 1721 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:34:59.228768 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-ff25a4b6-25f1-4e76-9618-a7be3dbf38a6 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:34:59.230176 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-ff25a4b6-25f1-4e76-9618-a7be3dbf38a6 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 26622189-19d7-4ce4-b2a8-8f50a6080307] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:34:59.240146 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ff25a4b6-25f1-4e76-9618-a7be3dbf38a6 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:34:59.240758 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ff25a4b6-25f1-4e76-9618-a7be3dbf38a6 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:34:59.241891 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ff25a4b6-25f1-4e76-9618-a7be3dbf38a6 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:34:59.242607 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ff25a4b6-25f1-4e76-9618-a7be3dbf38a6 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:34:59.267712 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:34:59.272695 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-ff25a4b6-25f1-4e76-9618-a7be3dbf38a6 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/26622189-19d7-4ce4-b2a8-8f50a6080307/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050363 Jun 17 13:34:59.273237 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1658/3357] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:34:59 2022] GET /compute/v2.1/servers/26622189-19d7-4ce4-b2a8-8f50a6080307/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:34:59.877463 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-dcec8bb3-3286-47d1-83ee-4bb552bf13c7 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:34:59.878565 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-dcec8bb3-3286-47d1-83ee-4bb552bf13c7 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: 53ede50e-496d-480c-b292-30e95344eaac] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:34:59.889770 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-dcec8bb3-3286-47d1-83ee-4bb552bf13c7 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:34:59.890583 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-dcec8bb3-3286-47d1-83ee-4bb552bf13c7 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:34:59.891839 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-dcec8bb3-3286-47d1-83ee-4bb552bf13c7 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:34:59.892581 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-dcec8bb3-3286-47d1-83ee-4bb552bf13c7 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:35:00.042064 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-dcec8bb3-3286-47d1-83ee-4bb552bf13c7 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:35:00.050395 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-dcec8bb3-3286-47d1-83ee-4bb552bf13c7 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:35:00.051885 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-dcec8bb3-3286-47d1-83ee-4bb552bf13c7 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:35:00.053038 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-dcec8bb3-3286-47d1-83ee-4bb552bf13c7 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/53ede50e-496d-480c-b292-30e95344eaac" status: 200 len: 1721 microversion: 2.20 time: 0.182726 Jun 17 13:35:00.053600 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1700/3358] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:34:59 2022] GET /compute/v2.1/servers/53ede50e-496d-480c-b292-30e95344eaac => generated 1721 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:35:00.284972 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-a6443642-87db-44d0-b321-8c7d3e3c6748 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:35:00.285898 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-a6443642-87db-44d0-b321-8c7d3e3c6748 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 26622189-19d7-4ce4-b2a8-8f50a6080307] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:35:00.293954 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a6443642-87db-44d0-b321-8c7d3e3c6748 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:35:00.294389 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a6443642-87db-44d0-b321-8c7d3e3c6748 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:35:00.295426 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a6443642-87db-44d0-b321-8c7d3e3c6748 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:35:00.295846 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a6443642-87db-44d0-b321-8c7d3e3c6748 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:35:00.327730 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-a6443642-87db-44d0-b321-8c7d3e3c6748 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/26622189-19d7-4ce4-b2a8-8f50a6080307/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047075 Jun 17 13:35:00.328298 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1659/3359] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:35:00 2022] GET /compute/v2.1/servers/26622189-19d7-4ce4-b2a8-8f50a6080307/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:35:01.074979 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-6fbcce59-19e0-4cbb-baa7-5a82f3eea413 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:35:01.075711 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-6fbcce59-19e0-4cbb-baa7-5a82f3eea413 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: 53ede50e-496d-480c-b292-30e95344eaac] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:35:01.084085 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6fbcce59-19e0-4cbb-baa7-5a82f3eea413 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:35:01.084645 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6fbcce59-19e0-4cbb-baa7-5a82f3eea413 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:35:01.085580 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6fbcce59-19e0-4cbb-baa7-5a82f3eea413 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:35:01.086150 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6fbcce59-19e0-4cbb-baa7-5a82f3eea413 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:35:01.224893 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-6fbcce59-19e0-4cbb-baa7-5a82f3eea413 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:35:01.234603 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-6fbcce59-19e0-4cbb-baa7-5a82f3eea413 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:35:01.236088 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-6fbcce59-19e0-4cbb-baa7-5a82f3eea413 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:35:01.237249 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-6fbcce59-19e0-4cbb-baa7-5a82f3eea413 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/53ede50e-496d-480c-b292-30e95344eaac" status: 200 len: 1724 microversion: 2.20 time: 0.168209 Jun 17 13:35:01.237804 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1701/3360] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:35:01 2022] GET /compute/v2.1/servers/53ede50e-496d-480c-b292-30e95344eaac => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:35:01.256774 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-6e72b5cb-c6c6-4849-a922-388181a43203 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4452e947-4568-4fd6-9958-d8ed22fc74dc"}} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:35:01.257838 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-6e72b5cb-c6c6-4849-a922-388181a43203 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: 53ede50e-496d-480c-b292-30e95344eaac] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:35:01.264419 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6e72b5cb-c6c6-4849-a922-388181a43203 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:35:01.264855 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6e72b5cb-c6c6-4849-a922-388181a43203 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:35:01.265857 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6e72b5cb-c6c6-4849-a922-388181a43203 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:35:01.266321 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6e72b5cb-c6c6-4849-a922-388181a43203 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:35:01.339203 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-2457be01-67da-44f1-a6a0-a490dd4fa839 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:35:01.340353 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-2457be01-67da-44f1-a6a0-a490dd4fa839 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 26622189-19d7-4ce4-b2a8-8f50a6080307] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:35:01.346900 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2457be01-67da-44f1-a6a0-a490dd4fa839 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:35:01.347639 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2457be01-67da-44f1-a6a0-a490dd4fa839 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:35:01.348705 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2457be01-67da-44f1-a6a0-a490dd4fa839 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:35:01.349522 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2457be01-67da-44f1-a6a0-a490dd4fa839 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:35:01.384172 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-2457be01-67da-44f1-a6a0-a490dd4fa839 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/26622189-19d7-4ce4-b2a8-8f50a6080307/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048959 Jun 17 13:35:01.389774 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1702/3361] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:35:01 2022] GET /compute/v2.1/servers/26622189-19d7-4ce4-b2a8-8f50a6080307/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 17 13:35:01.524554 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-51d3616b-3640-4f18-af17-a9bf84327533 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:35:01.525628 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-51d3616b-3640-4f18-af17-a9bf84327533 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 26622189-19d7-4ce4-b2a8-8f50a6080307] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:35:01.532017 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-51d3616b-3640-4f18-af17-a9bf84327533 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:35:01.532534 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-51d3616b-3640-4f18-af17-a9bf84327533 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:35:01.533345 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-51d3616b-3640-4f18-af17-a9bf84327533 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:35:01.533843 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-51d3616b-3640-4f18-af17-a9bf84327533 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:35:01.564888 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-51d3616b-3640-4f18-af17-a9bf84327533 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/26622189-19d7-4ce4-b2a8-8f50a6080307/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044555 Jun 17 13:35:01.565454 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1703/3362] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:35:01 2022] GET /compute/v2.1/servers/26622189-19d7-4ce4-b2a8-8f50a6080307/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 17 13:35:01.583649 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-6e72b5cb-c6c6-4849-a922-388181a43203 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "POST /compute/v2.1/servers/53ede50e-496d-480c-b292-30e95344eaac/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.330805 Jun 17 13:35:01.584614 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1660/3363] 10.222.0.48 () {62 vars in 1363 bytes} [Fri Jun 17 13:35:01 2022] POST /compute/v2.1/servers/53ede50e-496d-480c-b292-30e95344eaac/os-volume_attachments => generated 188 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 13:35:01.628867 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-a71e08a2-60ed-4889-ac01-4945d2e97cac tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:35:01.629361 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-a71e08a2-60ed-4889-ac01-4945d2e97cac tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 26622189-19d7-4ce4-b2a8-8f50a6080307] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:35:01.636219 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a71e08a2-60ed-4889-ac01-4945d2e97cac tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:35:01.636669 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a71e08a2-60ed-4889-ac01-4945d2e97cac tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:35:01.637594 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a71e08a2-60ed-4889-ac01-4945d2e97cac tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:35:01.638031 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a71e08a2-60ed-4889-ac01-4945d2e97cac tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:35:01.665598 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-a71e08a2-60ed-4889-ac01-4945d2e97cac tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 26622189-19d7-4ce4-b2a8-8f50a6080307] Going to try to terminate instance {{(pid=117659) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 17 13:35:01.712152 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-6fe5bb8e-4237-41bb-bbad-f9768180c792 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:35:01.712578 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-6fe5bb8e-4237-41bb-bbad-f9768180c792 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: 53ede50e-496d-480c-b292-30e95344eaac] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:35:01.721118 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6fe5bb8e-4237-41bb-bbad-f9768180c792 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:35:01.721563 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6fe5bb8e-4237-41bb-bbad-f9768180c792 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:35:01.722405 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6fe5bb8e-4237-41bb-bbad-f9768180c792 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:35:01.722815 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6fe5bb8e-4237-41bb-bbad-f9768180c792 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:35:01.758260 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-a71e08a2-60ed-4889-ac01-4945d2e97cac tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "DELETE /compute/v2.1/servers/26622189-19d7-4ce4-b2a8-8f50a6080307" status: 204 len: 0 microversion: 2.1 time: 0.132830 Jun 17 13:35:01.762756 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1704/3364] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Jun 17 13:35:01 2022] DELETE /compute/v2.1/servers/26622189-19d7-4ce4-b2a8-8f50a6080307 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 17 13:35:01.770615 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-28635807-1662-4204-926e-3ee8c628551d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:35:01.771319 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-28635807-1662-4204-926e-3ee8c628551d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 26622189-19d7-4ce4-b2a8-8f50a6080307] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:35:01.777734 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-28635807-1662-4204-926e-3ee8c628551d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:35:01.778210 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-28635807-1662-4204-926e-3ee8c628551d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:35:01.779031 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-28635807-1662-4204-926e-3ee8c628551d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:35:01.779461 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-28635807-1662-4204-926e-3ee8c628551d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:35:01.919340 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-28635807-1662-4204-926e-3ee8c628551d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:35:01.926904 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-28635807-1662-4204-926e-3ee8c628551d tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/26622189-19d7-4ce4-b2a8-8f50a6080307" status: 200 len: 1674 microversion: 2.1 time: 0.160376 Jun 17 13:35:01.927474 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1705/3365] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:35:01 2022] GET /compute/v2.1/servers/26622189-19d7-4ce4-b2a8-8f50a6080307 => generated 1674 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:35:01.995727 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-6fe5bb8e-4237-41bb-bbad-f9768180c792 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "DELETE /compute/v2.1/servers/53ede50e-496d-480c-b292-30e95344eaac/os-volume_attachments/4452e947-4568-4fd6-9958-d8ed22fc74dc" status: 202 len: 0 microversion: 2.20 time: 0.287729 Jun 17 13:35:01.996452 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1661/3366] 10.222.0.48 () {60 vars in 1456 bytes} [Fri Jun 17 13:35:01 2022] DELETE /compute/v2.1/servers/53ede50e-496d-480c-b292-30e95344eaac/os-volume_attachments/4452e947-4568-4fd6-9958-d8ed22fc74dc => generated 0 bytes in 289 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 17 13:35:02.055647 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-31c259ed-bcf3-46f7-b664-b7aeb4e63ab8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:35:02.056180 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-31c259ed-bcf3-46f7-b664-b7aeb4e63ab8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: 53ede50e-496d-480c-b292-30e95344eaac] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:35:02.062692 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-31c259ed-bcf3-46f7-b664-b7aeb4e63ab8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:35:02.063143 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-31c259ed-bcf3-46f7-b664-b7aeb4e63ab8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:35:02.063899 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-31c259ed-bcf3-46f7-b664-b7aeb4e63ab8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:35:02.064335 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-31c259ed-bcf3-46f7-b664-b7aeb4e63ab8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:35:02.161992 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-31c259ed-bcf3-46f7-b664-b7aeb4e63ab8 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "POST /compute/v2.1/servers/53ede50e-496d-480c-b292-30e95344eaac/action" status: 202 len: 0 microversion: 2.20 time: 0.112558 Jun 17 13:35:02.162781 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1706/3367] 10.222.0.48 () {62 vars in 1318 bytes} [Fri Jun 17 13:35:02 2022] POST /compute/v2.1/servers/53ede50e-496d-480c-b292-30e95344eaac/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 17 13:35:02.171043 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-22d6e906-0de8-4038-9e5b-4179059417fd tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:35:02.171674 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-22d6e906-0de8-4038-9e5b-4179059417fd tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: 53ede50e-496d-480c-b292-30e95344eaac] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:35:02.177759 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-22d6e906-0de8-4038-9e5b-4179059417fd tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:35:02.178236 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-22d6e906-0de8-4038-9e5b-4179059417fd tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:35:02.178984 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-22d6e906-0de8-4038-9e5b-4179059417fd tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:35:02.179407 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-22d6e906-0de8-4038-9e5b-4179059417fd tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:35:02.316796 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-22d6e906-0de8-4038-9e5b-4179059417fd tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:35:02.325681 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-22d6e906-0de8-4038-9e5b-4179059417fd tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:35:02.327217 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-22d6e906-0de8-4038-9e5b-4179059417fd tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:35:02.328354 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-22d6e906-0de8-4038-9e5b-4179059417fd tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/53ede50e-496d-480c-b292-30e95344eaac" status: 200 len: 1672 microversion: 2.20 time: 0.161313 Jun 17 13:35:02.329126 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1662/3368] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:35:02 2022] GET /compute/v2.1/servers/53ede50e-496d-480c-b292-30e95344eaac => generated 1672 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:35:02.947771 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-50b4fd9b-a036-4548-943c-13a074b492e7 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:35:02.948619 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-50b4fd9b-a036-4548-943c-13a074b492e7 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 26622189-19d7-4ce4-b2a8-8f50a6080307] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:35:02.958038 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-50b4fd9b-a036-4548-943c-13a074b492e7 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:35:02.958750 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-50b4fd9b-a036-4548-943c-13a074b492e7 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:35:02.961122 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-50b4fd9b-a036-4548-943c-13a074b492e7 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:35:02.962344 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-50b4fd9b-a036-4548-943c-13a074b492e7 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:35:03.093019 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-50b4fd9b-a036-4548-943c-13a074b492e7 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:35:03.104334 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-50b4fd9b-a036-4548-943c-13a074b492e7 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/26622189-19d7-4ce4-b2a8-8f50a6080307" status: 200 len: 1674 microversion: 2.1 time: 0.162852 Jun 17 13:35:03.105488 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1707/3369] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:35:02 2022] GET /compute/v2.1/servers/26622189-19d7-4ce4-b2a8-8f50a6080307 => generated 1674 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:35:03.347685 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-00f2e242-1b67-4b0a-bef1-4914652e9019 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:35:03.348408 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-00f2e242-1b67-4b0a-bef1-4914652e9019 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: 53ede50e-496d-480c-b292-30e95344eaac] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:35:03.355722 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-00f2e242-1b67-4b0a-bef1-4914652e9019 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:35:03.356183 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-00f2e242-1b67-4b0a-bef1-4914652e9019 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:35:03.356940 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-00f2e242-1b67-4b0a-bef1-4914652e9019 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:35:03.357367 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-00f2e242-1b67-4b0a-bef1-4914652e9019 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:35:03.503750 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-00f2e242-1b67-4b0a-bef1-4914652e9019 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:35:03.512159 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-00f2e242-1b67-4b0a-bef1-4914652e9019 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:35:03.513635 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-00f2e242-1b67-4b0a-bef1-4914652e9019 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:35:03.514875 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-00f2e242-1b67-4b0a-bef1-4914652e9019 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/53ede50e-496d-480c-b292-30e95344eaac" status: 200 len: 1672 microversion: 2.20 time: 0.171339 Jun 17 13:35:03.515434 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1663/3370] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:35:03 2022] GET /compute/v2.1/servers/53ede50e-496d-480c-b292-30e95344eaac => generated 1672 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:35:04.130407 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-3db43a92-a52a-44f6-9d2d-e30a54d8de83 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:35:04.131297 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-3db43a92-a52a-44f6-9d2d-e30a54d8de83 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 26622189-19d7-4ce4-b2a8-8f50a6080307] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:35:04.139116 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-3db43a92-a52a-44f6-9d2d-e30a54d8de83 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:35:04.139560 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-3db43a92-a52a-44f6-9d2d-e30a54d8de83 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:35:04.140310 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-3db43a92-a52a-44f6-9d2d-e30a54d8de83 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:35:04.140735 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-3db43a92-a52a-44f6-9d2d-e30a54d8de83 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:35:04.284927 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-3db43a92-a52a-44f6-9d2d-e30a54d8de83 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:35:04.293097 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-3db43a92-a52a-44f6-9d2d-e30a54d8de83 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/26622189-19d7-4ce4-b2a8-8f50a6080307" status: 200 len: 1674 microversion: 2.1 time: 0.169363 Jun 17 13:35:04.293671 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1708/3371] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:35:04 2022] GET /compute/v2.1/servers/26622189-19d7-4ce4-b2a8-8f50a6080307 => generated 1674 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:35:04.533260 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-e0cf687b-45d7-4e43-ab11-a8b34a707216 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:35:04.533968 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-e0cf687b-45d7-4e43-ab11-a8b34a707216 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: 53ede50e-496d-480c-b292-30e95344eaac] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:35:04.540776 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e0cf687b-45d7-4e43-ab11-a8b34a707216 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:35:04.541318 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e0cf687b-45d7-4e43-ab11-a8b34a707216 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:35:04.542214 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e0cf687b-45d7-4e43-ab11-a8b34a707216 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:35:04.542673 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e0cf687b-45d7-4e43-ab11-a8b34a707216 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:35:04.727658 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-b60af25b-0437-4d24-a667-e50294b56b86 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:35:04.728419 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-b60af25b-0437-4d24-a667-e50294b56b86 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 4d474404-89d1-4844-bf86-75f6464a1a6f] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:35:04.735399 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b60af25b-0437-4d24-a667-e50294b56b86 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:35:04.735865 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b60af25b-0437-4d24-a667-e50294b56b86 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:35:04.736617 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b60af25b-0437-4d24-a667-e50294b56b86 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:35:04.737063 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b60af25b-0437-4d24-a667-e50294b56b86 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:35:04.751383 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-e0cf687b-45d7-4e43-ab11-a8b34a707216 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:35:04.762705 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-e0cf687b-45d7-4e43-ab11-a8b34a707216 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:35:04.764611 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-e0cf687b-45d7-4e43-ab11-a8b34a707216 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:35:04.766212 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-e0cf687b-45d7-4e43-ab11-a8b34a707216 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/53ede50e-496d-480c-b292-30e95344eaac" status: 200 len: 1730 microversion: 2.20 time: 0.237155 Jun 17 13:35:04.767362 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1664/3372] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:35:04 2022] GET /compute/v2.1/servers/53ede50e-496d-480c-b292-30e95344eaac => generated 1730 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:35:04.837125 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.objects.instance [None req-b60af25b-0437-4d24-a667-e50294b56b86 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lazy-loading 'services' on Instance uuid 4d474404-89d1-4844-bf86-75f6464a1a6f {{(pid=117659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 13:35:04.932831 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-b60af25b-0437-4d24-a667-e50294b56b86 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "DELETE /compute/v2.1/servers/4d474404-89d1-4844-bf86-75f6464a1a6f/os-volume_attachments/e8603f2b-6569-4e8e-b17f-5c92b4b7bc2a" status: 202 len: 0 microversion: 2.1 time: 0.209405 Jun 17 13:35:04.933692 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1709/3373] 10.222.0.48 () {58 vars in 1415 bytes} [Fri Jun 17 13:35:04 2022] DELETE /compute/v2.1/servers/4d474404-89d1-4844-bf86-75f6464a1a6f/os-volume_attachments/e8603f2b-6569-4e8e-b17f-5c92b4b7bc2a => generated 0 bytes in 211 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 13:35:05.186814 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [req-d77beef6-4920-471a-83af-13bedb282a2a req-75331dfb-61b4-45ed-be37-8470fae2b7c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26622189-19d7-4ce4-b2a8-8f50a6080307", "name": "network-vif-deleted", "tag": "209cdeed-f97f-4f00-863c-3c79fed52166"}]} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:35:05.195217 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-d77beef6-4920-471a-83af-13bedb282a2a req-75331dfb-61b4-45ed-be37-8470fae2b7c6 service nova] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:35:05.195666 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-d77beef6-4920-471a-83af-13bedb282a2a req-75331dfb-61b4-45ed-be37-8470fae2b7c6 service nova] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:35:05.207376 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.compute.server_external_events [req-d77beef6-4920-471a-83af-13bedb282a2a req-75331dfb-61b4-45ed-be37-8470fae2b7c6 service nova] Creating event network-vif-deleted:209cdeed-f97f-4f00-863c-3c79fed52166 for instance 26622189-19d7-4ce4-b2a8-8f50a6080307 on hv-cinder-83754 Jun 17 13:35:05.212738 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [req-d77beef6-4920-471a-83af-13bedb282a2a req-75331dfb-61b4-45ed-be37-8470fae2b7c6 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029988 Jun 17 13:35:05.213332 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1665/3374] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 13:35:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:35:05.312426 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-c4caf3bf-e388-4083-95a1-a70522d95db9 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:35:05.313189 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-c4caf3bf-e388-4083-95a1-a70522d95db9 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 26622189-19d7-4ce4-b2a8-8f50a6080307] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:35:05.320845 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c4caf3bf-e388-4083-95a1-a70522d95db9 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:35:05.321612 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c4caf3bf-e388-4083-95a1-a70522d95db9 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:35:05.322487 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c4caf3bf-e388-4083-95a1-a70522d95db9 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:35:05.322982 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c4caf3bf-e388-4083-95a1-a70522d95db9 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:35:05.345685 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:35:05.397458 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-c4caf3bf-e388-4083-95a1-a70522d95db9 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:35:05.405222 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-c4caf3bf-e388-4083-95a1-a70522d95db9 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/26622189-19d7-4ce4-b2a8-8f50a6080307" status: 200 len: 1606 microversion: 2.1 time: 0.098285 Jun 17 13:35:05.405761 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1710/3375] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:35:05 2022] GET /compute/v2.1/servers/26622189-19d7-4ce4-b2a8-8f50a6080307 => generated 1606 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:35:05.786005 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-cc7c1bbd-e1df-4121-a799-1d66f58ba461 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:35:05.787365 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-cc7c1bbd-e1df-4121-a799-1d66f58ba461 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: 53ede50e-496d-480c-b292-30e95344eaac] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:35:05.793667 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cc7c1bbd-e1df-4121-a799-1d66f58ba461 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:35:05.794150 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cc7c1bbd-e1df-4121-a799-1d66f58ba461 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:35:05.795201 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cc7c1bbd-e1df-4121-a799-1d66f58ba461 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:35:05.795637 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cc7c1bbd-e1df-4121-a799-1d66f58ba461 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:35:05.945908 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-cc7c1bbd-e1df-4121-a799-1d66f58ba461 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:35:05.960557 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-cc7c1bbd-e1df-4121-a799-1d66f58ba461 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:35:05.970078 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-cc7c1bbd-e1df-4121-a799-1d66f58ba461 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:35:05.972324 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-cc7c1bbd-e1df-4121-a799-1d66f58ba461 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/53ede50e-496d-480c-b292-30e95344eaac" status: 200 len: 1730 microversion: 2.20 time: 0.191230 Jun 17 13:35:05.973284 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1666/3376] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:35:05 2022] GET /compute/v2.1/servers/53ede50e-496d-480c-b292-30e95344eaac => generated 1730 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 13:35:06.422870 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-21f249f4-5187-48ad-bc91-8bf45051f465 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:35:06.423571 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-21f249f4-5187-48ad-bc91-8bf45051f465 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 26622189-19d7-4ce4-b2a8-8f50a6080307] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:35:06.430776 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-21f249f4-5187-48ad-bc91-8bf45051f465 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:35:06.431398 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-21f249f4-5187-48ad-bc91-8bf45051f465 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:35:06.432408 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-21f249f4-5187-48ad-bc91-8bf45051f465 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:35:06.432965 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-21f249f4-5187-48ad-bc91-8bf45051f465 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:35:06.468792 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-21f249f4-5187-48ad-bc91-8bf45051f465 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:35:06.469450 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-21f249f4-5187-48ad-bc91-8bf45051f465 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:35:06.470226 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.objects.instance [None req-21f249f4-5187-48ad-bc91-8bf45051f465 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lazy-loading 'fault' on Instance uuid 26622189-19d7-4ce4-b2a8-8f50a6080307 {{(pid=117659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 13:35:06.526428 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-21f249f4-5187-48ad-bc91-8bf45051f465 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:35:06.544735 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-21f249f4-5187-48ad-bc91-8bf45051f465 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/26622189-19d7-4ce4-b2a8-8f50a6080307" status: 200 len: 1327 microversion: 2.1 time: 0.125643 Jun 17 13:35:06.545324 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1711/3377] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:35:06 2022] GET /compute/v2.1/servers/26622189-19d7-4ce4-b2a8-8f50a6080307 => generated 1327 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:35:07.000138 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-2ddc54c5-b220-4838-b15c-08842b9f1d39 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:35:07.001258 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-2ddc54c5-b220-4838-b15c-08842b9f1d39 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: 53ede50e-496d-480c-b292-30e95344eaac] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:35:07.011269 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2ddc54c5-b220-4838-b15c-08842b9f1d39 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:35:07.011818 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2ddc54c5-b220-4838-b15c-08842b9f1d39 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:35:07.012694 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2ddc54c5-b220-4838-b15c-08842b9f1d39 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:35:07.013203 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2ddc54c5-b220-4838-b15c-08842b9f1d39 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:35:07.160725 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-2ddc54c5-b220-4838-b15c-08842b9f1d39 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:35:07.168712 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-2ddc54c5-b220-4838-b15c-08842b9f1d39 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:35:07.170220 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-2ddc54c5-b220-4838-b15c-08842b9f1d39 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:35:07.171377 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-2ddc54c5-b220-4838-b15c-08842b9f1d39 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/53ede50e-496d-480c-b292-30e95344eaac" status: 200 len: 1730 microversion: 2.20 time: 0.178895 Jun 17 13:35:07.171937 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1667/3378] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:35:06 2022] GET /compute/v2.1/servers/53ede50e-496d-480c-b292-30e95344eaac => generated 1730 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:35:07.562187 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-70478a1b-5741-4eb5-93f1-05c1229b1bfe tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:35:07.563488 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-70478a1b-5741-4eb5-93f1-05c1229b1bfe tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 26622189-19d7-4ce4-b2a8-8f50a6080307] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:35:07.571838 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-70478a1b-5741-4eb5-93f1-05c1229b1bfe tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:35:07.572400 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-70478a1b-5741-4eb5-93f1-05c1229b1bfe tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:35:07.573515 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-70478a1b-5741-4eb5-93f1-05c1229b1bfe tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:35:07.574167 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-70478a1b-5741-4eb5-93f1-05c1229b1bfe tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:35:07.613757 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-70478a1b-5741-4eb5-93f1-05c1229b1bfe tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:35:07.614077 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-70478a1b-5741-4eb5-93f1-05c1229b1bfe tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:35:07.614619 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.objects.instance [None req-70478a1b-5741-4eb5-93f1-05c1229b1bfe tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lazy-loading 'fault' on Instance uuid 26622189-19d7-4ce4-b2a8-8f50a6080307 {{(pid=117659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 13:35:07.660425 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-70478a1b-5741-4eb5-93f1-05c1229b1bfe tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:35:07.670998 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-70478a1b-5741-4eb5-93f1-05c1229b1bfe tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/26622189-19d7-4ce4-b2a8-8f50a6080307" status: 200 len: 1327 microversion: 2.1 time: 0.112031 Jun 17 13:35:07.681547 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1712/3379] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:35:07 2022] GET /compute/v2.1/servers/26622189-19d7-4ce4-b2a8-8f50a6080307 => generated 1327 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:35:08.190733 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-15c09771-a2b6-43e8-8670-1993970abf7b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:35:08.191498 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-15c09771-a2b6-43e8-8670-1993970abf7b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: 53ede50e-496d-480c-b292-30e95344eaac] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:35:08.200688 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-15c09771-a2b6-43e8-8670-1993970abf7b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:35:08.201526 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-15c09771-a2b6-43e8-8670-1993970abf7b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:35:08.202424 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-15c09771-a2b6-43e8-8670-1993970abf7b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:35:08.202925 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-15c09771-a2b6-43e8-8670-1993970abf7b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:35:08.371169 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-15c09771-a2b6-43e8-8670-1993970abf7b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:35:08.379363 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-15c09771-a2b6-43e8-8670-1993970abf7b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:35:08.380833 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-15c09771-a2b6-43e8-8670-1993970abf7b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:35:08.381975 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-15c09771-a2b6-43e8-8670-1993970abf7b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/53ede50e-496d-480c-b292-30e95344eaac" status: 200 len: 1730 microversion: 2.20 time: 0.195740 Jun 17 13:35:08.382554 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1668/3380] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:35:08 2022] GET /compute/v2.1/servers/53ede50e-496d-480c-b292-30e95344eaac => generated 1730 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:35:08.693592 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-7b613757-03d5-4fc0-b39b-7e4128db6bc7 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:35:08.696107 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-7b613757-03d5-4fc0-b39b-7e4128db6bc7 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 26622189-19d7-4ce4-b2a8-8f50a6080307] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:35:08.712146 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7b613757-03d5-4fc0-b39b-7e4128db6bc7 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:35:08.712988 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7b613757-03d5-4fc0-b39b-7e4128db6bc7 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:35:08.714004 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7b613757-03d5-4fc0-b39b-7e4128db6bc7 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:35:08.715547 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7b613757-03d5-4fc0-b39b-7e4128db6bc7 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:35:08.750919 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7b613757-03d5-4fc0-b39b-7e4128db6bc7 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:35:08.751364 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7b613757-03d5-4fc0-b39b-7e4128db6bc7 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:35:08.751809 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.objects.instance [None req-7b613757-03d5-4fc0-b39b-7e4128db6bc7 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lazy-loading 'fault' on Instance uuid 26622189-19d7-4ce4-b2a8-8f50a6080307 {{(pid=117659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 13:35:08.797122 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-7b613757-03d5-4fc0-b39b-7e4128db6bc7 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:35:08.806511 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-7b613757-03d5-4fc0-b39b-7e4128db6bc7 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/26622189-19d7-4ce4-b2a8-8f50a6080307" status: 200 len: 1327 microversion: 2.1 time: 0.119828 Jun 17 13:35:08.807484 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1713/3381] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:35:08 2022] GET /compute/v2.1/servers/26622189-19d7-4ce4-b2a8-8f50a6080307 => generated 1327 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:35:09.401617 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-2360615e-acc9-494e-a98b-b4e2ce56d75a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:35:09.403467 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-2360615e-acc9-494e-a98b-b4e2ce56d75a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: 53ede50e-496d-480c-b292-30e95344eaac] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:35:09.411930 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2360615e-acc9-494e-a98b-b4e2ce56d75a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:35:09.412494 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2360615e-acc9-494e-a98b-b4e2ce56d75a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:35:09.413687 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2360615e-acc9-494e-a98b-b4e2ce56d75a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:35:09.414354 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2360615e-acc9-494e-a98b-b4e2ce56d75a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:35:09.555353 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-2360615e-acc9-494e-a98b-b4e2ce56d75a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:35:09.564981 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-2360615e-acc9-494e-a98b-b4e2ce56d75a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:35:09.566862 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-2360615e-acc9-494e-a98b-b4e2ce56d75a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:35:09.568308 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-2360615e-acc9-494e-a98b-b4e2ce56d75a tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/53ede50e-496d-480c-b292-30e95344eaac" status: 200 len: 1730 microversion: 2.20 time: 0.171357 Jun 17 13:35:09.569357 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1669/3382] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:35:09 2022] GET /compute/v2.1/servers/53ede50e-496d-480c-b292-30e95344eaac => generated 1730 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:35:09.824831 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-243f7bfd-52ab-4c3b-8566-8b5a60129f09 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:35:09.825442 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-243f7bfd-52ab-4c3b-8566-8b5a60129f09 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 26622189-19d7-4ce4-b2a8-8f50a6080307] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:35:09.831789 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-243f7bfd-52ab-4c3b-8566-8b5a60129f09 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:35:09.832244 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-243f7bfd-52ab-4c3b-8566-8b5a60129f09 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:35:09.832972 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-243f7bfd-52ab-4c3b-8566-8b5a60129f09 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:35:09.833401 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-243f7bfd-52ab-4c3b-8566-8b5a60129f09 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:35:09.863933 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-243f7bfd-52ab-4c3b-8566-8b5a60129f09 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:35:09.864378 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-243f7bfd-52ab-4c3b-8566-8b5a60129f09 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:35:09.864818 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.objects.instance [None req-243f7bfd-52ab-4c3b-8566-8b5a60129f09 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lazy-loading 'fault' on Instance uuid 26622189-19d7-4ce4-b2a8-8f50a6080307 {{(pid=117659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 13:35:09.916903 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-243f7bfd-52ab-4c3b-8566-8b5a60129f09 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:35:09.924835 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-243f7bfd-52ab-4c3b-8566-8b5a60129f09 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/26622189-19d7-4ce4-b2a8-8f50a6080307" status: 200 len: 1327 microversion: 2.1 time: 0.104289 Jun 17 13:35:09.925409 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1714/3383] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:35:09 2022] GET /compute/v2.1/servers/26622189-19d7-4ce4-b2a8-8f50a6080307 => generated 1327 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:35:10.587573 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-720d6303-f627-4272-a250-84ca77e924e4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:35:10.588173 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-720d6303-f627-4272-a250-84ca77e924e4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: 53ede50e-496d-480c-b292-30e95344eaac] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:35:10.594948 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-720d6303-f627-4272-a250-84ca77e924e4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:35:10.595401 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-720d6303-f627-4272-a250-84ca77e924e4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:35:10.596157 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-720d6303-f627-4272-a250-84ca77e924e4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:35:10.596588 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-720d6303-f627-4272-a250-84ca77e924e4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:35:10.737653 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-720d6303-f627-4272-a250-84ca77e924e4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:35:10.745897 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-720d6303-f627-4272-a250-84ca77e924e4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:35:10.747640 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-720d6303-f627-4272-a250-84ca77e924e4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:35:10.748801 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-720d6303-f627-4272-a250-84ca77e924e4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/53ede50e-496d-480c-b292-30e95344eaac" status: 200 len: 1730 microversion: 2.20 time: 0.165347 Jun 17 13:35:10.749356 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1670/3384] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:35:10 2022] GET /compute/v2.1/servers/53ede50e-496d-480c-b292-30e95344eaac => generated 1730 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:35:10.941550 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-ebe6e392-fbb9-452a-9dc2-de9727d96890 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:35:10.942189 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-ebe6e392-fbb9-452a-9dc2-de9727d96890 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 26622189-19d7-4ce4-b2a8-8f50a6080307] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:35:10.948956 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ebe6e392-fbb9-452a-9dc2-de9727d96890 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:35:10.949396 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ebe6e392-fbb9-452a-9dc2-de9727d96890 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:35:10.950139 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ebe6e392-fbb9-452a-9dc2-de9727d96890 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:35:10.950590 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ebe6e392-fbb9-452a-9dc2-de9727d96890 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:35:10.983048 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ebe6e392-fbb9-452a-9dc2-de9727d96890 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:35:10.983481 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ebe6e392-fbb9-452a-9dc2-de9727d96890 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:35:10.983926 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.objects.instance [None req-ebe6e392-fbb9-452a-9dc2-de9727d96890 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lazy-loading 'fault' on Instance uuid 26622189-19d7-4ce4-b2a8-8f50a6080307 {{(pid=117659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 13:35:11.026297 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-ebe6e392-fbb9-452a-9dc2-de9727d96890 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:35:11.034689 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-ebe6e392-fbb9-452a-9dc2-de9727d96890 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/26622189-19d7-4ce4-b2a8-8f50a6080307" status: 200 len: 1327 microversion: 2.1 time: 0.097020 Jun 17 13:35:11.035576 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1715/3385] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:35:10 2022] GET /compute/v2.1/servers/26622189-19d7-4ce4-b2a8-8f50a6080307 => generated 1327 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:35:11.770328 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-2b22b203-f715-4862-9c6b-893101ac873b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:35:11.770328 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-2b22b203-f715-4862-9c6b-893101ac873b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: 53ede50e-496d-480c-b292-30e95344eaac] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:35:11.776599 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2b22b203-f715-4862-9c6b-893101ac873b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:35:11.777045 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2b22b203-f715-4862-9c6b-893101ac873b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:35:11.777819 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2b22b203-f715-4862-9c6b-893101ac873b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:35:11.778267 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2b22b203-f715-4862-9c6b-893101ac873b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:35:11.781354 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=87,nova_cell1:INSERT=5,nova_cell1:UPDATE=8 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:35:11.925834 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-2b22b203-f715-4862-9c6b-893101ac873b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:35:11.934180 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-2b22b203-f715-4862-9c6b-893101ac873b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:35:11.935647 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-2b22b203-f715-4862-9c6b-893101ac873b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:35:11.936816 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-2b22b203-f715-4862-9c6b-893101ac873b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/53ede50e-496d-480c-b292-30e95344eaac" status: 200 len: 1730 microversion: 2.20 time: 0.173121 Jun 17 13:35:11.937366 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1671/3386] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:35:11 2022] GET /compute/v2.1/servers/53ede50e-496d-480c-b292-30e95344eaac => generated 1730 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:35:12.114460 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-b8aa7db6-ad7b-4dcc-b008-d224793f00b6 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:35:12.115102 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-b8aa7db6-ad7b-4dcc-b008-d224793f00b6 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 26622189-19d7-4ce4-b2a8-8f50a6080307] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:35:12.121330 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b8aa7db6-ad7b-4dcc-b008-d224793f00b6 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:35:12.121777 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b8aa7db6-ad7b-4dcc-b008-d224793f00b6 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:35:12.122564 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b8aa7db6-ad7b-4dcc-b008-d224793f00b6 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:35:12.122998 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b8aa7db6-ad7b-4dcc-b008-d224793f00b6 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:35:12.155025 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b8aa7db6-ad7b-4dcc-b008-d224793f00b6 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:35:12.155466 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b8aa7db6-ad7b-4dcc-b008-d224793f00b6 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:35:12.155914 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.objects.instance [None req-b8aa7db6-ad7b-4dcc-b008-d224793f00b6 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lazy-loading 'fault' on Instance uuid 26622189-19d7-4ce4-b2a8-8f50a6080307 {{(pid=117659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 13:35:12.196386 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-b8aa7db6-ad7b-4dcc-b008-d224793f00b6 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:35:12.203747 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-b8aa7db6-ad7b-4dcc-b008-d224793f00b6 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/26622189-19d7-4ce4-b2a8-8f50a6080307" status: 200 len: 1327 microversion: 2.1 time: 0.154094 Jun 17 13:35:12.204322 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1716/3387] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:35:12 2022] GET /compute/v2.1/servers/26622189-19d7-4ce4-b2a8-8f50a6080307 => generated 1327 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:35:12.955084 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-82b54a7d-f438-4228-b392-d13547082c2b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:35:12.955712 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-82b54a7d-f438-4228-b392-d13547082c2b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: 53ede50e-496d-480c-b292-30e95344eaac] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:35:12.971350 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-82b54a7d-f438-4228-b392-d13547082c2b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:35:12.973311 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-82b54a7d-f438-4228-b392-d13547082c2b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:35:12.974186 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-82b54a7d-f438-4228-b392-d13547082c2b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:35:12.974624 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-82b54a7d-f438-4228-b392-d13547082c2b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:35:13.126060 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-82b54a7d-f438-4228-b392-d13547082c2b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:35:13.136459 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-82b54a7d-f438-4228-b392-d13547082c2b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:35:13.137958 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-82b54a7d-f438-4228-b392-d13547082c2b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:35:13.139142 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-82b54a7d-f438-4228-b392-d13547082c2b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/53ede50e-496d-480c-b292-30e95344eaac" status: 200 len: 1730 microversion: 2.20 time: 0.188107 Jun 17 13:35:13.139700 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1672/3388] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:35:12 2022] GET /compute/v2.1/servers/53ede50e-496d-480c-b292-30e95344eaac => generated 1730 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:35:13.219703 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-58e71c53-8365-496b-98cf-4aebb5f14d11 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:35:13.220320 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-58e71c53-8365-496b-98cf-4aebb5f14d11 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 26622189-19d7-4ce4-b2a8-8f50a6080307] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:35:13.227416 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-58e71c53-8365-496b-98cf-4aebb5f14d11 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:35:13.227840 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-58e71c53-8365-496b-98cf-4aebb5f14d11 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:35:13.228591 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-58e71c53-8365-496b-98cf-4aebb5f14d11 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:35:13.229062 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-58e71c53-8365-496b-98cf-4aebb5f14d11 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:35:13.261922 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-58e71c53-8365-496b-98cf-4aebb5f14d11 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:35:13.262418 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-58e71c53-8365-496b-98cf-4aebb5f14d11 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:35:13.262873 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.objects.instance [None req-58e71c53-8365-496b-98cf-4aebb5f14d11 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lazy-loading 'fault' on Instance uuid 26622189-19d7-4ce4-b2a8-8f50a6080307 {{(pid=117659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 13:35:13.310497 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-58e71c53-8365-496b-98cf-4aebb5f14d11 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:35:13.316652 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-58e71c53-8365-496b-98cf-4aebb5f14d11 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/26622189-19d7-4ce4-b2a8-8f50a6080307" status: 200 len: 1327 microversion: 2.1 time: 0.100900 Jun 17 13:35:13.317185 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1717/3389] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:35:13 2022] GET /compute/v2.1/servers/26622189-19d7-4ce4-b2a8-8f50a6080307 => generated 1327 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:35:14.157128 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-a710668e-31bc-48cc-ab4f-459e7743de61 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:35:14.157806 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-a710668e-31bc-48cc-ab4f-459e7743de61 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: 53ede50e-496d-480c-b292-30e95344eaac] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:35:14.164745 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a710668e-31bc-48cc-ab4f-459e7743de61 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:35:14.165782 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a710668e-31bc-48cc-ab4f-459e7743de61 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:35:14.166568 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a710668e-31bc-48cc-ab4f-459e7743de61 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:35:14.167031 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a710668e-31bc-48cc-ab4f-459e7743de61 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:35:14.332810 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-be813477-a471-40e0-b730-99ba45f52742 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:35:14.333422 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-be813477-a471-40e0-b730-99ba45f52742 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 26622189-19d7-4ce4-b2a8-8f50a6080307] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:35:14.340708 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-be813477-a471-40e0-b730-99ba45f52742 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:35:14.341147 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-be813477-a471-40e0-b730-99ba45f52742 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:35:14.341906 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-be813477-a471-40e0-b730-99ba45f52742 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:35:14.342371 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-be813477-a471-40e0-b730-99ba45f52742 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:35:14.367768 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-a710668e-31bc-48cc-ab4f-459e7743de61 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:35:14.375115 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-be813477-a471-40e0-b730-99ba45f52742 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:35:14.375858 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-be813477-a471-40e0-b730-99ba45f52742 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:35:14.376513 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.objects.instance [None req-be813477-a471-40e0-b730-99ba45f52742 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lazy-loading 'fault' on Instance uuid 26622189-19d7-4ce4-b2a8-8f50a6080307 {{(pid=117659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 13:35:14.376662 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-a710668e-31bc-48cc-ab4f-459e7743de61 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:35:14.378182 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-a710668e-31bc-48cc-ab4f-459e7743de61 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:35:14.379427 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-a710668e-31bc-48cc-ab4f-459e7743de61 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/53ede50e-496d-480c-b292-30e95344eaac" status: 200 len: 1730 microversion: 2.20 time: 0.226482 Jun 17 13:35:14.380045 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1673/3390] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:35:14 2022] GET /compute/v2.1/servers/53ede50e-496d-480c-b292-30e95344eaac => generated 1730 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:35:14.422169 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-be813477-a471-40e0-b730-99ba45f52742 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:35:14.429842 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-be813477-a471-40e0-b730-99ba45f52742 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/26622189-19d7-4ce4-b2a8-8f50a6080307" status: 200 len: 1327 microversion: 2.1 time: 0.100958 Jun 17 13:35:14.430462 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1718/3391] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:35:14 2022] GET /compute/v2.1/servers/26622189-19d7-4ce4-b2a8-8f50a6080307 => generated 1327 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:35:15.397915 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-2c47f18c-148e-41a5-af3e-1970a2877ac3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:35:15.398560 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-2c47f18c-148e-41a5-af3e-1970a2877ac3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: 53ede50e-496d-480c-b292-30e95344eaac] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:35:15.406260 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2c47f18c-148e-41a5-af3e-1970a2877ac3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:35:15.406701 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2c47f18c-148e-41a5-af3e-1970a2877ac3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:35:15.407486 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2c47f18c-148e-41a5-af3e-1970a2877ac3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:35:15.407911 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2c47f18c-148e-41a5-af3e-1970a2877ac3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:35:15.446750 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-53b6bb6a-f2e1-464a-b755-4875607423dc tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:35:15.447394 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-53b6bb6a-f2e1-464a-b755-4875607423dc tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 26622189-19d7-4ce4-b2a8-8f50a6080307] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:35:15.455054 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-53b6bb6a-f2e1-464a-b755-4875607423dc tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:35:15.455500 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-53b6bb6a-f2e1-464a-b755-4875607423dc tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:35:15.456259 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-53b6bb6a-f2e1-464a-b755-4875607423dc tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:35:15.456686 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-53b6bb6a-f2e1-464a-b755-4875607423dc tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:35:15.495494 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-53b6bb6a-f2e1-464a-b755-4875607423dc tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:35:15.495991 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-53b6bb6a-f2e1-464a-b755-4875607423dc tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:35:15.496450 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.objects.instance [None req-53b6bb6a-f2e1-464a-b755-4875607423dc tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lazy-loading 'fault' on Instance uuid 26622189-19d7-4ce4-b2a8-8f50a6080307 {{(pid=117659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 13:35:15.563107 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-2c47f18c-148e-41a5-af3e-1970a2877ac3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:35:15.571547 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-2c47f18c-148e-41a5-af3e-1970a2877ac3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:35:15.573422 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-2c47f18c-148e-41a5-af3e-1970a2877ac3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:35:15.575823 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-2c47f18c-148e-41a5-af3e-1970a2877ac3 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/53ede50e-496d-480c-b292-30e95344eaac" status: 200 len: 1730 microversion: 2.20 time: 0.180834 Jun 17 13:35:15.577177 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1674/3392] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:35:15 2022] GET /compute/v2.1/servers/53ede50e-496d-480c-b292-30e95344eaac => generated 1730 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:35:15.614717 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-53b6bb6a-f2e1-464a-b755-4875607423dc tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:35:15.623715 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-53b6bb6a-f2e1-464a-b755-4875607423dc tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/26622189-19d7-4ce4-b2a8-8f50a6080307" status: 200 len: 1327 microversion: 2.1 time: 0.180897 Jun 17 13:35:15.624294 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1719/3393] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:35:15 2022] GET /compute/v2.1/servers/26622189-19d7-4ce4-b2a8-8f50a6080307 => generated 1327 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 13:35:16.595099 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-17eb2977-c712-4047-8d85-8e76b2adafb9 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:35:16.596587 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-17eb2977-c712-4047-8d85-8e76b2adafb9 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: 53ede50e-496d-480c-b292-30e95344eaac] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:35:16.604049 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-17eb2977-c712-4047-8d85-8e76b2adafb9 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:35:16.604569 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-17eb2977-c712-4047-8d85-8e76b2adafb9 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:35:16.605719 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-17eb2977-c712-4047-8d85-8e76b2adafb9 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:35:16.606290 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-17eb2977-c712-4047-8d85-8e76b2adafb9 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:35:16.642079 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-9dc26a4b-252f-4e3f-a188-2a2bab9a638c tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:35:16.642851 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-9dc26a4b-252f-4e3f-a188-2a2bab9a638c tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 26622189-19d7-4ce4-b2a8-8f50a6080307] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:35:16.657997 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9dc26a4b-252f-4e3f-a188-2a2bab9a638c tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:35:16.658201 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9dc26a4b-252f-4e3f-a188-2a2bab9a638c tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:35:16.659294 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9dc26a4b-252f-4e3f-a188-2a2bab9a638c tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:35:16.659936 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9dc26a4b-252f-4e3f-a188-2a2bab9a638c tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:35:16.713342 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9dc26a4b-252f-4e3f-a188-2a2bab9a638c tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:35:16.713811 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9dc26a4b-252f-4e3f-a188-2a2bab9a638c tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:35:16.714274 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.objects.instance [None req-9dc26a4b-252f-4e3f-a188-2a2bab9a638c tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lazy-loading 'fault' on Instance uuid 26622189-19d7-4ce4-b2a8-8f50a6080307 {{(pid=117659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 13:35:16.772925 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-9dc26a4b-252f-4e3f-a188-2a2bab9a638c tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:35:16.781023 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-9dc26a4b-252f-4e3f-a188-2a2bab9a638c tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/26622189-19d7-4ce4-b2a8-8f50a6080307" status: 200 len: 1327 microversion: 2.1 time: 0.143068 Jun 17 13:35:16.781683 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1720/3394] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:35:16 2022] GET /compute/v2.1/servers/26622189-19d7-4ce4-b2a8-8f50a6080307 => generated 1327 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:35:16.801885 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-17eb2977-c712-4047-8d85-8e76b2adafb9 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:35:16.809993 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-17eb2977-c712-4047-8d85-8e76b2adafb9 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:35:16.811526 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-17eb2977-c712-4047-8d85-8e76b2adafb9 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:35:16.812696 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-17eb2977-c712-4047-8d85-8e76b2adafb9 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/53ede50e-496d-480c-b292-30e95344eaac" status: 200 len: 1730 microversion: 2.20 time: 0.221681 Jun 17 13:35:16.813229 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1675/3395] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:35:16 2022] GET /compute/v2.1/servers/53ede50e-496d-480c-b292-30e95344eaac => generated 1730 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:35:17.798382 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-4c35d313-d055-4621-b49b-a716472cee93 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:35:17.799037 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-4c35d313-d055-4621-b49b-a716472cee93 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 26622189-19d7-4ce4-b2a8-8f50a6080307] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:35:17.806584 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4c35d313-d055-4621-b49b-a716472cee93 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:35:17.807038 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4c35d313-d055-4621-b49b-a716472cee93 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:35:17.807801 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4c35d313-d055-4621-b49b-a716472cee93 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:35:17.808235 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4c35d313-d055-4621-b49b-a716472cee93 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:35:17.840120 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4c35d313-d055-4621-b49b-a716472cee93 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:35:17.840389 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-f54d3a0b-455d-464f-b246-d9a5c96e1df4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:35:17.840856 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4c35d313-d055-4621-b49b-a716472cee93 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:35:17.840967 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-f54d3a0b-455d-464f-b246-d9a5c96e1df4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: 53ede50e-496d-480c-b292-30e95344eaac] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:35:17.841075 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.objects.instance [None req-4c35d313-d055-4621-b49b-a716472cee93 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lazy-loading 'fault' on Instance uuid 26622189-19d7-4ce4-b2a8-8f50a6080307 {{(pid=117659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 13:35:17.847689 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f54d3a0b-455d-464f-b246-d9a5c96e1df4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:35:17.848178 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f54d3a0b-455d-464f-b246-d9a5c96e1df4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:35:17.848970 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f54d3a0b-455d-464f-b246-d9a5c96e1df4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:35:17.849707 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f54d3a0b-455d-464f-b246-d9a5c96e1df4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:35:17.884774 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-4c35d313-d055-4621-b49b-a716472cee93 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:35:17.892417 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-4c35d313-d055-4621-b49b-a716472cee93 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/26622189-19d7-4ce4-b2a8-8f50a6080307" status: 200 len: 1327 microversion: 2.1 time: 0.097999 Jun 17 13:35:17.892996 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1721/3396] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:35:17 2022] GET /compute/v2.1/servers/26622189-19d7-4ce4-b2a8-8f50a6080307 => generated 1327 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:35:17.989211 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-f54d3a0b-455d-464f-b246-d9a5c96e1df4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:35:17.997600 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-f54d3a0b-455d-464f-b246-d9a5c96e1df4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:35:17.999134 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-f54d3a0b-455d-464f-b246-d9a5c96e1df4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:35:18.000301 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-f54d3a0b-455d-464f-b246-d9a5c96e1df4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/53ede50e-496d-480c-b292-30e95344eaac" status: 200 len: 1730 microversion: 2.20 time: 0.172215 Jun 17 13:35:18.000877 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1676/3397] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:35:17 2022] GET /compute/v2.1/servers/53ede50e-496d-480c-b292-30e95344eaac => generated 1730 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:35:18.912671 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-477a90c6-831e-4569-b78a-adb4a0d50656 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:35:18.913623 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-477a90c6-831e-4569-b78a-adb4a0d50656 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 26622189-19d7-4ce4-b2a8-8f50a6080307] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:35:18.920921 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-477a90c6-831e-4569-b78a-adb4a0d50656 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:35:18.921370 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-477a90c6-831e-4569-b78a-adb4a0d50656 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:35:18.922449 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-477a90c6-831e-4569-b78a-adb4a0d50656 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:35:18.922891 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-477a90c6-831e-4569-b78a-adb4a0d50656 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:35:18.953973 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-477a90c6-831e-4569-b78a-adb4a0d50656 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:35:18.954443 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-477a90c6-831e-4569-b78a-adb4a0d50656 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:35:18.954888 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.objects.instance [None req-477a90c6-831e-4569-b78a-adb4a0d50656 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lazy-loading 'fault' on Instance uuid 26622189-19d7-4ce4-b2a8-8f50a6080307 {{(pid=117659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 13:35:19.004803 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-477a90c6-831e-4569-b78a-adb4a0d50656 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:35:19.012813 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-477a90c6-831e-4569-b78a-adb4a0d50656 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/26622189-19d7-4ce4-b2a8-8f50a6080307" status: 200 len: 1327 microversion: 2.1 time: 0.106175 Jun 17 13:35:19.022172 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1722/3398] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:35:18 2022] GET /compute/v2.1/servers/26622189-19d7-4ce4-b2a8-8f50a6080307 => generated 1327 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:35:19.022362 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-39a8aaed-78fa-47cb-b6f5-b9da9b1aa497 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:35:19.022362 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-39a8aaed-78fa-47cb-b6f5-b9da9b1aa497 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: 53ede50e-496d-480c-b292-30e95344eaac] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:35:19.026396 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-39a8aaed-78fa-47cb-b6f5-b9da9b1aa497 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:35:19.026841 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-39a8aaed-78fa-47cb-b6f5-b9da9b1aa497 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:35:19.027588 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-39a8aaed-78fa-47cb-b6f5-b9da9b1aa497 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:35:19.028018 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-39a8aaed-78fa-47cb-b6f5-b9da9b1aa497 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:35:19.172340 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-39a8aaed-78fa-47cb-b6f5-b9da9b1aa497 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:35:19.184928 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-39a8aaed-78fa-47cb-b6f5-b9da9b1aa497 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:35:19.187377 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-39a8aaed-78fa-47cb-b6f5-b9da9b1aa497 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:35:19.189150 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-39a8aaed-78fa-47cb-b6f5-b9da9b1aa497 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/53ede50e-496d-480c-b292-30e95344eaac" status: 200 len: 1730 microversion: 2.20 time: 0.173995 Jun 17 13:35:19.190037 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1677/3399] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:35:19 2022] GET /compute/v2.1/servers/53ede50e-496d-480c-b292-30e95344eaac => generated 1730 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:35:20.033827 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-4c938676-7810-41e5-abca-29a1907909f8 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:35:20.034793 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-4c938676-7810-41e5-abca-29a1907909f8 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 26622189-19d7-4ce4-b2a8-8f50a6080307] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:35:20.045764 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4c938676-7810-41e5-abca-29a1907909f8 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:35:20.046566 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4c938676-7810-41e5-abca-29a1907909f8 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:35:20.047859 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4c938676-7810-41e5-abca-29a1907909f8 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:35:20.048541 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4c938676-7810-41e5-abca-29a1907909f8 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:35:20.055178 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_cell1:SELECT=100 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:35:20.091693 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4c938676-7810-41e5-abca-29a1907909f8 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:35:20.092206 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4c938676-7810-41e5-abca-29a1907909f8 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:35:20.092689 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.objects.instance [None req-4c938676-7810-41e5-abca-29a1907909f8 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lazy-loading 'fault' on Instance uuid 26622189-19d7-4ce4-b2a8-8f50a6080307 {{(pid=117659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 13:35:20.139085 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-4c938676-7810-41e5-abca-29a1907909f8 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:35:20.146887 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-4c938676-7810-41e5-abca-29a1907909f8 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/26622189-19d7-4ce4-b2a8-8f50a6080307" status: 200 len: 1327 microversion: 2.1 time: 0.119617 Jun 17 13:35:20.147460 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1723/3400] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:35:20 2022] GET /compute/v2.1/servers/26622189-19d7-4ce4-b2a8-8f50a6080307 => generated 1327 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:35:20.207242 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-6f0ff397-4d80-4bff-9bc7-58243758db01 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:35:20.207814 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-6f0ff397-4d80-4bff-9bc7-58243758db01 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: 53ede50e-496d-480c-b292-30e95344eaac] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:35:20.209917 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_api:SELECT=56 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:35:20.215859 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6f0ff397-4d80-4bff-9bc7-58243758db01 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:35:20.216305 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6f0ff397-4d80-4bff-9bc7-58243758db01 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:35:20.217065 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6f0ff397-4d80-4bff-9bc7-58243758db01 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:35:20.217495 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6f0ff397-4d80-4bff-9bc7-58243758db01 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:35:20.347988 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-6f0ff397-4d80-4bff-9bc7-58243758db01 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:35:20.356408 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-6f0ff397-4d80-4bff-9bc7-58243758db01 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:35:20.357938 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-6f0ff397-4d80-4bff-9bc7-58243758db01 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:35:20.359121 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-6f0ff397-4d80-4bff-9bc7-58243758db01 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/53ede50e-496d-480c-b292-30e95344eaac" status: 200 len: 1730 microversion: 2.20 time: 0.155828 Jun 17 13:35:20.359683 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1678/3401] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:35:20 2022] GET /compute/v2.1/servers/53ede50e-496d-480c-b292-30e95344eaac => generated 1730 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:35:21.165694 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-eb6c2aa1-461f-45c0-9f6b-06cb4f36cfb7 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:35:21.166381 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-eb6c2aa1-461f-45c0-9f6b-06cb4f36cfb7 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 26622189-19d7-4ce4-b2a8-8f50a6080307] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:35:21.172178 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:35:21.174122 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-eb6c2aa1-461f-45c0-9f6b-06cb4f36cfb7 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:35:21.174580 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-eb6c2aa1-461f-45c0-9f6b-06cb4f36cfb7 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:35:21.175363 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-eb6c2aa1-461f-45c0-9f6b-06cb4f36cfb7 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:35:21.175798 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-eb6c2aa1-461f-45c0-9f6b-06cb4f36cfb7 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:35:21.220632 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-eb6c2aa1-461f-45c0-9f6b-06cb4f36cfb7 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:35:21.221082 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-eb6c2aa1-461f-45c0-9f6b-06cb4f36cfb7 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:35:21.221774 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.objects.instance [None req-eb6c2aa1-461f-45c0-9f6b-06cb4f36cfb7 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lazy-loading 'fault' on Instance uuid 26622189-19d7-4ce4-b2a8-8f50a6080307 {{(pid=117659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 13:35:21.284046 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-eb6c2aa1-461f-45c0-9f6b-06cb4f36cfb7 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:35:21.291898 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-eb6c2aa1-461f-45c0-9f6b-06cb4f36cfb7 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/26622189-19d7-4ce4-b2a8-8f50a6080307" status: 200 len: 1327 microversion: 2.1 time: 0.130756 Jun 17 13:35:21.292435 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1724/3402] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:35:21 2022] GET /compute/v2.1/servers/26622189-19d7-4ce4-b2a8-8f50a6080307 => generated 1327 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:35:21.382355 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-bb2b61a8-32dd-4e57-8cb4-60cf98232f08 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:35:21.383488 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-bb2b61a8-32dd-4e57-8cb4-60cf98232f08 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: 53ede50e-496d-480c-b292-30e95344eaac] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:35:21.390778 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bb2b61a8-32dd-4e57-8cb4-60cf98232f08 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:35:21.391459 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bb2b61a8-32dd-4e57-8cb4-60cf98232f08 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:35:21.391998 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bb2b61a8-32dd-4e57-8cb4-60cf98232f08 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:35:21.392406 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bb2b61a8-32dd-4e57-8cb4-60cf98232f08 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:35:21.525280 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-bb2b61a8-32dd-4e57-8cb4-60cf98232f08 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:35:21.533753 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-bb2b61a8-32dd-4e57-8cb4-60cf98232f08 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:35:21.535274 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-bb2b61a8-32dd-4e57-8cb4-60cf98232f08 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:35:21.536415 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-bb2b61a8-32dd-4e57-8cb4-60cf98232f08 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/53ede50e-496d-480c-b292-30e95344eaac" status: 200 len: 1730 microversion: 2.20 time: 0.160549 Jun 17 13:35:21.536992 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1679/3403] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:35:21 2022] GET /compute/v2.1/servers/53ede50e-496d-480c-b292-30e95344eaac => generated 1730 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:35:22.309314 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-b3ecb7a8-9c66-430e-b36f-cffebcf66f4a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:35:22.309896 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-b3ecb7a8-9c66-430e-b36f-cffebcf66f4a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 26622189-19d7-4ce4-b2a8-8f50a6080307] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:35:22.316997 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b3ecb7a8-9c66-430e-b36f-cffebcf66f4a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:35:22.317442 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b3ecb7a8-9c66-430e-b36f-cffebcf66f4a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:35:22.318228 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b3ecb7a8-9c66-430e-b36f-cffebcf66f4a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:35:22.318662 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b3ecb7a8-9c66-430e-b36f-cffebcf66f4a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:35:22.350125 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b3ecb7a8-9c66-430e-b36f-cffebcf66f4a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:35:22.350586 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b3ecb7a8-9c66-430e-b36f-cffebcf66f4a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:35:22.351019 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.objects.instance [None req-b3ecb7a8-9c66-430e-b36f-cffebcf66f4a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lazy-loading 'fault' on Instance uuid 26622189-19d7-4ce4-b2a8-8f50a6080307 {{(pid=117659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 13:35:22.394808 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-b3ecb7a8-9c66-430e-b36f-cffebcf66f4a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:35:22.402790 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-b3ecb7a8-9c66-430e-b36f-cffebcf66f4a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/26622189-19d7-4ce4-b2a8-8f50a6080307" status: 200 len: 1327 microversion: 2.1 time: 0.097381 Jun 17 13:35:22.403343 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1725/3404] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:35:22 2022] GET /compute/v2.1/servers/26622189-19d7-4ce4-b2a8-8f50a6080307 => generated 1327 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:35:22.555029 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-333ad720-d925-4d2f-97ca-1193af68a6eb tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:35:22.555614 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-333ad720-d925-4d2f-97ca-1193af68a6eb tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: 53ede50e-496d-480c-b292-30e95344eaac] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:35:22.562359 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-333ad720-d925-4d2f-97ca-1193af68a6eb tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:35:22.562801 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-333ad720-d925-4d2f-97ca-1193af68a6eb tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:35:22.563550 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-333ad720-d925-4d2f-97ca-1193af68a6eb tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:35:22.563973 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-333ad720-d925-4d2f-97ca-1193af68a6eb tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:35:22.702683 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-333ad720-d925-4d2f-97ca-1193af68a6eb tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:35:22.710626 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-333ad720-d925-4d2f-97ca-1193af68a6eb tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:35:22.712170 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-333ad720-d925-4d2f-97ca-1193af68a6eb tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:35:22.713329 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-333ad720-d925-4d2f-97ca-1193af68a6eb tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/53ede50e-496d-480c-b292-30e95344eaac" status: 200 len: 1730 microversion: 2.20 time: 0.162285 Jun 17 13:35:22.713883 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1680/3405] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:35:22 2022] GET /compute/v2.1/servers/53ede50e-496d-480c-b292-30e95344eaac => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:35:23.422543 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-19981bc6-de38-48c6-848f-a91e35077390 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:35:23.423303 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-19981bc6-de38-48c6-848f-a91e35077390 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 26622189-19d7-4ce4-b2a8-8f50a6080307] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:35:23.433132 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-19981bc6-de38-48c6-848f-a91e35077390 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:35:23.433746 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-19981bc6-de38-48c6-848f-a91e35077390 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:35:23.434860 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-19981bc6-de38-48c6-848f-a91e35077390 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:35:23.435440 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-19981bc6-de38-48c6-848f-a91e35077390 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:35:23.471902 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-19981bc6-de38-48c6-848f-a91e35077390 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:35:23.472351 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-19981bc6-de38-48c6-848f-a91e35077390 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:35:23.472798 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.objects.instance [None req-19981bc6-de38-48c6-848f-a91e35077390 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lazy-loading 'fault' on Instance uuid 26622189-19d7-4ce4-b2a8-8f50a6080307 {{(pid=117659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 13:35:23.520608 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-19981bc6-de38-48c6-848f-a91e35077390 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:35:23.529020 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-19981bc6-de38-48c6-848f-a91e35077390 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/26622189-19d7-4ce4-b2a8-8f50a6080307" status: 200 len: 1327 microversion: 2.1 time: 0.111799 Jun 17 13:35:23.529418 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1726/3406] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:35:23 2022] GET /compute/v2.1/servers/26622189-19d7-4ce4-b2a8-8f50a6080307 => generated 1327 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:35:23.736814 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-3c77eecf-a009-4f01-99e2-2e8feddbda7f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:35:23.737806 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-3c77eecf-a009-4f01-99e2-2e8feddbda7f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: 53ede50e-496d-480c-b292-30e95344eaac] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:35:23.748945 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3c77eecf-a009-4f01-99e2-2e8feddbda7f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:35:23.749719 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3c77eecf-a009-4f01-99e2-2e8feddbda7f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:35:23.751012 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3c77eecf-a009-4f01-99e2-2e8feddbda7f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:35:23.751736 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3c77eecf-a009-4f01-99e2-2e8feddbda7f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:35:23.897790 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-3c77eecf-a009-4f01-99e2-2e8feddbda7f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:35:23.908233 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-3c77eecf-a009-4f01-99e2-2e8feddbda7f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:35:23.909708 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-3c77eecf-a009-4f01-99e2-2e8feddbda7f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:35:23.910915 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-3c77eecf-a009-4f01-99e2-2e8feddbda7f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/53ede50e-496d-480c-b292-30e95344eaac" status: 200 len: 1730 microversion: 2.20 time: 0.181061 Jun 17 13:35:23.911476 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1681/3407] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:35:23 2022] GET /compute/v2.1/servers/53ede50e-496d-480c-b292-30e95344eaac => generated 1730 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:35:24.553172 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-e41163af-ece3-47db-a074-e6dc821dffb3 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:35:24.553990 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-e41163af-ece3-47db-a074-e6dc821dffb3 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 26622189-19d7-4ce4-b2a8-8f50a6080307] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:35:24.561866 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e41163af-ece3-47db-a074-e6dc821dffb3 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:35:24.562363 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e41163af-ece3-47db-a074-e6dc821dffb3 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:35:24.563124 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e41163af-ece3-47db-a074-e6dc821dffb3 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:35:24.563561 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e41163af-ece3-47db-a074-e6dc821dffb3 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:35:24.595936 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e41163af-ece3-47db-a074-e6dc821dffb3 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:35:24.596379 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e41163af-ece3-47db-a074-e6dc821dffb3 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:35:24.597029 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.objects.instance [None req-e41163af-ece3-47db-a074-e6dc821dffb3 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lazy-loading 'fault' on Instance uuid 26622189-19d7-4ce4-b2a8-8f50a6080307 {{(pid=117659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 13:35:24.642475 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-e41163af-ece3-47db-a074-e6dc821dffb3 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfbd9324f8040c496a83eb599ca80c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a3f9864ad04941bc902febad84876d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:35:24.650119 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-e41163af-ece3-47db-a074-e6dc821dffb3 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/26622189-19d7-4ce4-b2a8-8f50a6080307" status: 200 len: 1327 microversion: 2.1 time: 0.103585 Jun 17 13:35:24.650765 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1727/3408] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:35:24 2022] GET /compute/v2.1/servers/26622189-19d7-4ce4-b2a8-8f50a6080307 => generated 1327 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:35:24.928994 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-4459df13-c4f8-4a4b-8ed3-99e310bf2b2e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:35:24.929568 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-4459df13-c4f8-4a4b-8ed3-99e310bf2b2e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: 53ede50e-496d-480c-b292-30e95344eaac] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:35:24.936909 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4459df13-c4f8-4a4b-8ed3-99e310bf2b2e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:35:24.937320 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4459df13-c4f8-4a4b-8ed3-99e310bf2b2e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:35:24.938354 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4459df13-c4f8-4a4b-8ed3-99e310bf2b2e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:35:24.938837 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4459df13-c4f8-4a4b-8ed3-99e310bf2b2e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:35:25.071775 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-4459df13-c4f8-4a4b-8ed3-99e310bf2b2e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:35:25.081035 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-4459df13-c4f8-4a4b-8ed3-99e310bf2b2e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:35:25.082789 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-4459df13-c4f8-4a4b-8ed3-99e310bf2b2e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:35:25.084135 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-4459df13-c4f8-4a4b-8ed3-99e310bf2b2e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/53ede50e-496d-480c-b292-30e95344eaac" status: 200 len: 1730 microversion: 2.20 time: 0.159178 Jun 17 13:35:25.084876 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1682/3409] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:35:24 2022] GET /compute/v2.1/servers/53ede50e-496d-480c-b292-30e95344eaac => generated 1730 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:35:25.244706 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-d03f9ceb-90fd-4ed6-be24-b1ffdb7c3afc tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:35:25.245207 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-d03f9ceb-90fd-4ed6-be24-b1ffdb7c3afc tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 4d474404-89d1-4844-bf86-75f6464a1a6f] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:35:25.251369 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d03f9ceb-90fd-4ed6-be24-b1ffdb7c3afc tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:35:25.251815 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d03f9ceb-90fd-4ed6-be24-b1ffdb7c3afc tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:35:25.252561 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d03f9ceb-90fd-4ed6-be24-b1ffdb7c3afc tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:35:25.253008 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d03f9ceb-90fd-4ed6-be24-b1ffdb7c3afc tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:35:25.277373 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-d03f9ceb-90fd-4ed6-be24-b1ffdb7c3afc tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 4d474404-89d1-4844-bf86-75f6464a1a6f] Going to try to terminate instance {{(pid=117659) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 17 13:35:25.355235 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-d03f9ceb-90fd-4ed6-be24-b1ffdb7c3afc tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "DELETE /compute/v2.1/servers/4d474404-89d1-4844-bf86-75f6464a1a6f" status: 204 len: 0 microversion: 2.1 time: 0.113691 Jun 17 13:35:25.355966 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1728/3410] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Jun 17 13:35:25 2022] DELETE /compute/v2.1/servers/4d474404-89d1-4844-bf86-75f6464a1a6f => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 17 13:35:25.364338 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-46704ebf-edb4-4b91-8dd8-7e6a4c58e1f9 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:35:25.364949 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-46704ebf-edb4-4b91-8dd8-7e6a4c58e1f9 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 4d474404-89d1-4844-bf86-75f6464a1a6f] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:35:25.371838 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-46704ebf-edb4-4b91-8dd8-7e6a4c58e1f9 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:35:25.372288 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-46704ebf-edb4-4b91-8dd8-7e6a4c58e1f9 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:35:25.373045 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-46704ebf-edb4-4b91-8dd8-7e6a4c58e1f9 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:35:25.373479 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-46704ebf-edb4-4b91-8dd8-7e6a4c58e1f9 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:35:25.505676 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-46704ebf-edb4-4b91-8dd8-7e6a4c58e1f9 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:35:25.513236 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-46704ebf-edb4-4b91-8dd8-7e6a4c58e1f9 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/4d474404-89d1-4844-bf86-75f6464a1a6f" status: 200 len: 1514 microversion: 2.1 time: 0.152848 Jun 17 13:35:25.513803 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1683/3411] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:35:25 2022] GET /compute/v2.1/servers/4d474404-89d1-4844-bf86-75f6464a1a6f => generated 1514 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:35:25.667773 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-4cb1519e-a96d-47a0-b9cd-61da17e69aaa tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:35:25.668482 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-4cb1519e-a96d-47a0-b9cd-61da17e69aaa tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 26622189-19d7-4ce4-b2a8-8f50a6080307] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:35:25.675197 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4cb1519e-a96d-47a0-b9cd-61da17e69aaa tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:35:25.675648 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4cb1519e-a96d-47a0-b9cd-61da17e69aaa tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:35:25.676441 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4cb1519e-a96d-47a0-b9cd-61da17e69aaa tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:35:25.676871 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4cb1519e-a96d-47a0-b9cd-61da17e69aaa tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:35:25.691249 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.wsgi [None req-4cb1519e-a96d-47a0-b9cd-61da17e69aaa tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] HTTP exception thrown: Instance 26622189-19d7-4ce4-b2a8-8f50a6080307 could not be found. Jun 17 13:35:25.692909 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-4cb1519e-a96d-47a0-b9cd-61da17e69aaa tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Request method failure captured: Jun 17 13:35:25.692909 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: request: GET /compute/v2.1/servers/26622189-19d7-4ce4-b2a8-8f50a6080307 HTTP/1.1 Jun 17 13:35:25.692909 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Accept: application/json Jun 17 13:35:25.692909 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Accept-Encoding: identity Jun 17 13:35:25.692909 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Connection: close Jun 17 13:35:25.692909 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Content-Length: 0 Jun 17 13:35:25.692909 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Content-Type: application/json Jun 17 13:35:25.692909 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Host: 10.222.0.48 Jun 17 13:35:25.692909 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Openstack-System-Scope: None Jun 17 13:35:25.692909 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: User-Agent: python-urllib3/1.26.9 Jun 17 13:35:25.692909 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Auth-Token: gAAAAABirHot9G0ec80w-7dFEBJ7HFl7IIcgVvLR7hTWA8J1DyAE7iTwXuDCoX5bY_4XJhfT6lNujAWwKIgX_BAUsO4EI1B0xhwYR-PYFd_9H1rc1sND_P8VGFbNecPEEPEdWnRNbwHHfQarvXh11Kj9bGDdr0IVMVJbCFA3PhbLss2wXItBDjY Jun 17 13:35:25.692909 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Domain-Id: None Jun 17 13:35:25.692909 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Domain-Name: None Jun 17 13:35:25.692909 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Identity-Status: Confirmed Jun 17 13:35:25.692909 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Is-Admin-Project: True Jun 17 13:35:25.692909 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Project-Domain-Id: default Jun 17 13:35:25.692909 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Project-Domain-Name: Default Jun 17 13:35:25.692909 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Project-Id: 13a3f9864ad04941bc902febad84876d Jun 17 13:35:25.692909 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Project-Name: tempest-AttachVolumeTestJSON-5002524 Jun 17 13:35:25.692909 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Role: member,reader Jun 17 13:35:25.692909 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Roles: member,reader Jun 17 13:35:25.694176 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_13a3f9864ad04941bc902febad84876d", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/13a3f9864ad04941bc902febad84876d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/13a3f9864ad04941bc902febad84876d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/13a3f9864ad04941bc902febad84876d"}]}] Jun 17 13:35:25.694176 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Tenant: tempest-AttachVolumeTestJSON-5002524 Jun 17 13:35:25.694176 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Tenant-Id: 13a3f9864ad04941bc902febad84876d Jun 17 13:35:25.694176 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Tenant-Name: tempest-AttachVolumeTestJSON-5002524 Jun 17 13:35:25.694176 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User: tempest-AttachVolumeTestJSON-5002524-project Jun 17 13:35:25.694176 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User-Domain-Id: default Jun 17 13:35:25.694176 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User-Domain-Name: Default Jun 17 13:35:25.694176 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User-Id: 8bfbd9324f8040c496a83eb599ca80c0 Jun 17 13:35:25.694176 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User-Name: tempest-AttachVolumeTestJSON-5002524-project Jun 17 13:35:25.694176 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: method: > Jun 17 13:35:25.694176 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: exception: Instance 26622189-19d7-4ce4-b2a8-8f50a6080307 could not be found. Jun 17 13:35:25.694176 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: action_args: {'id': '26622189-19d7-4ce4-b2a8-8f50a6080307'} Jun 17 13:35:25.694860 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 13:35:25.694860 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:35:25.694860 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 13:35:25.694860 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 13:35:25.694860 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 13:35:25.694860 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 13:35:25.694860 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 13:35:25.694860 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 13:35:25.694860 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 13:35:25.694860 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 13:35:25.694860 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26622189-19d7-4ce4-b2a8-8f50a6080307 could not be found. Jun 17 13:35:25.694860 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:35:25.694860 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:35:25.694860 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:35:25.694860 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:35:25.694860 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:35:25.694860 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:35:25.694860 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 13:35:25.694860 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 13:35:25.694860 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 13:35:25.696169 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 13:35:25.696169 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 13:35:25.696169 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 13:35:25.696169 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 13:35:25.696169 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 13:35:25.696169 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 13:35:25.696169 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 13:35:25.696169 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26622189-19d7-4ce4-b2a8-8f50a6080307 could not be found. Jun 17 13:35:25.696169 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:35:25.696169 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:35:25.696169 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:35:25.696169 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:35:25.696169 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:35:25.696169 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:35:25.696169 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 13:35:25.696169 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 13:35:25.696169 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26622189-19d7-4ce4-b2a8-8f50a6080307 could not be found. Jun 17 13:35:25.696169 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:35:25.697223 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-4cb1519e-a96d-47a0-b9cd-61da17e69aaa tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Returning 404 to user: Instance 26622189-19d7-4ce4-b2a8-8f50a6080307 could not be found. {{(pid=117659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 13:35:25.697223 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-4cb1519e-a96d-47a0-b9cd-61da17e69aaa tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/26622189-19d7-4ce4-b2a8-8f50a6080307" status: 404 len: 111 microversion: 2.1 time: 0.030968 Jun 17 13:35:25.697223 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1729/3412] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:35:25 2022] GET /compute/v2.1/servers/26622189-19d7-4ce4-b2a8-8f50a6080307 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 13:35:25.703106 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-5f1bbfb4-0d8c-4fac-b5a4-ce84e00caaac tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '.version_select at 0x7f01948f6a60>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:35:25.706301 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR oslo.messaging._drivers.impl_rabbit [None req-5f1bbfb4-0d8c-4fac-b5a4-ce84e00caaac tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [0ed9d8b5-d76a-4e8d-ab5d-efa776ea90ce] AMQP server on 10.222.0.48:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 17 13:35:26.107656 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-de7b590d-3137-4617-a547-4cb265287fc4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:35:26.108630 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-de7b590d-3137-4617-a547-4cb265287fc4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: 53ede50e-496d-480c-b292-30e95344eaac] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:35:26.118414 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-de7b590d-3137-4617-a547-4cb265287fc4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:35:26.118868 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-de7b590d-3137-4617-a547-4cb265287fc4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:35:26.119618 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-de7b590d-3137-4617-a547-4cb265287fc4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:35:26.120035 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-de7b590d-3137-4617-a547-4cb265287fc4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:35:26.257977 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-de7b590d-3137-4617-a547-4cb265287fc4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:35:26.266616 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-de7b590d-3137-4617-a547-4cb265287fc4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:35:26.268110 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-de7b590d-3137-4617-a547-4cb265287fc4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:35:26.269266 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-de7b590d-3137-4617-a547-4cb265287fc4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/53ede50e-496d-480c-b292-30e95344eaac" status: 200 len: 1730 microversion: 2.20 time: 0.168948 Jun 17 13:35:26.269826 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1730/3413] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:35:26 2022] GET /compute/v2.1/servers/53ede50e-496d-480c-b292-30e95344eaac => generated 1730 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:35:26.534575 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-ef675adb-7f40-4ed9-bfb8-5a91e8a4f412 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:35:26.535459 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-ef675adb-7f40-4ed9-bfb8-5a91e8a4f412 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 4d474404-89d1-4844-bf86-75f6464a1a6f] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:35:26.543746 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ef675adb-7f40-4ed9-bfb8-5a91e8a4f412 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:35:26.544194 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ef675adb-7f40-4ed9-bfb8-5a91e8a4f412 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:35:26.544950 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ef675adb-7f40-4ed9-bfb8-5a91e8a4f412 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:35:26.545384 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ef675adb-7f40-4ed9-bfb8-5a91e8a4f412 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:35:26.686923 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-ef675adb-7f40-4ed9-bfb8-5a91e8a4f412 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:35:26.694951 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-ef675adb-7f40-4ed9-bfb8-5a91e8a4f412 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/4d474404-89d1-4844-bf86-75f6464a1a6f" status: 200 len: 1514 microversion: 2.1 time: 0.166921 Jun 17 13:35:26.695607 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1731/3414] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:35:26 2022] GET /compute/v2.1/servers/4d474404-89d1-4844-bf86-75f6464a1a6f => generated 1514 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:35:26.713803 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO oslo.messaging._drivers.impl_rabbit [None req-5f1bbfb4-0d8c-4fac-b5a4-ce84e00caaac tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [0ed9d8b5-d76a-4e8d-ab5d-efa776ea90ce] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 43806. Jun 17 13:35:26.733214 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-5f1bbfb4-0d8c-4fac-b5a4-ce84e00caaac tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1697365276" status: 202 len: 0 microversion: 2.1 time: 1.033853 Jun 17 13:35:26.733798 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1684/3415] 10.222.0.48 () {58 vars in 1220 bytes} [Fri Jun 17 13:35:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1697365276 => generated 0 bytes in 1035 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 13:35:27.161948 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [req-be1b0546-6988-4eaa-99fe-a1fe227f6a10 req-aa46f913-bada-438c-b2de-211c91fec17d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53ede50e-496d-480c-b292-30e95344eaac", "name": "network-vif-plugged", "status": "completed", "tag": "18820e99-834c-4f86-aa42-a4db70cd683d"}]} {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:35:27.171287 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [req-be1b0546-6988-4eaa-99fe-a1fe227f6a10 req-aa46f913-bada-438c-b2de-211c91fec17d service nova] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:35:27.171850 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [req-be1b0546-6988-4eaa-99fe-a1fe227f6a10 req-aa46f913-bada-438c-b2de-211c91fec17d service nova] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:35:27.183504 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.compute.server_external_events [req-be1b0546-6988-4eaa-99fe-a1fe227f6a10 req-aa46f913-bada-438c-b2de-211c91fec17d service nova] Creating event network-vif-plugged:18820e99-834c-4f86-aa42-a4db70cd683d for instance 53ede50e-496d-480c-b292-30e95344eaac on hv-cinder-83754 Jun 17 13:35:27.189250 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [req-be1b0546-6988-4eaa-99fe-a1fe227f6a10 req-aa46f913-bada-438c-b2de-211c91fec17d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097024 Jun 17 13:35:27.190249 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1732/3416] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 13:35:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:35:27.289434 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-6970f30e-ddbe-4ecb-9953-0425af6a0c28 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:35:27.290013 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-6970f30e-ddbe-4ecb-9953-0425af6a0c28 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: 53ede50e-496d-480c-b292-30e95344eaac] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:35:27.298216 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6970f30e-ddbe-4ecb-9953-0425af6a0c28 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:35:27.298740 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6970f30e-ddbe-4ecb-9953-0425af6a0c28 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:35:27.299458 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6970f30e-ddbe-4ecb-9953-0425af6a0c28 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:35:27.299982 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6970f30e-ddbe-4ecb-9953-0425af6a0c28 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:35:27.453978 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-6970f30e-ddbe-4ecb-9953-0425af6a0c28 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:35:27.464066 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-6970f30e-ddbe-4ecb-9953-0425af6a0c28 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:35:27.465627 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-6970f30e-ddbe-4ecb-9953-0425af6a0c28 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:35:27.466935 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-6970f30e-ddbe-4ecb-9953-0425af6a0c28 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/53ede50e-496d-480c-b292-30e95344eaac" status: 200 len: 1730 microversion: 2.20 time: 0.182366 Jun 17 13:35:27.467476 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1685/3417] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:35:27 2022] GET /compute/v2.1/servers/53ede50e-496d-480c-b292-30e95344eaac => generated 1730 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:35:27.714628 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-8df356ca-f0d5-4188-a523-d388db526a26 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:35:27.715417 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-8df356ca-f0d5-4188-a523-d388db526a26 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 4d474404-89d1-4844-bf86-75f6464a1a6f] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:35:27.723630 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8df356ca-f0d5-4188-a523-d388db526a26 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:35:27.724291 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8df356ca-f0d5-4188-a523-d388db526a26 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:35:27.725053 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8df356ca-f0d5-4188-a523-d388db526a26 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:35:27.725461 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8df356ca-f0d5-4188-a523-d388db526a26 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:35:27.896492 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-8df356ca-f0d5-4188-a523-d388db526a26 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:35:27.909895 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-8df356ca-f0d5-4188-a523-d388db526a26 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/4d474404-89d1-4844-bf86-75f6464a1a6f" status: 200 len: 1514 microversion: 2.1 time: 0.199634 Jun 17 13:35:27.910820 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1733/3418] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:35:27 2022] GET /compute/v2.1/servers/4d474404-89d1-4844-bf86-75f6464a1a6f => generated 1514 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:35:28.004045 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [req-37378f75-e0a7-4e5c-bcb5-8730905be6bc req-a211c1c7-4f90-4049-b268-812c54081016 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d474404-89d1-4844-bf86-75f6464a1a6f", "name": "network-vif-deleted", "tag": "14412039-68b6-47ce-95ff-e28cd44b9489"}]} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:35:28.012545 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-37378f75-e0a7-4e5c-bcb5-8730905be6bc req-a211c1c7-4f90-4049-b268-812c54081016 service nova] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:35:28.013034 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-37378f75-e0a7-4e5c-bcb5-8730905be6bc req-a211c1c7-4f90-4049-b268-812c54081016 service nova] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:35:28.025610 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.compute.server_external_events [req-37378f75-e0a7-4e5c-bcb5-8730905be6bc req-a211c1c7-4f90-4049-b268-812c54081016 service nova] Creating event network-vif-deleted:14412039-68b6-47ce-95ff-e28cd44b9489 for instance 4d474404-89d1-4844-bf86-75f6464a1a6f on hv-cinder-83754 Jun 17 13:35:28.031154 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [req-37378f75-e0a7-4e5c-bcb5-8730905be6bc req-a211c1c7-4f90-4049-b268-812c54081016 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030850 Jun 17 13:35:28.031748 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1686/3419] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 13:35:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:35:28.487696 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-ab19af93-b2ae-4c6e-9816-f6ef3d7b265b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:35:28.488248 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-ab19af93-b2ae-4c6e-9816-f6ef3d7b265b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: 53ede50e-496d-480c-b292-30e95344eaac] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:35:28.496849 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ab19af93-b2ae-4c6e-9816-f6ef3d7b265b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:35:28.497297 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ab19af93-b2ae-4c6e-9816-f6ef3d7b265b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:35:28.498123 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ab19af93-b2ae-4c6e-9816-f6ef3d7b265b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:35:28.498565 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ab19af93-b2ae-4c6e-9816-f6ef3d7b265b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:35:28.663851 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-ab19af93-b2ae-4c6e-9816-f6ef3d7b265b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:35:28.672377 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-ab19af93-b2ae-4c6e-9816-f6ef3d7b265b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:35:28.673856 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-ab19af93-b2ae-4c6e-9816-f6ef3d7b265b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:35:28.675037 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-ab19af93-b2ae-4c6e-9816-f6ef3d7b265b tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/53ede50e-496d-480c-b292-30e95344eaac" status: 200 len: 1730 microversion: 2.20 time: 0.191476 Jun 17 13:35:28.675599 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1734/3420] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:35:28 2022] GET /compute/v2.1/servers/53ede50e-496d-480c-b292-30e95344eaac => generated 1730 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:35:28.929002 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-03d4f164-a264-463c-8650-a5d6836beabe tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:35:28.930057 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-03d4f164-a264-463c-8650-a5d6836beabe tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 4d474404-89d1-4844-bf86-75f6464a1a6f] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:35:28.936945 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-03d4f164-a264-463c-8650-a5d6836beabe tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:35:28.937386 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-03d4f164-a264-463c-8650-a5d6836beabe tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:35:28.938137 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-03d4f164-a264-463c-8650-a5d6836beabe tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:35:28.938565 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-03d4f164-a264-463c-8650-a5d6836beabe tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:35:28.969422 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-03d4f164-a264-463c-8650-a5d6836beabe tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:35:28.969865 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-03d4f164-a264-463c-8650-a5d6836beabe tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:35:28.970343 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.objects.instance [None req-03d4f164-a264-463c-8650-a5d6836beabe tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lazy-loading 'fault' on Instance uuid 4d474404-89d1-4844-bf86-75f6464a1a6f {{(pid=117660) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 13:35:29.016378 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-03d4f164-a264-463c-8650-a5d6836beabe tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bc5146c28948c5859cd9eb3d09e0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ac53907e54975851947e5f653c688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:35:29.025265 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-03d4f164-a264-463c-8650-a5d6836beabe tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/4d474404-89d1-4844-bf86-75f6464a1a6f" status: 200 len: 1309 microversion: 2.1 time: 0.100930 Jun 17 13:35:29.025997 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1687/3421] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:35:28 2022] GET /compute/v2.1/servers/4d474404-89d1-4844-bf86-75f6464a1a6f => generated 1309 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:35:29.670613 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-0ec8d874-53da-4c3b-8260-409d75076127 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:35:29.671600 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-0ec8d874-53da-4c3b-8260-409d75076127 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 26622189-19d7-4ce4-b2a8-8f50a6080307] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:35:29.677919 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0ec8d874-53da-4c3b-8260-409d75076127 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:35:29.678401 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0ec8d874-53da-4c3b-8260-409d75076127 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:35:29.679154 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0ec8d874-53da-4c3b-8260-409d75076127 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:35:29.679583 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0ec8d874-53da-4c3b-8260-409d75076127 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:35:29.693211 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-7ee1f907-4e79-4b26-a8cc-e84abf27cc68 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:35:29.693833 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-7ee1f907-4e79-4b26-a8cc-e84abf27cc68 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: 53ede50e-496d-480c-b292-30e95344eaac] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:35:29.693923 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.wsgi [None req-0ec8d874-53da-4c3b-8260-409d75076127 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] HTTP exception thrown: Instance 26622189-19d7-4ce4-b2a8-8f50a6080307 could not be found. Jun 17 13:35:29.695736 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-0ec8d874-53da-4c3b-8260-409d75076127 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Request method failure captured: Jun 17 13:35:29.695736 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: request: DELETE /compute/v2.1/servers/26622189-19d7-4ce4-b2a8-8f50a6080307 HTTP/1.1 Jun 17 13:35:29.695736 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Accept: application/json Jun 17 13:35:29.695736 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Accept-Encoding: identity Jun 17 13:35:29.695736 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Connection: close Jun 17 13:35:29.695736 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Content-Length: 0 Jun 17 13:35:29.695736 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Content-Type: application/json Jun 17 13:35:29.695736 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Host: 10.222.0.48 Jun 17 13:35:29.695736 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Openstack-System-Scope: None Jun 17 13:35:29.695736 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: User-Agent: python-urllib3/1.26.9 Jun 17 13:35:29.695736 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Auth-Token: gAAAAABirHot9G0ec80w-7dFEBJ7HFl7IIcgVvLR7hTWA8J1DyAE7iTwXuDCoX5bY_4XJhfT6lNujAWwKIgX_BAUsO4EI1B0xhwYR-PYFd_9H1rc1sND_P8VGFbNecPEEPEdWnRNbwHHfQarvXh11Kj9bGDdr0IVMVJbCFA3PhbLss2wXItBDjY Jun 17 13:35:29.695736 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Domain-Id: None Jun 17 13:35:29.695736 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Domain-Name: None Jun 17 13:35:29.695736 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Identity-Status: Confirmed Jun 17 13:35:29.695736 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Is-Admin-Project: True Jun 17 13:35:29.695736 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Project-Domain-Id: default Jun 17 13:35:29.695736 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Project-Domain-Name: Default Jun 17 13:35:29.695736 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Project-Id: 13a3f9864ad04941bc902febad84876d Jun 17 13:35:29.695736 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Project-Name: tempest-AttachVolumeTestJSON-5002524 Jun 17 13:35:29.695736 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Role: member,reader Jun 17 13:35:29.695736 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Roles: member,reader Jun 17 13:35:29.696709 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_13a3f9864ad04941bc902febad84876d", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/13a3f9864ad04941bc902febad84876d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/13a3f9864ad04941bc902febad84876d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/13a3f9864ad04941bc902febad84876d"}]}] Jun 17 13:35:29.696709 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Tenant: tempest-AttachVolumeTestJSON-5002524 Jun 17 13:35:29.696709 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Tenant-Id: 13a3f9864ad04941bc902febad84876d Jun 17 13:35:29.696709 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Tenant-Name: tempest-AttachVolumeTestJSON-5002524 Jun 17 13:35:29.696709 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User: tempest-AttachVolumeTestJSON-5002524-project Jun 17 13:35:29.696709 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User-Domain-Id: default Jun 17 13:35:29.696709 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User-Domain-Name: Default Jun 17 13:35:29.696709 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User-Id: 8bfbd9324f8040c496a83eb599ca80c0 Jun 17 13:35:29.696709 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User-Name: tempest-AttachVolumeTestJSON-5002524-project Jun 17 13:35:29.696709 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: method: > Jun 17 13:35:29.696709 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: exception: Instance 26622189-19d7-4ce4-b2a8-8f50a6080307 could not be found. Jun 17 13:35:29.696709 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: action_args: {'id': '26622189-19d7-4ce4-b2a8-8f50a6080307'} Jun 17 13:35:29.697284 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 13:35:29.697284 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:35:29.697284 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 13:35:29.697284 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 13:35:29.697284 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 13:35:29.697284 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 13:35:29.697284 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 13:35:29.697284 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 13:35:29.697284 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 13:35:29.697284 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 13:35:29.697284 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26622189-19d7-4ce4-b2a8-8f50a6080307 could not be found. Jun 17 13:35:29.697284 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:35:29.697284 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:35:29.697284 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:35:29.697284 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:35:29.697284 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:35:29.697284 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:35:29.697284 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 13:35:29.697284 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 13:35:29.697284 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 13:35:29.698187 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 13:35:29.698187 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 17 13:35:29.698187 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 17 13:35:29.698187 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 17 13:35:29.698187 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 17 13:35:29.698187 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 13:35:29.698187 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 13:35:29.698187 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 13:35:29.698187 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 13:35:29.698187 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26622189-19d7-4ce4-b2a8-8f50a6080307 could not be found. Jun 17 13:35:29.698187 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:35:29.698187 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:35:29.698187 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:35:29.698187 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:35:29.698187 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:35:29.698187 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:35:29.698187 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 13:35:29.698187 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 13:35:29.698187 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26622189-19d7-4ce4-b2a8-8f50a6080307 could not be found. Jun 17 13:35:29.698187 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:35:29.699105 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-0ec8d874-53da-4c3b-8260-409d75076127 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Returning 404 to user: Instance 26622189-19d7-4ce4-b2a8-8f50a6080307 could not be found. {{(pid=117659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 13:35:29.699105 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-0ec8d874-53da-4c3b-8260-409d75076127 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "DELETE /compute/v2.1/servers/26622189-19d7-4ce4-b2a8-8f50a6080307" status: 404 len: 111 microversion: 2.1 time: 0.030545 Jun 17 13:35:29.699105 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1735/3422] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Jun 17 13:35:29 2022] DELETE /compute/v2.1/servers/26622189-19d7-4ce4-b2a8-8f50a6080307 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 13:35:29.705495 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-c63995ae-a011-49ee-868e-cfa939de3f6a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:35:29.706115 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-c63995ae-a011-49ee-868e-cfa939de3f6a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 26622189-19d7-4ce4-b2a8-8f50a6080307] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:35:29.711987 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7ee1f907-4e79-4b26-a8cc-e84abf27cc68 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:35:29.712483 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c63995ae-a011-49ee-868e-cfa939de3f6a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:35:29.712657 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7ee1f907-4e79-4b26-a8cc-e84abf27cc68 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:35:29.713232 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c63995ae-a011-49ee-868e-cfa939de3f6a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:35:29.713805 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7ee1f907-4e79-4b26-a8cc-e84abf27cc68 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:35:29.714310 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c63995ae-a011-49ee-868e-cfa939de3f6a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:35:29.714580 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7ee1f907-4e79-4b26-a8cc-e84abf27cc68 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:35:29.715016 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c63995ae-a011-49ee-868e-cfa939de3f6a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:35:29.731694 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.wsgi [None req-c63995ae-a011-49ee-868e-cfa939de3f6a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] HTTP exception thrown: Instance 26622189-19d7-4ce4-b2a8-8f50a6080307 could not be found. Jun 17 13:35:29.733453 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-c63995ae-a011-49ee-868e-cfa939de3f6a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Request method failure captured: Jun 17 13:35:29.733453 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: request: GET /compute/v2.1/servers/26622189-19d7-4ce4-b2a8-8f50a6080307 HTTP/1.1 Jun 17 13:35:29.733453 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Accept: application/json Jun 17 13:35:29.733453 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Accept-Encoding: identity Jun 17 13:35:29.733453 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Connection: close Jun 17 13:35:29.733453 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Content-Length: 0 Jun 17 13:35:29.733453 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Content-Type: application/json Jun 17 13:35:29.733453 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Host: 10.222.0.48 Jun 17 13:35:29.733453 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Openstack-System-Scope: None Jun 17 13:35:29.733453 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: User-Agent: python-urllib3/1.26.9 Jun 17 13:35:29.733453 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Auth-Token: gAAAAABirHot9G0ec80w-7dFEBJ7HFl7IIcgVvLR7hTWA8J1DyAE7iTwXuDCoX5bY_4XJhfT6lNujAWwKIgX_BAUsO4EI1B0xhwYR-PYFd_9H1rc1sND_P8VGFbNecPEEPEdWnRNbwHHfQarvXh11Kj9bGDdr0IVMVJbCFA3PhbLss2wXItBDjY Jun 17 13:35:29.733453 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Domain-Id: None Jun 17 13:35:29.733453 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Domain-Name: None Jun 17 13:35:29.733453 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Identity-Status: Confirmed Jun 17 13:35:29.733453 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Is-Admin-Project: True Jun 17 13:35:29.733453 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Project-Domain-Id: default Jun 17 13:35:29.733453 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Project-Domain-Name: Default Jun 17 13:35:29.733453 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Project-Id: 13a3f9864ad04941bc902febad84876d Jun 17 13:35:29.733453 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Project-Name: tempest-AttachVolumeTestJSON-5002524 Jun 17 13:35:29.733453 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Role: member,reader Jun 17 13:35:29.733453 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Roles: member,reader Jun 17 13:35:29.734472 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_13a3f9864ad04941bc902febad84876d", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/13a3f9864ad04941bc902febad84876d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/13a3f9864ad04941bc902febad84876d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/13a3f9864ad04941bc902febad84876d"}]}] Jun 17 13:35:29.734472 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Tenant: tempest-AttachVolumeTestJSON-5002524 Jun 17 13:35:29.734472 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Tenant-Id: 13a3f9864ad04941bc902febad84876d Jun 17 13:35:29.734472 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Tenant-Name: tempest-AttachVolumeTestJSON-5002524 Jun 17 13:35:29.734472 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User: tempest-AttachVolumeTestJSON-5002524-project Jun 17 13:35:29.734472 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User-Domain-Id: default Jun 17 13:35:29.734472 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User-Domain-Name: Default Jun 17 13:35:29.734472 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User-Id: 8bfbd9324f8040c496a83eb599ca80c0 Jun 17 13:35:29.734472 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User-Name: tempest-AttachVolumeTestJSON-5002524-project Jun 17 13:35:29.734472 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: method: > Jun 17 13:35:29.734472 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: exception: Instance 26622189-19d7-4ce4-b2a8-8f50a6080307 could not be found. Jun 17 13:35:29.734472 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: action_args: {'id': '26622189-19d7-4ce4-b2a8-8f50a6080307'} Jun 17 13:35:29.735015 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 13:35:29.735015 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:35:29.735015 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 13:35:29.735015 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 13:35:29.735015 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 13:35:29.735015 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 13:35:29.735015 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 13:35:29.735015 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 13:35:29.735015 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 13:35:29.735015 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 13:35:29.735015 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26622189-19d7-4ce4-b2a8-8f50a6080307 could not be found. Jun 17 13:35:29.735015 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:35:29.735015 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:35:29.735015 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:35:29.735015 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:35:29.735015 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:35:29.735015 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:35:29.735015 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 13:35:29.735015 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 13:35:29.735015 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 13:35:29.735907 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 13:35:29.735907 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 13:35:29.735907 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 13:35:29.735907 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 13:35:29.735907 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 13:35:29.735907 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 13:35:29.735907 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 13:35:29.735907 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26622189-19d7-4ce4-b2a8-8f50a6080307 could not be found. Jun 17 13:35:29.735907 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:35:29.735907 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:35:29.735907 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:35:29.735907 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:35:29.735907 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:35:29.735907 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:35:29.735907 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 13:35:29.735907 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 13:35:29.735907 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26622189-19d7-4ce4-b2a8-8f50a6080307 could not be found. Jun 17 13:35:29.735907 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:35:29.738152 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-c63995ae-a011-49ee-868e-cfa939de3f6a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Returning 404 to user: Instance 26622189-19d7-4ce4-b2a8-8f50a6080307 could not be found. {{(pid=117659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 13:35:29.740354 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-c63995ae-a011-49ee-868e-cfa939de3f6a tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/26622189-19d7-4ce4-b2a8-8f50a6080307" status: 404 len: 111 microversion: 2.1 time: 0.037498 Jun 17 13:35:29.741387 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1736/3423] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:35:29 2022] GET /compute/v2.1/servers/26622189-19d7-4ce4-b2a8-8f50a6080307 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 17 13:35:29.927709 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-7ee1f907-4e79-4b26-a8cc-e84abf27cc68 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:35:29.937031 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-7ee1f907-4e79-4b26-a8cc-e84abf27cc68 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:35:29.938903 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-7ee1f907-4e79-4b26-a8cc-e84abf27cc68 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:35:29.940262 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-7ee1f907-4e79-4b26-a8cc-e84abf27cc68 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/53ede50e-496d-480c-b292-30e95344eaac" status: 200 len: 1730 microversion: 2.20 time: 0.250979 Jun 17 13:35:29.946185 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1688/3424] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:35:29 2022] GET /compute/v2.1/servers/53ede50e-496d-480c-b292-30e95344eaac => generated 1730 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:35:30.042999 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-3b4ac4f8-93f7-41eb-9578-4c1e1c58c5e1 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:35:30.043669 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-3b4ac4f8-93f7-41eb-9578-4c1e1c58c5e1 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] [instance: 4d474404-89d1-4844-bf86-75f6464a1a6f] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:35:30.049723 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-3b4ac4f8-93f7-41eb-9578-4c1e1c58c5e1 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:35:30.050210 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-3b4ac4f8-93f7-41eb-9578-4c1e1c58c5e1 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:35:30.050967 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-3b4ac4f8-93f7-41eb-9578-4c1e1c58c5e1 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:35:30.051432 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-3b4ac4f8-93f7-41eb-9578-4c1e1c58c5e1 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:35:30.065998 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.wsgi [None req-3b4ac4f8-93f7-41eb-9578-4c1e1c58c5e1 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] HTTP exception thrown: Instance 4d474404-89d1-4844-bf86-75f6464a1a6f could not be found. Jun 17 13:35:30.067837 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-3b4ac4f8-93f7-41eb-9578-4c1e1c58c5e1 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Request method failure captured: Jun 17 13:35:30.067837 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: request: GET /compute/v2.1/servers/4d474404-89d1-4844-bf86-75f6464a1a6f HTTP/1.1 Jun 17 13:35:30.067837 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Accept: application/json Jun 17 13:35:30.067837 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Accept-Encoding: identity Jun 17 13:35:30.067837 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Connection: close Jun 17 13:35:30.067837 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Content-Length: 0 Jun 17 13:35:30.067837 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Content-Type: application/json Jun 17 13:35:30.067837 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Host: 10.222.0.48 Jun 17 13:35:30.067837 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Openstack-System-Scope: None Jun 17 13:35:30.067837 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: User-Agent: python-urllib3/1.26.9 Jun 17 13:35:30.067837 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Auth-Token: gAAAAABirHtJLCe2LP9MRlJDle7vvcWMIS_cCFhmeW5lXWgl7DKiqidAB5tTXlYaElJ2a_UVwuEPiK1yoTFws0P3TFX2eFYka44vecr0bPBwst2ud9dcIMeb-f70G8jqnmiPJkvqd5D0pAagP8LY3L5m32ekpx4SCjzJ2BGPGVtPjt3hN_62p7g Jun 17 13:35:30.067837 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Domain-Id: None Jun 17 13:35:30.067837 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Domain-Name: None Jun 17 13:35:30.067837 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Identity-Status: Confirmed Jun 17 13:35:30.067837 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Is-Admin-Project: True Jun 17 13:35:30.067837 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Project-Domain-Id: default Jun 17 13:35:30.067837 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Project-Domain-Name: Default Jun 17 13:35:30.067837 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Project-Id: 834ac53907e54975851947e5f653c688 Jun 17 13:35:30.067837 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1799690958 Jun 17 13:35:30.067837 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Role: member,reader Jun 17 13:35:30.067837 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Roles: member,reader Jun 17 13:35:30.069093 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_834ac53907e54975851947e5f653c688", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/834ac53907e54975851947e5f653c688"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/834ac53907e54975851947e5f653c688"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/834ac53907e54975851947e5f653c688"}]}] Jun 17 13:35:30.069093 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Tenant: tempest-VolumesSnapshotTestJSON-1799690958 Jun 17 13:35:30.069093 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Tenant-Id: 834ac53907e54975851947e5f653c688 Jun 17 13:35:30.069093 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1799690958 Jun 17 13:35:30.069093 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User: tempest-VolumesSnapshotTestJSON-1799690958-project Jun 17 13:35:30.069093 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User-Domain-Id: default Jun 17 13:35:30.069093 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User-Domain-Name: Default Jun 17 13:35:30.069093 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User-Id: c6bc5146c28948c5859cd9eb3d09e0cf Jun 17 13:35:30.069093 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User-Name: tempest-VolumesSnapshotTestJSON-1799690958-project Jun 17 13:35:30.069093 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: method: > Jun 17 13:35:30.069093 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: exception: Instance 4d474404-89d1-4844-bf86-75f6464a1a6f could not be found. Jun 17 13:35:30.069093 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: action_args: {'id': '4d474404-89d1-4844-bf86-75f6464a1a6f'} Jun 17 13:35:30.069802 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 13:35:30.069802 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:35:30.069802 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 13:35:30.069802 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 13:35:30.069802 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 13:35:30.069802 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 13:35:30.069802 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 13:35:30.069802 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 13:35:30.069802 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 13:35:30.069802 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 13:35:30.069802 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d474404-89d1-4844-bf86-75f6464a1a6f could not be found. Jun 17 13:35:30.069802 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:35:30.069802 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:35:30.069802 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:35:30.069802 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:35:30.069802 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:35:30.069802 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:35:30.069802 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 13:35:30.069802 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 13:35:30.069802 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 13:35:30.070948 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 13:35:30.070948 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 13:35:30.070948 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 13:35:30.070948 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 13:35:30.070948 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 13:35:30.070948 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 13:35:30.070948 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 13:35:30.070948 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d474404-89d1-4844-bf86-75f6464a1a6f could not be found. Jun 17 13:35:30.070948 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:35:30.070948 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:35:30.070948 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:35:30.070948 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:35:30.070948 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:35:30.070948 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:35:30.070948 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 13:35:30.070948 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 13:35:30.070948 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d474404-89d1-4844-bf86-75f6464a1a6f could not be found. Jun 17 13:35:30.070948 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:35:30.071756 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-3b4ac4f8-93f7-41eb-9578-4c1e1c58c5e1 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] Returning 404 to user: Instance 4d474404-89d1-4844-bf86-75f6464a1a6f could not be found. {{(pid=117659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 13:35:30.071756 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-3b4ac4f8-93f7-41eb-9578-4c1e1c58c5e1 tempest-VolumesSnapshotTestJSON-1799690958 tempest-VolumesSnapshotTestJSON-1799690958-project] 10.222.0.48 "GET /compute/v2.1/servers/4d474404-89d1-4844-bf86-75f6464a1a6f" status: 404 len: 111 microversion: 2.1 time: 0.030750 Jun 17 13:35:30.071756 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1737/3425] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:35:30 2022] GET /compute/v2.1/servers/4d474404-89d1-4844-bf86-75f6464a1a6f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 13:35:30.920206 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-823836a8-d497-4865-b766-7097b25e3619 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:35:30.920672 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-823836a8-d497-4865-b766-7097b25e3619 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:35:30.927104 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-823836a8-d497-4865-b766-7097b25e3619 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:35:30.927590 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-823836a8-d497-4865-b766-7097b25e3619 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:35:30.928316 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-823836a8-d497-4865-b766-7097b25e3619 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:35:30.928743 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-823836a8-d497-4865-b766-7097b25e3619 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:35:30.931985 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=100 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:35:30.944745 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.wsgi [None req-823836a8-d497-4865-b766-7097b25e3619 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] HTTP exception thrown: Instance 748a3422-aeab-41c8-b051-df5f7d7ca509 could not be found. Jun 17 13:35:30.946618 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-823836a8-d497-4865-b766-7097b25e3619 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Request method failure captured: Jun 17 13:35:30.946618 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: request: DELETE /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 HTTP/1.1 Jun 17 13:35:30.946618 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Accept: application/json Jun 17 13:35:30.946618 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Accept-Encoding: identity Jun 17 13:35:30.946618 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Connection: close Jun 17 13:35:30.946618 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Content-Length: 0 Jun 17 13:35:30.946618 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Content-Type: application/json Jun 17 13:35:30.946618 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Host: 10.222.0.48 Jun 17 13:35:30.946618 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Openstack-System-Scope: None Jun 17 13:35:30.946618 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: User-Agent: python-urllib3/1.26.9 Jun 17 13:35:30.946618 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Auth-Token: gAAAAABirHot9G0ec80w-7dFEBJ7HFl7IIcgVvLR7hTWA8J1DyAE7iTwXuDCoX5bY_4XJhfT6lNujAWwKIgX_BAUsO4EI1B0xhwYR-PYFd_9H1rc1sND_P8VGFbNecPEEPEdWnRNbwHHfQarvXh11Kj9bGDdr0IVMVJbCFA3PhbLss2wXItBDjY Jun 17 13:35:30.946618 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Domain-Id: None Jun 17 13:35:30.946618 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Domain-Name: None Jun 17 13:35:30.946618 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Identity-Status: Confirmed Jun 17 13:35:30.946618 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Is-Admin-Project: True Jun 17 13:35:30.946618 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Project-Domain-Id: default Jun 17 13:35:30.946618 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Project-Domain-Name: Default Jun 17 13:35:30.946618 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Project-Id: 13a3f9864ad04941bc902febad84876d Jun 17 13:35:30.946618 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Project-Name: tempest-AttachVolumeTestJSON-5002524 Jun 17 13:35:30.946618 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Role: member,reader Jun 17 13:35:30.946618 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Roles: member,reader Jun 17 13:35:30.948055 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_13a3f9864ad04941bc902febad84876d", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/13a3f9864ad04941bc902febad84876d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/13a3f9864ad04941bc902febad84876d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/13a3f9864ad04941bc902febad84876d"}]}] Jun 17 13:35:30.948055 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Tenant: tempest-AttachVolumeTestJSON-5002524 Jun 17 13:35:30.948055 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Tenant-Id: 13a3f9864ad04941bc902febad84876d Jun 17 13:35:30.948055 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Tenant-Name: tempest-AttachVolumeTestJSON-5002524 Jun 17 13:35:30.948055 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-User: tempest-AttachVolumeTestJSON-5002524-project Jun 17 13:35:30.948055 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-User-Domain-Id: default Jun 17 13:35:30.948055 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-User-Domain-Name: Default Jun 17 13:35:30.948055 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-User-Id: 8bfbd9324f8040c496a83eb599ca80c0 Jun 17 13:35:30.948055 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-User-Name: tempest-AttachVolumeTestJSON-5002524-project Jun 17 13:35:30.948055 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: method: > Jun 17 13:35:30.948055 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: exception: Instance 748a3422-aeab-41c8-b051-df5f7d7ca509 could not be found. Jun 17 13:35:30.948055 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: action_args: {'id': '748a3422-aeab-41c8-b051-df5f7d7ca509'} Jun 17 13:35:30.948735 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 13:35:30.948735 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:35:30.948735 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 13:35:30.948735 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 13:35:30.948735 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 13:35:30.948735 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 13:35:30.948735 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 13:35:30.948735 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 13:35:30.948735 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 13:35:30.948735 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 13:35:30.948735 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 748a3422-aeab-41c8-b051-df5f7d7ca509 could not be found. Jun 17 13:35:30.948735 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 13:35:30.948735 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:35:30.948735 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 13:35:30.948735 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:35:30.948735 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:35:30.948735 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:35:30.948735 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 13:35:30.948735 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 13:35:30.948735 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 13:35:30.949801 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 13:35:30.949801 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 17 13:35:30.949801 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 17 13:35:30.949801 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 17 13:35:30.949801 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 17 13:35:30.949801 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 13:35:30.949801 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 13:35:30.949801 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 13:35:30.949801 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 13:35:30.949801 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 748a3422-aeab-41c8-b051-df5f7d7ca509 could not be found. Jun 17 13:35:30.949801 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 13:35:30.949801 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:35:30.949801 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 13:35:30.949801 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:35:30.949801 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:35:30.949801 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:35:30.949801 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 13:35:30.949801 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 13:35:30.949801 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 748a3422-aeab-41c8-b051-df5f7d7ca509 could not be found. Jun 17 13:35:30.949801 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 13:35:30.950925 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-823836a8-d497-4865-b766-7097b25e3619 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Returning 404 to user: Instance 748a3422-aeab-41c8-b051-df5f7d7ca509 could not be found. {{(pid=117660) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 13:35:30.950925 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-823836a8-d497-4865-b766-7097b25e3619 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "DELETE /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 404 len: 111 microversion: 2.1 time: 0.031752 Jun 17 13:35:30.951719 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1689/3426] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Jun 17 13:35:30 2022] DELETE /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 13:35:30.957304 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-a1af9015-dde9-4628-b0de-5f3fc3939d82 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:35:30.957993 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-a1af9015-dde9-4628-b0de-5f3fc3939d82 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] [instance: 748a3422-aeab-41c8-b051-df5f7d7ca509] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:35:30.959154 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-c9958039-797c-412c-b5ec-e03c0f4ae10e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:35:30.959754 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-c9958039-797c-412c-b5ec-e03c0f4ae10e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: 53ede50e-496d-480c-b292-30e95344eaac] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:35:30.966229 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c9958039-797c-412c-b5ec-e03c0f4ae10e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:35:30.966673 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c9958039-797c-412c-b5ec-e03c0f4ae10e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:35:30.967189 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a1af9015-dde9-4628-b0de-5f3fc3939d82 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:35:30.967423 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c9958039-797c-412c-b5ec-e03c0f4ae10e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:35:30.967770 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a1af9015-dde9-4628-b0de-5f3fc3939d82 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:35:30.967855 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c9958039-797c-412c-b5ec-e03c0f4ae10e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:35:30.968688 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a1af9015-dde9-4628-b0de-5f3fc3939d82 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:35:30.969161 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a1af9015-dde9-4628-b0de-5f3fc3939d82 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:35:30.984240 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.wsgi [None req-a1af9015-dde9-4628-b0de-5f3fc3939d82 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] HTTP exception thrown: Instance 748a3422-aeab-41c8-b051-df5f7d7ca509 could not be found. Jun 17 13:35:30.986006 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-a1af9015-dde9-4628-b0de-5f3fc3939d82 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Request method failure captured: Jun 17 13:35:30.986006 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: request: GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 HTTP/1.1 Jun 17 13:35:30.986006 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Accept: application/json Jun 17 13:35:30.986006 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Accept-Encoding: identity Jun 17 13:35:30.986006 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Connection: close Jun 17 13:35:30.986006 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Content-Length: 0 Jun 17 13:35:30.986006 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Content-Type: application/json Jun 17 13:35:30.986006 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Host: 10.222.0.48 Jun 17 13:35:30.986006 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Openstack-System-Scope: None Jun 17 13:35:30.986006 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: User-Agent: python-urllib3/1.26.9 Jun 17 13:35:30.986006 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Auth-Token: gAAAAABirHot9G0ec80w-7dFEBJ7HFl7IIcgVvLR7hTWA8J1DyAE7iTwXuDCoX5bY_4XJhfT6lNujAWwKIgX_BAUsO4EI1B0xhwYR-PYFd_9H1rc1sND_P8VGFbNecPEEPEdWnRNbwHHfQarvXh11Kj9bGDdr0IVMVJbCFA3PhbLss2wXItBDjY Jun 17 13:35:30.986006 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Domain-Id: None Jun 17 13:35:30.986006 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Domain-Name: None Jun 17 13:35:30.986006 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Identity-Status: Confirmed Jun 17 13:35:30.986006 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Is-Admin-Project: True Jun 17 13:35:30.986006 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Project-Domain-Id: default Jun 17 13:35:30.986006 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Project-Domain-Name: Default Jun 17 13:35:30.986006 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Project-Id: 13a3f9864ad04941bc902febad84876d Jun 17 13:35:30.986006 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Project-Name: tempest-AttachVolumeTestJSON-5002524 Jun 17 13:35:30.986006 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Role: member,reader Jun 17 13:35:30.986006 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Roles: member,reader Jun 17 13:35:30.987159 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_13a3f9864ad04941bc902febad84876d", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/13a3f9864ad04941bc902febad84876d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/13a3f9864ad04941bc902febad84876d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/13a3f9864ad04941bc902febad84876d"}]}] Jun 17 13:35:30.987159 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Tenant: tempest-AttachVolumeTestJSON-5002524 Jun 17 13:35:30.987159 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Tenant-Id: 13a3f9864ad04941bc902febad84876d Jun 17 13:35:30.987159 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Tenant-Name: tempest-AttachVolumeTestJSON-5002524 Jun 17 13:35:30.987159 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User: tempest-AttachVolumeTestJSON-5002524-project Jun 17 13:35:30.987159 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User-Domain-Id: default Jun 17 13:35:30.987159 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User-Domain-Name: Default Jun 17 13:35:30.987159 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User-Id: 8bfbd9324f8040c496a83eb599ca80c0 Jun 17 13:35:30.987159 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User-Name: tempest-AttachVolumeTestJSON-5002524-project Jun 17 13:35:30.987159 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: method: > Jun 17 13:35:30.987159 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: exception: Instance 748a3422-aeab-41c8-b051-df5f7d7ca509 could not be found. Jun 17 13:35:30.987159 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: action_args: {'id': '748a3422-aeab-41c8-b051-df5f7d7ca509'} Jun 17 13:35:30.987915 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 13:35:30.987915 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:35:30.987915 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 13:35:30.987915 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 13:35:30.987915 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 13:35:30.987915 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 13:35:30.987915 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 13:35:30.987915 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 13:35:30.987915 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 13:35:30.987915 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 13:35:30.987915 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 748a3422-aeab-41c8-b051-df5f7d7ca509 could not be found. Jun 17 13:35:30.987915 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:35:30.987915 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:35:30.987915 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:35:30.987915 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:35:30.987915 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:35:30.987915 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:35:30.987915 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 13:35:30.987915 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 13:35:30.987915 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 13:35:30.988972 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 13:35:30.988972 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 13:35:30.988972 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 13:35:30.988972 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 13:35:30.988972 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 13:35:30.988972 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 13:35:30.988972 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 13:35:30.988972 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 748a3422-aeab-41c8-b051-df5f7d7ca509 could not be found. Jun 17 13:35:30.988972 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:35:30.988972 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:35:30.988972 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:35:30.988972 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:35:30.988972 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:35:30.988972 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:35:30.988972 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 13:35:30.988972 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 13:35:30.988972 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 748a3422-aeab-41c8-b051-df5f7d7ca509 could not be found. Jun 17 13:35:30.988972 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:35:30.990716 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-a1af9015-dde9-4628-b0de-5f3fc3939d82 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] Returning 404 to user: Instance 748a3422-aeab-41c8-b051-df5f7d7ca509 could not be found. {{(pid=117659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 13:35:30.991560 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-a1af9015-dde9-4628-b0de-5f3fc3939d82 tempest-AttachVolumeTestJSON-5002524 tempest-AttachVolumeTestJSON-5002524-project] 10.222.0.48 "GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509" status: 404 len: 111 microversion: 2.1 time: 0.038620 Jun 17 13:35:30.992766 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1738/3427] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:35:30 2022] GET /compute/v2.1/servers/748a3422-aeab-41c8-b051-df5f7d7ca509 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 13:35:31.147877 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-c9958039-797c-412c-b5ec-e03c0f4ae10e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:35:31.156353 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-c9958039-797c-412c-b5ec-e03c0f4ae10e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:35:31.157865 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-c9958039-797c-412c-b5ec-e03c0f4ae10e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:35:31.159051 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-c9958039-797c-412c-b5ec-e03c0f4ae10e tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/53ede50e-496d-480c-b292-30e95344eaac" status: 200 len: 1717 microversion: 2.20 time: 0.203871 Jun 17 13:35:31.159579 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1690/3428] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:35:30 2022] GET /compute/v2.1/servers/53ede50e-496d-480c-b292-30e95344eaac => generated 1717 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:35:35.854241 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-324145de-1fe4-47b2-a89b-38d9b514523f tempest-VolumesGetTestJSON-1322571319 tempest-VolumesGetTestJSON-1322571319-project] Action: 'create', calling method: .version_select at 0x7f019016e670>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-847340773", "metadata": {"Type": "work"}}} {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:35:36.179318 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-324145de-1fe4-47b2-a89b-38d9b514523f tempest-VolumesGetTestJSON-1322571319 tempest-VolumesGetTestJSON-1322571319-project] 10.222.0.48 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.443269 Jun 17 13:35:36.190843 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-549c0b39-c1b6-485a-9c7a-ac7a595d48ee tempest-VolumesGetTestJSON-1322571319 tempest-VolumesGetTestJSON-1322571319-project] Calling method '.version_select at 0x7f01948f1d30>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:35:36.197281 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1739/3429] 10.222.0.48 () {60 vars in 1155 bytes} [Fri Jun 17 13:35:35 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 462 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 17 13:35:36.248417 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-549c0b39-c1b6-485a-9c7a-ac7a595d48ee tempest-VolumesGetTestJSON-1322571319 tempest-VolumesGetTestJSON-1322571319-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/4519f6da-13ba-4236-90bf-36dc32d31cf5" status: 200 len: 352 microversion: 2.1 time: 0.061387 Jun 17 13:35:36.248996 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1691/3430] 10.222.0.48 () {58 vars in 1244 bytes} [Fri Jun 17 13:35:36 2022] GET /compute/v2.1/os-volumes/4519f6da-13ba-4236-90bf-36dc32d31cf5 => generated 352 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 13:35:37.263010 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-c96504ff-3dfc-44bc-9bec-750e1fb10f6e tempest-VolumesGetTestJSON-1322571319 tempest-VolumesGetTestJSON-1322571319-project] Calling method '.version_select at 0x7f01902e6af0>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:35:37.311588 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-c96504ff-3dfc-44bc-9bec-750e1fb10f6e tempest-VolumesGetTestJSON-1322571319 tempest-VolumesGetTestJSON-1322571319-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/4519f6da-13ba-4236-90bf-36dc32d31cf5" status: 200 len: 352 microversion: 2.1 time: 0.053631 Jun 17 13:35:37.312667 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1740/3431] 10.222.0.48 () {58 vars in 1244 bytes} [Fri Jun 17 13:35:37 2022] GET /compute/v2.1/os-volumes/4519f6da-13ba-4236-90bf-36dc32d31cf5 => generated 352 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:35:38.324585 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-e8744a55-807d-44db-8c1d-ae7edf5a542b tempest-VolumesGetTestJSON-1322571319 tempest-VolumesGetTestJSON-1322571319-project] Calling method '.version_select at 0x7f01948f6a60>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:35:38.371673 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-e8744a55-807d-44db-8c1d-ae7edf5a542b tempest-VolumesGetTestJSON-1322571319 tempest-VolumesGetTestJSON-1322571319-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/4519f6da-13ba-4236-90bf-36dc32d31cf5" status: 200 len: 353 microversion: 2.1 time: 0.051507 Jun 17 13:35:38.372254 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1692/3432] 10.222.0.48 () {58 vars in 1244 bytes} [Fri Jun 17 13:35:38 2022] GET /compute/v2.1/os-volumes/4519f6da-13ba-4236-90bf-36dc32d31cf5 => generated 353 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:35:38.383635 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-f2d688a2-a0ab-4dc0-9769-5d8f2da06fb2 tempest-VolumesGetTestJSON-1322571319 tempest-VolumesGetTestJSON-1322571319-project] Calling method '.version_select at 0x7f01901a4e50>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:35:38.433189 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-f2d688a2-a0ab-4dc0-9769-5d8f2da06fb2 tempest-VolumesGetTestJSON-1322571319 tempest-VolumesGetTestJSON-1322571319-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/4519f6da-13ba-4236-90bf-36dc32d31cf5" status: 200 len: 353 microversion: 2.1 time: 0.053894 Jun 17 13:35:38.433763 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1741/3433] 10.222.0.48 () {58 vars in 1244 bytes} [Fri Jun 17 13:35:38 2022] GET /compute/v2.1/os-volumes/4519f6da-13ba-4236-90bf-36dc32d31cf5 => generated 353 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:35:38.453484 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-5d590886-2d2e-4b59-a05b-9bf6ee4414cb tempest-VolumesGetTestJSON-1322571319 tempest-VolumesGetTestJSON-1322571319-project] Calling method '.version_select at 0x7f0183d84af0>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:35:38.519388 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-5d590886-2d2e-4b59-a05b-9bf6ee4414cb tempest-VolumesGetTestJSON-1322571319 tempest-VolumesGetTestJSON-1322571319-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/4519f6da-13ba-4236-90bf-36dc32d31cf5" status: 202 len: 0 microversion: 2.1 time: 0.069545 Jun 17 13:35:38.519999 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1693/3434] 10.222.0.48 () {58 vars in 1247 bytes} [Fri Jun 17 13:35:38 2022] DELETE /compute/v2.1/os-volumes/4519f6da-13ba-4236-90bf-36dc32d31cf5 => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 13:35:38.529959 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-b4476b01-011f-4f04-8da4-1f0339400dcf tempest-VolumesGetTestJSON-1322571319 tempest-VolumesGetTestJSON-1322571319-project] Calling method '.version_select at 0x7f01902e6310>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:35:38.578449 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-b4476b01-011f-4f04-8da4-1f0339400dcf tempest-VolumesGetTestJSON-1322571319 tempest-VolumesGetTestJSON-1322571319-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/4519f6da-13ba-4236-90bf-36dc32d31cf5" status: 200 len: 352 microversion: 2.1 time: 0.053628 Jun 17 13:35:38.579026 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1742/3435] 10.222.0.48 () {58 vars in 1244 bytes} [Fri Jun 17 13:35:38 2022] GET /compute/v2.1/os-volumes/4519f6da-13ba-4236-90bf-36dc32d31cf5 => generated 352 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:35:39.591192 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-ebec5815-79f7-4c35-afb5-3e2ac2aee449 tempest-VolumesGetTestJSON-1322571319 tempest-VolumesGetTestJSON-1322571319-project] Calling method '.version_select at 0x7f0183de71f0>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:35:39.620241 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.wsgi [None req-ebec5815-79f7-4c35-afb5-3e2ac2aee449 tempest-VolumesGetTestJSON-1322571319 tempest-VolumesGetTestJSON-1322571319-project] HTTP exception thrown: Volume 4519f6da-13ba-4236-90bf-36dc32d31cf5 could not be found. Jun 17 13:35:39.622280 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-ebec5815-79f7-4c35-afb5-3e2ac2aee449 tempest-VolumesGetTestJSON-1322571319 tempest-VolumesGetTestJSON-1322571319-project] Request method failure captured: Jun 17 13:35:39.622280 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: request: GET /compute/v2.1/os-volumes/4519f6da-13ba-4236-90bf-36dc32d31cf5 HTTP/1.1 Jun 17 13:35:39.622280 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Accept: application/json Jun 17 13:35:39.622280 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Accept-Encoding: identity Jun 17 13:35:39.622280 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Connection: close Jun 17 13:35:39.622280 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Content-Length: 0 Jun 17 13:35:39.622280 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Content-Type: application/json Jun 17 13:35:39.622280 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Host: 10.222.0.48 Jun 17 13:35:39.622280 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Openstack-System-Scope: None Jun 17 13:35:39.622280 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: User-Agent: python-urllib3/1.26.9 Jun 17 13:35:39.622280 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Auth-Token: gAAAAABirIMnUgjhjIZHJ1IPbGF9GboFuaZ3P2-Z0z30vxMTzG1hRXTw8TZnJIDYVlPO2usK-hldsjn682MGD7nnA0mnJ9Jvpf9ppMfzSGkOZPFBdiC2t0khuWpTh2-lt28G_HdjodKhwDza1KhGC2hzGqgr6xKlxaNzsM0To8CifknSI9GgcOU Jun 17 13:35:39.622280 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Domain-Id: None Jun 17 13:35:39.622280 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Domain-Name: None Jun 17 13:35:39.622280 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Identity-Status: Confirmed Jun 17 13:35:39.622280 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Is-Admin-Project: True Jun 17 13:35:39.622280 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Project-Domain-Id: default Jun 17 13:35:39.622280 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Project-Domain-Name: Default Jun 17 13:35:39.622280 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Project-Id: 914f522801294f9298927cec1f3c4ccc Jun 17 13:35:39.622280 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Project-Name: tempest-VolumesGetTestJSON-1322571319 Jun 17 13:35:39.622280 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Role: member,reader Jun 17 13:35:39.622280 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Roles: member,reader Jun 17 13:35:39.623577 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_914f522801294f9298927cec1f3c4ccc", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/914f522801294f9298927cec1f3c4ccc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/914f522801294f9298927cec1f3c4ccc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/914f522801294f9298927cec1f3c4ccc"}]}] Jun 17 13:35:39.623577 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Tenant: tempest-VolumesGetTestJSON-1322571319 Jun 17 13:35:39.623577 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Tenant-Id: 914f522801294f9298927cec1f3c4ccc Jun 17 13:35:39.623577 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Tenant-Name: tempest-VolumesGetTestJSON-1322571319 Jun 17 13:35:39.623577 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-User: tempest-VolumesGetTestJSON-1322571319-project Jun 17 13:35:39.623577 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-User-Domain-Id: default Jun 17 13:35:39.623577 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-User-Domain-Name: Default Jun 17 13:35:39.623577 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-User-Id: 0443ce09d57541c78ab475377e4fe1fb Jun 17 13:35:39.623577 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-User-Name: tempest-VolumesGetTestJSON-1322571319-project Jun 17 13:35:39.623577 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: method: Jun 17 13:35:39.623577 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: exception: Volume 4519f6da-13ba-4236-90bf-36dc32d31cf5 could not be found. Jun 17 13:35:39.623577 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: action_args: {'id': '4519f6da-13ba-4236-90bf-36dc32d31cf5'} Jun 17 13:35:39.623577 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 13:35:39.624355 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:35:39.624355 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 13:35:39.624355 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 13:35:39.624355 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 17 13:35:39.624355 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 17 13:35:39.624355 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 17 13:35:39.624355 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 17 13:35:39.624355 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 17 13:35:39.624355 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 17 13:35:39.624355 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 17 13:35:39.624355 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 17 13:35:39.624355 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 13:35:39.624355 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 13:35:39.624355 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 13:35:39.624355 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 13:35:39.624355 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4519f6da-13ba-4236-90bf-36dc32d31cf5 could not be found. (HTTP 404) (Request-ID: req-2f278ed7-6a65-4efb-b272-7d347e75fa41) Jun 17 13:35:39.624355 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 13:35:39.624355 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:35:39.624355 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 13:35:39.625462 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:35:39.625462 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 17 13:35:39.625462 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 17 13:35:39.625462 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 13:35:39.625462 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 13:35:39.625462 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 17 13:35:39.625462 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 17 13:35:39.625462 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 17 13:35:39.625462 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 17 13:35:39.625462 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 13:35:39.625462 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 13:35:39.625462 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 17 13:35:39.625462 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 17 13:35:39.625462 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 17 13:35:39.625462 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 17 13:35:39.625462 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 17 13:35:39.625462 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 17 13:35:39.625462 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 17 13:35:39.625462 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 17 13:35:39.627061 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 13:35:39.627061 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 13:35:39.627061 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 13:35:39.627061 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 13:35:39.627061 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4519f6da-13ba-4236-90bf-36dc32d31cf5 could not be found. Jun 17 13:35:39.627061 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 13:35:39.627061 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:35:39.627061 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 13:35:39.627061 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:35:39.627061 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:35:39.627061 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:35:39.627061 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 13:35:39.627061 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 13:35:39.627061 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 17 13:35:39.627061 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 17 13:35:39.627061 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 13:35:39.627061 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 13:35:39.627061 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 17 13:35:39.627061 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 13:35:39.628129 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4519f6da-13ba-4236-90bf-36dc32d31cf5 could not be found. Jun 17 13:35:39.628129 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 13:35:39.628129 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:35:39.628129 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 13:35:39.628129 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:35:39.628129 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:35:39.628129 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:35:39.628129 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 13:35:39.628129 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 13:35:39.628129 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4519f6da-13ba-4236-90bf-36dc32d31cf5 could not be found. Jun 17 13:35:39.628129 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 13:35:39.628129 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-ebec5815-79f7-4c35-afb5-3e2ac2aee449 tempest-VolumesGetTestJSON-1322571319 tempest-VolumesGetTestJSON-1322571319-project] Returning 404 to user: Volume 4519f6da-13ba-4236-90bf-36dc32d31cf5 could not be found. {{(pid=117660) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 13:35:39.628129 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-ebec5815-79f7-4c35-afb5-3e2ac2aee449 tempest-VolumesGetTestJSON-1322571319 tempest-VolumesGetTestJSON-1322571319-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/4519f6da-13ba-4236-90bf-36dc32d31cf5" status: 404 len: 109 microversion: 2.1 time: 0.037000 Jun 17 13:35:39.628129 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1694/3436] 10.222.0.48 () {58 vars in 1244 bytes} [Fri Jun 17 13:35:39 2022] GET /compute/v2.1/os-volumes/4519f6da-13ba-4236-90bf-36dc32d31cf5 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 13:36:47.961356 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:36:47.962118 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:36:47.966923 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-ec228970-6475-44c8-91cd-3d0557e9ea42 tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1663897605", "imageRef": "ccec3e37-1df8-4f10-a8f6-f97dfac54cf5", "flavorRef": "452", "networks": [{"uuid": "587d0679-e82e-47ed-8ce8-1f2f41091158"}]}} {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:36:48.022635 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.network.neutron [None req-ec228970-6475-44c8-91cd-3d0557e9ea42 tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] validate_networks() for [('587d0679-e82e-47ed-8ce8-1f2f41091158', None, None, None, None, None)] {{(pid=117659) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 17 13:36:48.454159 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.virt.hardware [None req-ec228970-6475-44c8-91cd-3d0557e9ea42 tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Flavor limits 0:0:0 {{(pid=117659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 17 13:36:48.454884 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.virt.hardware [None req-ec228970-6475-44c8-91cd-3d0557e9ea42 tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Image limits 0:0:0 {{(pid=117659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 17 13:36:48.455654 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.virt.hardware [None req-ec228970-6475-44c8-91cd-3d0557e9ea42 tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Flavor pref 0:0:0 {{(pid=117659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 17 13:36:48.456358 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.virt.hardware [None req-ec228970-6475-44c8-91cd-3d0557e9ea42 tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Image pref 0:0:0 {{(pid=117659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 17 13:36:48.457008 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.virt.hardware [None req-ec228970-6475-44c8-91cd-3d0557e9ea42 tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 17 13:36:48.471837 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ec228970-6475-44c8-91cd-3d0557e9ea42 tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:36:48.472581 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ec228970-6475-44c8-91cd-3d0557e9ea42 tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:36:48.473868 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ec228970-6475-44c8-91cd-3d0557e9ea42 tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:36:48.474559 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ec228970-6475-44c8-91cd-3d0557e9ea42 tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:36:48.492363 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.quota [None req-ec228970-6475-44c8-91cd-3d0557e9ea42 tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Getting quotas for project 0913f851ff164415a466c466de1ece6e. Resources: {'ram', 'cores', 'instances'} {{(pid=117659) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 13:36:48.496768 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.quota [None req-ec228970-6475-44c8-91cd-3d0557e9ea42 tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Getting quotas for user 0a3da974f5be44e2946fc0d3b9423d9d and project 0913f851ff164415a466c466de1ece6e. Resources: {'ram', 'cores', 'instances'} {{(pid=117659) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 13:36:48.508875 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-ec228970-6475-44c8-91cd-3d0557e9ea42 tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Going to run 1 instances... {{(pid=117659) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 17 13:36:48.511153 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-ec228970-6475-44c8-91cd-3d0557e9ea42 tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] [instance: 11c884ea-957b-4494-9108-6276ac898718] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ccec3e37-1df8-4f10-a8f6-f97dfac54cf5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117659) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 17 13:36:48.561681 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-ec228970-6475-44c8-91cd-3d0557e9ea42 tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.602338 Jun 17 13:36:48.562330 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1743/3437] 10.222.0.48 () {60 vars in 1146 bytes} [Fri Jun 17 13:36:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 604 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 17 13:36:48.570202 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_api:SELECT=28,nova_api:DELETE=1 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:36:48.571312 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=7 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:36:48.576289 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-e5e467e1-06c9-4bbf-b237-1575cb595dda tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:36:48.576505 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-e5e467e1-06c9-4bbf-b237-1575cb595dda tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] [instance: 11c884ea-957b-4494-9108-6276ac898718] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:36:48.638638 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-e5e467e1-06c9-4bbf-b237-1575cb595dda tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3da974f5be44e2946fc0d3b9423d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0913f851ff164415a466c466de1ece6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:36:48.646076 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-e5e467e1-06c9-4bbf-b237-1575cb595dda tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] 10.222.0.48 "GET /compute/v2.1/servers/11c884ea-957b-4494-9108-6276ac898718" status: 200 len: 1214 microversion: 2.1 time: 0.077635 Jun 17 13:36:48.646682 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1695/3438] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:36:48 2022] GET /compute/v2.1/servers/11c884ea-957b-4494-9108-6276ac898718 => generated 1214 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 13:36:49.664391 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-66b7ca6c-ebf5-4d7f-9022-86c964e6d171 tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:36:49.665025 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-66b7ca6c-ebf5-4d7f-9022-86c964e6d171 tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] [instance: 11c884ea-957b-4494-9108-6276ac898718] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:36:49.720042 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-66b7ca6c-ebf5-4d7f-9022-86c964e6d171 tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3da974f5be44e2946fc0d3b9423d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0913f851ff164415a466c466de1ece6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:36:49.727784 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-66b7ca6c-ebf5-4d7f-9022-86c964e6d171 tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] 10.222.0.48 "GET /compute/v2.1/servers/11c884ea-957b-4494-9108-6276ac898718" status: 200 len: 1214 microversion: 2.1 time: 0.067818 Jun 17 13:36:49.728354 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1744/3439] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:36:49 2022] GET /compute/v2.1/servers/11c884ea-957b-4494-9108-6276ac898718 => generated 1214 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:36:50.749227 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-acf94ea4-1469-41a1-b040-9e375436503e tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:36:50.750328 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-acf94ea4-1469-41a1-b040-9e375436503e tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] [instance: 11c884ea-957b-4494-9108-6276ac898718] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:36:50.818539 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-acf94ea4-1469-41a1-b040-9e375436503e tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3da974f5be44e2946fc0d3b9423d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0913f851ff164415a466c466de1ece6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:36:50.825989 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-acf94ea4-1469-41a1-b040-9e375436503e tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] 10.222.0.48 "GET /compute/v2.1/servers/11c884ea-957b-4494-9108-6276ac898718" status: 200 len: 1214 microversion: 2.1 time: 0.083580 Jun 17 13:36:50.826630 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1696/3440] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:36:50 2022] GET /compute/v2.1/servers/11c884ea-957b-4494-9108-6276ac898718 => generated 1214 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:36:51.846156 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-2f9b9980-2a55-4ee4-b38d-c0990f9cccb9 tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:36:51.847140 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-2f9b9980-2a55-4ee4-b38d-c0990f9cccb9 tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] [instance: 11c884ea-957b-4494-9108-6276ac898718] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:36:51.911760 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-2f9b9980-2a55-4ee4-b38d-c0990f9cccb9 tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3da974f5be44e2946fc0d3b9423d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0913f851ff164415a466c466de1ece6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:36:51.919701 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-2f9b9980-2a55-4ee4-b38d-c0990f9cccb9 tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] 10.222.0.48 "GET /compute/v2.1/servers/11c884ea-957b-4494-9108-6276ac898718" status: 200 len: 1214 microversion: 2.1 time: 0.080064 Jun 17 13:36:51.920274 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1745/3441] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:36:51 2022] GET /compute/v2.1/servers/11c884ea-957b-4494-9108-6276ac898718 => generated 1214 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:36:52.940789 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-3e4a6a0b-224a-4676-9018-6bdb5e5c84ec tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:36:52.941785 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-3e4a6a0b-224a-4676-9018-6bdb5e5c84ec tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] [instance: 11c884ea-957b-4494-9108-6276ac898718] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:36:52.950203 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3e4a6a0b-224a-4676-9018-6bdb5e5c84ec tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:36:52.950654 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3e4a6a0b-224a-4676-9018-6bdb5e5c84ec tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:36:52.951407 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3e4a6a0b-224a-4676-9018-6bdb5e5c84ec tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:36:52.951832 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3e4a6a0b-224a-4676-9018-6bdb5e5c84ec tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:36:53.016410 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-3e4a6a0b-224a-4676-9018-6bdb5e5c84ec tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3da974f5be44e2946fc0d3b9423d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0913f851ff164415a466c466de1ece6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:36:53.023974 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-3e4a6a0b-224a-4676-9018-6bdb5e5c84ec tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] 10.222.0.48 "GET /compute/v2.1/servers/11c884ea-957b-4494-9108-6276ac898718" status: 200 len: 1218 microversion: 2.1 time: 0.089700 Jun 17 13:36:53.024543 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1697/3442] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:36:52 2022] GET /compute/v2.1/servers/11c884ea-957b-4494-9108-6276ac898718 => generated 1218 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:36:54.045942 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-f73c4bf7-e36e-441f-8eae-7a44a1627887 tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:36:54.046688 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-f73c4bf7-e36e-441f-8eae-7a44a1627887 tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] [instance: 11c884ea-957b-4494-9108-6276ac898718] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:36:54.054245 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f73c4bf7-e36e-441f-8eae-7a44a1627887 tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:36:54.054689 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f73c4bf7-e36e-441f-8eae-7a44a1627887 tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:36:54.055442 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f73c4bf7-e36e-441f-8eae-7a44a1627887 tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:36:54.055870 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f73c4bf7-e36e-441f-8eae-7a44a1627887 tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:36:54.120215 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-f73c4bf7-e36e-441f-8eae-7a44a1627887 tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3da974f5be44e2946fc0d3b9423d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0913f851ff164415a466c466de1ece6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:36:54.129088 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-f73c4bf7-e36e-441f-8eae-7a44a1627887 tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] 10.222.0.48 "GET /compute/v2.1/servers/11c884ea-957b-4494-9108-6276ac898718" status: 200 len: 1272 microversion: 2.1 time: 0.087421 Jun 17 13:36:54.129623 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1746/3443] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:36:54 2022] GET /compute/v2.1/servers/11c884ea-957b-4494-9108-6276ac898718 => generated 1272 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:36:55.147094 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-673ee3aa-af1a-43fa-be76-45eabe9b120c tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:36:55.148534 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-673ee3aa-af1a-43fa-be76-45eabe9b120c tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] [instance: 11c884ea-957b-4494-9108-6276ac898718] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:36:55.156607 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-673ee3aa-af1a-43fa-be76-45eabe9b120c tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:36:55.157317 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-673ee3aa-af1a-43fa-be76-45eabe9b120c tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:36:55.158323 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-673ee3aa-af1a-43fa-be76-45eabe9b120c tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:36:55.158956 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-673ee3aa-af1a-43fa-be76-45eabe9b120c tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:36:55.279690 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [req-a8176dc7-e194-4bbe-8053-563a6efdbb23 req-99adab9f-ee18-486a-a1e6-d06b0a4d3be2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11c884ea-957b-4494-9108-6276ac898718", "tag": "a2f3c13a-45e2-4803-8874-84776b1d50b9"}]} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:36:55.288466 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-a8176dc7-e194-4bbe-8053-563a6efdbb23 req-99adab9f-ee18-486a-a1e6-d06b0a4d3be2 service nova] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:36:55.289056 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-a8176dc7-e194-4bbe-8053-563a6efdbb23 req-99adab9f-ee18-486a-a1e6-d06b0a4d3be2 service nova] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:36:55.297186 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-673ee3aa-af1a-43fa-be76-45eabe9b120c tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3da974f5be44e2946fc0d3b9423d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0913f851ff164415a466c466de1ece6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:36:55.300848 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.compute.server_external_events [req-a8176dc7-e194-4bbe-8053-563a6efdbb23 req-99adab9f-ee18-486a-a1e6-d06b0a4d3be2 service nova] Creating event network-changed:a2f3c13a-45e2-4803-8874-84776b1d50b9 for instance 11c884ea-957b-4494-9108-6276ac898718 on hv-cinder-83754 Jun 17 13:36:55.306321 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [req-a8176dc7-e194-4bbe-8053-563a6efdbb23 req-99adab9f-ee18-486a-a1e6-d06b0a4d3be2 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.186174 Jun 17 13:36:55.307388 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1698/3444] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 13:36:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:36:55.307873 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-673ee3aa-af1a-43fa-be76-45eabe9b120c tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] 10.222.0.48 "GET /compute/v2.1/servers/11c884ea-957b-4494-9108-6276ac898718" status: 200 len: 1314 microversion: 2.1 time: 0.164728 Jun 17 13:36:55.308913 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1747/3445] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:36:55 2022] GET /compute/v2.1/servers/11c884ea-957b-4494-9108-6276ac898718 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:36:56.326060 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-3023fad2-99c2-488f-a95e-1cca624cb2ca tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:36:56.326785 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-3023fad2-99c2-488f-a95e-1cca624cb2ca tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] [instance: 11c884ea-957b-4494-9108-6276ac898718] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:36:56.333612 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3023fad2-99c2-488f-a95e-1cca624cb2ca tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:36:56.334058 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3023fad2-99c2-488f-a95e-1cca624cb2ca tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:36:56.334895 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3023fad2-99c2-488f-a95e-1cca624cb2ca tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:36:56.335325 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3023fad2-99c2-488f-a95e-1cca624cb2ca tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:36:56.469159 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-3023fad2-99c2-488f-a95e-1cca624cb2ca tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3da974f5be44e2946fc0d3b9423d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0913f851ff164415a466c466de1ece6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:36:56.477186 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-3023fad2-99c2-488f-a95e-1cca624cb2ca tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] 10.222.0.48 "GET /compute/v2.1/servers/11c884ea-957b-4494-9108-6276ac898718" status: 200 len: 1314 microversion: 2.1 time: 0.155843 Jun 17 13:36:56.477785 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1699/3446] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:36:56 2022] GET /compute/v2.1/servers/11c884ea-957b-4494-9108-6276ac898718 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:36:57.494825 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-34bdf680-8d94-407f-9d8b-7f25e35a391d tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:36:57.495437 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-34bdf680-8d94-407f-9d8b-7f25e35a391d tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] [instance: 11c884ea-957b-4494-9108-6276ac898718] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:36:57.502324 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-34bdf680-8d94-407f-9d8b-7f25e35a391d tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:36:57.502774 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-34bdf680-8d94-407f-9d8b-7f25e35a391d tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:36:57.503514 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-34bdf680-8d94-407f-9d8b-7f25e35a391d tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:36:57.503940 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-34bdf680-8d94-407f-9d8b-7f25e35a391d tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:36:57.646253 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-34bdf680-8d94-407f-9d8b-7f25e35a391d tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3da974f5be44e2946fc0d3b9423d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0913f851ff164415a466c466de1ece6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:36:57.653960 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-34bdf680-8d94-407f-9d8b-7f25e35a391d tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] 10.222.0.48 "GET /compute/v2.1/servers/11c884ea-957b-4494-9108-6276ac898718" status: 200 len: 1314 microversion: 2.1 time: 0.163266 Jun 17 13:36:57.654561 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1748/3447] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:36:57 2022] GET /compute/v2.1/servers/11c884ea-957b-4494-9108-6276ac898718 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:36:58.108746 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-090b0da1-235d-4dd9-8597-0a5f0420b864 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:36:58.109722 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-090b0da1-235d-4dd9-8597-0a5f0420b864 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: 53ede50e-496d-480c-b292-30e95344eaac] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:36:58.117049 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-090b0da1-235d-4dd9-8597-0a5f0420b864 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:36:58.117493 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-090b0da1-235d-4dd9-8597-0a5f0420b864 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:36:58.118297 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-090b0da1-235d-4dd9-8597-0a5f0420b864 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:36:58.118825 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-090b0da1-235d-4dd9-8597-0a5f0420b864 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:36:58.148668 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-090b0da1-235d-4dd9-8597-0a5f0420b864 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/53ede50e-496d-480c-b292-30e95344eaac/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.044204 Jun 17 13:36:58.149201 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1700/3448] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 13:36:58 2022] GET /compute/v2.1/servers/53ede50e-496d-480c-b292-30e95344eaac/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:36:58.208341 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-777af93a-de32-4e4c-a2d2-90c18be88a8f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:36:58.208831 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-777af93a-de32-4e4c-a2d2-90c18be88a8f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: 53ede50e-496d-480c-b292-30e95344eaac] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:36:58.215685 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-777af93a-de32-4e4c-a2d2-90c18be88a8f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:36:58.216131 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-777af93a-de32-4e4c-a2d2-90c18be88a8f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:36:58.216882 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-777af93a-de32-4e4c-a2d2-90c18be88a8f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:36:58.217314 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-777af93a-de32-4e4c-a2d2-90c18be88a8f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:36:58.242729 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-777af93a-de32-4e4c-a2d2-90c18be88a8f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: 53ede50e-496d-480c-b292-30e95344eaac] Going to try to terminate instance {{(pid=117659) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 17 13:36:58.326201 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-777af93a-de32-4e4c-a2d2-90c18be88a8f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "DELETE /compute/v2.1/servers/53ede50e-496d-480c-b292-30e95344eaac" status: 204 len: 0 microversion: 2.20 time: 0.121469 Jun 17 13:36:58.326800 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1749/3449] 10.222.0.48 () {60 vars in 1279 bytes} [Fri Jun 17 13:36:58 2022] DELETE /compute/v2.1/servers/53ede50e-496d-480c-b292-30e95344eaac => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 17 13:36:58.335024 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-d20b736f-ed05-4dfa-ae45-61bbfca4871f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:36:58.335632 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-d20b736f-ed05-4dfa-ae45-61bbfca4871f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: 53ede50e-496d-480c-b292-30e95344eaac] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:36:58.341633 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d20b736f-ed05-4dfa-ae45-61bbfca4871f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:36:58.342078 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d20b736f-ed05-4dfa-ae45-61bbfca4871f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:36:58.342857 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d20b736f-ed05-4dfa-ae45-61bbfca4871f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:36:58.343284 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d20b736f-ed05-4dfa-ae45-61bbfca4871f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:36:58.491128 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-d20b736f-ed05-4dfa-ae45-61bbfca4871f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:36:58.499318 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-d20b736f-ed05-4dfa-ae45-61bbfca4871f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:36:58.500858 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-d20b736f-ed05-4dfa-ae45-61bbfca4871f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:36:58.502010 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-d20b736f-ed05-4dfa-ae45-61bbfca4871f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/53ede50e-496d-480c-b292-30e95344eaac" status: 200 len: 1723 microversion: 2.20 time: 0.170913 Jun 17 13:36:58.502594 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1701/3450] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:36:58 2022] GET /compute/v2.1/servers/53ede50e-496d-480c-b292-30e95344eaac => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:36:58.676002 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-4a4cb166-782b-4856-b6e6-e8a1d404b7a3 tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:36:58.677143 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-4a4cb166-782b-4856-b6e6-e8a1d404b7a3 tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] [instance: 11c884ea-957b-4494-9108-6276ac898718] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:36:58.680441 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_cell0:SELECT=2 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:36:58.690444 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4a4cb166-782b-4856-b6e6-e8a1d404b7a3 tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:36:58.691192 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4a4cb166-782b-4856-b6e6-e8a1d404b7a3 tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:36:58.692821 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4a4cb166-782b-4856-b6e6-e8a1d404b7a3 tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:36:58.693925 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4a4cb166-782b-4856-b6e6-e8a1d404b7a3 tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:36:58.846266 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-4a4cb166-782b-4856-b6e6-e8a1d404b7a3 tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3da974f5be44e2946fc0d3b9423d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0913f851ff164415a466c466de1ece6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:36:58.854359 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-4a4cb166-782b-4856-b6e6-e8a1d404b7a3 tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] 10.222.0.48 "GET /compute/v2.1/servers/11c884ea-957b-4494-9108-6276ac898718" status: 200 len: 1314 microversion: 2.1 time: 0.185483 Jun 17 13:36:58.854904 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1750/3451] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:36:58 2022] GET /compute/v2.1/servers/11c884ea-957b-4494-9108-6276ac898718 => generated 1314 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:36:59.525542 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-ff690843-e99a-46c9-ab58-b9e726ea84f4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:36:59.526596 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-ff690843-e99a-46c9-ab58-b9e726ea84f4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: 53ede50e-496d-480c-b292-30e95344eaac] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:36:59.538077 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ff690843-e99a-46c9-ab58-b9e726ea84f4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:36:59.538574 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ff690843-e99a-46c9-ab58-b9e726ea84f4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:36:59.539337 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ff690843-e99a-46c9-ab58-b9e726ea84f4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:36:59.539795 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ff690843-e99a-46c9-ab58-b9e726ea84f4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:36:59.682509 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-ff690843-e99a-46c9-ab58-b9e726ea84f4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:36:59.690652 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-ff690843-e99a-46c9-ab58-b9e726ea84f4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:36:59.692155 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-ff690843-e99a-46c9-ab58-b9e726ea84f4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:36:59.693302 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-ff690843-e99a-46c9-ab58-b9e726ea84f4 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/53ede50e-496d-480c-b292-30e95344eaac" status: 200 len: 1723 microversion: 2.20 time: 0.174969 Jun 17 13:36:59.694534 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1702/3452] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:36:59 2022] GET /compute/v2.1/servers/53ede50e-496d-480c-b292-30e95344eaac => generated 1723 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:36:59.876998 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-d39d39d0-7e3d-445d-916a-fc18d231c889 tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:36:59.877575 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-d39d39d0-7e3d-445d-916a-fc18d231c889 tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] [instance: 11c884ea-957b-4494-9108-6276ac898718] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:36:59.884406 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d39d39d0-7e3d-445d-916a-fc18d231c889 tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:36:59.884854 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d39d39d0-7e3d-445d-916a-fc18d231c889 tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:36:59.885601 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d39d39d0-7e3d-445d-916a-fc18d231c889 tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:36:59.886031 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d39d39d0-7e3d-445d-916a-fc18d231c889 tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:37:00.017681 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-d39d39d0-7e3d-445d-916a-fc18d231c889 tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3da974f5be44e2946fc0d3b9423d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0913f851ff164415a466c466de1ece6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:37:00.025347 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-d39d39d0-7e3d-445d-916a-fc18d231c889 tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] 10.222.0.48 "GET /compute/v2.1/servers/11c884ea-957b-4494-9108-6276ac898718" status: 200 len: 1314 microversion: 2.1 time: 0.152669 Jun 17 13:37:00.025927 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1751/3453] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:36:59 2022] GET /compute/v2.1/servers/11c884ea-957b-4494-9108-6276ac898718 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:37:00.711955 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-b2b0943a-3fc8-4217-82ab-01bfac97075f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:37:00.713210 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-b2b0943a-3fc8-4217-82ab-01bfac97075f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: 53ede50e-496d-480c-b292-30e95344eaac] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:37:00.719970 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b2b0943a-3fc8-4217-82ab-01bfac97075f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:37:00.720412 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b2b0943a-3fc8-4217-82ab-01bfac97075f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:37:00.721379 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b2b0943a-3fc8-4217-82ab-01bfac97075f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:37:00.721820 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b2b0943a-3fc8-4217-82ab-01bfac97075f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:37:00.822688 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell0:SELECT=4 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:37:00.871518 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-b2b0943a-3fc8-4217-82ab-01bfac97075f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:37:00.879995 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-b2b0943a-3fc8-4217-82ab-01bfac97075f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:37:00.881615 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-b2b0943a-3fc8-4217-82ab-01bfac97075f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '847c39439e874e68b72e07c311a53bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c777f8f104af4d37a3b89ff9a57d2218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:37:00.882798 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-b2b0943a-3fc8-4217-82ab-01bfac97075f tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/53ede50e-496d-480c-b292-30e95344eaac" status: 200 len: 1723 microversion: 2.20 time: 0.175124 Jun 17 13:37:00.883352 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1703/3454] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:37:00 2022] GET /compute/v2.1/servers/53ede50e-496d-480c-b292-30e95344eaac => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 13:37:01.042116 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-031c9714-9721-41ac-a61e-a06174c501ec tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:37:01.042686 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-031c9714-9721-41ac-a61e-a06174c501ec tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] [instance: 11c884ea-957b-4494-9108-6276ac898718] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:37:01.049661 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-031c9714-9721-41ac-a61e-a06174c501ec tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:37:01.050124 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-031c9714-9721-41ac-a61e-a06174c501ec tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:37:01.050904 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-031c9714-9721-41ac-a61e-a06174c501ec tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:37:01.051341 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-031c9714-9721-41ac-a61e-a06174c501ec tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:37:01.195770 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [req-02ab0b7a-e412-476d-8905-64e49b289f99 req-4fc9d312-0a71-43c1-a2b0-1c6b0733478e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53ede50e-496d-480c-b292-30e95344eaac", "name": "network-vif-deleted", "tag": "18820e99-834c-4f86-aa42-a4db70cd683d"}]} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:37:01.196973 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-031c9714-9721-41ac-a61e-a06174c501ec tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3da974f5be44e2946fc0d3b9423d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0913f851ff164415a466c466de1ece6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:37:01.205385 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-031c9714-9721-41ac-a61e-a06174c501ec tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] 10.222.0.48 "GET /compute/v2.1/servers/11c884ea-957b-4494-9108-6276ac898718" status: 200 len: 1314 microversion: 2.1 time: 0.167229 Jun 17 13:37:01.211213 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1752/3455] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:37:01 2022] GET /compute/v2.1/servers/11c884ea-957b-4494-9108-6276ac898718 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:37:01.213665 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-02ab0b7a-e412-476d-8905-64e49b289f99 req-4fc9d312-0a71-43c1-a2b0-1c6b0733478e service nova] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:37:01.214131 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-02ab0b7a-e412-476d-8905-64e49b289f99 req-4fc9d312-0a71-43c1-a2b0-1c6b0733478e service nova] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:37:01.227929 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.compute.server_external_events [req-02ab0b7a-e412-476d-8905-64e49b289f99 req-4fc9d312-0a71-43c1-a2b0-1c6b0733478e service nova] Creating event network-vif-deleted:18820e99-834c-4f86-aa42-a4db70cd683d for instance 53ede50e-496d-480c-b292-30e95344eaac on hv-cinder-83754 Jun 17 13:37:01.235375 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [req-02ab0b7a-e412-476d-8905-64e49b289f99 req-4fc9d312-0a71-43c1-a2b0-1c6b0733478e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043738 Jun 17 13:37:01.235990 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1704/3456] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 13:37:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:37:01.901538 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-bde0b75d-fe0c-44c8-9264-eb8e91c7d63d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:37:01.902361 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-bde0b75d-fe0c-44c8-9264-eb8e91c7d63d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: 53ede50e-496d-480c-b292-30e95344eaac] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:37:01.909063 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-bde0b75d-fe0c-44c8-9264-eb8e91c7d63d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:37:01.909512 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-bde0b75d-fe0c-44c8-9264-eb8e91c7d63d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:37:01.910297 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-bde0b75d-fe0c-44c8-9264-eb8e91c7d63d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:37:01.910787 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-bde0b75d-fe0c-44c8-9264-eb8e91c7d63d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:37:01.923591 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_cell0:SELECT=10 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:37:01.925794 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.wsgi [None req-bde0b75d-fe0c-44c8-9264-eb8e91c7d63d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] HTTP exception thrown: Instance 53ede50e-496d-480c-b292-30e95344eaac could not be found. Jun 17 13:37:01.927660 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-bde0b75d-fe0c-44c8-9264-eb8e91c7d63d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Request method failure captured: Jun 17 13:37:01.927660 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: request: GET /compute/v2.1/servers/53ede50e-496d-480c-b292-30e95344eaac HTTP/1.1 Jun 17 13:37:01.927660 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Accept: application/json Jun 17 13:37:01.927660 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Accept-Encoding: identity Jun 17 13:37:01.927660 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Connection: close Jun 17 13:37:01.927660 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Content-Length: 0 Jun 17 13:37:01.927660 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Content-Type: application/json Jun 17 13:37:01.927660 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Host: 10.222.0.48 Jun 17 13:37:01.927660 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Openstack-System-Scope: None Jun 17 13:37:01.927660 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: User-Agent: python-urllib3/1.26.9 Jun 17 13:37:01.927660 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Auth-Token: gAAAAABirHovuSKXhsYnyM1ICQHfCBnAkcBbRuuwZgxhkoNNkDDA8V46u4bM0d1Ij3mDA-GnbWHcDVDPBrFR3gqwdKLqUjwJvDZ_b3brdODlYgnHT8j_9TL2kWiym-dIXC0QOJO96MqfgUwsdiseafc9vSwBlwUt2XH_DR7FE-ChC01iKCOrpX0 Jun 17 13:37:01.927660 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Domain-Id: None Jun 17 13:37:01.927660 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Domain-Name: None Jun 17 13:37:01.927660 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Identity-Status: Confirmed Jun 17 13:37:01.927660 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Is-Admin-Project: True Jun 17 13:37:01.927660 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Openstack-Nova-Api-Version: 2.20 Jun 17 13:37:01.927660 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Project-Domain-Id: default Jun 17 13:37:01.927660 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Project-Domain-Name: Default Jun 17 13:37:01.927660 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Project-Id: c777f8f104af4d37a3b89ff9a57d2218 Jun 17 13:37:01.927660 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1116672173 Jun 17 13:37:01.927660 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Role: member,reader Jun 17 13:37:01.927660 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Roles: member,reader Jun 17 13:37:01.929706 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c777f8f104af4d37a3b89ff9a57d2218", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c777f8f104af4d37a3b89ff9a57d2218"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c777f8f104af4d37a3b89ff9a57d2218"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c777f8f104af4d37a3b89ff9a57d2218"}]}] Jun 17 13:37:01.929706 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1116672173 Jun 17 13:37:01.929706 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Tenant-Id: c777f8f104af4d37a3b89ff9a57d2218 Jun 17 13:37:01.929706 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1116672173 Jun 17 13:37:01.929706 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User: tempest-AttachVolumeShelveTestJSON-1116672173-project Jun 17 13:37:01.929706 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User-Domain-Id: default Jun 17 13:37:01.929706 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User-Domain-Name: Default Jun 17 13:37:01.929706 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User-Id: 847c39439e874e68b72e07c311a53bec Jun 17 13:37:01.929706 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1116672173-project Jun 17 13:37:01.929706 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: method: > Jun 17 13:37:01.929706 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: exception: Instance 53ede50e-496d-480c-b292-30e95344eaac could not be found. Jun 17 13:37:01.929706 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: action_args: {'id': '53ede50e-496d-480c-b292-30e95344eaac'} Jun 17 13:37:01.930436 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 13:37:01.930436 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:37:01.930436 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 13:37:01.930436 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 13:37:01.930436 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 13:37:01.930436 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 13:37:01.930436 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 13:37:01.930436 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 13:37:01.930436 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 13:37:01.930436 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 13:37:01.930436 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53ede50e-496d-480c-b292-30e95344eaac could not be found. Jun 17 13:37:01.930436 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:37:01.930436 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:37:01.930436 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:37:01.930436 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:37:01.930436 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:37:01.930436 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:37:01.930436 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 13:37:01.930436 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 13:37:01.930436 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 13:37:01.931502 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 13:37:01.931502 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 13:37:01.931502 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 13:37:01.931502 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 13:37:01.931502 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 13:37:01.931502 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 13:37:01.931502 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 13:37:01.931502 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53ede50e-496d-480c-b292-30e95344eaac could not be found. Jun 17 13:37:01.931502 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:37:01.931502 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:37:01.931502 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:37:01.931502 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:37:01.931502 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:37:01.931502 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:37:01.931502 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 13:37:01.931502 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 13:37:01.931502 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53ede50e-496d-480c-b292-30e95344eaac could not be found. Jun 17 13:37:01.931502 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:37:01.932394 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-bde0b75d-fe0c-44c8-9264-eb8e91c7d63d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Returning 404 to user: Instance 53ede50e-496d-480c-b292-30e95344eaac could not be found. {{(pid=117659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 13:37:01.932394 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-bde0b75d-fe0c-44c8-9264-eb8e91c7d63d tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/53ede50e-496d-480c-b292-30e95344eaac" status: 404 len: 111 microversion: 2.20 time: 0.032190 Jun 17 13:37:01.932394 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1753/3457] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:37:01 2022] GET /compute/v2.1/servers/53ede50e-496d-480c-b292-30e95344eaac => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 17 13:37:01.951613 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-20101e23-6bf8-436d-ba39-af4e9bcb9777 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '.version_select at 0x7f01948e8ee0>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:37:01.971644 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-20101e23-6bf8-436d-ba39-af4e9bcb9777 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-920926838" status: 204 len: 0 microversion: 2.20 time: 0.036741 Jun 17 13:37:01.972237 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1705/3458] 10.222.0.48 () {60 vars in 1258 bytes} [Fri Jun 17 13:37:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-920926838 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 17 13:37:02.223821 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-54e689c0-7279-49ce-aaa0-8e5a1bbb6234 tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:37:02.224443 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-54e689c0-7279-49ce-aaa0-8e5a1bbb6234 tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] [instance: 11c884ea-957b-4494-9108-6276ac898718] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:37:02.231649 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-54e689c0-7279-49ce-aaa0-8e5a1bbb6234 tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:37:02.232094 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-54e689c0-7279-49ce-aaa0-8e5a1bbb6234 tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:37:02.232853 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-54e689c0-7279-49ce-aaa0-8e5a1bbb6234 tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:37:02.233293 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-54e689c0-7279-49ce-aaa0-8e5a1bbb6234 tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:37:02.384973 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-54e689c0-7279-49ce-aaa0-8e5a1bbb6234 tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3da974f5be44e2946fc0d3b9423d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0913f851ff164415a466c466de1ece6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:37:02.393232 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-54e689c0-7279-49ce-aaa0-8e5a1bbb6234 tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] 10.222.0.48 "GET /compute/v2.1/servers/11c884ea-957b-4494-9108-6276ac898718" status: 200 len: 1314 microversion: 2.1 time: 0.173686 Jun 17 13:37:02.393771 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1754/3459] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:37:02 2022] GET /compute/v2.1/servers/11c884ea-957b-4494-9108-6276ac898718 => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:37:02.769500 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [req-32f908b5-d9ef-4754-8ef8-6a1d6a7ddd8c req-fa44fe25-5a1e-4aca-b54e-46947e412ce2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11c884ea-957b-4494-9108-6276ac898718", "name": "network-vif-plugged", "status": "completed", "tag": "a2f3c13a-45e2-4803-8874-84776b1d50b9"}]} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:37:02.779472 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-32f908b5-d9ef-4754-8ef8-6a1d6a7ddd8c req-fa44fe25-5a1e-4aca-b54e-46947e412ce2 service nova] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:37:02.779999 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-32f908b5-d9ef-4754-8ef8-6a1d6a7ddd8c req-fa44fe25-5a1e-4aca-b54e-46947e412ce2 service nova] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:37:02.791015 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.compute.server_external_events [req-32f908b5-d9ef-4754-8ef8-6a1d6a7ddd8c req-fa44fe25-5a1e-4aca-b54e-46947e412ce2 service nova] Creating event network-vif-plugged:a2f3c13a-45e2-4803-8874-84776b1d50b9 for instance 11c884ea-957b-4494-9108-6276ac898718 on hv-cinder-83754 Jun 17 13:37:02.795949 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [req-32f908b5-d9ef-4754-8ef8-6a1d6a7ddd8c req-fa44fe25-5a1e-4aca-b54e-46947e412ce2 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030235 Jun 17 13:37:02.796537 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1706/3460] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 13:37:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:37:03.410847 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-e10d1dff-e258-43f3-8352-4a55a65a30c4 tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:37:03.411420 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-e10d1dff-e258-43f3-8352-4a55a65a30c4 tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] [instance: 11c884ea-957b-4494-9108-6276ac898718] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:37:03.418656 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e10d1dff-e258-43f3-8352-4a55a65a30c4 tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:37:03.419100 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e10d1dff-e258-43f3-8352-4a55a65a30c4 tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:37:03.419847 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e10d1dff-e258-43f3-8352-4a55a65a30c4 tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:37:03.420303 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e10d1dff-e258-43f3-8352-4a55a65a30c4 tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:37:03.562488 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-e10d1dff-e258-43f3-8352-4a55a65a30c4 tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3da974f5be44e2946fc0d3b9423d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0913f851ff164415a466c466de1ece6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:37:03.573576 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-e10d1dff-e258-43f3-8352-4a55a65a30c4 tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] 10.222.0.48 "GET /compute/v2.1/servers/11c884ea-957b-4494-9108-6276ac898718" status: 200 len: 1314 microversion: 2.1 time: 0.166316 Jun 17 13:37:03.574319 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1755/3461] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:37:03 2022] GET /compute/v2.1/servers/11c884ea-957b-4494-9108-6276ac898718 => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:37:03.764618 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-b130fdde-0839-474f-843f-bd81d53438f0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:37:03.765200 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-b130fdde-0839-474f-843f-bd81d53438f0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: 53ede50e-496d-480c-b292-30e95344eaac] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:37:03.772374 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b130fdde-0839-474f-843f-bd81d53438f0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:37:03.772806 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b130fdde-0839-474f-843f-bd81d53438f0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:37:03.773594 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b130fdde-0839-474f-843f-bd81d53438f0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:37:03.774012 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b130fdde-0839-474f-843f-bd81d53438f0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:37:03.787384 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.wsgi [None req-b130fdde-0839-474f-843f-bd81d53438f0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] HTTP exception thrown: Instance 53ede50e-496d-480c-b292-30e95344eaac could not be found. Jun 17 13:37:03.789122 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-b130fdde-0839-474f-843f-bd81d53438f0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Request method failure captured: Jun 17 13:37:03.789122 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: request: DELETE /compute/v2.1/servers/53ede50e-496d-480c-b292-30e95344eaac HTTP/1.1 Jun 17 13:37:03.789122 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Accept: application/json Jun 17 13:37:03.789122 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Accept-Encoding: identity Jun 17 13:37:03.789122 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Connection: close Jun 17 13:37:03.789122 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Content-Length: 0 Jun 17 13:37:03.789122 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Content-Type: application/json Jun 17 13:37:03.789122 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Host: 10.222.0.48 Jun 17 13:37:03.789122 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Openstack-System-Scope: None Jun 17 13:37:03.789122 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: User-Agent: python-urllib3/1.26.9 Jun 17 13:37:03.789122 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Auth-Token: gAAAAABirHovuSKXhsYnyM1ICQHfCBnAkcBbRuuwZgxhkoNNkDDA8V46u4bM0d1Ij3mDA-GnbWHcDVDPBrFR3gqwdKLqUjwJvDZ_b3brdODlYgnHT8j_9TL2kWiym-dIXC0QOJO96MqfgUwsdiseafc9vSwBlwUt2XH_DR7FE-ChC01iKCOrpX0 Jun 17 13:37:03.789122 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Domain-Id: None Jun 17 13:37:03.789122 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Domain-Name: None Jun 17 13:37:03.789122 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Identity-Status: Confirmed Jun 17 13:37:03.789122 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Is-Admin-Project: True Jun 17 13:37:03.789122 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Openstack-Nova-Api-Version: 2.20 Jun 17 13:37:03.789122 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Project-Domain-Id: default Jun 17 13:37:03.789122 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Project-Domain-Name: Default Jun 17 13:37:03.789122 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Project-Id: c777f8f104af4d37a3b89ff9a57d2218 Jun 17 13:37:03.789122 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1116672173 Jun 17 13:37:03.789122 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Role: member,reader Jun 17 13:37:03.789122 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Roles: member,reader Jun 17 13:37:03.790323 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c777f8f104af4d37a3b89ff9a57d2218", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c777f8f104af4d37a3b89ff9a57d2218"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c777f8f104af4d37a3b89ff9a57d2218"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c777f8f104af4d37a3b89ff9a57d2218"}]}] Jun 17 13:37:03.790323 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1116672173 Jun 17 13:37:03.790323 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Tenant-Id: c777f8f104af4d37a3b89ff9a57d2218 Jun 17 13:37:03.790323 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1116672173 Jun 17 13:37:03.790323 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-User: tempest-AttachVolumeShelveTestJSON-1116672173-project Jun 17 13:37:03.790323 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-User-Domain-Id: default Jun 17 13:37:03.790323 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-User-Domain-Name: Default Jun 17 13:37:03.790323 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-User-Id: 847c39439e874e68b72e07c311a53bec Jun 17 13:37:03.790323 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1116672173-project Jun 17 13:37:03.790323 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: method: > Jun 17 13:37:03.790323 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: exception: Instance 53ede50e-496d-480c-b292-30e95344eaac could not be found. Jun 17 13:37:03.790323 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: action_args: {'id': '53ede50e-496d-480c-b292-30e95344eaac'} Jun 17 13:37:03.791034 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 13:37:03.791034 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:37:03.791034 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 13:37:03.791034 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 13:37:03.791034 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 13:37:03.791034 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 13:37:03.791034 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 13:37:03.791034 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 13:37:03.791034 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 13:37:03.791034 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 13:37:03.791034 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53ede50e-496d-480c-b292-30e95344eaac could not be found. Jun 17 13:37:03.791034 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 13:37:03.791034 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:37:03.791034 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 13:37:03.791034 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:37:03.791034 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:37:03.791034 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:37:03.791034 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 13:37:03.791034 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 13:37:03.791034 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 13:37:03.792019 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 13:37:03.792019 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 17 13:37:03.792019 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 17 13:37:03.792019 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 17 13:37:03.792019 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 17 13:37:03.792019 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 13:37:03.792019 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 13:37:03.792019 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 13:37:03.792019 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 13:37:03.792019 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53ede50e-496d-480c-b292-30e95344eaac could not be found. Jun 17 13:37:03.792019 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 13:37:03.792019 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:37:03.792019 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 13:37:03.792019 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:37:03.792019 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:37:03.792019 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:37:03.792019 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 13:37:03.792019 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 13:37:03.792019 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53ede50e-496d-480c-b292-30e95344eaac could not be found. Jun 17 13:37:03.792019 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 13:37:03.793055 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-b130fdde-0839-474f-843f-bd81d53438f0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Returning 404 to user: Instance 53ede50e-496d-480c-b292-30e95344eaac could not be found. {{(pid=117660) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 13:37:03.793055 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-b130fdde-0839-474f-843f-bd81d53438f0 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "DELETE /compute/v2.1/servers/53ede50e-496d-480c-b292-30e95344eaac" status: 404 len: 111 microversion: 2.20 time: 0.030722 Jun 17 13:37:03.793055 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1707/3462] 10.222.0.48 () {60 vars in 1279 bytes} [Fri Jun 17 13:37:03 2022] DELETE /compute/v2.1/servers/53ede50e-496d-480c-b292-30e95344eaac => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 17 13:37:03.799338 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-c0532537-e509-439e-924a-3b850b36ac39 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:37:03.799949 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-c0532537-e509-439e-924a-3b850b36ac39 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: 53ede50e-496d-480c-b292-30e95344eaac] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:37:03.808287 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c0532537-e509-439e-924a-3b850b36ac39 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:37:03.808993 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c0532537-e509-439e-924a-3b850b36ac39 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:37:03.810070 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c0532537-e509-439e-924a-3b850b36ac39 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:37:03.810678 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c0532537-e509-439e-924a-3b850b36ac39 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:37:03.831856 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.wsgi [None req-c0532537-e509-439e-924a-3b850b36ac39 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] HTTP exception thrown: Instance 53ede50e-496d-480c-b292-30e95344eaac could not be found. Jun 17 13:37:03.834388 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-c0532537-e509-439e-924a-3b850b36ac39 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Request method failure captured: Jun 17 13:37:03.834388 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: request: GET /compute/v2.1/servers/53ede50e-496d-480c-b292-30e95344eaac HTTP/1.1 Jun 17 13:37:03.834388 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Accept: application/json Jun 17 13:37:03.834388 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Accept-Encoding: identity Jun 17 13:37:03.834388 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Connection: close Jun 17 13:37:03.834388 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Content-Length: 0 Jun 17 13:37:03.834388 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Content-Type: application/json Jun 17 13:37:03.834388 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Host: 10.222.0.48 Jun 17 13:37:03.834388 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Openstack-System-Scope: None Jun 17 13:37:03.834388 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: User-Agent: python-urllib3/1.26.9 Jun 17 13:37:03.834388 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Auth-Token: gAAAAABirHovuSKXhsYnyM1ICQHfCBnAkcBbRuuwZgxhkoNNkDDA8V46u4bM0d1Ij3mDA-GnbWHcDVDPBrFR3gqwdKLqUjwJvDZ_b3brdODlYgnHT8j_9TL2kWiym-dIXC0QOJO96MqfgUwsdiseafc9vSwBlwUt2XH_DR7FE-ChC01iKCOrpX0 Jun 17 13:37:03.834388 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Domain-Id: None Jun 17 13:37:03.834388 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Domain-Name: None Jun 17 13:37:03.834388 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Identity-Status: Confirmed Jun 17 13:37:03.834388 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Is-Admin-Project: True Jun 17 13:37:03.834388 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Openstack-Nova-Api-Version: 2.20 Jun 17 13:37:03.834388 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Project-Domain-Id: default Jun 17 13:37:03.834388 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Project-Domain-Name: Default Jun 17 13:37:03.834388 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Project-Id: c777f8f104af4d37a3b89ff9a57d2218 Jun 17 13:37:03.834388 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1116672173 Jun 17 13:37:03.834388 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Role: member,reader Jun 17 13:37:03.834388 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Roles: member,reader Jun 17 13:37:03.835577 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c777f8f104af4d37a3b89ff9a57d2218", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c777f8f104af4d37a3b89ff9a57d2218"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c777f8f104af4d37a3b89ff9a57d2218"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c777f8f104af4d37a3b89ff9a57d2218"}]}] Jun 17 13:37:03.835577 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1116672173 Jun 17 13:37:03.835577 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Tenant-Id: c777f8f104af4d37a3b89ff9a57d2218 Jun 17 13:37:03.835577 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1116672173 Jun 17 13:37:03.835577 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User: tempest-AttachVolumeShelveTestJSON-1116672173-project Jun 17 13:37:03.835577 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User-Domain-Id: default Jun 17 13:37:03.835577 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User-Domain-Name: Default Jun 17 13:37:03.835577 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User-Id: 847c39439e874e68b72e07c311a53bec Jun 17 13:37:03.835577 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1116672173-project Jun 17 13:37:03.835577 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: method: > Jun 17 13:37:03.835577 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: exception: Instance 53ede50e-496d-480c-b292-30e95344eaac could not be found. Jun 17 13:37:03.835577 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: action_args: {'id': '53ede50e-496d-480c-b292-30e95344eaac'} Jun 17 13:37:03.836211 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 13:37:03.836211 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:37:03.836211 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 13:37:03.836211 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 13:37:03.836211 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 13:37:03.836211 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 13:37:03.836211 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 13:37:03.836211 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 13:37:03.836211 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 13:37:03.836211 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 13:37:03.836211 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53ede50e-496d-480c-b292-30e95344eaac could not be found. Jun 17 13:37:03.836211 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:37:03.836211 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:37:03.836211 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:37:03.836211 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:37:03.836211 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:37:03.836211 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:37:03.836211 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 13:37:03.836211 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 13:37:03.836211 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 13:37:03.837345 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 13:37:03.837345 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 13:37:03.837345 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 13:37:03.837345 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 13:37:03.837345 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 13:37:03.837345 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 13:37:03.837345 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 13:37:03.837345 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53ede50e-496d-480c-b292-30e95344eaac could not be found. Jun 17 13:37:03.837345 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:37:03.837345 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:37:03.837345 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:37:03.837345 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:37:03.837345 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:37:03.837345 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:37:03.837345 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 13:37:03.837345 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 13:37:03.837345 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53ede50e-496d-480c-b292-30e95344eaac could not be found. Jun 17 13:37:03.837345 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:37:03.838417 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-c0532537-e509-439e-924a-3b850b36ac39 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Returning 404 to user: Instance 53ede50e-496d-480c-b292-30e95344eaac could not be found. {{(pid=117659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 13:37:03.838417 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-c0532537-e509-439e-924a-3b850b36ac39 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/53ede50e-496d-480c-b292-30e95344eaac" status: 404 len: 111 microversion: 2.20 time: 0.040415 Jun 17 13:37:03.838417 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1756/3463] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:37:03 2022] GET /compute/v2.1/servers/53ede50e-496d-480c-b292-30e95344eaac => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 17 13:37:04.594143 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-d2a59fe5-b280-4d31-a184-db0a23613dc2 tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:37:04.594827 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-d2a59fe5-b280-4d31-a184-db0a23613dc2 tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] [instance: 11c884ea-957b-4494-9108-6276ac898718] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:37:04.604142 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d2a59fe5-b280-4d31-a184-db0a23613dc2 tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:37:04.604742 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d2a59fe5-b280-4d31-a184-db0a23613dc2 tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:37:04.606253 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d2a59fe5-b280-4d31-a184-db0a23613dc2 tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:37:04.606686 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d2a59fe5-b280-4d31-a184-db0a23613dc2 tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:37:04.743149 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-d2a59fe5-b280-4d31-a184-db0a23613dc2 tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3da974f5be44e2946fc0d3b9423d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0913f851ff164415a466c466de1ece6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:37:04.750730 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-d2a59fe5-b280-4d31-a184-db0a23613dc2 tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] 10.222.0.48 "GET /compute/v2.1/servers/11c884ea-957b-4494-9108-6276ac898718" status: 200 len: 1498 microversion: 2.1 time: 0.163084 Jun 17 13:37:04.751288 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1708/3464] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:37:04 2022] GET /compute/v2.1/servers/11c884ea-957b-4494-9108-6276ac898718 => generated 1498 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:37:04.983603 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-c94dc725-d1bf-4856-8e72-53a548063919 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:37:04.984070 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-c94dc725-d1bf-4856-8e72-53a548063919 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:37:04.991419 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c94dc725-d1bf-4856-8e72-53a548063919 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:37:04.991950 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c94dc725-d1bf-4856-8e72-53a548063919 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:37:04.992757 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c94dc725-d1bf-4856-8e72-53a548063919 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:37:04.993215 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c94dc725-d1bf-4856-8e72-53a548063919 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:37:05.007933 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.wsgi [None req-c94dc725-d1bf-4856-8e72-53a548063919 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] HTTP exception thrown: Instance c8fdea98-917f-4c4d-aaba-d4f5df4622d6 could not be found. Jun 17 13:37:05.009509 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-c94dc725-d1bf-4856-8e72-53a548063919 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Request method failure captured: Jun 17 13:37:05.009509 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: request: DELETE /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 HTTP/1.1 Jun 17 13:37:05.009509 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Accept: application/json Jun 17 13:37:05.009509 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Accept-Encoding: identity Jun 17 13:37:05.009509 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Connection: close Jun 17 13:37:05.009509 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Content-Length: 0 Jun 17 13:37:05.009509 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Content-Type: application/json Jun 17 13:37:05.009509 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Host: 10.222.0.48 Jun 17 13:37:05.009509 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Openstack-System-Scope: None Jun 17 13:37:05.009509 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: User-Agent: python-urllib3/1.26.9 Jun 17 13:37:05.009509 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Auth-Token: gAAAAABirHovuSKXhsYnyM1ICQHfCBnAkcBbRuuwZgxhkoNNkDDA8V46u4bM0d1Ij3mDA-GnbWHcDVDPBrFR3gqwdKLqUjwJvDZ_b3brdODlYgnHT8j_9TL2kWiym-dIXC0QOJO96MqfgUwsdiseafc9vSwBlwUt2XH_DR7FE-ChC01iKCOrpX0 Jun 17 13:37:05.009509 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Domain-Id: None Jun 17 13:37:05.009509 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Domain-Name: None Jun 17 13:37:05.009509 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Identity-Status: Confirmed Jun 17 13:37:05.009509 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Is-Admin-Project: True Jun 17 13:37:05.009509 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Openstack-Nova-Api-Version: 2.20 Jun 17 13:37:05.009509 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Project-Domain-Id: default Jun 17 13:37:05.009509 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Project-Domain-Name: Default Jun 17 13:37:05.009509 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Project-Id: c777f8f104af4d37a3b89ff9a57d2218 Jun 17 13:37:05.009509 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1116672173 Jun 17 13:37:05.009509 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Role: member,reader Jun 17 13:37:05.009509 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Roles: member,reader Jun 17 13:37:05.010997 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c777f8f104af4d37a3b89ff9a57d2218", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c777f8f104af4d37a3b89ff9a57d2218"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c777f8f104af4d37a3b89ff9a57d2218"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c777f8f104af4d37a3b89ff9a57d2218"}]}] Jun 17 13:37:05.010997 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1116672173 Jun 17 13:37:05.010997 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Tenant-Id: c777f8f104af4d37a3b89ff9a57d2218 Jun 17 13:37:05.010997 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1116672173 Jun 17 13:37:05.010997 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User: tempest-AttachVolumeShelveTestJSON-1116672173-project Jun 17 13:37:05.010997 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User-Domain-Id: default Jun 17 13:37:05.010997 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User-Domain-Name: Default Jun 17 13:37:05.010997 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User-Id: 847c39439e874e68b72e07c311a53bec Jun 17 13:37:05.010997 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1116672173-project Jun 17 13:37:05.010997 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: method: > Jun 17 13:37:05.010997 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: exception: Instance c8fdea98-917f-4c4d-aaba-d4f5df4622d6 could not be found. Jun 17 13:37:05.010997 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: action_args: {'id': 'c8fdea98-917f-4c4d-aaba-d4f5df4622d6'} Jun 17 13:37:05.011694 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 13:37:05.011694 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:37:05.011694 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 13:37:05.011694 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 13:37:05.011694 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 13:37:05.011694 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 13:37:05.011694 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 13:37:05.011694 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 13:37:05.011694 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 13:37:05.011694 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 13:37:05.011694 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8fdea98-917f-4c4d-aaba-d4f5df4622d6 could not be found. Jun 17 13:37:05.011694 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:37:05.011694 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:37:05.011694 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:37:05.011694 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:37:05.011694 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:37:05.011694 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:37:05.011694 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 13:37:05.011694 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 13:37:05.011694 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 13:37:05.012656 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 13:37:05.012656 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 17 13:37:05.012656 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 17 13:37:05.012656 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 17 13:37:05.012656 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 17 13:37:05.012656 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 13:37:05.012656 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 13:37:05.012656 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 13:37:05.012656 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 13:37:05.012656 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8fdea98-917f-4c4d-aaba-d4f5df4622d6 could not be found. Jun 17 13:37:05.012656 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:37:05.012656 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:37:05.012656 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:37:05.012656 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:37:05.012656 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:37:05.012656 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:37:05.012656 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 13:37:05.012656 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 13:37:05.012656 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8fdea98-917f-4c4d-aaba-d4f5df4622d6 could not be found. Jun 17 13:37:05.012656 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:37:05.013625 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-c94dc725-d1bf-4856-8e72-53a548063919 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Returning 404 to user: Instance c8fdea98-917f-4c4d-aaba-d4f5df4622d6 could not be found. {{(pid=117659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 13:37:05.013625 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-c94dc725-d1bf-4856-8e72-53a548063919 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "DELETE /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 404 len: 111 microversion: 2.20 time: 0.031583 Jun 17 13:37:05.013625 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1757/3465] 10.222.0.48 () {60 vars in 1279 bytes} [Fri Jun 17 13:37:04 2022] DELETE /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 17 13:37:05.019416 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-fbdc3d8b-ee06-4c57-91fa-dbd83f3b5178 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:37:05.020028 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-fbdc3d8b-ee06-4c57-91fa-dbd83f3b5178 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] [instance: c8fdea98-917f-4c4d-aaba-d4f5df4622d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:37:05.027222 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fbdc3d8b-ee06-4c57-91fa-dbd83f3b5178 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:37:05.027672 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fbdc3d8b-ee06-4c57-91fa-dbd83f3b5178 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:37:05.028428 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fbdc3d8b-ee06-4c57-91fa-dbd83f3b5178 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:37:05.028861 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fbdc3d8b-ee06-4c57-91fa-dbd83f3b5178 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:37:05.043362 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.wsgi [None req-fbdc3d8b-ee06-4c57-91fa-dbd83f3b5178 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] HTTP exception thrown: Instance c8fdea98-917f-4c4d-aaba-d4f5df4622d6 could not be found. Jun 17 13:37:05.044928 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-fbdc3d8b-ee06-4c57-91fa-dbd83f3b5178 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Request method failure captured: Jun 17 13:37:05.044928 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: request: GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 HTTP/1.1 Jun 17 13:37:05.044928 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Accept: application/json Jun 17 13:37:05.044928 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Accept-Encoding: identity Jun 17 13:37:05.044928 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Connection: close Jun 17 13:37:05.044928 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Content-Length: 0 Jun 17 13:37:05.044928 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Content-Type: application/json Jun 17 13:37:05.044928 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Host: 10.222.0.48 Jun 17 13:37:05.044928 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Openstack-System-Scope: None Jun 17 13:37:05.044928 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: User-Agent: python-urllib3/1.26.9 Jun 17 13:37:05.044928 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Auth-Token: gAAAAABirHovuSKXhsYnyM1ICQHfCBnAkcBbRuuwZgxhkoNNkDDA8V46u4bM0d1Ij3mDA-GnbWHcDVDPBrFR3gqwdKLqUjwJvDZ_b3brdODlYgnHT8j_9TL2kWiym-dIXC0QOJO96MqfgUwsdiseafc9vSwBlwUt2XH_DR7FE-ChC01iKCOrpX0 Jun 17 13:37:05.044928 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Domain-Id: None Jun 17 13:37:05.044928 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Domain-Name: None Jun 17 13:37:05.044928 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Identity-Status: Confirmed Jun 17 13:37:05.044928 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Is-Admin-Project: True Jun 17 13:37:05.044928 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Openstack-Nova-Api-Version: 2.20 Jun 17 13:37:05.044928 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Project-Domain-Id: default Jun 17 13:37:05.044928 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Project-Domain-Name: Default Jun 17 13:37:05.044928 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Project-Id: c777f8f104af4d37a3b89ff9a57d2218 Jun 17 13:37:05.044928 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1116672173 Jun 17 13:37:05.044928 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Role: member,reader Jun 17 13:37:05.044928 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Roles: member,reader Jun 17 13:37:05.046162 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c777f8f104af4d37a3b89ff9a57d2218", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c777f8f104af4d37a3b89ff9a57d2218"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c777f8f104af4d37a3b89ff9a57d2218"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c777f8f104af4d37a3b89ff9a57d2218"}]}] Jun 17 13:37:05.046162 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1116672173 Jun 17 13:37:05.046162 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Tenant-Id: c777f8f104af4d37a3b89ff9a57d2218 Jun 17 13:37:05.046162 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1116672173 Jun 17 13:37:05.046162 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-User: tempest-AttachVolumeShelveTestJSON-1116672173-project Jun 17 13:37:05.046162 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-User-Domain-Id: default Jun 17 13:37:05.046162 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-User-Domain-Name: Default Jun 17 13:37:05.046162 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-User-Id: 847c39439e874e68b72e07c311a53bec Jun 17 13:37:05.046162 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1116672173-project Jun 17 13:37:05.046162 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: method: > Jun 17 13:37:05.046162 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: exception: Instance c8fdea98-917f-4c4d-aaba-d4f5df4622d6 could not be found. Jun 17 13:37:05.046162 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: action_args: {'id': 'c8fdea98-917f-4c4d-aaba-d4f5df4622d6'} Jun 17 13:37:05.046794 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 13:37:05.046794 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:37:05.046794 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 13:37:05.046794 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 13:37:05.046794 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 13:37:05.046794 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 13:37:05.046794 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 13:37:05.046794 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 13:37:05.046794 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 13:37:05.046794 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 13:37:05.046794 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8fdea98-917f-4c4d-aaba-d4f5df4622d6 could not be found. Jun 17 13:37:05.046794 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 13:37:05.046794 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:37:05.046794 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 13:37:05.046794 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:37:05.046794 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:37:05.046794 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:37:05.046794 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 13:37:05.046794 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 13:37:05.046794 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 13:37:05.048262 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 13:37:05.048262 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 13:37:05.048262 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 13:37:05.048262 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 13:37:05.048262 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 13:37:05.048262 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 13:37:05.048262 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 13:37:05.048262 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8fdea98-917f-4c4d-aaba-d4f5df4622d6 could not be found. Jun 17 13:37:05.048262 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 13:37:05.048262 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:37:05.048262 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 13:37:05.048262 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:37:05.048262 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:37:05.048262 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:37:05.048262 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 13:37:05.048262 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 13:37:05.048262 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8fdea98-917f-4c4d-aaba-d4f5df4622d6 could not be found. Jun 17 13:37:05.048262 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 13:37:05.049367 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-fbdc3d8b-ee06-4c57-91fa-dbd83f3b5178 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] Returning 404 to user: Instance c8fdea98-917f-4c4d-aaba-d4f5df4622d6 could not be found. {{(pid=117660) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 13:37:05.049367 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-fbdc3d8b-ee06-4c57-91fa-dbd83f3b5178 tempest-AttachVolumeShelveTestJSON-1116672173 tempest-AttachVolumeShelveTestJSON-1116672173-project] 10.222.0.48 "GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6" status: 404 len: 111 microversion: 2.20 time: 0.030724 Jun 17 13:37:05.049367 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1709/3466] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 13:37:05 2022] GET /compute/v2.1/servers/c8fdea98-917f-4c4d-aaba-d4f5df4622d6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 17 13:37:05.215576 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-0d69fd83-0fa1-4b12-81a9-025507488af9 tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:37:05.216067 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-0d69fd83-0fa1-4b12-81a9-025507488af9 tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] [instance: 11c884ea-957b-4494-9108-6276ac898718] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:37:05.222030 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0d69fd83-0fa1-4b12-81a9-025507488af9 tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:37:05.222500 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0d69fd83-0fa1-4b12-81a9-025507488af9 tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:37:05.223246 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0d69fd83-0fa1-4b12-81a9-025507488af9 tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:37:05.223693 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0d69fd83-0fa1-4b12-81a9-025507488af9 tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:37:05.249103 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-0d69fd83-0fa1-4b12-81a9-025507488af9 tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] [instance: 11c884ea-957b-4494-9108-6276ac898718] Going to try to terminate instance {{(pid=117659) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 17 13:37:05.328119 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-0d69fd83-0fa1-4b12-81a9-025507488af9 tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] 10.222.0.48 "DELETE /compute/v2.1/servers/11c884ea-957b-4494-9108-6276ac898718" status: 204 len: 0 microversion: 2.1 time: 0.115954 Jun 17 13:37:05.328905 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1758/3467] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Jun 17 13:37:05 2022] DELETE /compute/v2.1/servers/11c884ea-957b-4494-9108-6276ac898718 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 17 13:37:05.337852 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-018bea7a-a494-4f27-9806-66e2b61f7528 tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:37:05.338505 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-018bea7a-a494-4f27-9806-66e2b61f7528 tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] [instance: 11c884ea-957b-4494-9108-6276ac898718] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:37:05.344664 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-018bea7a-a494-4f27-9806-66e2b61f7528 tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:37:05.345115 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-018bea7a-a494-4f27-9806-66e2b61f7528 tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:37:05.345873 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-018bea7a-a494-4f27-9806-66e2b61f7528 tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:37:05.346737 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-018bea7a-a494-4f27-9806-66e2b61f7528 tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:37:05.487680 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-018bea7a-a494-4f27-9806-66e2b61f7528 tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3da974f5be44e2946fc0d3b9423d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0913f851ff164415a466c466de1ece6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:37:05.496543 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-018bea7a-a494-4f27-9806-66e2b61f7528 tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] 10.222.0.48 "GET /compute/v2.1/servers/11c884ea-957b-4494-9108-6276ac898718" status: 200 len: 1504 microversion: 2.1 time: 0.162656 Jun 17 13:37:05.496543 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1710/3468] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:37:05 2022] GET /compute/v2.1/servers/11c884ea-957b-4494-9108-6276ac898718 => generated 1504 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:37:06.516190 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-2705552d-6bf3-47f8-9036-cf864c095cfe tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:37:06.516190 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-2705552d-6bf3-47f8-9036-cf864c095cfe tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] [instance: 11c884ea-957b-4494-9108-6276ac898718] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:37:06.521770 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2705552d-6bf3-47f8-9036-cf864c095cfe tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:37:06.524345 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2705552d-6bf3-47f8-9036-cf864c095cfe tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:37:06.525141 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2705552d-6bf3-47f8-9036-cf864c095cfe tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:37:06.525584 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2705552d-6bf3-47f8-9036-cf864c095cfe tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:37:06.663868 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-2705552d-6bf3-47f8-9036-cf864c095cfe tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3da974f5be44e2946fc0d3b9423d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0913f851ff164415a466c466de1ece6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:37:06.676250 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-2705552d-6bf3-47f8-9036-cf864c095cfe tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] 10.222.0.48 "GET /compute/v2.1/servers/11c884ea-957b-4494-9108-6276ac898718" status: 200 len: 1504 microversion: 2.1 time: 0.166910 Jun 17 13:37:06.677033 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1759/3469] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:37:06 2022] GET /compute/v2.1/servers/11c884ea-957b-4494-9108-6276ac898718 => generated 1504 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:37:07.693081 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-2ea7e589-f64c-437d-9ab0-5a89eca34516 tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:37:07.693879 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-2ea7e589-f64c-437d-9ab0-5a89eca34516 tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] [instance: 11c884ea-957b-4494-9108-6276ac898718] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:37:07.700493 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2ea7e589-f64c-437d-9ab0-5a89eca34516 tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:37:07.700928 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2ea7e589-f64c-437d-9ab0-5a89eca34516 tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:37:07.701683 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2ea7e589-f64c-437d-9ab0-5a89eca34516 tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:37:07.702128 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2ea7e589-f64c-437d-9ab0-5a89eca34516 tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:37:07.841899 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-2ea7e589-f64c-437d-9ab0-5a89eca34516 tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3da974f5be44e2946fc0d3b9423d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0913f851ff164415a466c466de1ece6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:37:07.850703 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-2ea7e589-f64c-437d-9ab0-5a89eca34516 tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] 10.222.0.48 "GET /compute/v2.1/servers/11c884ea-957b-4494-9108-6276ac898718" status: 200 len: 1504 microversion: 2.1 time: 0.160931 Jun 17 13:37:07.860373 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1711/3470] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:37:07 2022] GET /compute/v2.1/servers/11c884ea-957b-4494-9108-6276ac898718 => generated 1504 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:37:08.110758 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [req-8af538a2-9338-4f2e-bfa1-9ed6e3469e11 req-802696af-038f-48dc-b421-bab7c74b9037 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11c884ea-957b-4494-9108-6276ac898718", "name": "network-vif-deleted", "tag": "a2f3c13a-45e2-4803-8874-84776b1d50b9"}]} {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:37:08.122747 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [req-8af538a2-9338-4f2e-bfa1-9ed6e3469e11 req-802696af-038f-48dc-b421-bab7c74b9037 service nova] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:37:08.123306 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [req-8af538a2-9338-4f2e-bfa1-9ed6e3469e11 req-802696af-038f-48dc-b421-bab7c74b9037 service nova] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:37:08.136856 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.compute.server_external_events [req-8af538a2-9338-4f2e-bfa1-9ed6e3469e11 req-802696af-038f-48dc-b421-bab7c74b9037 service nova] Creating event network-vif-deleted:a2f3c13a-45e2-4803-8874-84776b1d50b9 for instance 11c884ea-957b-4494-9108-6276ac898718 on hv-cinder-83754 Jun 17 13:37:08.142392 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [req-8af538a2-9338-4f2e-bfa1-9ed6e3469e11 req-802696af-038f-48dc-b421-bab7c74b9037 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040930 Jun 17 13:37:08.143002 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1760/3471] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 13:37:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:37:08.867860 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-58e49b5c-0afd-4fc7-8687-9722748efe10 tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:37:08.868717 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-58e49b5c-0afd-4fc7-8687-9722748efe10 tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] [instance: 11c884ea-957b-4494-9108-6276ac898718] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:37:08.875902 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-58e49b5c-0afd-4fc7-8687-9722748efe10 tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:37:08.876356 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-58e49b5c-0afd-4fc7-8687-9722748efe10 tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:37:08.877125 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-58e49b5c-0afd-4fc7-8687-9722748efe10 tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:37:08.877558 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-58e49b5c-0afd-4fc7-8687-9722748efe10 tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:37:08.892098 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.wsgi [None req-58e49b5c-0afd-4fc7-8687-9722748efe10 tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] HTTP exception thrown: Instance 11c884ea-957b-4494-9108-6276ac898718 could not be found. Jun 17 13:37:08.893639 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-58e49b5c-0afd-4fc7-8687-9722748efe10 tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Request method failure captured: Jun 17 13:37:08.893639 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: request: GET /compute/v2.1/servers/11c884ea-957b-4494-9108-6276ac898718 HTTP/1.1 Jun 17 13:37:08.893639 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Accept: application/json Jun 17 13:37:08.893639 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Accept-Encoding: identity Jun 17 13:37:08.893639 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Connection: close Jun 17 13:37:08.893639 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Content-Length: 0 Jun 17 13:37:08.893639 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Content-Type: application/json Jun 17 13:37:08.893639 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Host: 10.222.0.48 Jun 17 13:37:08.893639 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Openstack-System-Scope: None Jun 17 13:37:08.893639 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: User-Agent: python-urllib3/1.26.9 Jun 17 13:37:08.893639 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Auth-Token: gAAAAABirINum3udgcWV1LgmGo7PFghCrUK0zKP5QKzaZCH3A3rI5qXx2h08NF2Zg_Jc9AtjHKxk7E-q21ZIt9rRfFmfAzyApfxkRtjL5241QfI2Jk5DyWceoG3W6lvggc1MpBFLX76e2YcqxPU18LkDsMpjzpK4owEjELcydlbZXLeh8Vy5J6E Jun 17 13:37:08.893639 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Domain-Id: None Jun 17 13:37:08.893639 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Domain-Name: None Jun 17 13:37:08.893639 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Identity-Status: Confirmed Jun 17 13:37:08.893639 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Is-Admin-Project: True Jun 17 13:37:08.893639 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Project-Domain-Id: default Jun 17 13:37:08.893639 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Project-Domain-Name: Default Jun 17 13:37:08.893639 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Project-Id: 0913f851ff164415a466c466de1ece6e Jun 17 13:37:08.893639 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Project-Name: tempest-VolumesActionsTest-1850369894 Jun 17 13:37:08.893639 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Role: member,reader Jun 17 13:37:08.893639 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Roles: member,reader Jun 17 13:37:08.895088 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_0913f851ff164415a466c466de1ece6e", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0913f851ff164415a466c466de1ece6e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0913f851ff164415a466c466de1ece6e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/0913f851ff164415a466c466de1ece6e"}]}] Jun 17 13:37:08.895088 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Tenant: tempest-VolumesActionsTest-1850369894 Jun 17 13:37:08.895088 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Tenant-Id: 0913f851ff164415a466c466de1ece6e Jun 17 13:37:08.895088 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Tenant-Name: tempest-VolumesActionsTest-1850369894 Jun 17 13:37:08.895088 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-User: tempest-VolumesActionsTest-1850369894-project Jun 17 13:37:08.895088 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-User-Domain-Id: default Jun 17 13:37:08.895088 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-User-Domain-Name: Default Jun 17 13:37:08.895088 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-User-Id: 0a3da974f5be44e2946fc0d3b9423d9d Jun 17 13:37:08.895088 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-User-Name: tempest-VolumesActionsTest-1850369894-project Jun 17 13:37:08.895088 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: method: > Jun 17 13:37:08.895088 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: exception: Instance 11c884ea-957b-4494-9108-6276ac898718 could not be found. Jun 17 13:37:08.895088 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: action_args: {'id': '11c884ea-957b-4494-9108-6276ac898718'} Jun 17 13:37:08.895906 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 13:37:08.895906 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:37:08.895906 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 13:37:08.895906 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 13:37:08.895906 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 13:37:08.895906 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 13:37:08.895906 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 13:37:08.895906 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 13:37:08.895906 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 13:37:08.895906 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 13:37:08.895906 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11c884ea-957b-4494-9108-6276ac898718 could not be found. Jun 17 13:37:08.895906 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 13:37:08.895906 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:37:08.895906 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 13:37:08.895906 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:37:08.895906 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:37:08.895906 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:37:08.895906 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 13:37:08.895906 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 13:37:08.895906 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 13:37:08.897016 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 13:37:08.897016 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 13:37:08.897016 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 13:37:08.897016 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 13:37:08.897016 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 13:37:08.897016 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 13:37:08.897016 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 13:37:08.897016 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11c884ea-957b-4494-9108-6276ac898718 could not be found. Jun 17 13:37:08.897016 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 13:37:08.897016 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:37:08.897016 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 13:37:08.897016 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:37:08.897016 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:37:08.897016 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:37:08.897016 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 13:37:08.897016 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 13:37:08.897016 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11c884ea-957b-4494-9108-6276ac898718 could not be found. Jun 17 13:37:08.897016 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 13:37:08.898743 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-58e49b5c-0afd-4fc7-8687-9722748efe10 tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Returning 404 to user: Instance 11c884ea-957b-4494-9108-6276ac898718 could not be found. {{(pid=117660) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 13:37:08.899749 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-58e49b5c-0afd-4fc7-8687-9722748efe10 tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] 10.222.0.48 "GET /compute/v2.1/servers/11c884ea-957b-4494-9108-6276ac898718" status: 404 len: 111 microversion: 2.1 time: 0.036125 Jun 17 13:37:08.900301 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1712/3472] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:37:08 2022] GET /compute/v2.1/servers/11c884ea-957b-4494-9108-6276ac898718 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 13:37:09.003951 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-8d88190d-8a25-4a30-a57a-e9f95ac1b581 tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-685002140", "imageRef": "ccec3e37-1df8-4f10-a8f6-f97dfac54cf5", "flavorRef": "452", "networks": [{"uuid": "587d0679-e82e-47ed-8ce8-1f2f41091158"}]}} {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:37:09.058055 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.network.neutron [None req-8d88190d-8a25-4a30-a57a-e9f95ac1b581 tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] validate_networks() for [('587d0679-e82e-47ed-8ce8-1f2f41091158', None, None, None, None, None)] {{(pid=117659) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 17 13:37:09.418665 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.virt.hardware [None req-8d88190d-8a25-4a30-a57a-e9f95ac1b581 tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Flavor limits 0:0:0 {{(pid=117659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 17 13:37:09.419228 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.virt.hardware [None req-8d88190d-8a25-4a30-a57a-e9f95ac1b581 tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Image limits 0:0:0 {{(pid=117659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 17 13:37:09.419554 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.virt.hardware [None req-8d88190d-8a25-4a30-a57a-e9f95ac1b581 tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Flavor pref 0:0:0 {{(pid=117659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 17 13:37:09.420181 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.virt.hardware [None req-8d88190d-8a25-4a30-a57a-e9f95ac1b581 tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Image pref 0:0:0 {{(pid=117659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 17 13:37:09.420591 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.virt.hardware [None req-8d88190d-8a25-4a30-a57a-e9f95ac1b581 tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 17 13:37:09.429322 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8d88190d-8a25-4a30-a57a-e9f95ac1b581 tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:37:09.429765 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8d88190d-8a25-4a30-a57a-e9f95ac1b581 tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:37:09.430710 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8d88190d-8a25-4a30-a57a-e9f95ac1b581 tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:37:09.431137 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8d88190d-8a25-4a30-a57a-e9f95ac1b581 tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:37:09.448876 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.quota [None req-8d88190d-8a25-4a30-a57a-e9f95ac1b581 tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Getting quotas for project 0913f851ff164415a466c466de1ece6e. Resources: {'ram', 'cores', 'instances'} {{(pid=117659) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 13:37:09.453002 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.quota [None req-8d88190d-8a25-4a30-a57a-e9f95ac1b581 tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Getting quotas for user 0a3da974f5be44e2946fc0d3b9423d9d and project 0913f851ff164415a466c466de1ece6e. Resources: {'ram', 'cores', 'instances'} {{(pid=117659) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 13:37:09.467330 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-8d88190d-8a25-4a30-a57a-e9f95ac1b581 tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Going to run 1 instances... {{(pid=117659) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 17 13:37:09.469697 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-8d88190d-8a25-4a30-a57a-e9f95ac1b581 tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] [instance: 87b65b06-4c0f-4d0c-a970-1bf5f186368b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ccec3e37-1df8-4f10-a8f6-f97dfac54cf5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117659) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 17 13:37:09.516650 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-8d88190d-8a25-4a30-a57a-e9f95ac1b581 tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.517970 Jun 17 13:37:09.522005 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1761/3473] 10.222.0.48 () {60 vars in 1146 bytes} [Fri Jun 17 13:37:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 520 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 17 13:37:09.528375 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-4e02163a-f43e-4b1f-a363-4c83d7c782a6 tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:37:09.529283 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-4e02163a-f43e-4b1f-a363-4c83d7c782a6 tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] [instance: 87b65b06-4c0f-4d0c-a970-1bf5f186368b] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:37:09.585321 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-4e02163a-f43e-4b1f-a363-4c83d7c782a6 tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3da974f5be44e2946fc0d3b9423d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0913f851ff164415a466c466de1ece6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:37:09.592587 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-4e02163a-f43e-4b1f-a363-4c83d7c782a6 tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] 10.222.0.48 "GET /compute/v2.1/servers/87b65b06-4c0f-4d0c-a970-1bf5f186368b" status: 200 len: 1213 microversion: 2.1 time: 0.069058 Jun 17 13:37:09.600637 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1713/3474] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:37:09 2022] GET /compute/v2.1/servers/87b65b06-4c0f-4d0c-a970-1bf5f186368b => generated 1213 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:37:10.609825 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-e533ccb4-9578-4189-8138-dedc5f8a1a1e tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:37:10.610565 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-e533ccb4-9578-4189-8138-dedc5f8a1a1e tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] [instance: 87b65b06-4c0f-4d0c-a970-1bf5f186368b] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:37:10.618736 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e533ccb4-9578-4189-8138-dedc5f8a1a1e tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:37:10.619243 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e533ccb4-9578-4189-8138-dedc5f8a1a1e tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:37:10.620173 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e533ccb4-9578-4189-8138-dedc5f8a1a1e tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:37:10.620752 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e533ccb4-9578-4189-8138-dedc5f8a1a1e tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:37:10.625477 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:37:10.710672 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-e533ccb4-9578-4189-8138-dedc5f8a1a1e tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3da974f5be44e2946fc0d3b9423d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0913f851ff164415a466c466de1ece6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:37:10.720565 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-e533ccb4-9578-4189-8138-dedc5f8a1a1e tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] 10.222.0.48 "GET /compute/v2.1/servers/87b65b06-4c0f-4d0c-a970-1bf5f186368b" status: 200 len: 1271 microversion: 2.1 time: 0.115522 Jun 17 13:37:10.721154 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1762/3475] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:37:10 2022] GET /compute/v2.1/servers/87b65b06-4c0f-4d0c-a970-1bf5f186368b => generated 1271 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:37:11.739342 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-3e82535d-eeeb-495c-a2fe-38d150821c1d tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:37:11.739958 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-3e82535d-eeeb-495c-a2fe-38d150821c1d tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] [instance: 87b65b06-4c0f-4d0c-a970-1bf5f186368b] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:37:11.747980 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3e82535d-eeeb-495c-a2fe-38d150821c1d tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:37:11.748557 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3e82535d-eeeb-495c-a2fe-38d150821c1d tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:37:11.749793 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3e82535d-eeeb-495c-a2fe-38d150821c1d tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:37:11.750447 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3e82535d-eeeb-495c-a2fe-38d150821c1d tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:37:11.913721 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-3e82535d-eeeb-495c-a2fe-38d150821c1d tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3da974f5be44e2946fc0d3b9423d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0913f851ff164415a466c466de1ece6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:37:11.924111 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-3e82535d-eeeb-495c-a2fe-38d150821c1d tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] 10.222.0.48 "GET /compute/v2.1/servers/87b65b06-4c0f-4d0c-a970-1bf5f186368b" status: 200 len: 1313 microversion: 2.1 time: 0.189030 Jun 17 13:37:11.924899 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1714/3476] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:37:11 2022] GET /compute/v2.1/servers/87b65b06-4c0f-4d0c-a970-1bf5f186368b => generated 1313 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:37:12.018302 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [req-e0fb04d5-42ce-49cb-b8f2-d0328719a5d8 req-e96df591-a242-4b22-9675-0232c92a13d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87b65b06-4c0f-4d0c-a970-1bf5f186368b", "tag": "ce3f50ec-58d5-482a-8d87-6cff0b032881"}]} {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:37:12.028660 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [req-e0fb04d5-42ce-49cb-b8f2-d0328719a5d8 req-e96df591-a242-4b22-9675-0232c92a13d1 service nova] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:37:12.029456 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [req-e0fb04d5-42ce-49cb-b8f2-d0328719a5d8 req-e96df591-a242-4b22-9675-0232c92a13d1 service nova] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:37:12.044129 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.compute.server_external_events [req-e0fb04d5-42ce-49cb-b8f2-d0328719a5d8 req-e96df591-a242-4b22-9675-0232c92a13d1 service nova] Creating event network-changed:ce3f50ec-58d5-482a-8d87-6cff0b032881 for instance 87b65b06-4c0f-4d0c-a970-1bf5f186368b on hv-cinder-83754 Jun 17 13:37:12.049703 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [req-e0fb04d5-42ce-49cb-b8f2-d0328719a5d8 req-e96df591-a242-4b22-9675-0232c92a13d1 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036243 Jun 17 13:37:12.050512 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1763/3477] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 13:37:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:37:12.940485 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-2ebc4ed6-2451-4121-8499-9f54ed35b90e tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:37:12.941094 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-2ebc4ed6-2451-4121-8499-9f54ed35b90e tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] [instance: 87b65b06-4c0f-4d0c-a970-1bf5f186368b] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:37:12.947353 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2ebc4ed6-2451-4121-8499-9f54ed35b90e tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:37:12.947790 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2ebc4ed6-2451-4121-8499-9f54ed35b90e tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:37:12.948566 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2ebc4ed6-2451-4121-8499-9f54ed35b90e tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:37:12.948982 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2ebc4ed6-2451-4121-8499-9f54ed35b90e tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:37:13.084910 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-2ebc4ed6-2451-4121-8499-9f54ed35b90e tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3da974f5be44e2946fc0d3b9423d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0913f851ff164415a466c466de1ece6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:37:13.092603 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-2ebc4ed6-2451-4121-8499-9f54ed35b90e tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] 10.222.0.48 "GET /compute/v2.1/servers/87b65b06-4c0f-4d0c-a970-1bf5f186368b" status: 200 len: 1313 microversion: 2.1 time: 0.155854 Jun 17 13:37:13.093168 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1715/3478] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:37:12 2022] GET /compute/v2.1/servers/87b65b06-4c0f-4d0c-a970-1bf5f186368b => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:37:14.111335 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-6c9aeb43-3134-4d71-ae3b-a37fdfd54651 tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:37:14.112201 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-6c9aeb43-3134-4d71-ae3b-a37fdfd54651 tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] [instance: 87b65b06-4c0f-4d0c-a970-1bf5f186368b] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:37:14.119431 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6c9aeb43-3134-4d71-ae3b-a37fdfd54651 tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:37:14.119964 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6c9aeb43-3134-4d71-ae3b-a37fdfd54651 tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:37:14.120832 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6c9aeb43-3134-4d71-ae3b-a37fdfd54651 tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:37:14.121349 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6c9aeb43-3134-4d71-ae3b-a37fdfd54651 tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:37:14.259635 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-6c9aeb43-3134-4d71-ae3b-a37fdfd54651 tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3da974f5be44e2946fc0d3b9423d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0913f851ff164415a466c466de1ece6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:37:14.274070 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-6c9aeb43-3134-4d71-ae3b-a37fdfd54651 tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] 10.222.0.48 "GET /compute/v2.1/servers/87b65b06-4c0f-4d0c-a970-1bf5f186368b" status: 200 len: 1313 microversion: 2.1 time: 0.160483 Jun 17 13:37:14.274070 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1764/3479] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:37:14 2022] GET /compute/v2.1/servers/87b65b06-4c0f-4d0c-a970-1bf5f186368b => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:37:15.288880 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-f575f924-b077-4773-bd78-8e9e747264bd tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:37:15.289553 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-f575f924-b077-4773-bd78-8e9e747264bd tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] [instance: 87b65b06-4c0f-4d0c-a970-1bf5f186368b] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:37:15.297352 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f575f924-b077-4773-bd78-8e9e747264bd tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:37:15.297960 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f575f924-b077-4773-bd78-8e9e747264bd tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:37:15.299004 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f575f924-b077-4773-bd78-8e9e747264bd tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:37:15.299595 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f575f924-b077-4773-bd78-8e9e747264bd tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:37:15.440475 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-f575f924-b077-4773-bd78-8e9e747264bd tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3da974f5be44e2946fc0d3b9423d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0913f851ff164415a466c466de1ece6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:37:15.448660 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-f575f924-b077-4773-bd78-8e9e747264bd tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] 10.222.0.48 "GET /compute/v2.1/servers/87b65b06-4c0f-4d0c-a970-1bf5f186368b" status: 200 len: 1313 microversion: 2.1 time: 0.165336 Jun 17 13:37:15.449291 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1716/3480] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:37:15 2022] GET /compute/v2.1/servers/87b65b06-4c0f-4d0c-a970-1bf5f186368b => generated 1313 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:37:16.466038 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-5d458977-bc67-47d8-aa6b-b3b141e1fb09 tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:37:16.466660 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-5d458977-bc67-47d8-aa6b-b3b141e1fb09 tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] [instance: 87b65b06-4c0f-4d0c-a970-1bf5f186368b] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:37:16.473576 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-5d458977-bc67-47d8-aa6b-b3b141e1fb09 tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:37:16.474029 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-5d458977-bc67-47d8-aa6b-b3b141e1fb09 tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:37:16.475140 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-5d458977-bc67-47d8-aa6b-b3b141e1fb09 tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:37:16.475274 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-5d458977-bc67-47d8-aa6b-b3b141e1fb09 tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:37:16.614139 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-5d458977-bc67-47d8-aa6b-b3b141e1fb09 tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3da974f5be44e2946fc0d3b9423d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0913f851ff164415a466c466de1ece6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:37:16.622504 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-5d458977-bc67-47d8-aa6b-b3b141e1fb09 tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] 10.222.0.48 "GET /compute/v2.1/servers/87b65b06-4c0f-4d0c-a970-1bf5f186368b" status: 200 len: 1313 microversion: 2.1 time: 0.160673 Jun 17 13:37:16.623114 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1765/3481] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:37:16 2022] GET /compute/v2.1/servers/87b65b06-4c0f-4d0c-a970-1bf5f186368b => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:37:17.640141 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-360e04af-a0a3-4d14-a82b-db51bd878a0b tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:37:17.640906 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-360e04af-a0a3-4d14-a82b-db51bd878a0b tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] [instance: 87b65b06-4c0f-4d0c-a970-1bf5f186368b] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:37:17.647835 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-360e04af-a0a3-4d14-a82b-db51bd878a0b tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:37:17.648281 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-360e04af-a0a3-4d14-a82b-db51bd878a0b tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:37:17.649044 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-360e04af-a0a3-4d14-a82b-db51bd878a0b tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:37:17.649474 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-360e04af-a0a3-4d14-a82b-db51bd878a0b tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:37:17.781314 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-360e04af-a0a3-4d14-a82b-db51bd878a0b tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3da974f5be44e2946fc0d3b9423d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0913f851ff164415a466c466de1ece6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:37:17.789096 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-360e04af-a0a3-4d14-a82b-db51bd878a0b tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] 10.222.0.48 "GET /compute/v2.1/servers/87b65b06-4c0f-4d0c-a970-1bf5f186368b" status: 200 len: 1313 microversion: 2.1 time: 0.153058 Jun 17 13:37:17.791383 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1717/3482] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:37:17 2022] GET /compute/v2.1/servers/87b65b06-4c0f-4d0c-a970-1bf5f186368b => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:37:18.806293 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-1f57c2d1-703b-4ed8-ab1a-f565e2db671f tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:37:18.806883 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-1f57c2d1-703b-4ed8-ab1a-f565e2db671f tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] [instance: 87b65b06-4c0f-4d0c-a970-1bf5f186368b] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:37:18.809666 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:37:18.815584 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-1f57c2d1-703b-4ed8-ab1a-f565e2db671f tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:37:18.816033 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-1f57c2d1-703b-4ed8-ab1a-f565e2db671f tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:37:18.816798 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-1f57c2d1-703b-4ed8-ab1a-f565e2db671f tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:37:18.817241 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-1f57c2d1-703b-4ed8-ab1a-f565e2db671f tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:37:18.930603 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [req-9559cbac-37b5-4f2c-a1ba-c73a9e5ef420 req-3566a635-cd24-4e11-b66d-be120b51a894 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87b65b06-4c0f-4d0c-a970-1bf5f186368b", "name": "network-vif-plugged", "status": "completed", "tag": "ce3f50ec-58d5-482a-8d87-6cff0b032881"}]} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:37:18.934125 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_api:SELECT=54,nova_api:DELETE=1 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:37:18.941910 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-9559cbac-37b5-4f2c-a1ba-c73a9e5ef420 req-3566a635-cd24-4e11-b66d-be120b51a894 service nova] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:37:18.942460 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-9559cbac-37b5-4f2c-a1ba-c73a9e5ef420 req-3566a635-cd24-4e11-b66d-be120b51a894 service nova] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:37:18.946319 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=91 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:37:18.970425 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.compute.server_external_events [req-9559cbac-37b5-4f2c-a1ba-c73a9e5ef420 req-3566a635-cd24-4e11-b66d-be120b51a894 service nova] Creating event network-vif-plugged:ce3f50ec-58d5-482a-8d87-6cff0b032881 for instance 87b65b06-4c0f-4d0c-a970-1bf5f186368b on hv-cinder-83754 Jun 17 13:37:18.976821 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-1f57c2d1-703b-4ed8-ab1a-f565e2db671f tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3da974f5be44e2946fc0d3b9423d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0913f851ff164415a466c466de1ece6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:37:18.979842 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [req-9559cbac-37b5-4f2c-a1ba-c73a9e5ef420 req-3566a635-cd24-4e11-b66d-be120b51a894 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053568 Jun 17 13:37:18.981057 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1718/3483] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 13:37:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 13:37:18.985116 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-1f57c2d1-703b-4ed8-ab1a-f565e2db671f tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] 10.222.0.48 "GET /compute/v2.1/servers/87b65b06-4c0f-4d0c-a970-1bf5f186368b" status: 200 len: 1313 microversion: 2.1 time: 0.182873 Jun 17 13:37:18.985658 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1766/3484] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:37:18 2022] GET /compute/v2.1/servers/87b65b06-4c0f-4d0c-a970-1bf5f186368b => generated 1313 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 13:37:20.000129 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell0:SELECT=2 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:37:20.004809 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-3157699f-3338-4b62-915a-8173e88beafa tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:37:20.005504 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-3157699f-3338-4b62-915a-8173e88beafa tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] [instance: 87b65b06-4c0f-4d0c-a970-1bf5f186368b] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:37:20.012579 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3157699f-3338-4b62-915a-8173e88beafa tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:37:20.013020 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3157699f-3338-4b62-915a-8173e88beafa tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:37:20.013797 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3157699f-3338-4b62-915a-8173e88beafa tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:37:20.014257 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3157699f-3338-4b62-915a-8173e88beafa tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:37:20.150030 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-3157699f-3338-4b62-915a-8173e88beafa tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3da974f5be44e2946fc0d3b9423d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0913f851ff164415a466c466de1ece6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:37:20.157552 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-3157699f-3338-4b62-915a-8173e88beafa tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] 10.222.0.48 "GET /compute/v2.1/servers/87b65b06-4c0f-4d0c-a970-1bf5f186368b" status: 200 len: 1313 microversion: 2.1 time: 0.158579 Jun 17 13:37:20.158176 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1719/3485] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:37:19 2022] GET /compute/v2.1/servers/87b65b06-4c0f-4d0c-a970-1bf5f186368b => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:37:21.177058 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-fbf5cdd1-97be-414f-84fa-fa1ced1bdc1d tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:37:21.177754 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-fbf5cdd1-97be-414f-84fa-fa1ced1bdc1d tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] [instance: 87b65b06-4c0f-4d0c-a970-1bf5f186368b] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:37:21.180120 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_cell0:SELECT=2 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:37:21.180778 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_cell0:SELECT=6 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:37:21.187772 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-fbf5cdd1-97be-414f-84fa-fa1ced1bdc1d tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:37:21.188200 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-fbf5cdd1-97be-414f-84fa-fa1ced1bdc1d tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:37:21.188951 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-fbf5cdd1-97be-414f-84fa-fa1ced1bdc1d tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:37:21.189386 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-fbf5cdd1-97be-414f-84fa-fa1ced1bdc1d tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:37:21.280776 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 13:37:21.280776 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Fri Jun 17 13:37:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/87b65b06-4c0f-4d0c-a970-1bf5f186368b (ip 10.222.0.48) !!! Jun 17 13:37:21.577754 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-fbf5cdd1-97be-414f-84fa-fa1ced1bdc1d tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3da974f5be44e2946fc0d3b9423d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0913f851ff164415a466c466de1ece6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:37:21.586388 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-fbf5cdd1-97be-414f-84fa-fa1ced1bdc1d tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] 10.222.0.48 "GET /compute/v2.1/servers/87b65b06-4c0f-4d0c-a970-1bf5f186368b" status: 200 len: 1498 microversion: 2.1 time: 0.414785 Jun 17 13:37:21.586959 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1767/3486] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:37:21 2022] GET /compute/v2.1/servers/87b65b06-4c0f-4d0c-a970-1bf5f186368b => generated 1498 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:37:22.272697 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-90ac7617-73e7-4b05-84b5-cfa9e45ff5fe tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:37:22.273202 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-90ac7617-73e7-4b05-84b5-cfa9e45ff5fe tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] [instance: 87b65b06-4c0f-4d0c-a970-1bf5f186368b] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:37:22.280020 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-90ac7617-73e7-4b05-84b5-cfa9e45ff5fe tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:37:22.280442 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-90ac7617-73e7-4b05-84b5-cfa9e45ff5fe tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:37:22.281189 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-90ac7617-73e7-4b05-84b5-cfa9e45ff5fe tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:37:22.281615 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-90ac7617-73e7-4b05-84b5-cfa9e45ff5fe tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:37:22.307150 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-90ac7617-73e7-4b05-84b5-cfa9e45ff5fe tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] [instance: 87b65b06-4c0f-4d0c-a970-1bf5f186368b] Going to try to terminate instance {{(pid=117660) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 17 13:37:22.385747 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-90ac7617-73e7-4b05-84b5-cfa9e45ff5fe tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] 10.222.0.48 "DELETE /compute/v2.1/servers/87b65b06-4c0f-4d0c-a970-1bf5f186368b" status: 204 len: 0 microversion: 2.1 time: 0.116657 Jun 17 13:37:22.386355 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1720/3487] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Jun 17 13:37:22 2022] DELETE /compute/v2.1/servers/87b65b06-4c0f-4d0c-a970-1bf5f186368b => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 17 13:37:22.396625 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-dd04311d-c243-4327-9528-ba8eb149c012 tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:37:22.397344 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-dd04311d-c243-4327-9528-ba8eb149c012 tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] [instance: 87b65b06-4c0f-4d0c-a970-1bf5f186368b] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:37:22.404257 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-dd04311d-c243-4327-9528-ba8eb149c012 tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:37:22.404711 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-dd04311d-c243-4327-9528-ba8eb149c012 tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:37:22.405474 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-dd04311d-c243-4327-9528-ba8eb149c012 tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:37:22.405916 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-dd04311d-c243-4327-9528-ba8eb149c012 tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:37:22.534990 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-dd04311d-c243-4327-9528-ba8eb149c012 tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3da974f5be44e2946fc0d3b9423d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0913f851ff164415a466c466de1ece6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:37:22.542593 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-dd04311d-c243-4327-9528-ba8eb149c012 tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] 10.222.0.48 "GET /compute/v2.1/servers/87b65b06-4c0f-4d0c-a970-1bf5f186368b" status: 200 len: 1504 microversion: 2.1 time: 0.150909 Jun 17 13:37:22.543148 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1768/3488] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:37:22 2022] GET /compute/v2.1/servers/87b65b06-4c0f-4d0c-a970-1bf5f186368b => generated 1504 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:37:23.565533 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-5fa30300-65d8-4bbd-bc69-8f08272d4a8a tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:37:23.566733 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-5fa30300-65d8-4bbd-bc69-8f08272d4a8a tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] [instance: 87b65b06-4c0f-4d0c-a970-1bf5f186368b] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:37:23.574520 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5fa30300-65d8-4bbd-bc69-8f08272d4a8a tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:37:23.574959 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5fa30300-65d8-4bbd-bc69-8f08272d4a8a tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:37:23.575731 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5fa30300-65d8-4bbd-bc69-8f08272d4a8a tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:37:23.576133 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5fa30300-65d8-4bbd-bc69-8f08272d4a8a tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:37:23.726414 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-5fa30300-65d8-4bbd-bc69-8f08272d4a8a tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3da974f5be44e2946fc0d3b9423d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0913f851ff164415a466c466de1ece6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:37:23.734764 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-5fa30300-65d8-4bbd-bc69-8f08272d4a8a tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] 10.222.0.48 "GET /compute/v2.1/servers/87b65b06-4c0f-4d0c-a970-1bf5f186368b" status: 200 len: 1504 microversion: 2.1 time: 0.176283 Jun 17 13:37:23.735547 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1721/3489] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:37:23 2022] GET /compute/v2.1/servers/87b65b06-4c0f-4d0c-a970-1bf5f186368b => generated 1504 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:37:24.459962 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [req-006b6158-921b-4c0b-b034-c8dd1f25575b req-4a2ba28a-ed29-4b61-bdc9-33745c484cf4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87b65b06-4c0f-4d0c-a970-1bf5f186368b", "name": "network-vif-deleted", "tag": "ce3f50ec-58d5-482a-8d87-6cff0b032881"}]} {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:37:24.471360 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [req-006b6158-921b-4c0b-b034-c8dd1f25575b req-4a2ba28a-ed29-4b61-bdc9-33745c484cf4 service nova] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:37:24.471703 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [req-006b6158-921b-4c0b-b034-c8dd1f25575b req-4a2ba28a-ed29-4b61-bdc9-33745c484cf4 service nova] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:37:24.486541 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.compute.server_external_events [req-006b6158-921b-4c0b-b034-c8dd1f25575b req-4a2ba28a-ed29-4b61-bdc9-33745c484cf4 service nova] Creating event network-vif-deleted:ce3f50ec-58d5-482a-8d87-6cff0b032881 for instance 87b65b06-4c0f-4d0c-a970-1bf5f186368b on hv-cinder-83754 Jun 17 13:37:24.495451 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [req-006b6158-921b-4c0b-b034-c8dd1f25575b req-4a2ba28a-ed29-4b61-bdc9-33745c484cf4 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039096 Jun 17 13:37:24.496579 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1769/3490] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 13:37:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:37:24.752651 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-1f068660-da09-48dd-8774-63caa4787e4b tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:37:24.753342 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-1f068660-da09-48dd-8774-63caa4787e4b tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] [instance: 87b65b06-4c0f-4d0c-a970-1bf5f186368b] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:37:24.759993 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1f068660-da09-48dd-8774-63caa4787e4b tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:37:24.760439 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1f068660-da09-48dd-8774-63caa4787e4b tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:37:24.761193 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1f068660-da09-48dd-8774-63caa4787e4b tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:37:24.761615 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1f068660-da09-48dd-8774-63caa4787e4b tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:37:24.793697 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1f068660-da09-48dd-8774-63caa4787e4b tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:37:24.794168 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1f068660-da09-48dd-8774-63caa4787e4b tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:37:24.794611 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.objects.instance [None req-1f068660-da09-48dd-8774-63caa4787e4b tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Lazy-loading 'fault' on Instance uuid 87b65b06-4c0f-4d0c-a970-1bf5f186368b {{(pid=117660) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 13:37:24.835429 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-1f068660-da09-48dd-8774-63caa4787e4b tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3da974f5be44e2946fc0d3b9423d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0913f851ff164415a466c466de1ece6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:37:24.843022 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-1f068660-da09-48dd-8774-63caa4787e4b tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] 10.222.0.48 "GET /compute/v2.1/servers/87b65b06-4c0f-4d0c-a970-1bf5f186368b" status: 200 len: 1303 microversion: 2.1 time: 0.094346 Jun 17 13:37:24.843552 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1722/3491] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:37:24 2022] GET /compute/v2.1/servers/87b65b06-4c0f-4d0c-a970-1bf5f186368b => generated 1303 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:37:25.861983 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-fb3c2b8c-8233-497a-a79c-c36636fc698e tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:37:25.862782 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-fb3c2b8c-8233-497a-a79c-c36636fc698e tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] [instance: 87b65b06-4c0f-4d0c-a970-1bf5f186368b] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:37:25.869754 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-fb3c2b8c-8233-497a-a79c-c36636fc698e tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:37:25.870226 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-fb3c2b8c-8233-497a-a79c-c36636fc698e tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:37:25.870985 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-fb3c2b8c-8233-497a-a79c-c36636fc698e tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:37:25.871448 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-fb3c2b8c-8233-497a-a79c-c36636fc698e tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:37:25.888359 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.wsgi [None req-fb3c2b8c-8233-497a-a79c-c36636fc698e tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] HTTP exception thrown: Instance 87b65b06-4c0f-4d0c-a970-1bf5f186368b could not be found. Jun 17 13:37:25.890025 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-fb3c2b8c-8233-497a-a79c-c36636fc698e tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Request method failure captured: Jun 17 13:37:25.890025 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: request: GET /compute/v2.1/servers/87b65b06-4c0f-4d0c-a970-1bf5f186368b HTTP/1.1 Jun 17 13:37:25.890025 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Accept: application/json Jun 17 13:37:25.890025 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Accept-Encoding: identity Jun 17 13:37:25.890025 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Connection: close Jun 17 13:37:25.890025 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Content-Length: 0 Jun 17 13:37:25.890025 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Content-Type: application/json Jun 17 13:37:25.890025 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Host: 10.222.0.48 Jun 17 13:37:25.890025 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Openstack-System-Scope: None Jun 17 13:37:25.890025 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: User-Agent: python-urllib3/1.26.9 Jun 17 13:37:25.890025 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Auth-Token: gAAAAABirINum3udgcWV1LgmGo7PFghCrUK0zKP5QKzaZCH3A3rI5qXx2h08NF2Zg_Jc9AtjHKxk7E-q21ZIt9rRfFmfAzyApfxkRtjL5241QfI2Jk5DyWceoG3W6lvggc1MpBFLX76e2YcqxPU18LkDsMpjzpK4owEjELcydlbZXLeh8Vy5J6E Jun 17 13:37:25.890025 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Domain-Id: None Jun 17 13:37:25.890025 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Domain-Name: None Jun 17 13:37:25.890025 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Identity-Status: Confirmed Jun 17 13:37:25.890025 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Is-Admin-Project: True Jun 17 13:37:25.890025 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Project-Domain-Id: default Jun 17 13:37:25.890025 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Project-Domain-Name: Default Jun 17 13:37:25.890025 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Project-Id: 0913f851ff164415a466c466de1ece6e Jun 17 13:37:25.890025 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Project-Name: tempest-VolumesActionsTest-1850369894 Jun 17 13:37:25.890025 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Role: member,reader Jun 17 13:37:25.890025 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Roles: member,reader Jun 17 13:37:25.891403 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_0913f851ff164415a466c466de1ece6e", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0913f851ff164415a466c466de1ece6e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0913f851ff164415a466c466de1ece6e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/0913f851ff164415a466c466de1ece6e"}]}] Jun 17 13:37:25.891403 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Tenant: tempest-VolumesActionsTest-1850369894 Jun 17 13:37:25.891403 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Tenant-Id: 0913f851ff164415a466c466de1ece6e Jun 17 13:37:25.891403 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Tenant-Name: tempest-VolumesActionsTest-1850369894 Jun 17 13:37:25.891403 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User: tempest-VolumesActionsTest-1850369894-project Jun 17 13:37:25.891403 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User-Domain-Id: default Jun 17 13:37:25.891403 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User-Domain-Name: Default Jun 17 13:37:25.891403 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User-Id: 0a3da974f5be44e2946fc0d3b9423d9d Jun 17 13:37:25.891403 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User-Name: tempest-VolumesActionsTest-1850369894-project Jun 17 13:37:25.891403 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: method: > Jun 17 13:37:25.891403 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: exception: Instance 87b65b06-4c0f-4d0c-a970-1bf5f186368b could not be found. Jun 17 13:37:25.891403 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: action_args: {'id': '87b65b06-4c0f-4d0c-a970-1bf5f186368b'} Jun 17 13:37:25.892585 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 13:37:25.892585 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:37:25.892585 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 13:37:25.892585 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 13:37:25.892585 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 13:37:25.892585 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 13:37:25.892585 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 13:37:25.892585 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 13:37:25.892585 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 13:37:25.892585 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 13:37:25.892585 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87b65b06-4c0f-4d0c-a970-1bf5f186368b could not be found. Jun 17 13:37:25.892585 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:37:25.892585 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:37:25.892585 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:37:25.892585 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:37:25.892585 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:37:25.892585 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:37:25.892585 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 13:37:25.892585 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 13:37:25.892585 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 13:37:25.893962 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 13:37:25.893962 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 13:37:25.893962 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 13:37:25.893962 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 13:37:25.893962 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 13:37:25.893962 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 13:37:25.893962 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 13:37:25.893962 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87b65b06-4c0f-4d0c-a970-1bf5f186368b could not be found. Jun 17 13:37:25.893962 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:37:25.893962 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:37:25.893962 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:37:25.893962 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:37:25.893962 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:37:25.893962 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:37:25.893962 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 13:37:25.893962 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 13:37:25.893962 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87b65b06-4c0f-4d0c-a970-1bf5f186368b could not be found. Jun 17 13:37:25.893962 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:37:25.895122 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-fb3c2b8c-8233-497a-a79c-c36636fc698e tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] Returning 404 to user: Instance 87b65b06-4c0f-4d0c-a970-1bf5f186368b could not be found. {{(pid=117659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 13:37:25.895122 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-fb3c2b8c-8233-497a-a79c-c36636fc698e tempest-VolumesActionsTest-1850369894 tempest-VolumesActionsTest-1850369894-project] 10.222.0.48 "GET /compute/v2.1/servers/87b65b06-4c0f-4d0c-a970-1bf5f186368b" status: 404 len: 111 microversion: 2.1 time: 0.034560 Jun 17 13:37:25.895122 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1770/3492] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:37:25 2022] GET /compute/v2.1/servers/87b65b06-4c0f-4d0c-a970-1bf5f186368b => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 13:37:27.913567 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 13:37:27.914127 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Fri Jun 17 13:37:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 17 13:37:40.395486 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-b1c59230-e9f9-482d-9f71-0e7fe30760e1 tempest-VolumesNegativeTest-400691057 tempest-VolumesNegativeTest-400691057-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1076757209", "imageRef": "ccec3e37-1df8-4f10-a8f6-f97dfac54cf5", "flavorRef": "452"}} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:37:40.407485 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:37:40.408193 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=35,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:37:40.461912 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.network.neutron [None req-b1c59230-e9f9-482d-9f71-0e7fe30760e1 tempest-VolumesNegativeTest-400691057 tempest-VolumesNegativeTest-400691057-project] validate_networks() for None {{(pid=117660) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 17 13:37:40.763794 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.virt.hardware [None req-b1c59230-e9f9-482d-9f71-0e7fe30760e1 tempest-VolumesNegativeTest-400691057 tempest-VolumesNegativeTest-400691057-project] Flavor limits 0:0:0 {{(pid=117660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 17 13:37:40.764220 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.virt.hardware [None req-b1c59230-e9f9-482d-9f71-0e7fe30760e1 tempest-VolumesNegativeTest-400691057 tempest-VolumesNegativeTest-400691057-project] Image limits 0:0:0 {{(pid=117660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 17 13:37:40.764685 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.virt.hardware [None req-b1c59230-e9f9-482d-9f71-0e7fe30760e1 tempest-VolumesNegativeTest-400691057 tempest-VolumesNegativeTest-400691057-project] Flavor pref 0:0:0 {{(pid=117660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 17 13:37:40.765088 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.virt.hardware [None req-b1c59230-e9f9-482d-9f71-0e7fe30760e1 tempest-VolumesNegativeTest-400691057 tempest-VolumesNegativeTest-400691057-project] Image pref 0:0:0 {{(pid=117660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 17 13:37:40.765495 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.virt.hardware [None req-b1c59230-e9f9-482d-9f71-0e7fe30760e1 tempest-VolumesNegativeTest-400691057 tempest-VolumesNegativeTest-400691057-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 17 13:37:40.775637 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b1c59230-e9f9-482d-9f71-0e7fe30760e1 tempest-VolumesNegativeTest-400691057 tempest-VolumesNegativeTest-400691057-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:37:40.776336 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b1c59230-e9f9-482d-9f71-0e7fe30760e1 tempest-VolumesNegativeTest-400691057 tempest-VolumesNegativeTest-400691057-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:37:40.777228 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b1c59230-e9f9-482d-9f71-0e7fe30760e1 tempest-VolumesNegativeTest-400691057 tempest-VolumesNegativeTest-400691057-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:37:40.777678 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b1c59230-e9f9-482d-9f71-0e7fe30760e1 tempest-VolumesNegativeTest-400691057 tempest-VolumesNegativeTest-400691057-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:37:40.795814 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.quota [None req-b1c59230-e9f9-482d-9f71-0e7fe30760e1 tempest-VolumesNegativeTest-400691057 tempest-VolumesNegativeTest-400691057-project] Getting quotas for project b930725523554152a3cfe3be04ec1362. Resources: {'ram', 'cores', 'instances'} {{(pid=117660) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 13:37:40.799769 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.quota [None req-b1c59230-e9f9-482d-9f71-0e7fe30760e1 tempest-VolumesNegativeTest-400691057 tempest-VolumesNegativeTest-400691057-project] Getting quotas for user df6ee253918c48aea90c6aa3eb998cc5 and project b930725523554152a3cfe3be04ec1362. Resources: {'ram', 'cores', 'instances'} {{(pid=117660) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 13:37:40.811861 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-b1c59230-e9f9-482d-9f71-0e7fe30760e1 tempest-VolumesNegativeTest-400691057 tempest-VolumesNegativeTest-400691057-project] Going to run 1 instances... {{(pid=117660) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 17 13:37:40.814373 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-b1c59230-e9f9-482d-9f71-0e7fe30760e1 tempest-VolumesNegativeTest-400691057 tempest-VolumesNegativeTest-400691057-project] [instance: c161499b-a50e-4237-9222-026b84cd22e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ccec3e37-1df8-4f10-a8f6-f97dfac54cf5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117660) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 17 13:37:40.872132 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-b1c59230-e9f9-482d-9f71-0e7fe30760e1 tempest-VolumesNegativeTest-400691057 tempest-VolumesNegativeTest-400691057-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.480464 Jun 17 13:37:40.878099 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1723/3493] 10.222.0.48 () {60 vars in 1146 bytes} [Fri Jun 17 13:37:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 487 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 17 13:37:40.891016 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-31e74dfd-d792-4576-937b-6c4cbb928a8f tempest-VolumesNegativeTest-400691057 tempest-VolumesNegativeTest-400691057-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:37:40.892365 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-31e74dfd-d792-4576-937b-6c4cbb928a8f tempest-VolumesNegativeTest-400691057 tempest-VolumesNegativeTest-400691057-project] [instance: c161499b-a50e-4237-9222-026b84cd22e2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:37:40.894738 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_api:SELECT=9 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:37:40.897049 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_cell1:SELECT=40 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:37:40.961474 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-31e74dfd-d792-4576-937b-6c4cbb928a8f tempest-VolumesNegativeTest-400691057 tempest-VolumesNegativeTest-400691057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df6ee253918c48aea90c6aa3eb998cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b930725523554152a3cfe3be04ec1362', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:37:40.971330 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-31e74dfd-d792-4576-937b-6c4cbb928a8f tempest-VolumesNegativeTest-400691057 tempest-VolumesNegativeTest-400691057-project] 10.222.0.48 "GET /compute/v2.1/servers/c161499b-a50e-4237-9222-026b84cd22e2" status: 200 len: 1215 microversion: 2.1 time: 0.084613 Jun 17 13:37:40.974431 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1771/3494] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:37:40 2022] GET /compute/v2.1/servers/c161499b-a50e-4237-9222-026b84cd22e2 => generated 1215 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:37:41.997114 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-856c82df-064f-42c2-95a3-ddc784a5a865 tempest-VolumesNegativeTest-400691057 tempest-VolumesNegativeTest-400691057-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:37:41.997786 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-856c82df-064f-42c2-95a3-ddc784a5a865 tempest-VolumesNegativeTest-400691057 tempest-VolumesNegativeTest-400691057-project] [instance: c161499b-a50e-4237-9222-026b84cd22e2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:37:42.017594 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-856c82df-064f-42c2-95a3-ddc784a5a865 tempest-VolumesNegativeTest-400691057 tempest-VolumesNegativeTest-400691057-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:37:42.018233 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-856c82df-064f-42c2-95a3-ddc784a5a865 tempest-VolumesNegativeTest-400691057 tempest-VolumesNegativeTest-400691057-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:37:42.019157 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-856c82df-064f-42c2-95a3-ddc784a5a865 tempest-VolumesNegativeTest-400691057 tempest-VolumesNegativeTest-400691057-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:37:42.019729 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-856c82df-064f-42c2-95a3-ddc784a5a865 tempest-VolumesNegativeTest-400691057 tempest-VolumesNegativeTest-400691057-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:37:42.112081 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-856c82df-064f-42c2-95a3-ddc784a5a865 tempest-VolumesNegativeTest-400691057 tempest-VolumesNegativeTest-400691057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df6ee253918c48aea90c6aa3eb998cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b930725523554152a3cfe3be04ec1362', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:37:42.121276 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-856c82df-064f-42c2-95a3-ddc784a5a865 tempest-VolumesNegativeTest-400691057 tempest-VolumesNegativeTest-400691057-project] 10.222.0.48 "GET /compute/v2.1/servers/c161499b-a50e-4237-9222-026b84cd22e2" status: 200 len: 1275 microversion: 2.1 time: 0.134468 Jun 17 13:37:42.123405 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1724/3495] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:37:41 2022] GET /compute/v2.1/servers/c161499b-a50e-4237-9222-026b84cd22e2 => generated 1275 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:37:43.140679 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-59488225-aba6-45f2-a45e-d8083b372e7b tempest-VolumesNegativeTest-400691057 tempest-VolumesNegativeTest-400691057-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:37:43.142073 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-59488225-aba6-45f2-a45e-d8083b372e7b tempest-VolumesNegativeTest-400691057 tempest-VolumesNegativeTest-400691057-project] [instance: c161499b-a50e-4237-9222-026b84cd22e2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:37:43.156333 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-59488225-aba6-45f2-a45e-d8083b372e7b tempest-VolumesNegativeTest-400691057 tempest-VolumesNegativeTest-400691057-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:37:43.156913 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-59488225-aba6-45f2-a45e-d8083b372e7b tempest-VolumesNegativeTest-400691057 tempest-VolumesNegativeTest-400691057-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:37:43.157911 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-59488225-aba6-45f2-a45e-d8083b372e7b tempest-VolumesNegativeTest-400691057 tempest-VolumesNegativeTest-400691057-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:37:43.158376 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-59488225-aba6-45f2-a45e-d8083b372e7b tempest-VolumesNegativeTest-400691057 tempest-VolumesNegativeTest-400691057-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:37:43.241335 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-59488225-aba6-45f2-a45e-d8083b372e7b tempest-VolumesNegativeTest-400691057 tempest-VolumesNegativeTest-400691057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df6ee253918c48aea90c6aa3eb998cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b930725523554152a3cfe3be04ec1362', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:37:43.254957 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-59488225-aba6-45f2-a45e-d8083b372e7b tempest-VolumesNegativeTest-400691057 tempest-VolumesNegativeTest-400691057-project] 10.222.0.48 "GET /compute/v2.1/servers/c161499b-a50e-4237-9222-026b84cd22e2" status: 200 len: 1273 microversion: 2.1 time: 0.118189 Jun 17 13:37:43.257257 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1772/3496] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:37:43 2022] GET /compute/v2.1/servers/c161499b-a50e-4237-9222-026b84cd22e2 => generated 1273 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:37:44.275017 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-817af6c1-56bc-48c5-b8b5-80c302959437 tempest-VolumesNegativeTest-400691057 tempest-VolumesNegativeTest-400691057-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:37:44.276253 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-817af6c1-56bc-48c5-b8b5-80c302959437 tempest-VolumesNegativeTest-400691057 tempest-VolumesNegativeTest-400691057-project] [instance: c161499b-a50e-4237-9222-026b84cd22e2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:37:44.282838 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-817af6c1-56bc-48c5-b8b5-80c302959437 tempest-VolumesNegativeTest-400691057 tempest-VolumesNegativeTest-400691057-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:37:44.283614 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-817af6c1-56bc-48c5-b8b5-80c302959437 tempest-VolumesNegativeTest-400691057 tempest-VolumesNegativeTest-400691057-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:37:44.284653 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-817af6c1-56bc-48c5-b8b5-80c302959437 tempest-VolumesNegativeTest-400691057 tempest-VolumesNegativeTest-400691057-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:37:44.285367 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-817af6c1-56bc-48c5-b8b5-80c302959437 tempest-VolumesNegativeTest-400691057 tempest-VolumesNegativeTest-400691057-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:37:44.311578 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [req-f387f3c5-1fc1-4232-88b6-acc11ce3a0d6 req-bd671d36-1ac1-4fc8-9f08-ab8bffc8852e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c161499b-a50e-4237-9222-026b84cd22e2", "tag": "42fe8aae-da73-4965-810f-2c0e8ba5c39a"}]} {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:37:44.327189 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [req-f387f3c5-1fc1-4232-88b6-acc11ce3a0d6 req-bd671d36-1ac1-4fc8-9f08-ab8bffc8852e service nova] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:37:44.328406 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [req-f387f3c5-1fc1-4232-88b6-acc11ce3a0d6 req-bd671d36-1ac1-4fc8-9f08-ab8bffc8852e service nova] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:37:44.348791 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.compute.server_external_events [req-f387f3c5-1fc1-4232-88b6-acc11ce3a0d6 req-bd671d36-1ac1-4fc8-9f08-ab8bffc8852e service nova] Creating event network-changed:42fe8aae-da73-4965-810f-2c0e8ba5c39a for instance c161499b-a50e-4237-9222-026b84cd22e2 on hv-cinder-83754 Jun 17 13:37:44.361999 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [req-f387f3c5-1fc1-4232-88b6-acc11ce3a0d6 req-bd671d36-1ac1-4fc8-9f08-ab8bffc8852e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054273 Jun 17 13:37:44.366434 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1773/3497] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 13:37:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 13:37:44.525601 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-817af6c1-56bc-48c5-b8b5-80c302959437 tempest-VolumesNegativeTest-400691057 tempest-VolumesNegativeTest-400691057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df6ee253918c48aea90c6aa3eb998cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b930725523554152a3cfe3be04ec1362', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:37:44.533749 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-817af6c1-56bc-48c5-b8b5-80c302959437 tempest-VolumesNegativeTest-400691057 tempest-VolumesNegativeTest-400691057-project] 10.222.0.48 "GET /compute/v2.1/servers/c161499b-a50e-4237-9222-026b84cd22e2" status: 200 len: 1315 microversion: 2.1 time: 0.262630 Jun 17 13:37:44.534370 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1725/3498] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:37:44 2022] GET /compute/v2.1/servers/c161499b-a50e-4237-9222-026b84cd22e2 => generated 1315 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 13:37:45.551731 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-79f5b9c1-cf50-49f8-83d5-335e2bcefc0d tempest-VolumesNegativeTest-400691057 tempest-VolumesNegativeTest-400691057-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:37:45.553523 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-79f5b9c1-cf50-49f8-83d5-335e2bcefc0d tempest-VolumesNegativeTest-400691057 tempest-VolumesNegativeTest-400691057-project] [instance: c161499b-a50e-4237-9222-026b84cd22e2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:37:45.560376 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-79f5b9c1-cf50-49f8-83d5-335e2bcefc0d tempest-VolumesNegativeTest-400691057 tempest-VolumesNegativeTest-400691057-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:37:45.561104 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-79f5b9c1-cf50-49f8-83d5-335e2bcefc0d tempest-VolumesNegativeTest-400691057 tempest-VolumesNegativeTest-400691057-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:37:45.562063 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-79f5b9c1-cf50-49f8-83d5-335e2bcefc0d tempest-VolumesNegativeTest-400691057 tempest-VolumesNegativeTest-400691057-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:37:45.562586 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-79f5b9c1-cf50-49f8-83d5-335e2bcefc0d tempest-VolumesNegativeTest-400691057 tempest-VolumesNegativeTest-400691057-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:37:45.713224 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-79f5b9c1-cf50-49f8-83d5-335e2bcefc0d tempest-VolumesNegativeTest-400691057 tempest-VolumesNegativeTest-400691057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df6ee253918c48aea90c6aa3eb998cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b930725523554152a3cfe3be04ec1362', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:37:45.722117 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-79f5b9c1-cf50-49f8-83d5-335e2bcefc0d tempest-VolumesNegativeTest-400691057 tempest-VolumesNegativeTest-400691057-project] 10.222.0.48 "GET /compute/v2.1/servers/c161499b-a50e-4237-9222-026b84cd22e2" status: 200 len: 1315 microversion: 2.1 time: 0.175232 Jun 17 13:37:45.722932 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1774/3499] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:37:45 2022] GET /compute/v2.1/servers/c161499b-a50e-4237-9222-026b84cd22e2 => generated 1315 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:37:46.740502 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-b2d36d3e-bfba-410a-a6da-728d0eb64ade tempest-VolumesNegativeTest-400691057 tempest-VolumesNegativeTest-400691057-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:37:46.741971 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-b2d36d3e-bfba-410a-a6da-728d0eb64ade tempest-VolumesNegativeTest-400691057 tempest-VolumesNegativeTest-400691057-project] [instance: c161499b-a50e-4237-9222-026b84cd22e2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:37:46.749384 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b2d36d3e-bfba-410a-a6da-728d0eb64ade tempest-VolumesNegativeTest-400691057 tempest-VolumesNegativeTest-400691057-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:37:46.749819 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b2d36d3e-bfba-410a-a6da-728d0eb64ade tempest-VolumesNegativeTest-400691057 tempest-VolumesNegativeTest-400691057-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:37:46.750769 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b2d36d3e-bfba-410a-a6da-728d0eb64ade tempest-VolumesNegativeTest-400691057 tempest-VolumesNegativeTest-400691057-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:37:46.751188 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b2d36d3e-bfba-410a-a6da-728d0eb64ade tempest-VolumesNegativeTest-400691057 tempest-VolumesNegativeTest-400691057-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:37:46.900061 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-b2d36d3e-bfba-410a-a6da-728d0eb64ade tempest-VolumesNegativeTest-400691057 tempest-VolumesNegativeTest-400691057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df6ee253918c48aea90c6aa3eb998cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b930725523554152a3cfe3be04ec1362', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:37:46.908067 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-b2d36d3e-bfba-410a-a6da-728d0eb64ade tempest-VolumesNegativeTest-400691057 tempest-VolumesNegativeTest-400691057-project] 10.222.0.48 "GET /compute/v2.1/servers/c161499b-a50e-4237-9222-026b84cd22e2" status: 200 len: 1315 microversion: 2.1 time: 0.172072 Jun 17 13:37:46.908762 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1726/3500] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:37:46 2022] GET /compute/v2.1/servers/c161499b-a50e-4237-9222-026b84cd22e2 => generated 1315 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:37:47.925235 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-6597c899-0c32-4988-96bf-1e3085fd652d tempest-VolumesNegativeTest-400691057 tempest-VolumesNegativeTest-400691057-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:37:47.926259 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-6597c899-0c32-4988-96bf-1e3085fd652d tempest-VolumesNegativeTest-400691057 tempest-VolumesNegativeTest-400691057-project] [instance: c161499b-a50e-4237-9222-026b84cd22e2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:37:47.933672 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6597c899-0c32-4988-96bf-1e3085fd652d tempest-VolumesNegativeTest-400691057 tempest-VolumesNegativeTest-400691057-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:37:47.934157 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6597c899-0c32-4988-96bf-1e3085fd652d tempest-VolumesNegativeTest-400691057 tempest-VolumesNegativeTest-400691057-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:37:47.935094 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6597c899-0c32-4988-96bf-1e3085fd652d tempest-VolumesNegativeTest-400691057 tempest-VolumesNegativeTest-400691057-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:37:47.935678 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-6597c899-0c32-4988-96bf-1e3085fd652d tempest-VolumesNegativeTest-400691057 tempest-VolumesNegativeTest-400691057-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:37:48.084295 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-6597c899-0c32-4988-96bf-1e3085fd652d tempest-VolumesNegativeTest-400691057 tempest-VolumesNegativeTest-400691057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df6ee253918c48aea90c6aa3eb998cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b930725523554152a3cfe3be04ec1362', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:37:48.093174 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-6597c899-0c32-4988-96bf-1e3085fd652d tempest-VolumesNegativeTest-400691057 tempest-VolumesNegativeTest-400691057-project] 10.222.0.48 "GET /compute/v2.1/servers/c161499b-a50e-4237-9222-026b84cd22e2" status: 200 len: 1315 microversion: 2.1 time: 0.171993 Jun 17 13:37:48.104409 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1775/3501] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:37:47 2022] GET /compute/v2.1/servers/c161499b-a50e-4237-9222-026b84cd22e2 => generated 1315 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:37:49.112414 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-a8e7e770-1221-455a-b4f2-de84e622ddeb tempest-VolumesNegativeTest-400691057 tempest-VolumesNegativeTest-400691057-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:37:49.113209 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-a8e7e770-1221-455a-b4f2-de84e622ddeb tempest-VolumesNegativeTest-400691057 tempest-VolumesNegativeTest-400691057-project] [instance: c161499b-a50e-4237-9222-026b84cd22e2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:37:49.121522 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a8e7e770-1221-455a-b4f2-de84e622ddeb tempest-VolumesNegativeTest-400691057 tempest-VolumesNegativeTest-400691057-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:37:49.121971 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a8e7e770-1221-455a-b4f2-de84e622ddeb tempest-VolumesNegativeTest-400691057 tempest-VolumesNegativeTest-400691057-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:37:49.122773 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a8e7e770-1221-455a-b4f2-de84e622ddeb tempest-VolumesNegativeTest-400691057 tempest-VolumesNegativeTest-400691057-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:37:49.123198 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a8e7e770-1221-455a-b4f2-de84e622ddeb tempest-VolumesNegativeTest-400691057 tempest-VolumesNegativeTest-400691057-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:37:49.267021 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-a8e7e770-1221-455a-b4f2-de84e622ddeb tempest-VolumesNegativeTest-400691057 tempest-VolumesNegativeTest-400691057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df6ee253918c48aea90c6aa3eb998cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b930725523554152a3cfe3be04ec1362', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:37:49.275563 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-a8e7e770-1221-455a-b4f2-de84e622ddeb tempest-VolumesNegativeTest-400691057 tempest-VolumesNegativeTest-400691057-project] 10.222.0.48 "GET /compute/v2.1/servers/c161499b-a50e-4237-9222-026b84cd22e2" status: 200 len: 1315 microversion: 2.1 time: 0.167440 Jun 17 13:37:49.276105 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1727/3502] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:37:49 2022] GET /compute/v2.1/servers/c161499b-a50e-4237-9222-026b84cd22e2 => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:37:50.295328 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-7c3eff0a-8bba-4c84-9129-b524a01147bb tempest-VolumesNegativeTest-400691057 tempest-VolumesNegativeTest-400691057-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:37:50.296257 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-7c3eff0a-8bba-4c84-9129-b524a01147bb tempest-VolumesNegativeTest-400691057 tempest-VolumesNegativeTest-400691057-project] [instance: c161499b-a50e-4237-9222-026b84cd22e2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:37:50.305229 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7c3eff0a-8bba-4c84-9129-b524a01147bb tempest-VolumesNegativeTest-400691057 tempest-VolumesNegativeTest-400691057-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:37:50.305833 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7c3eff0a-8bba-4c84-9129-b524a01147bb tempest-VolumesNegativeTest-400691057 tempest-VolumesNegativeTest-400691057-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:37:50.306635 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7c3eff0a-8bba-4c84-9129-b524a01147bb tempest-VolumesNegativeTest-400691057 tempest-VolumesNegativeTest-400691057-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:37:50.307066 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7c3eff0a-8bba-4c84-9129-b524a01147bb tempest-VolumesNegativeTest-400691057 tempest-VolumesNegativeTest-400691057-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:37:50.444607 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-7c3eff0a-8bba-4c84-9129-b524a01147bb tempest-VolumesNegativeTest-400691057 tempest-VolumesNegativeTest-400691057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df6ee253918c48aea90c6aa3eb998cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b930725523554152a3cfe3be04ec1362', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:37:50.452638 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-7c3eff0a-8bba-4c84-9129-b524a01147bb tempest-VolumesNegativeTest-400691057 tempest-VolumesNegativeTest-400691057-project] 10.222.0.48 "GET /compute/v2.1/servers/c161499b-a50e-4237-9222-026b84cd22e2" status: 200 len: 1315 microversion: 2.1 time: 0.162617 Jun 17 13:37:50.453202 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1776/3503] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:37:50 2022] GET /compute/v2.1/servers/c161499b-a50e-4237-9222-026b84cd22e2 => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:37:51.053035 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [req-122747e1-54e0-43ed-98f1-0754a983f639 req-d16d6de0-6958-4821-a463-1d936cd1e09b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c161499b-a50e-4237-9222-026b84cd22e2", "name": "network-vif-plugged", "status": "completed", "tag": "42fe8aae-da73-4965-810f-2c0e8ba5c39a"}]} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:37:51.057892 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell0:SELECT=2 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:37:51.058731 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell0:SELECT=6 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:37:51.064998 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-122747e1-54e0-43ed-98f1-0754a983f639 req-d16d6de0-6958-4821-a463-1d936cd1e09b service nova] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:37:51.065551 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-122747e1-54e0-43ed-98f1-0754a983f639 req-d16d6de0-6958-4821-a463-1d936cd1e09b service nova] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:37:51.078630 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.compute.server_external_events [req-122747e1-54e0-43ed-98f1-0754a983f639 req-d16d6de0-6958-4821-a463-1d936cd1e09b service nova] Creating event network-vif-plugged:42fe8aae-da73-4965-810f-2c0e8ba5c39a for instance c161499b-a50e-4237-9222-026b84cd22e2 on hv-cinder-83754 Jun 17 13:37:51.085178 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [req-122747e1-54e0-43ed-98f1-0754a983f639 req-d16d6de0-6958-4821-a463-1d936cd1e09b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036309 Jun 17 13:37:51.085941 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1728/3504] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 13:37:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:37:51.473422 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-2d49303e-1402-41b6-bcd8-3b8a93f10c92 tempest-VolumesNegativeTest-400691057 tempest-VolumesNegativeTest-400691057-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:37:51.474162 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-2d49303e-1402-41b6-bcd8-3b8a93f10c92 tempest-VolumesNegativeTest-400691057 tempest-VolumesNegativeTest-400691057-project] [instance: c161499b-a50e-4237-9222-026b84cd22e2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:37:51.476252 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_cell0:SELECT=2 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:37:51.482343 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2d49303e-1402-41b6-bcd8-3b8a93f10c92 tempest-VolumesNegativeTest-400691057 tempest-VolumesNegativeTest-400691057-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:37:51.482992 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2d49303e-1402-41b6-bcd8-3b8a93f10c92 tempest-VolumesNegativeTest-400691057 tempest-VolumesNegativeTest-400691057-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:37:51.483763 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2d49303e-1402-41b6-bcd8-3b8a93f10c92 tempest-VolumesNegativeTest-400691057 tempest-VolumesNegativeTest-400691057-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:37:51.484198 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2d49303e-1402-41b6-bcd8-3b8a93f10c92 tempest-VolumesNegativeTest-400691057 tempest-VolumesNegativeTest-400691057-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:37:51.627821 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-2d49303e-1402-41b6-bcd8-3b8a93f10c92 tempest-VolumesNegativeTest-400691057 tempest-VolumesNegativeTest-400691057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df6ee253918c48aea90c6aa3eb998cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b930725523554152a3cfe3be04ec1362', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:37:51.635558 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-2d49303e-1402-41b6-bcd8-3b8a93f10c92 tempest-VolumesNegativeTest-400691057 tempest-VolumesNegativeTest-400691057-project] 10.222.0.48 "GET /compute/v2.1/servers/c161499b-a50e-4237-9222-026b84cd22e2" status: 200 len: 1315 microversion: 2.1 time: 0.166277 Jun 17 13:37:51.636326 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1777/3505] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:37:51 2022] GET /compute/v2.1/servers/c161499b-a50e-4237-9222-026b84cd22e2 => generated 1315 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:37:52.657887 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-697d4ef0-a641-44dd-b376-c8901c185967 tempest-VolumesNegativeTest-400691057 tempest-VolumesNegativeTest-400691057-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:37:52.659380 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-697d4ef0-a641-44dd-b376-c8901c185967 tempest-VolumesNegativeTest-400691057 tempest-VolumesNegativeTest-400691057-project] [instance: c161499b-a50e-4237-9222-026b84cd22e2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:37:52.667706 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-697d4ef0-a641-44dd-b376-c8901c185967 tempest-VolumesNegativeTest-400691057 tempest-VolumesNegativeTest-400691057-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:37:52.668171 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-697d4ef0-a641-44dd-b376-c8901c185967 tempest-VolumesNegativeTest-400691057 tempest-VolumesNegativeTest-400691057-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:37:52.668922 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-697d4ef0-a641-44dd-b376-c8901c185967 tempest-VolumesNegativeTest-400691057 tempest-VolumesNegativeTest-400691057-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:37:52.669343 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-697d4ef0-a641-44dd-b376-c8901c185967 tempest-VolumesNegativeTest-400691057 tempest-VolumesNegativeTest-400691057-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:37:52.804281 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-697d4ef0-a641-44dd-b376-c8901c185967 tempest-VolumesNegativeTest-400691057 tempest-VolumesNegativeTest-400691057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df6ee253918c48aea90c6aa3eb998cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b930725523554152a3cfe3be04ec1362', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:37:52.812123 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-697d4ef0-a641-44dd-b376-c8901c185967 tempest-VolumesNegativeTest-400691057 tempest-VolumesNegativeTest-400691057-project] 10.222.0.48 "GET /compute/v2.1/servers/c161499b-a50e-4237-9222-026b84cd22e2" status: 200 len: 1315 microversion: 2.1 time: 0.162037 Jun 17 13:37:52.812686 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1729/3506] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:37:52 2022] GET /compute/v2.1/servers/c161499b-a50e-4237-9222-026b84cd22e2 => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:37:53.833532 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-2d20e580-5ca0-4c60-8faf-af508997e75e tempest-VolumesNegativeTest-400691057 tempest-VolumesNegativeTest-400691057-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:37:53.834231 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-2d20e580-5ca0-4c60-8faf-af508997e75e tempest-VolumesNegativeTest-400691057 tempest-VolumesNegativeTest-400691057-project] [instance: c161499b-a50e-4237-9222-026b84cd22e2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:37:53.841338 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2d20e580-5ca0-4c60-8faf-af508997e75e tempest-VolumesNegativeTest-400691057 tempest-VolumesNegativeTest-400691057-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:37:53.841792 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2d20e580-5ca0-4c60-8faf-af508997e75e tempest-VolumesNegativeTest-400691057 tempest-VolumesNegativeTest-400691057-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:37:53.842587 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2d20e580-5ca0-4c60-8faf-af508997e75e tempest-VolumesNegativeTest-400691057 tempest-VolumesNegativeTest-400691057-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:37:53.843031 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2d20e580-5ca0-4c60-8faf-af508997e75e tempest-VolumesNegativeTest-400691057 tempest-VolumesNegativeTest-400691057-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:37:53.987763 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-2d20e580-5ca0-4c60-8faf-af508997e75e tempest-VolumesNegativeTest-400691057 tempest-VolumesNegativeTest-400691057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df6ee253918c48aea90c6aa3eb998cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b930725523554152a3cfe3be04ec1362', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:37:53.996338 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-2d20e580-5ca0-4c60-8faf-af508997e75e tempest-VolumesNegativeTest-400691057 tempest-VolumesNegativeTest-400691057-project] 10.222.0.48 "GET /compute/v2.1/servers/c161499b-a50e-4237-9222-026b84cd22e2" status: 200 len: 1465 microversion: 2.1 time: 0.169309 Jun 17 13:37:53.996876 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1778/3507] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:37:53 2022] GET /compute/v2.1/servers/c161499b-a50e-4237-9222-026b84cd22e2 => generated 1465 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:37:54.036489 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-20fed612-8a23-481d-af39-71c510f51fcd tempest-VolumesNegativeTest-400691057 tempest-VolumesNegativeTest-400691057-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:37:54.036998 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-20fed612-8a23-481d-af39-71c510f51fcd tempest-VolumesNegativeTest-400691057 tempest-VolumesNegativeTest-400691057-project] [instance: c161499b-a50e-4237-9222-026b84cd22e2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:37:54.044286 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-20fed612-8a23-481d-af39-71c510f51fcd tempest-VolumesNegativeTest-400691057 tempest-VolumesNegativeTest-400691057-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:37:54.044730 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-20fed612-8a23-481d-af39-71c510f51fcd tempest-VolumesNegativeTest-400691057 tempest-VolumesNegativeTest-400691057-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:37:54.045497 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-20fed612-8a23-481d-af39-71c510f51fcd tempest-VolumesNegativeTest-400691057 tempest-VolumesNegativeTest-400691057-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:37:54.045932 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-20fed612-8a23-481d-af39-71c510f51fcd tempest-VolumesNegativeTest-400691057 tempest-VolumesNegativeTest-400691057-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:37:54.071080 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-20fed612-8a23-481d-af39-71c510f51fcd tempest-VolumesNegativeTest-400691057 tempest-VolumesNegativeTest-400691057-project] [instance: c161499b-a50e-4237-9222-026b84cd22e2] Going to try to terminate instance {{(pid=117660) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 17 13:37:54.152228 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-20fed612-8a23-481d-af39-71c510f51fcd tempest-VolumesNegativeTest-400691057 tempest-VolumesNegativeTest-400691057-project] 10.222.0.48 "DELETE /compute/v2.1/servers/c161499b-a50e-4237-9222-026b84cd22e2" status: 204 len: 0 microversion: 2.1 time: 0.119385 Jun 17 13:37:54.153412 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1730/3508] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Jun 17 13:37:54 2022] DELETE /compute/v2.1/servers/c161499b-a50e-4237-9222-026b84cd22e2 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 17 13:37:54.162640 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-a79ec2b9-11a6-4602-96c6-ce73c5f2a0e8 tempest-VolumesNegativeTest-400691057 tempest-VolumesNegativeTest-400691057-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:37:54.164123 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-a79ec2b9-11a6-4602-96c6-ce73c5f2a0e8 tempest-VolumesNegativeTest-400691057 tempest-VolumesNegativeTest-400691057-project] [instance: c161499b-a50e-4237-9222-026b84cd22e2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:37:54.171192 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a79ec2b9-11a6-4602-96c6-ce73c5f2a0e8 tempest-VolumesNegativeTest-400691057 tempest-VolumesNegativeTest-400691057-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:37:54.171681 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a79ec2b9-11a6-4602-96c6-ce73c5f2a0e8 tempest-VolumesNegativeTest-400691057 tempest-VolumesNegativeTest-400691057-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:37:54.172442 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a79ec2b9-11a6-4602-96c6-ce73c5f2a0e8 tempest-VolumesNegativeTest-400691057 tempest-VolumesNegativeTest-400691057-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:37:54.172874 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a79ec2b9-11a6-4602-96c6-ce73c5f2a0e8 tempest-VolumesNegativeTest-400691057 tempest-VolumesNegativeTest-400691057-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:37:54.317166 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-a79ec2b9-11a6-4602-96c6-ce73c5f2a0e8 tempest-VolumesNegativeTest-400691057 tempest-VolumesNegativeTest-400691057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df6ee253918c48aea90c6aa3eb998cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b930725523554152a3cfe3be04ec1362', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:37:54.325123 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-a79ec2b9-11a6-4602-96c6-ce73c5f2a0e8 tempest-VolumesNegativeTest-400691057 tempest-VolumesNegativeTest-400691057-project] 10.222.0.48 "GET /compute/v2.1/servers/c161499b-a50e-4237-9222-026b84cd22e2" status: 200 len: 1471 microversion: 2.1 time: 0.167819 Jun 17 13:37:54.325695 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1779/3509] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:37:54 2022] GET /compute/v2.1/servers/c161499b-a50e-4237-9222-026b84cd22e2 => generated 1471 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:37:55.347054 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-99768533-e1bc-483c-828b-2bde02f0d55d tempest-VolumesNegativeTest-400691057 tempest-VolumesNegativeTest-400691057-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:37:55.347830 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-99768533-e1bc-483c-828b-2bde02f0d55d tempest-VolumesNegativeTest-400691057 tempest-VolumesNegativeTest-400691057-project] [instance: c161499b-a50e-4237-9222-026b84cd22e2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:37:55.358035 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-99768533-e1bc-483c-828b-2bde02f0d55d tempest-VolumesNegativeTest-400691057 tempest-VolumesNegativeTest-400691057-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:37:55.358557 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-99768533-e1bc-483c-828b-2bde02f0d55d tempest-VolumesNegativeTest-400691057 tempest-VolumesNegativeTest-400691057-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:37:55.359648 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-99768533-e1bc-483c-828b-2bde02f0d55d tempest-VolumesNegativeTest-400691057 tempest-VolumesNegativeTest-400691057-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:37:55.360178 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-99768533-e1bc-483c-828b-2bde02f0d55d tempest-VolumesNegativeTest-400691057 tempest-VolumesNegativeTest-400691057-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:37:55.508320 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-99768533-e1bc-483c-828b-2bde02f0d55d tempest-VolumesNegativeTest-400691057 tempest-VolumesNegativeTest-400691057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df6ee253918c48aea90c6aa3eb998cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b930725523554152a3cfe3be04ec1362', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:37:55.516403 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-99768533-e1bc-483c-828b-2bde02f0d55d tempest-VolumesNegativeTest-400691057 tempest-VolumesNegativeTest-400691057-project] 10.222.0.48 "GET /compute/v2.1/servers/c161499b-a50e-4237-9222-026b84cd22e2" status: 200 len: 1471 microversion: 2.1 time: 0.176515 Jun 17 13:37:55.516967 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1731/3510] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:37:55 2022] GET /compute/v2.1/servers/c161499b-a50e-4237-9222-026b84cd22e2 => generated 1471 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:37:56.331107 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [req-36554fc5-7954-4a20-baa5-8a6b40b4cbdf req-0aea9eeb-6c36-4c15-9928-8a7d1ba9fac7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c161499b-a50e-4237-9222-026b84cd22e2", "name": "network-vif-deleted", "tag": "42fe8aae-da73-4965-810f-2c0e8ba5c39a"}]} {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:37:56.341557 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [req-36554fc5-7954-4a20-baa5-8a6b40b4cbdf req-0aea9eeb-6c36-4c15-9928-8a7d1ba9fac7 service nova] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:37:56.342006 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [req-36554fc5-7954-4a20-baa5-8a6b40b4cbdf req-0aea9eeb-6c36-4c15-9928-8a7d1ba9fac7 service nova] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:37:56.354444 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.compute.server_external_events [req-36554fc5-7954-4a20-baa5-8a6b40b4cbdf req-0aea9eeb-6c36-4c15-9928-8a7d1ba9fac7 service nova] Creating event network-vif-deleted:42fe8aae-da73-4965-810f-2c0e8ba5c39a for instance c161499b-a50e-4237-9222-026b84cd22e2 on hv-cinder-83754 Jun 17 13:37:56.360282 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [req-36554fc5-7954-4a20-baa5-8a6b40b4cbdf req-0aea9eeb-6c36-4c15-9928-8a7d1ba9fac7 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036749 Jun 17 13:37:56.361150 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1780/3511] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 13:37:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:37:56.535648 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-855a1a76-d9ba-4a96-92d8-c109fad5408b tempest-VolumesNegativeTest-400691057 tempest-VolumesNegativeTest-400691057-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:37:56.536223 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-855a1a76-d9ba-4a96-92d8-c109fad5408b tempest-VolumesNegativeTest-400691057 tempest-VolumesNegativeTest-400691057-project] [instance: c161499b-a50e-4237-9222-026b84cd22e2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:37:56.543166 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-855a1a76-d9ba-4a96-92d8-c109fad5408b tempest-VolumesNegativeTest-400691057 tempest-VolumesNegativeTest-400691057-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:37:56.543607 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-855a1a76-d9ba-4a96-92d8-c109fad5408b tempest-VolumesNegativeTest-400691057 tempest-VolumesNegativeTest-400691057-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:37:56.544358 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-855a1a76-d9ba-4a96-92d8-c109fad5408b tempest-VolumesNegativeTest-400691057 tempest-VolumesNegativeTest-400691057-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:37:56.544825 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-855a1a76-d9ba-4a96-92d8-c109fad5408b tempest-VolumesNegativeTest-400691057 tempest-VolumesNegativeTest-400691057-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:37:56.576580 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-855a1a76-d9ba-4a96-92d8-c109fad5408b tempest-VolumesNegativeTest-400691057 tempest-VolumesNegativeTest-400691057-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:37:56.576999 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-855a1a76-d9ba-4a96-92d8-c109fad5408b tempest-VolumesNegativeTest-400691057 tempest-VolumesNegativeTest-400691057-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:37:56.577432 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.objects.instance [None req-855a1a76-d9ba-4a96-92d8-c109fad5408b tempest-VolumesNegativeTest-400691057 tempest-VolumesNegativeTest-400691057-project] Lazy-loading 'fault' on Instance uuid c161499b-a50e-4237-9222-026b84cd22e2 {{(pid=117660) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 13:37:56.621444 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-855a1a76-d9ba-4a96-92d8-c109fad5408b tempest-VolumesNegativeTest-400691057 tempest-VolumesNegativeTest-400691057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df6ee253918c48aea90c6aa3eb998cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b930725523554152a3cfe3be04ec1362', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:37:56.629044 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-855a1a76-d9ba-4a96-92d8-c109fad5408b tempest-VolumesNegativeTest-400691057 tempest-VolumesNegativeTest-400691057-project] 10.222.0.48 "GET /compute/v2.1/servers/c161499b-a50e-4237-9222-026b84cd22e2" status: 200 len: 1305 microversion: 2.1 time: 0.097413 Jun 17 13:37:56.629605 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1732/3512] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:37:56 2022] GET /compute/v2.1/servers/c161499b-a50e-4237-9222-026b84cd22e2 => generated 1305 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:37:57.651830 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-3b32d4e7-3b93-4e85-bd80-e69597b08121 tempest-VolumesNegativeTest-400691057 tempest-VolumesNegativeTest-400691057-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:37:57.652974 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-3b32d4e7-3b93-4e85-bd80-e69597b08121 tempest-VolumesNegativeTest-400691057 tempest-VolumesNegativeTest-400691057-project] [instance: c161499b-a50e-4237-9222-026b84cd22e2] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:37:57.662873 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-3b32d4e7-3b93-4e85-bd80-e69597b08121 tempest-VolumesNegativeTest-400691057 tempest-VolumesNegativeTest-400691057-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:37:57.663322 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-3b32d4e7-3b93-4e85-bd80-e69597b08121 tempest-VolumesNegativeTest-400691057 tempest-VolumesNegativeTest-400691057-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:37:57.664073 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-3b32d4e7-3b93-4e85-bd80-e69597b08121 tempest-VolumesNegativeTest-400691057 tempest-VolumesNegativeTest-400691057-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:37:57.664510 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-3b32d4e7-3b93-4e85-bd80-e69597b08121 tempest-VolumesNegativeTest-400691057 tempest-VolumesNegativeTest-400691057-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:37:57.678588 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.wsgi [None req-3b32d4e7-3b93-4e85-bd80-e69597b08121 tempest-VolumesNegativeTest-400691057 tempest-VolumesNegativeTest-400691057-project] HTTP exception thrown: Instance c161499b-a50e-4237-9222-026b84cd22e2 could not be found. Jun 17 13:37:57.680220 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-3b32d4e7-3b93-4e85-bd80-e69597b08121 tempest-VolumesNegativeTest-400691057 tempest-VolumesNegativeTest-400691057-project] Request method failure captured: Jun 17 13:37:57.680220 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: request: GET /compute/v2.1/servers/c161499b-a50e-4237-9222-026b84cd22e2 HTTP/1.1 Jun 17 13:37:57.680220 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Accept: application/json Jun 17 13:37:57.680220 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Accept-Encoding: identity Jun 17 13:37:57.680220 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Connection: close Jun 17 13:37:57.680220 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Content-Length: 0 Jun 17 13:37:57.680220 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Content-Type: application/json Jun 17 13:37:57.680220 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Host: 10.222.0.48 Jun 17 13:37:57.680220 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Openstack-System-Scope: None Jun 17 13:37:57.680220 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: User-Agent: python-urllib3/1.26.9 Jun 17 13:37:57.680220 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Auth-Token: gAAAAABirIOizh82oCSKPPwRfvnv8ICgMQ9mkT0EadDoapwr-ivxI6DXeudCY0GcUZiEfQoxE1OpEaYaNtSFM7SxJUkMSKzuqbvmj6uGq99CwlpAhImcCOWMGiFFYtcK6rIolDp026Iidm4QpZKtt-15tD2vLeNv6BKy9TbVzJLRkZUTkRqij9U Jun 17 13:37:57.680220 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Domain-Id: None Jun 17 13:37:57.680220 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Domain-Name: None Jun 17 13:37:57.680220 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Identity-Status: Confirmed Jun 17 13:37:57.680220 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Is-Admin-Project: True Jun 17 13:37:57.680220 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Project-Domain-Id: default Jun 17 13:37:57.680220 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Project-Domain-Name: Default Jun 17 13:37:57.680220 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Project-Id: b930725523554152a3cfe3be04ec1362 Jun 17 13:37:57.680220 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Project-Name: tempest-VolumesNegativeTest-400691057 Jun 17 13:37:57.680220 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Role: member,reader Jun 17 13:37:57.680220 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Roles: member,reader Jun 17 13:37:57.681607 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_b930725523554152a3cfe3be04ec1362", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b930725523554152a3cfe3be04ec1362"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b930725523554152a3cfe3be04ec1362"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/b930725523554152a3cfe3be04ec1362"}]}] Jun 17 13:37:57.681607 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Tenant: tempest-VolumesNegativeTest-400691057 Jun 17 13:37:57.681607 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Tenant-Id: b930725523554152a3cfe3be04ec1362 Jun 17 13:37:57.681607 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Tenant-Name: tempest-VolumesNegativeTest-400691057 Jun 17 13:37:57.681607 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User: tempest-VolumesNegativeTest-400691057-project Jun 17 13:37:57.681607 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User-Domain-Id: default Jun 17 13:37:57.681607 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User-Domain-Name: Default Jun 17 13:37:57.681607 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User-Id: df6ee253918c48aea90c6aa3eb998cc5 Jun 17 13:37:57.681607 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User-Name: tempest-VolumesNegativeTest-400691057-project Jun 17 13:37:57.681607 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: method: > Jun 17 13:37:57.681607 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: exception: Instance c161499b-a50e-4237-9222-026b84cd22e2 could not be found. Jun 17 13:37:57.681607 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: action_args: {'id': 'c161499b-a50e-4237-9222-026b84cd22e2'} Jun 17 13:37:57.682449 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 13:37:57.682449 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:37:57.682449 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 13:37:57.682449 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 13:37:57.682449 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 13:37:57.682449 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 13:37:57.682449 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 13:37:57.682449 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 13:37:57.682449 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 13:37:57.682449 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 13:37:57.682449 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c161499b-a50e-4237-9222-026b84cd22e2 could not be found. Jun 17 13:37:57.682449 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:37:57.682449 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:37:57.682449 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:37:57.682449 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:37:57.682449 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:37:57.682449 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:37:57.682449 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 13:37:57.682449 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 13:37:57.682449 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 13:37:57.683640 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 13:37:57.683640 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 13:37:57.683640 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 13:37:57.683640 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 13:37:57.683640 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 13:37:57.683640 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 13:37:57.683640 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 13:37:57.683640 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c161499b-a50e-4237-9222-026b84cd22e2 could not be found. Jun 17 13:37:57.683640 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:37:57.683640 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:37:57.683640 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:37:57.683640 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:37:57.683640 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:37:57.683640 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:37:57.683640 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 13:37:57.683640 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 13:37:57.683640 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c161499b-a50e-4237-9222-026b84cd22e2 could not be found. Jun 17 13:37:57.683640 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:37:57.684600 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-3b32d4e7-3b93-4e85-bd80-e69597b08121 tempest-VolumesNegativeTest-400691057 tempest-VolumesNegativeTest-400691057-project] Returning 404 to user: Instance c161499b-a50e-4237-9222-026b84cd22e2 could not be found. {{(pid=117659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 13:37:57.684600 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-3b32d4e7-3b93-4e85-bd80-e69597b08121 tempest-VolumesNegativeTest-400691057 tempest-VolumesNegativeTest-400691057-project] 10.222.0.48 "GET /compute/v2.1/servers/c161499b-a50e-4237-9222-026b84cd22e2" status: 404 len: 111 microversion: 2.1 time: 0.037991 Jun 17 13:37:57.684600 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1781/3513] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:37:57 2022] GET /compute/v2.1/servers/c161499b-a50e-4237-9222-026b84cd22e2 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 13:38:12.195610 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:38:12.196958 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:38:12.370268 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-0fdc1063-4827-43c2-a117-a4d08fb07791 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Action: 'create', calling method: .version_select at 0x7f0194865040>, body: {"keypair": {"name": "tempest-TestShelveInstance-930884631", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLvX/VnksPJiJL46e3ElP3kMPibvp6xj8LdwiLNuVcGJlKaXbesunO9LEQU/RqMoGtKVskMxLIiVWrJT2BADLZTSRj2G7XXL+b8UUbM65t0W571sFcJACPZ1HgXsBq6Erg=="}} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:38:12.384538 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.quota [None req-0fdc1063-4827-43c2-a117-a4d08fb07791 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Getting quotas for project 442ee828e66f48429daed7cd48385680. Resources: {'key_pairs'} {{(pid=117660) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 13:38:12.390646 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.quota [None req-0fdc1063-4827-43c2-a117-a4d08fb07791 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Getting quotas for user a846dc3c667140e99d476aa8722c9052 and project 442ee828e66f48429daed7cd48385680. Resources: {'key_pairs'} {{(pid=117660) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 13:38:12.415360 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-0fdc1063-4827-43c2-a117-a4d08fb07791 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.224939 Jun 17 13:38:12.416153 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1733/3514] 10.222.0.48 () {60 vars in 1158 bytes} [Fri Jun 17 13:38:12 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:38:43.571388 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-20c2cecb-5ec3-4897-9e22-dc640562e0a9 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1812422464", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-930884631", "security_groups": [{"name": "tempest-secgroup-smoke-1678347501"}], "networks": [{"uuid": "6e2d1b5f-d6d6-41ec-bee3-126cdb310d44"}], "block_device_mapping_v2": [{"uuid": "356e40b4-38bf-4a6b-81a3-7e02ba5b9442", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:38:43.579830 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_api:SELECT=24 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:38:43.580481 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_cell1:SELECT=48 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:38:43.699413 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.network.neutron [None req-20c2cecb-5ec3-4897-9e22-dc640562e0a9 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] validate_networks() for [('6e2d1b5f-d6d6-41ec-bee3-126cdb310d44', None, None, None, None, None)] {{(pid=117659) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 17 13:38:44.079759 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.virt.hardware [None req-20c2cecb-5ec3-4897-9e22-dc640562e0a9 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Flavor limits 0:0:0 {{(pid=117659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 17 13:38:44.080180 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.virt.hardware [None req-20c2cecb-5ec3-4897-9e22-dc640562e0a9 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Image limits 0:0:0 {{(pid=117659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 17 13:38:44.080649 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.virt.hardware [None req-20c2cecb-5ec3-4897-9e22-dc640562e0a9 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Flavor pref 0:0:0 {{(pid=117659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 17 13:38:44.081052 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.virt.hardware [None req-20c2cecb-5ec3-4897-9e22-dc640562e0a9 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Image pref 0:0:0 {{(pid=117659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 17 13:38:44.081460 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.virt.hardware [None req-20c2cecb-5ec3-4897-9e22-dc640562e0a9 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 17 13:38:44.091876 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-20c2cecb-5ec3-4897-9e22-dc640562e0a9 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:38:44.092318 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-20c2cecb-5ec3-4897-9e22-dc640562e0a9 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:38:44.093101 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-20c2cecb-5ec3-4897-9e22-dc640562e0a9 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:38:44.093536 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-20c2cecb-5ec3-4897-9e22-dc640562e0a9 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:38:44.111185 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.quota [None req-20c2cecb-5ec3-4897-9e22-dc640562e0a9 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Getting quotas for project 442ee828e66f48429daed7cd48385680. Resources: {'ram', 'cores', 'instances'} {{(pid=117659) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 13:38:44.115138 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.quota [None req-20c2cecb-5ec3-4897-9e22-dc640562e0a9 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Getting quotas for user a846dc3c667140e99d476aa8722c9052 and project 442ee828e66f48429daed7cd48385680. Resources: {'ram', 'cores', 'instances'} {{(pid=117659) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 13:38:44.175177 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-20c2cecb-5ec3-4897-9e22-dc640562e0a9 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Going to run 1 instances... {{(pid=117659) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 17 13:38:44.177307 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-20c2cecb-5ec3-4897-9e22-dc640562e0a9 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] [instance: 89e95d57-9d79-4632-b2fb-921e6bc80538] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='356e40b4-38bf-4a6b-81a3-7e02ba5b9442',volume_size=None,volume_type=None)] {{(pid=117659) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 17 13:38:44.309137 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-20c2cecb-5ec3-4897-9e22-dc640562e0a9 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.743749 Jun 17 13:38:44.310386 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1782/3515] 10.222.0.48 () {60 vars in 1146 bytes} [Fri Jun 17 13:38:43 2022] POST /compute/v2.1/servers => generated 406 bytes in 746 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 17 13:38:44.320530 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-d388c37e-1c1e-4576-917b-d982379f2086 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:38:44.321140 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-d388c37e-1c1e-4576-917b-d982379f2086 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] [instance: 89e95d57-9d79-4632-b2fb-921e6bc80538] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:38:44.323576 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell0:SELECT=4 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:38:44.325301 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:38:44.384142 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-d388c37e-1c1e-4576-917b-d982379f2086 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a846dc3c667140e99d476aa8722c9052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442ee828e66f48429daed7cd48385680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:38:44.394857 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-d388c37e-1c1e-4576-917b-d982379f2086 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] 10.222.0.48 "GET /compute/v2.1/servers/89e95d57-9d79-4632-b2fb-921e6bc80538" status: 200 len: 1088 microversion: 2.1 time: 0.078319 Jun 17 13:38:44.395792 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1734/3516] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:38:44 2022] GET /compute/v2.1/servers/89e95d57-9d79-4632-b2fb-921e6bc80538 => generated 1088 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:38:45.412539 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-cba0e986-55df-4266-a030-bc10ccd2076f tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:38:45.413208 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-cba0e986-55df-4266-a030-bc10ccd2076f tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] [instance: 89e95d57-9d79-4632-b2fb-921e6bc80538] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:38:45.420307 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-cba0e986-55df-4266-a030-bc10ccd2076f tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:38:45.420760 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-cba0e986-55df-4266-a030-bc10ccd2076f tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:38:45.421522 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-cba0e986-55df-4266-a030-bc10ccd2076f tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:38:45.422150 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-cba0e986-55df-4266-a030-bc10ccd2076f tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:38:45.497334 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-cba0e986-55df-4266-a030-bc10ccd2076f tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a846dc3c667140e99d476aa8722c9052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442ee828e66f48429daed7cd48385680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:38:45.505232 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-cba0e986-55df-4266-a030-bc10ccd2076f tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] 10.222.0.48 "GET /compute/v2.1/servers/89e95d57-9d79-4632-b2fb-921e6bc80538" status: 200 len: 1204 microversion: 2.1 time: 0.097571 Jun 17 13:38:45.505727 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1783/3517] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:38:45 2022] GET /compute/v2.1/servers/89e95d57-9d79-4632-b2fb-921e6bc80538 => generated 1204 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:38:46.522800 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-bceb9272-4686-4bce-a3ec-a52d452936e9 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:38:46.523447 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-bceb9272-4686-4bce-a3ec-a52d452936e9 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] [instance: 89e95d57-9d79-4632-b2fb-921e6bc80538] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:38:46.530433 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bceb9272-4686-4bce-a3ec-a52d452936e9 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:38:46.531285 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bceb9272-4686-4bce-a3ec-a52d452936e9 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:38:46.532069 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bceb9272-4686-4bce-a3ec-a52d452936e9 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:38:46.532505 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bceb9272-4686-4bce-a3ec-a52d452936e9 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:38:46.676318 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-bceb9272-4686-4bce-a3ec-a52d452936e9 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a846dc3c667140e99d476aa8722c9052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442ee828e66f48429daed7cd48385680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:38:46.687765 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-bceb9272-4686-4bce-a3ec-a52d452936e9 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] 10.222.0.48 "GET /compute/v2.1/servers/89e95d57-9d79-4632-b2fb-921e6bc80538" status: 200 len: 1260 microversion: 2.1 time: 0.169355 Jun 17 13:38:46.688751 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1735/3518] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:38:46 2022] GET /compute/v2.1/servers/89e95d57-9d79-4632-b2fb-921e6bc80538 => generated 1260 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:38:46.801809 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [req-25ec7499-2e48-4159-9b33-cd9a735af064 req-3b88e7ac-b5b8-419b-9972-c8541e362bd4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89e95d57-9d79-4632-b2fb-921e6bc80538", "tag": "5708d08c-7f64-44a5-8190-ffa61c858f93"}]} {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:38:46.820408 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [req-25ec7499-2e48-4159-9b33-cd9a735af064 req-3b88e7ac-b5b8-419b-9972-c8541e362bd4 service nova] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:38:46.820772 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [req-25ec7499-2e48-4159-9b33-cd9a735af064 req-3b88e7ac-b5b8-419b-9972-c8541e362bd4 service nova] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:38:46.841499 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.compute.server_external_events [req-25ec7499-2e48-4159-9b33-cd9a735af064 req-3b88e7ac-b5b8-419b-9972-c8541e362bd4 service nova] Creating event network-changed:5708d08c-7f64-44a5-8190-ffa61c858f93 for instance 89e95d57-9d79-4632-b2fb-921e6bc80538 on hv-cinder-83754 Jun 17 13:38:46.847041 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [req-25ec7499-2e48-4159-9b33-cd9a735af064 req-3b88e7ac-b5b8-419b-9972-c8541e362bd4 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050461 Jun 17 13:38:46.847647 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1784/3519] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 13:38:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:38:47.708722 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-2b58976a-82d8-4e04-8f02-2f6c04cc8f6f tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:38:47.710149 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-2b58976a-82d8-4e04-8f02-2f6c04cc8f6f tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] [instance: 89e95d57-9d79-4632-b2fb-921e6bc80538] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:38:47.716620 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2b58976a-82d8-4e04-8f02-2f6c04cc8f6f tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:38:47.717072 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2b58976a-82d8-4e04-8f02-2f6c04cc8f6f tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:38:47.717831 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2b58976a-82d8-4e04-8f02-2f6c04cc8f6f tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:38:47.718324 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2b58976a-82d8-4e04-8f02-2f6c04cc8f6f tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:38:47.849135 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-2b58976a-82d8-4e04-8f02-2f6c04cc8f6f tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a846dc3c667140e99d476aa8722c9052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442ee828e66f48429daed7cd48385680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:38:47.857510 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-2b58976a-82d8-4e04-8f02-2f6c04cc8f6f tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] 10.222.0.48 "GET /compute/v2.1/servers/89e95d57-9d79-4632-b2fb-921e6bc80538" status: 200 len: 1260 microversion: 2.1 time: 0.154873 Jun 17 13:38:47.858049 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1736/3520] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:38:47 2022] GET /compute/v2.1/servers/89e95d57-9d79-4632-b2fb-921e6bc80538 => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:38:48.879177 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-d9e666a6-e091-4a18-8c0f-fbad11c92a32 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:38:48.880368 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-d9e666a6-e091-4a18-8c0f-fbad11c92a32 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] [instance: 89e95d57-9d79-4632-b2fb-921e6bc80538] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:38:48.891840 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d9e666a6-e091-4a18-8c0f-fbad11c92a32 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:38:48.892586 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d9e666a6-e091-4a18-8c0f-fbad11c92a32 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:38:48.893819 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d9e666a6-e091-4a18-8c0f-fbad11c92a32 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:38:48.894579 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d9e666a6-e091-4a18-8c0f-fbad11c92a32 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:38:49.034399 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-d9e666a6-e091-4a18-8c0f-fbad11c92a32 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a846dc3c667140e99d476aa8722c9052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442ee828e66f48429daed7cd48385680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:38:49.042529 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-d9e666a6-e091-4a18-8c0f-fbad11c92a32 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] 10.222.0.48 "GET /compute/v2.1/servers/89e95d57-9d79-4632-b2fb-921e6bc80538" status: 200 len: 1260 microversion: 2.1 time: 0.170423 Jun 17 13:38:49.043088 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1785/3521] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:38:48 2022] GET /compute/v2.1/servers/89e95d57-9d79-4632-b2fb-921e6bc80538 => generated 1260 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:38:50.063948 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-71d97ebd-08ba-448d-95f6-c7721b9776c7 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:38:50.064794 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-71d97ebd-08ba-448d-95f6-c7721b9776c7 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] [instance: 89e95d57-9d79-4632-b2fb-921e6bc80538] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:38:50.073013 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-71d97ebd-08ba-448d-95f6-c7721b9776c7 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:38:50.073461 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-71d97ebd-08ba-448d-95f6-c7721b9776c7 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:38:50.074398 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-71d97ebd-08ba-448d-95f6-c7721b9776c7 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:38:50.074828 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-71d97ebd-08ba-448d-95f6-c7721b9776c7 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:38:50.206967 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-71d97ebd-08ba-448d-95f6-c7721b9776c7 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a846dc3c667140e99d476aa8722c9052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442ee828e66f48429daed7cd48385680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:38:50.214662 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-71d97ebd-08ba-448d-95f6-c7721b9776c7 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] 10.222.0.48 "GET /compute/v2.1/servers/89e95d57-9d79-4632-b2fb-921e6bc80538" status: 200 len: 1260 microversion: 2.1 time: 0.157299 Jun 17 13:38:50.215228 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1737/3522] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:38:50 2022] GET /compute/v2.1/servers/89e95d57-9d79-4632-b2fb-921e6bc80538 => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:38:51.234449 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-65701be1-94de-4feb-b822-d31d26fa49de tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:38:51.235129 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-65701be1-94de-4feb-b822-d31d26fa49de tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] [instance: 89e95d57-9d79-4632-b2fb-921e6bc80538] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:38:51.243949 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-65701be1-94de-4feb-b822-d31d26fa49de tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:38:51.244422 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-65701be1-94de-4feb-b822-d31d26fa49de tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:38:51.245178 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-65701be1-94de-4feb-b822-d31d26fa49de tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:38:51.245619 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-65701be1-94de-4feb-b822-d31d26fa49de tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:38:51.381861 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-65701be1-94de-4feb-b822-d31d26fa49de tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a846dc3c667140e99d476aa8722c9052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442ee828e66f48429daed7cd48385680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:38:51.390701 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-65701be1-94de-4feb-b822-d31d26fa49de tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] 10.222.0.48 "GET /compute/v2.1/servers/89e95d57-9d79-4632-b2fb-921e6bc80538" status: 200 len: 1260 microversion: 2.1 time: 0.162129 Jun 17 13:38:51.391175 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1786/3523] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:38:51 2022] GET /compute/v2.1/servers/89e95d57-9d79-4632-b2fb-921e6bc80538 => generated 1260 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:38:52.409763 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-d9babadc-3aff-43fd-ace6-3a6a7042b952 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:38:52.410652 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-d9babadc-3aff-43fd-ace6-3a6a7042b952 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] [instance: 89e95d57-9d79-4632-b2fb-921e6bc80538] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:38:52.418435 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d9babadc-3aff-43fd-ace6-3a6a7042b952 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:38:52.418882 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d9babadc-3aff-43fd-ace6-3a6a7042b952 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:38:52.419651 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d9babadc-3aff-43fd-ace6-3a6a7042b952 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:38:52.420086 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d9babadc-3aff-43fd-ace6-3a6a7042b952 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:38:52.562083 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-d9babadc-3aff-43fd-ace6-3a6a7042b952 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a846dc3c667140e99d476aa8722c9052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442ee828e66f48429daed7cd48385680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:38:52.567298 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-d9babadc-3aff-43fd-ace6-3a6a7042b952 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] 10.222.0.48 "GET /compute/v2.1/servers/89e95d57-9d79-4632-b2fb-921e6bc80538" status: 200 len: 1260 microversion: 2.1 time: 0.162840 Jun 17 13:38:52.567872 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1738/3524] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:38:52 2022] GET /compute/v2.1/servers/89e95d57-9d79-4632-b2fb-921e6bc80538 => generated 1260 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:38:53.588939 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-36c1b29e-ba65-4cf7-94d0-2fd3c0cd4f9d tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:38:53.589826 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-36c1b29e-ba65-4cf7-94d0-2fd3c0cd4f9d tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] [instance: 89e95d57-9d79-4632-b2fb-921e6bc80538] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:38:53.600936 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-36c1b29e-ba65-4cf7-94d0-2fd3c0cd4f9d tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:38:53.601674 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-36c1b29e-ba65-4cf7-94d0-2fd3c0cd4f9d tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:38:53.602968 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-36c1b29e-ba65-4cf7-94d0-2fd3c0cd4f9d tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:38:53.603665 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-36c1b29e-ba65-4cf7-94d0-2fd3c0cd4f9d tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:38:53.741728 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-36c1b29e-ba65-4cf7-94d0-2fd3c0cd4f9d tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a846dc3c667140e99d476aa8722c9052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442ee828e66f48429daed7cd48385680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:38:53.749577 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-36c1b29e-ba65-4cf7-94d0-2fd3c0cd4f9d tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] 10.222.0.48 "GET /compute/v2.1/servers/89e95d57-9d79-4632-b2fb-921e6bc80538" status: 200 len: 1260 microversion: 2.1 time: 0.167375 Jun 17 13:38:53.750139 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1787/3525] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:38:53 2022] GET /compute/v2.1/servers/89e95d57-9d79-4632-b2fb-921e6bc80538 => generated 1260 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:38:54.770144 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-b7bbe741-572e-4fa9-a6a8-2580bf7fee85 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:38:54.770918 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-b7bbe741-572e-4fa9-a6a8-2580bf7fee85 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] [instance: 89e95d57-9d79-4632-b2fb-921e6bc80538] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:38:54.773919 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell0:SELECT=2 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:38:54.780842 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b7bbe741-572e-4fa9-a6a8-2580bf7fee85 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:38:54.781390 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b7bbe741-572e-4fa9-a6a8-2580bf7fee85 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:38:54.782366 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b7bbe741-572e-4fa9-a6a8-2580bf7fee85 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:38:54.782893 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b7bbe741-572e-4fa9-a6a8-2580bf7fee85 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:38:54.924548 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-b7bbe741-572e-4fa9-a6a8-2580bf7fee85 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a846dc3c667140e99d476aa8722c9052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442ee828e66f48429daed7cd48385680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:38:54.933713 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-b7bbe741-572e-4fa9-a6a8-2580bf7fee85 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] 10.222.0.48 "GET /compute/v2.1/servers/89e95d57-9d79-4632-b2fb-921e6bc80538" status: 200 len: 1260 microversion: 2.1 time: 0.168384 Jun 17 13:38:54.934308 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1739/3526] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:38:54 2022] GET /compute/v2.1/servers/89e95d57-9d79-4632-b2fb-921e6bc80538 => generated 1260 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:38:55.951345 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-1f5ab162-64eb-45af-b7fd-63bf283417d9 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:38:55.951935 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-1f5ab162-64eb-45af-b7fd-63bf283417d9 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] [instance: 89e95d57-9d79-4632-b2fb-921e6bc80538] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:38:55.953926 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_cell0:SELECT=2 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:38:55.954599 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_cell0:SELECT=6 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:38:55.961029 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-1f5ab162-64eb-45af-b7fd-63bf283417d9 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:38:55.961473 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-1f5ab162-64eb-45af-b7fd-63bf283417d9 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:38:55.962264 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-1f5ab162-64eb-45af-b7fd-63bf283417d9 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:38:55.962692 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-1f5ab162-64eb-45af-b7fd-63bf283417d9 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:38:56.109057 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-1f5ab162-64eb-45af-b7fd-63bf283417d9 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a846dc3c667140e99d476aa8722c9052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442ee828e66f48429daed7cd48385680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:38:56.121226 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-1f5ab162-64eb-45af-b7fd-63bf283417d9 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] 10.222.0.48 "GET /compute/v2.1/servers/89e95d57-9d79-4632-b2fb-921e6bc80538" status: 200 len: 1260 microversion: 2.1 time: 0.173842 Jun 17 13:38:56.121967 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1788/3527] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:38:55 2022] GET /compute/v2.1/servers/89e95d57-9d79-4632-b2fb-921e6bc80538 => generated 1260 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:38:57.144934 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-95bb3532-4c0e-4b9b-83eb-b40409c37821 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:38:57.145857 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-95bb3532-4c0e-4b9b-83eb-b40409c37821 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] [instance: 89e95d57-9d79-4632-b2fb-921e6bc80538] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:38:57.153194 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-95bb3532-4c0e-4b9b-83eb-b40409c37821 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:38:57.153633 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-95bb3532-4c0e-4b9b-83eb-b40409c37821 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:38:57.154410 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-95bb3532-4c0e-4b9b-83eb-b40409c37821 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:38:57.154832 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-95bb3532-4c0e-4b9b-83eb-b40409c37821 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:38:57.287182 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-95bb3532-4c0e-4b9b-83eb-b40409c37821 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a846dc3c667140e99d476aa8722c9052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442ee828e66f48429daed7cd48385680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:38:57.295032 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-95bb3532-4c0e-4b9b-83eb-b40409c37821 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] 10.222.0.48 "GET /compute/v2.1/servers/89e95d57-9d79-4632-b2fb-921e6bc80538" status: 200 len: 1260 microversion: 2.1 time: 0.156093 Jun 17 13:38:57.295597 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1740/3528] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:38:57 2022] GET /compute/v2.1/servers/89e95d57-9d79-4632-b2fb-921e6bc80538 => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:38:57.322119 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [req-6376f651-20f8-48c3-961e-81093eb11edd req-7d6e7c25-3cbf-4a3b-9093-a2c0c764a69f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89e95d57-9d79-4632-b2fb-921e6bc80538", "name": "network-vif-plugged", "status": "completed", "tag": "5708d08c-7f64-44a5-8190-ffa61c858f93"}]} {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:38:57.330615 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [req-6376f651-20f8-48c3-961e-81093eb11edd req-7d6e7c25-3cbf-4a3b-9093-a2c0c764a69f service nova] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:38:57.331045 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [req-6376f651-20f8-48c3-961e-81093eb11edd req-7d6e7c25-3cbf-4a3b-9093-a2c0c764a69f service nova] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:38:57.342588 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.compute.server_external_events [req-6376f651-20f8-48c3-961e-81093eb11edd req-7d6e7c25-3cbf-4a3b-9093-a2c0c764a69f service nova] Creating event network-vif-plugged:5708d08c-7f64-44a5-8190-ffa61c858f93 for instance 89e95d57-9d79-4632-b2fb-921e6bc80538 on hv-cinder-83754 Jun 17 13:38:57.347506 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [req-6376f651-20f8-48c3-961e-81093eb11edd req-7d6e7c25-3cbf-4a3b-9093-a2c0c764a69f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029855 Jun 17 13:38:57.348081 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1789/3529] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 13:38:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 13:38:58.312543 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-d2674a34-ae49-4f0d-b6d5-7e4b3b7f7b72 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:38:58.313695 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-d2674a34-ae49-4f0d-b6d5-7e4b3b7f7b72 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] [instance: 89e95d57-9d79-4632-b2fb-921e6bc80538] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:38:58.320760 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d2674a34-ae49-4f0d-b6d5-7e4b3b7f7b72 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:38:58.321203 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d2674a34-ae49-4f0d-b6d5-7e4b3b7f7b72 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:38:58.321959 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d2674a34-ae49-4f0d-b6d5-7e4b3b7f7b72 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:38:58.322429 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d2674a34-ae49-4f0d-b6d5-7e4b3b7f7b72 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:38:58.462280 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-d2674a34-ae49-4f0d-b6d5-7e4b3b7f7b72 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a846dc3c667140e99d476aa8722c9052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442ee828e66f48429daed7cd48385680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:38:58.474481 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-d2674a34-ae49-4f0d-b6d5-7e4b3b7f7b72 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] 10.222.0.48 "GET /compute/v2.1/servers/89e95d57-9d79-4632-b2fb-921e6bc80538" status: 200 len: 1260 microversion: 2.1 time: 0.165848 Jun 17 13:38:58.475654 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1741/3530] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:38:58 2022] GET /compute/v2.1/servers/89e95d57-9d79-4632-b2fb-921e6bc80538 => generated 1260 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:38:59.499757 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-7b4baa11-1944-4332-981a-556836ddc956 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:38:59.500910 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-7b4baa11-1944-4332-981a-556836ddc956 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] [instance: 89e95d57-9d79-4632-b2fb-921e6bc80538] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:38:59.510858 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7b4baa11-1944-4332-981a-556836ddc956 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:38:59.511542 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7b4baa11-1944-4332-981a-556836ddc956 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:38:59.512696 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7b4baa11-1944-4332-981a-556836ddc956 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:38:59.513362 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7b4baa11-1944-4332-981a-556836ddc956 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:38:59.659621 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-7b4baa11-1944-4332-981a-556836ddc956 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a846dc3c667140e99d476aa8722c9052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442ee828e66f48429daed7cd48385680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:38:59.672559 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-7b4baa11-1944-4332-981a-556836ddc956 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] 10.222.0.48 "GET /compute/v2.1/servers/89e95d57-9d79-4632-b2fb-921e6bc80538" status: 200 len: 1442 microversion: 2.1 time: 0.179826 Jun 17 13:38:59.673442 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1790/3531] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:38:59 2022] GET /compute/v2.1/servers/89e95d57-9d79-4632-b2fb-921e6bc80538 => generated 1442 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:38:59.691484 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-f4351ab9-7f01-4d03-8468-b2cbe795500c tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:38:59.692115 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-f4351ab9-7f01-4d03-8468-b2cbe795500c tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] [instance: 89e95d57-9d79-4632-b2fb-921e6bc80538] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:38:59.699508 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f4351ab9-7f01-4d03-8468-b2cbe795500c tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:38:59.699952 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f4351ab9-7f01-4d03-8468-b2cbe795500c tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:38:59.700822 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f4351ab9-7f01-4d03-8468-b2cbe795500c tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:38:59.701253 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f4351ab9-7f01-4d03-8468-b2cbe795500c tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:38:59.846747 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-f4351ab9-7f01-4d03-8468-b2cbe795500c tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a846dc3c667140e99d476aa8722c9052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442ee828e66f48429daed7cd48385680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:38:59.854531 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-f4351ab9-7f01-4d03-8468-b2cbe795500c tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] 10.222.0.48 "GET /compute/v2.1/servers/89e95d57-9d79-4632-b2fb-921e6bc80538" status: 200 len: 1442 microversion: 2.1 time: 0.166786 Jun 17 13:38:59.855032 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1742/3532] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:38:59 2022] GET /compute/v2.1/servers/89e95d57-9d79-4632-b2fb-921e6bc80538 => generated 1442 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:39:01.664265 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [req-b99e9cc6-8317-43e4-938a-bbea1ca975ec req-42e54ac2-8608-48e7-b4c7-158c26ac9a4f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89e95d57-9d79-4632-b2fb-921e6bc80538", "tag": "5708d08c-7f64-44a5-8190-ffa61c858f93"}]} {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:39:01.672956 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [req-b99e9cc6-8317-43e4-938a-bbea1ca975ec req-42e54ac2-8608-48e7-b4c7-158c26ac9a4f service nova] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:39:01.673394 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [req-b99e9cc6-8317-43e4-938a-bbea1ca975ec req-42e54ac2-8608-48e7-b4c7-158c26ac9a4f service nova] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:39:01.685642 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.compute.server_external_events [req-b99e9cc6-8317-43e4-938a-bbea1ca975ec req-42e54ac2-8608-48e7-b4c7-158c26ac9a4f service nova] Creating event network-changed:5708d08c-7f64-44a5-8190-ffa61c858f93 for instance 89e95d57-9d79-4632-b2fb-921e6bc80538 on hv-cinder-83754 Jun 17 13:39:01.690910 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [req-b99e9cc6-8317-43e4-938a-bbea1ca975ec req-42e54ac2-8608-48e7-b4c7-158c26ac9a4f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092266 Jun 17 13:39:01.691531 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1791/3533] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 13:39:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:40:17.695882 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-caa0b430-22d4-4d1b-ba07-27044c9b9623 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:40:17.696407 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-caa0b430-22d4-4d1b-ba07-27044c9b9623 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: cc3f5e1d-d03b-4fe4-b777-8aedac2761ce] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:40:17.698454 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_api:SELECT=20 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:40:17.699107 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=48 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:40:17.705038 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-caa0b430-22d4-4d1b-ba07-27044c9b9623 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:40:17.705480 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-caa0b430-22d4-4d1b-ba07-27044c9b9623 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:40:17.706438 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-caa0b430-22d4-4d1b-ba07-27044c9b9623 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:40:17.706874 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-caa0b430-22d4-4d1b-ba07-27044c9b9623 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:40:17.732619 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-caa0b430-22d4-4d1b-ba07-27044c9b9623 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: cc3f5e1d-d03b-4fe4-b777-8aedac2761ce] Going to try to terminate instance {{(pid=117660) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 17 13:40:17.813931 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-caa0b430-22d4-4d1b-ba07-27044c9b9623 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "DELETE /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce" status: 204 len: 0 microversion: 2.1 time: 0.122521 Jun 17 13:40:17.814490 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1743/3534] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Jun 17 13:40:17 2022] DELETE /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 17 13:40:17.822894 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:40:17.823661 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_cell1:SELECT=44 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:40:17.828330 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-e245ba7f-0684-44de-a505-986dfbc15c37 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:40:17.829017 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-e245ba7f-0684-44de-a505-986dfbc15c37 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: cc3f5e1d-d03b-4fe4-b777-8aedac2761ce] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:40:17.839468 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e245ba7f-0684-44de-a505-986dfbc15c37 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:40:17.840104 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e245ba7f-0684-44de-a505-986dfbc15c37 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:40:17.841139 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e245ba7f-0684-44de-a505-986dfbc15c37 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:40:17.841590 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e245ba7f-0684-44de-a505-986dfbc15c37 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:40:18.072378 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-e245ba7f-0684-44de-a505-986dfbc15c37 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:40:18.084461 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-e245ba7f-0684-44de-a505-986dfbc15c37 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce" status: 200 len: 1506 microversion: 2.1 time: 0.263461 Jun 17 13:40:18.085251 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1792/3535] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:40:17 2022] GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce => generated 1506 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:40:19.103249 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-4694856d-93b7-46db-96b9-03f95ab3aae9 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:40:19.103944 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-4694856d-93b7-46db-96b9-03f95ab3aae9 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: cc3f5e1d-d03b-4fe4-b777-8aedac2761ce] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:40:19.110919 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4694856d-93b7-46db-96b9-03f95ab3aae9 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:40:19.111396 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4694856d-93b7-46db-96b9-03f95ab3aae9 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:40:19.112154 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4694856d-93b7-46db-96b9-03f95ab3aae9 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:40:19.112584 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4694856d-93b7-46db-96b9-03f95ab3aae9 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:40:19.305401 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-4694856d-93b7-46db-96b9-03f95ab3aae9 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:40:19.313594 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-4694856d-93b7-46db-96b9-03f95ab3aae9 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce" status: 200 len: 1506 microversion: 2.1 time: 0.214767 Jun 17 13:40:19.314212 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1744/3536] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:40:19 2022] GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce => generated 1506 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:40:19.501419 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [req-fc3ac8b6-b48d-43d2-965c-c8b737441347 req-40103acf-721f-47cb-ac1a-2875bb9a74c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc3f5e1d-d03b-4fe4-b777-8aedac2761ce", "name": "network-vif-deleted", "tag": "bf0807bd-3b46-453e-8c9b-d856e04fe896"}]} {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:40:19.511291 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [req-fc3ac8b6-b48d-43d2-965c-c8b737441347 req-40103acf-721f-47cb-ac1a-2875bb9a74c2 service nova] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:40:19.511722 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [req-fc3ac8b6-b48d-43d2-965c-c8b737441347 req-40103acf-721f-47cb-ac1a-2875bb9a74c2 service nova] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:40:19.523228 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.compute.server_external_events [req-fc3ac8b6-b48d-43d2-965c-c8b737441347 req-40103acf-721f-47cb-ac1a-2875bb9a74c2 service nova] Creating event network-vif-deleted:bf0807bd-3b46-453e-8c9b-d856e04fe896 for instance cc3f5e1d-d03b-4fe4-b777-8aedac2761ce on hv-cinder-83754 Jun 17 13:40:19.528784 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [req-fc3ac8b6-b48d-43d2-965c-c8b737441347 req-40103acf-721f-47cb-ac1a-2875bb9a74c2 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031632 Jun 17 13:40:19.529530 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1793/3537] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 13:40:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:40:20.334654 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-3960c3b0-8cff-4bf4-a703-39101955a441 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:40:20.335269 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-3960c3b0-8cff-4bf4-a703-39101955a441 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: cc3f5e1d-d03b-4fe4-b777-8aedac2761ce] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:40:20.341898 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3960c3b0-8cff-4bf4-a703-39101955a441 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:40:20.342382 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3960c3b0-8cff-4bf4-a703-39101955a441 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:40:20.343142 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3960c3b0-8cff-4bf4-a703-39101955a441 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:40:20.343575 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3960c3b0-8cff-4bf4-a703-39101955a441 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:40:20.357528 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.wsgi [None req-3960c3b0-8cff-4bf4-a703-39101955a441 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] HTTP exception thrown: Instance cc3f5e1d-d03b-4fe4-b777-8aedac2761ce could not be found. Jun 17 13:40:20.359188 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-3960c3b0-8cff-4bf4-a703-39101955a441 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Request method failure captured: Jun 17 13:40:20.359188 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: request: GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce HTTP/1.1 Jun 17 13:40:20.359188 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Accept: application/json Jun 17 13:40:20.359188 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Accept-Encoding: identity Jun 17 13:40:20.359188 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Connection: close Jun 17 13:40:20.359188 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Content-Length: 0 Jun 17 13:40:20.359188 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Content-Type: application/json Jun 17 13:40:20.359188 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Host: 10.222.0.48 Jun 17 13:40:20.359188 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Openstack-System-Scope: None Jun 17 13:40:20.359188 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: User-Agent: python-urllib3/1.26.9 Jun 17 13:40:20.359188 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Auth-Token: gAAAAABirHoxM0oq9BgeHLRFPYzXBHG5U4OV8ZU-A1ymANbGzbLAnLt205Q4DLlvW5I3ZQK2kg4ViraZvfMlofkEkYssplETqKLDgpV_0cDAupkiyxxXo0oRMQ1NOAKA18FF8OZJnb5Gs-d_9R_XYIMft4Dwgbdu5CEqMFZ9aQiMHSbSwXIg9SU Jun 17 13:40:20.359188 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Domain-Id: None Jun 17 13:40:20.359188 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Domain-Name: None Jun 17 13:40:20.359188 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Identity-Status: Confirmed Jun 17 13:40:20.359188 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Is-Admin-Project: True Jun 17 13:40:20.359188 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Project-Domain-Id: default Jun 17 13:40:20.359188 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Project-Domain-Name: Default Jun 17 13:40:20.359188 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Project-Id: 17ea6f9d80f345dbb3b2bf75e0138fd3 Jun 17 13:40:20.359188 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1652483342 Jun 17 13:40:20.359188 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Role: member,reader Jun 17 13:40:20.359188 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Roles: member,reader Jun 17 13:40:20.360426 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_17ea6f9d80f345dbb3b2bf75e0138fd3", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/17ea6f9d80f345dbb3b2bf75e0138fd3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/17ea6f9d80f345dbb3b2bf75e0138fd3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/17ea6f9d80f345dbb3b2bf75e0138fd3"}]}] Jun 17 13:40:20.360426 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1652483342 Jun 17 13:40:20.360426 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Tenant-Id: 17ea6f9d80f345dbb3b2bf75e0138fd3 Jun 17 13:40:20.360426 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1652483342 Jun 17 13:40:20.360426 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-User: tempest-ServerRescueNegativeTestJSON-1652483342-project Jun 17 13:40:20.360426 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-User-Domain-Id: default Jun 17 13:40:20.360426 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-User-Domain-Name: Default Jun 17 13:40:20.360426 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-User-Id: b75243e37f2342c0a428d39e193e0d4b Jun 17 13:40:20.360426 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1652483342-project Jun 17 13:40:20.360426 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: method: > Jun 17 13:40:20.360426 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: exception: Instance cc3f5e1d-d03b-4fe4-b777-8aedac2761ce could not be found. Jun 17 13:40:20.360426 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: action_args: {'id': 'cc3f5e1d-d03b-4fe4-b777-8aedac2761ce'} Jun 17 13:40:20.361131 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 13:40:20.361131 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:40:20.361131 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 13:40:20.361131 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 13:40:20.361131 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 13:40:20.361131 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 13:40:20.361131 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 13:40:20.361131 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 13:40:20.361131 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 13:40:20.361131 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 13:40:20.361131 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc3f5e1d-d03b-4fe4-b777-8aedac2761ce could not be found. Jun 17 13:40:20.361131 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 13:40:20.361131 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:40:20.361131 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 13:40:20.361131 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:40:20.361131 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:40:20.361131 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:40:20.361131 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 13:40:20.361131 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 13:40:20.361131 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 13:40:20.362318 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 13:40:20.362318 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 13:40:20.362318 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 13:40:20.362318 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 13:40:20.362318 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 13:40:20.362318 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 13:40:20.362318 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 13:40:20.362318 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc3f5e1d-d03b-4fe4-b777-8aedac2761ce could not be found. Jun 17 13:40:20.362318 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 13:40:20.362318 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:40:20.362318 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 13:40:20.362318 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:40:20.362318 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:40:20.362318 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:40:20.362318 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 13:40:20.362318 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 13:40:20.362318 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc3f5e1d-d03b-4fe4-b777-8aedac2761ce could not be found. Jun 17 13:40:20.362318 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 13:40:20.363343 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-3960c3b0-8cff-4bf4-a703-39101955a441 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Returning 404 to user: Instance cc3f5e1d-d03b-4fe4-b777-8aedac2761ce could not be found. {{(pid=117660) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 13:40:20.363343 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-3960c3b0-8cff-4bf4-a703-39101955a441 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce" status: 404 len: 111 microversion: 2.1 time: 0.031458 Jun 17 13:40:20.363343 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1745/3538] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:40:20 2022] GET /compute/v2.1/servers/cc3f5e1d-d03b-4fe4-b777-8aedac2761ce => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 13:40:20.369871 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-dd3435db-9fac-4de6-900d-147194d4f357 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:40:20.370485 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-dd3435db-9fac-4de6-900d-147194d4f357 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 5db43a6d-a079-4e7c-948a-b2600a102f63] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:40:20.377210 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-dd3435db-9fac-4de6-900d-147194d4f357 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:40:20.377657 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-dd3435db-9fac-4de6-900d-147194d4f357 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:40:20.378442 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-dd3435db-9fac-4de6-900d-147194d4f357 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:40:20.378881 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-dd3435db-9fac-4de6-900d-147194d4f357 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:40:20.407156 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-dd3435db-9fac-4de6-900d-147194d4f357 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 5db43a6d-a079-4e7c-948a-b2600a102f63] Going to try to terminate instance {{(pid=117659) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 17 13:40:20.487124 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-dd3435db-9fac-4de6-900d-147194d4f357 tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "DELETE /compute/v2.1/servers/5db43a6d-a079-4e7c-948a-b2600a102f63" status: 204 len: 0 microversion: 2.1 time: 0.121199 Jun 17 13:40:20.487717 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1794/3539] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Jun 17 13:40:20 2022] DELETE /compute/v2.1/servers/5db43a6d-a079-4e7c-948a-b2600a102f63 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 17 13:40:20.499364 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-fe2b181e-b95d-4e56-8d38-a467fb518d0e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:40:20.500254 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-fe2b181e-b95d-4e56-8d38-a467fb518d0e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 5db43a6d-a079-4e7c-948a-b2600a102f63] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:40:20.507754 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fe2b181e-b95d-4e56-8d38-a467fb518d0e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:40:20.508199 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fe2b181e-b95d-4e56-8d38-a467fb518d0e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:40:20.508948 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fe2b181e-b95d-4e56-8d38-a467fb518d0e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:40:20.509378 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fe2b181e-b95d-4e56-8d38-a467fb518d0e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:40:20.650619 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-fe2b181e-b95d-4e56-8d38-a467fb518d0e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:40:20.658454 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-fe2b181e-b95d-4e56-8d38-a467fb518d0e tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/5db43a6d-a079-4e7c-948a-b2600a102f63" status: 200 len: 1521 microversion: 2.1 time: 0.165277 Jun 17 13:40:20.659018 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1746/3540] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:40:20 2022] GET /compute/v2.1/servers/5db43a6d-a079-4e7c-948a-b2600a102f63 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:40:21.676947 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-9a962a58-7e81-4ac9-b036-f384360fe38d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:40:21.677787 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-9a962a58-7e81-4ac9-b036-f384360fe38d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 5db43a6d-a079-4e7c-948a-b2600a102f63] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:40:21.684908 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9a962a58-7e81-4ac9-b036-f384360fe38d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:40:21.685372 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9a962a58-7e81-4ac9-b036-f384360fe38d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:40:21.686130 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9a962a58-7e81-4ac9-b036-f384360fe38d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:40:21.686570 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9a962a58-7e81-4ac9-b036-f384360fe38d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:40:21.820005 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-9a962a58-7e81-4ac9-b036-f384360fe38d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75243e37f2342c0a428d39e193e0d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:40:21.829196 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-9a962a58-7e81-4ac9-b036-f384360fe38d tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/5db43a6d-a079-4e7c-948a-b2600a102f63" status: 200 len: 1521 microversion: 2.1 time: 0.156749 Jun 17 13:40:21.829796 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1795/3541] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:40:21 2022] GET /compute/v2.1/servers/5db43a6d-a079-4e7c-948a-b2600a102f63 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:40:21.905023 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [req-50c5b238-11b4-4945-accf-9686dfc8f867 req-0cdc5daf-29c3-4c41-bded-710e4c2f0b03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5db43a6d-a079-4e7c-948a-b2600a102f63", "name": "network-vif-deleted", "tag": "510d5b97-81e2-401f-854a-3f165763e33d"}]} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:40:21.916800 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-50c5b238-11b4-4945-accf-9686dfc8f867 req-0cdc5daf-29c3-4c41-bded-710e4c2f0b03 service nova] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:40:21.917447 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-50c5b238-11b4-4945-accf-9686dfc8f867 req-0cdc5daf-29c3-4c41-bded-710e4c2f0b03 service nova] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:40:21.939494 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.compute.server_external_events [req-50c5b238-11b4-4945-accf-9686dfc8f867 req-0cdc5daf-29c3-4c41-bded-710e4c2f0b03 service nova] Creating event network-vif-deleted:510d5b97-81e2-401f-854a-3f165763e33d for instance 5db43a6d-a079-4e7c-948a-b2600a102f63 on hv-cinder-83754 Jun 17 13:40:21.946513 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [req-50c5b238-11b4-4945-accf-9686dfc8f867 req-0cdc5daf-29c3-4c41-bded-710e4c2f0b03 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045044 Jun 17 13:40:21.947498 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1747/3542] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 13:40:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:40:22.850351 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-0f6310a0-1669-49e6-a38a-358f74c5418f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:40:22.850964 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-0f6310a0-1669-49e6-a38a-358f74c5418f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] [instance: 5db43a6d-a079-4e7c-948a-b2600a102f63] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:40:22.859239 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0f6310a0-1669-49e6-a38a-358f74c5418f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:40:22.859769 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0f6310a0-1669-49e6-a38a-358f74c5418f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:40:22.860654 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0f6310a0-1669-49e6-a38a-358f74c5418f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:40:22.861162 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0f6310a0-1669-49e6-a38a-358f74c5418f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:40:22.877433 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.wsgi [None req-0f6310a0-1669-49e6-a38a-358f74c5418f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] HTTP exception thrown: Instance 5db43a6d-a079-4e7c-948a-b2600a102f63 could not be found. Jun 17 13:40:22.879878 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-0f6310a0-1669-49e6-a38a-358f74c5418f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Request method failure captured: Jun 17 13:40:22.879878 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: request: GET /compute/v2.1/servers/5db43a6d-a079-4e7c-948a-b2600a102f63 HTTP/1.1 Jun 17 13:40:22.879878 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Accept: application/json Jun 17 13:40:22.879878 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Accept-Encoding: identity Jun 17 13:40:22.879878 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Connection: close Jun 17 13:40:22.879878 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Content-Length: 0 Jun 17 13:40:22.879878 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Content-Type: application/json Jun 17 13:40:22.879878 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Host: 10.222.0.48 Jun 17 13:40:22.879878 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Openstack-System-Scope: None Jun 17 13:40:22.879878 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: User-Agent: python-urllib3/1.26.9 Jun 17 13:40:22.879878 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Auth-Token: gAAAAABirHoxM0oq9BgeHLRFPYzXBHG5U4OV8ZU-A1ymANbGzbLAnLt205Q4DLlvW5I3ZQK2kg4ViraZvfMlofkEkYssplETqKLDgpV_0cDAupkiyxxXo0oRMQ1NOAKA18FF8OZJnb5Gs-d_9R_XYIMft4Dwgbdu5CEqMFZ9aQiMHSbSwXIg9SU Jun 17 13:40:22.879878 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Domain-Id: None Jun 17 13:40:22.879878 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Domain-Name: None Jun 17 13:40:22.879878 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Identity-Status: Confirmed Jun 17 13:40:22.879878 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Is-Admin-Project: True Jun 17 13:40:22.879878 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Project-Domain-Id: default Jun 17 13:40:22.879878 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Project-Domain-Name: Default Jun 17 13:40:22.879878 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Project-Id: 17ea6f9d80f345dbb3b2bf75e0138fd3 Jun 17 13:40:22.879878 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1652483342 Jun 17 13:40:22.879878 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Role: member,reader Jun 17 13:40:22.879878 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Roles: member,reader Jun 17 13:40:22.881246 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_17ea6f9d80f345dbb3b2bf75e0138fd3", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/17ea6f9d80f345dbb3b2bf75e0138fd3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/17ea6f9d80f345dbb3b2bf75e0138fd3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/17ea6f9d80f345dbb3b2bf75e0138fd3"}]}] Jun 17 13:40:22.881246 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1652483342 Jun 17 13:40:22.881246 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Tenant-Id: 17ea6f9d80f345dbb3b2bf75e0138fd3 Jun 17 13:40:22.881246 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1652483342 Jun 17 13:40:22.881246 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User: tempest-ServerRescueNegativeTestJSON-1652483342-project Jun 17 13:40:22.881246 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User-Domain-Id: default Jun 17 13:40:22.881246 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User-Domain-Name: Default Jun 17 13:40:22.881246 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User-Id: b75243e37f2342c0a428d39e193e0d4b Jun 17 13:40:22.881246 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1652483342-project Jun 17 13:40:22.881246 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: method: > Jun 17 13:40:22.881246 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: exception: Instance 5db43a6d-a079-4e7c-948a-b2600a102f63 could not be found. Jun 17 13:40:22.881246 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: action_args: {'id': '5db43a6d-a079-4e7c-948a-b2600a102f63'} Jun 17 13:40:22.882185 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 13:40:22.882185 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:40:22.882185 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 13:40:22.882185 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 13:40:22.882185 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 13:40:22.882185 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 13:40:22.882185 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 13:40:22.882185 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 13:40:22.882185 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 13:40:22.882185 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 13:40:22.882185 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5db43a6d-a079-4e7c-948a-b2600a102f63 could not be found. Jun 17 13:40:22.882185 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:40:22.882185 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:40:22.882185 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:40:22.882185 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:40:22.882185 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:40:22.882185 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:40:22.882185 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 13:40:22.882185 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 13:40:22.882185 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 13:40:22.883521 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 13:40:22.883521 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 13:40:22.883521 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 13:40:22.883521 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 13:40:22.883521 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 13:40:22.883521 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 13:40:22.883521 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 13:40:22.883521 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5db43a6d-a079-4e7c-948a-b2600a102f63 could not be found. Jun 17 13:40:22.883521 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:40:22.883521 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:40:22.883521 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:40:22.883521 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:40:22.883521 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:40:22.883521 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:40:22.883521 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 13:40:22.883521 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 13:40:22.883521 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5db43a6d-a079-4e7c-948a-b2600a102f63 could not be found. Jun 17 13:40:22.883521 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:40:22.884705 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-0f6310a0-1669-49e6-a38a-358f74c5418f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] Returning 404 to user: Instance 5db43a6d-a079-4e7c-948a-b2600a102f63 could not be found. {{(pid=117659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 13:40:22.884705 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-0f6310a0-1669-49e6-a38a-358f74c5418f tempest-ServerRescueNegativeTestJSON-1652483342 tempest-ServerRescueNegativeTestJSON-1652483342-project] 10.222.0.48 "GET /compute/v2.1/servers/5db43a6d-a079-4e7c-948a-b2600a102f63" status: 404 len: 111 microversion: 2.1 time: 0.036921 Jun 17 13:40:22.884705 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1796/3543] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:40:22 2022] GET /compute/v2.1/servers/5db43a6d-a079-4e7c-948a-b2600a102f63 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 13:40:31.626586 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-68bb3674-46f9-44c6-ae69-c463bf1b3692 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Action: 'create', calling method: .version_select at 0x7f0194871700>, body: {"keypair": {"name": "tempest-keypair-1640334333", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG1eDRrPWLhUc1+EWWjuuXRjfIBT2rwQcCrS2ryAfkLGZaqLsA6dIZFzCxB6f/CcrD4iDHegZuhth20YNowNNslTM7dFLOOfoNcmFqgDB511B25l0ZvgK54LiNaU5Mn4ug=="}} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:40:31.641491 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.quota [None req-68bb3674-46f9-44c6-ae69-c463bf1b3692 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Getting quotas for project 082c995275404693ae4f1f686dd8fc92. Resources: {'key_pairs'} {{(pid=117660) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 13:40:31.645808 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.quota [None req-68bb3674-46f9-44c6-ae69-c463bf1b3692 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Getting quotas for user da449dd03e364eb0bebabd59bfe1d19c and project 082c995275404693ae4f1f686dd8fc92. Resources: {'key_pairs'} {{(pid=117660) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 13:40:31.658070 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR oslo.messaging._drivers.impl_rabbit [None req-68bb3674-46f9-44c6-ae69-c463bf1b3692 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] [0ed9d8b5-d76a-4e8d-ab5d-efa776ea90ce] AMQP server on 10.222.0.48:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 17 13:40:31.923331 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=30,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:40:32.666704 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO oslo.messaging._drivers.impl_rabbit [None req-68bb3674-46f9-44c6-ae69-c463bf1b3692 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] [0ed9d8b5-d76a-4e8d-ab5d-efa776ea90ce] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 46884. Jun 17 13:40:32.681872 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-68bb3674-46f9-44c6-ae69-c463bf1b3692 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.183793 Jun 17 13:40:32.687797 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1748/3544] 10.222.0.48 () {60 vars in 1158 bytes} [Fri Jun 17 13:40:31 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:40:34.258405 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:40:34.259147 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_cell1:SELECT=30,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:40:34.264583 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-10344f18-65d1-41b3-82f3-fa122ad4bf51 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-530215550", "imageRef": "ccec3e37-1df8-4f10-a8f6-f97dfac54cf5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1181c118-9277-4f31-b5e1-8dddb2767aa8"}], "security_groups": [{"name": "tempest-securitygroup--2065456872"}], "key_name": "tempest-keypair-1640334333", "user_data": "}} {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:40:34.403343 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.network.neutron [None req-10344f18-65d1-41b3-82f3-fa122ad4bf51 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] validate_networks() for [('1181c118-9277-4f31-b5e1-8dddb2767aa8', None, None, None, None, None)] {{(pid=117659) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 17 13:40:34.816611 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.virt.hardware [None req-10344f18-65d1-41b3-82f3-fa122ad4bf51 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Flavor limits 0:0:0 {{(pid=117659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 17 13:40:34.817033 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.virt.hardware [None req-10344f18-65d1-41b3-82f3-fa122ad4bf51 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Image limits 0:0:0 {{(pid=117659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 17 13:40:34.817508 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.virt.hardware [None req-10344f18-65d1-41b3-82f3-fa122ad4bf51 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Flavor pref 0:0:0 {{(pid=117659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 17 13:40:34.817923 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.virt.hardware [None req-10344f18-65d1-41b3-82f3-fa122ad4bf51 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Image pref 0:0:0 {{(pid=117659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 17 13:40:34.818358 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.virt.hardware [None req-10344f18-65d1-41b3-82f3-fa122ad4bf51 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 17 13:40:34.829139 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-10344f18-65d1-41b3-82f3-fa122ad4bf51 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:40:34.829590 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-10344f18-65d1-41b3-82f3-fa122ad4bf51 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:40:34.830421 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-10344f18-65d1-41b3-82f3-fa122ad4bf51 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:40:34.830857 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-10344f18-65d1-41b3-82f3-fa122ad4bf51 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:40:34.849556 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.quota [None req-10344f18-65d1-41b3-82f3-fa122ad4bf51 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Getting quotas for project 082c995275404693ae4f1f686dd8fc92. Resources: {'ram', 'cores', 'instances'} {{(pid=117659) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 13:40:34.854000 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.quota [None req-10344f18-65d1-41b3-82f3-fa122ad4bf51 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Getting quotas for user da449dd03e364eb0bebabd59bfe1d19c and project 082c995275404693ae4f1f686dd8fc92. Resources: {'ram', 'cores', 'instances'} {{(pid=117659) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 13:40:34.866305 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-10344f18-65d1-41b3-82f3-fa122ad4bf51 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Going to run 1 instances... {{(pid=117659) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 17 13:40:34.868622 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-10344f18-65d1-41b3-82f3-fa122ad4bf51 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] [instance: 924b7379-78e3-412f-8264-26b4aa06b2d6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ccec3e37-1df8-4f10-a8f6-f97dfac54cf5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117659) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 17 13:40:34.919069 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-10344f18-65d1-41b3-82f3-fa122ad4bf51 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.661995 Jun 17 13:40:34.926751 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1797/3545] 10.222.0.48 () {60 vars in 1146 bytes} [Fri Jun 17 13:40:34 2022] POST /compute/v2.1/servers => generated 402 bytes in 670 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 17 13:40:34.930975 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-ce0f14b8-9162-4398-8241-ee35f18f1fc9 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:40:34.931981 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-ce0f14b8-9162-4398-8241-ee35f18f1fc9 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] [instance: 924b7379-78e3-412f-8264-26b4aa06b2d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:40:35.003592 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-ce0f14b8-9162-4398-8241-ee35f18f1fc9 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da449dd03e364eb0bebabd59bfe1d19c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '082c995275404693ae4f1f686dd8fc92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:40:35.011334 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-ce0f14b8-9162-4398-8241-ee35f18f1fc9 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] 10.222.0.48 "GET /compute/v2.1/servers/924b7379-78e3-412f-8264-26b4aa06b2d6" status: 200 len: 1241 microversion: 2.1 time: 0.084994 Jun 17 13:40:35.012982 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1749/3546] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:40:34 2022] GET /compute/v2.1/servers/924b7379-78e3-412f-8264-26b4aa06b2d6 => generated 1241 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:40:36.029530 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-d2216f6d-556e-46ac-ac54-d02d0b6430d0 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:40:36.030070 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-d2216f6d-556e-46ac-ac54-d02d0b6430d0 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] [instance: 924b7379-78e3-412f-8264-26b4aa06b2d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:40:36.086404 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-d2216f6d-556e-46ac-ac54-d02d0b6430d0 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da449dd03e364eb0bebabd59bfe1d19c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '082c995275404693ae4f1f686dd8fc92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:40:36.093101 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-d2216f6d-556e-46ac-ac54-d02d0b6430d0 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] 10.222.0.48 "GET /compute/v2.1/servers/924b7379-78e3-412f-8264-26b4aa06b2d6" status: 200 len: 1241 microversion: 2.1 time: 0.068172 Jun 17 13:40:36.093658 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1798/3547] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:40:36 2022] GET /compute/v2.1/servers/924b7379-78e3-412f-8264-26b4aa06b2d6 => generated 1241 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:40:37.111154 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-06f30547-9f67-413c-9893-11873f38e698 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:40:37.111850 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-06f30547-9f67-413c-9893-11873f38e698 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] [instance: 924b7379-78e3-412f-8264-26b4aa06b2d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:40:37.169890 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-06f30547-9f67-413c-9893-11873f38e698 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da449dd03e364eb0bebabd59bfe1d19c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '082c995275404693ae4f1f686dd8fc92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:40:37.179544 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-06f30547-9f67-413c-9893-11873f38e698 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] 10.222.0.48 "GET /compute/v2.1/servers/924b7379-78e3-412f-8264-26b4aa06b2d6" status: 200 len: 1241 microversion: 2.1 time: 0.072351 Jun 17 13:40:37.192089 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1750/3548] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:40:37 2022] GET /compute/v2.1/servers/924b7379-78e3-412f-8264-26b4aa06b2d6 => generated 1241 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:40:38.202079 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-e913d2a7-7be8-4f34-b352-2cc05a581d8c tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:40:38.203576 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-e913d2a7-7be8-4f34-b352-2cc05a581d8c tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] [instance: 924b7379-78e3-412f-8264-26b4aa06b2d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:40:38.258532 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-e913d2a7-7be8-4f34-b352-2cc05a581d8c tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da449dd03e364eb0bebabd59bfe1d19c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '082c995275404693ae4f1f686dd8fc92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:40:38.265176 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-e913d2a7-7be8-4f34-b352-2cc05a581d8c tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] 10.222.0.48 "GET /compute/v2.1/servers/924b7379-78e3-412f-8264-26b4aa06b2d6" status: 200 len: 1241 microversion: 2.1 time: 0.068503 Jun 17 13:40:38.265782 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1799/3549] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:40:38 2022] GET /compute/v2.1/servers/924b7379-78e3-412f-8264-26b4aa06b2d6 => generated 1241 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:40:39.283785 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-d4507a49-9ed2-427e-a495-b4f2c695ddd5 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:40:39.284461 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-d4507a49-9ed2-427e-a495-b4f2c695ddd5 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] [instance: 924b7379-78e3-412f-8264-26b4aa06b2d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:40:39.299141 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d4507a49-9ed2-427e-a495-b4f2c695ddd5 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:40:39.299663 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d4507a49-9ed2-427e-a495-b4f2c695ddd5 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:40:39.300831 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d4507a49-9ed2-427e-a495-b4f2c695ddd5 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:40:39.301352 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d4507a49-9ed2-427e-a495-b4f2c695ddd5 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:40:39.369061 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-d4507a49-9ed2-427e-a495-b4f2c695ddd5 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da449dd03e364eb0bebabd59bfe1d19c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '082c995275404693ae4f1f686dd8fc92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:40:39.378237 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-d4507a49-9ed2-427e-a495-b4f2c695ddd5 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] 10.222.0.48 "GET /compute/v2.1/servers/924b7379-78e3-412f-8264-26b4aa06b2d6" status: 200 len: 1245 microversion: 2.1 time: 0.098228 Jun 17 13:40:39.379120 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1751/3550] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:40:39 2022] GET /compute/v2.1/servers/924b7379-78e3-412f-8264-26b4aa06b2d6 => generated 1245 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:40:40.396068 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-f8acd156-3dc9-41be-be67-87160028c27c tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:40:40.396770 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-f8acd156-3dc9-41be-be67-87160028c27c tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] [instance: 924b7379-78e3-412f-8264-26b4aa06b2d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:40:40.403772 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f8acd156-3dc9-41be-be67-87160028c27c tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:40:40.404190 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f8acd156-3dc9-41be-be67-87160028c27c tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:40:40.404956 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f8acd156-3dc9-41be-be67-87160028c27c tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:40:40.405406 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f8acd156-3dc9-41be-be67-87160028c27c tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:40:40.469731 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-f8acd156-3dc9-41be-be67-87160028c27c tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da449dd03e364eb0bebabd59bfe1d19c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '082c995275404693ae4f1f686dd8fc92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:40:40.477971 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-f8acd156-3dc9-41be-be67-87160028c27c tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] 10.222.0.48 "GET /compute/v2.1/servers/924b7379-78e3-412f-8264-26b4aa06b2d6" status: 200 len: 1299 microversion: 2.1 time: 0.086005 Jun 17 13:40:40.478595 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1800/3551] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:40:40 2022] GET /compute/v2.1/servers/924b7379-78e3-412f-8264-26b4aa06b2d6 => generated 1299 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:40:41.290862 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 13:40:41.290862 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Fri Jun 17 13:40:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 17 13:40:41.495809 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-c37c9b5f-82ea-4142-8d6a-677adecfbbcf tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:40:41.497257 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-c37c9b5f-82ea-4142-8d6a-677adecfbbcf tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] [instance: 924b7379-78e3-412f-8264-26b4aa06b2d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:40:41.504870 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c37c9b5f-82ea-4142-8d6a-677adecfbbcf tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:40:41.505605 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c37c9b5f-82ea-4142-8d6a-677adecfbbcf tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:40:41.506395 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c37c9b5f-82ea-4142-8d6a-677adecfbbcf tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:40:41.506970 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c37c9b5f-82ea-4142-8d6a-677adecfbbcf tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:40:41.594557 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [req-8c37a245-2abe-4303-a94a-8e3396d0a41d req-17c84886-c13d-447e-ab49-2a6d6e4e67f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "924b7379-78e3-412f-8264-26b4aa06b2d6", "tag": "a876efdd-2c01-4351-ac03-ab112ff48744"}]} {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:40:41.611668 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [req-8c37a245-2abe-4303-a94a-8e3396d0a41d req-17c84886-c13d-447e-ab49-2a6d6e4e67f9 service nova] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:40:41.612194 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [req-8c37a245-2abe-4303-a94a-8e3396d0a41d req-17c84886-c13d-447e-ab49-2a6d6e4e67f9 service nova] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:40:41.625272 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.compute.server_external_events [req-8c37a245-2abe-4303-a94a-8e3396d0a41d req-17c84886-c13d-447e-ab49-2a6d6e4e67f9 service nova] Creating event network-changed:a876efdd-2c01-4351-ac03-ab112ff48744 for instance 924b7379-78e3-412f-8264-26b4aa06b2d6 on hv-cinder-83754 Jun 17 13:40:41.630862 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [req-8c37a245-2abe-4303-a94a-8e3396d0a41d req-17c84886-c13d-447e-ab49-2a6d6e4e67f9 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051985 Jun 17 13:40:41.632439 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1801/3552] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 13:40:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:40:41.651144 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-c37c9b5f-82ea-4142-8d6a-677adecfbbcf tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da449dd03e364eb0bebabd59bfe1d19c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '082c995275404693ae4f1f686dd8fc92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:40:41.658957 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-c37c9b5f-82ea-4142-8d6a-677adecfbbcf tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] 10.222.0.48 "GET /compute/v2.1/servers/924b7379-78e3-412f-8264-26b4aa06b2d6" status: 200 len: 1367 microversion: 2.1 time: 0.167056 Jun 17 13:40:41.659633 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1752/3553] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:40:41 2022] GET /compute/v2.1/servers/924b7379-78e3-412f-8264-26b4aa06b2d6 => generated 1367 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:40:42.681552 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-e13dc84c-523d-4903-94e6-953778e6887d tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:40:42.682274 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-e13dc84c-523d-4903-94e6-953778e6887d tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] [instance: 924b7379-78e3-412f-8264-26b4aa06b2d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:40:42.689396 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e13dc84c-523d-4903-94e6-953778e6887d tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:40:42.689842 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e13dc84c-523d-4903-94e6-953778e6887d tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:40:42.690633 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e13dc84c-523d-4903-94e6-953778e6887d tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:40:42.691066 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e13dc84c-523d-4903-94e6-953778e6887d tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:40:42.842779 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-e13dc84c-523d-4903-94e6-953778e6887d tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da449dd03e364eb0bebabd59bfe1d19c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '082c995275404693ae4f1f686dd8fc92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:40:42.850735 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-e13dc84c-523d-4903-94e6-953778e6887d tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] 10.222.0.48 "GET /compute/v2.1/servers/924b7379-78e3-412f-8264-26b4aa06b2d6" status: 200 len: 1367 microversion: 2.1 time: 0.174795 Jun 17 13:40:42.851288 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1802/3554] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:40:42 2022] GET /compute/v2.1/servers/924b7379-78e3-412f-8264-26b4aa06b2d6 => generated 1367 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:40:43.872057 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-c0c1751c-a9dc-440e-990b-0105c5b94d37 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:40:43.873024 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-c0c1751c-a9dc-440e-990b-0105c5b94d37 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] [instance: 924b7379-78e3-412f-8264-26b4aa06b2d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:40:43.882280 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c0c1751c-a9dc-440e-990b-0105c5b94d37 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:40:43.882719 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c0c1751c-a9dc-440e-990b-0105c5b94d37 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:40:43.883512 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c0c1751c-a9dc-440e-990b-0105c5b94d37 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:40:43.883966 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c0c1751c-a9dc-440e-990b-0105c5b94d37 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:40:44.016765 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-c0c1751c-a9dc-440e-990b-0105c5b94d37 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da449dd03e364eb0bebabd59bfe1d19c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '082c995275404693ae4f1f686dd8fc92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:40:44.028405 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-c0c1751c-a9dc-440e-990b-0105c5b94d37 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] 10.222.0.48 "GET /compute/v2.1/servers/924b7379-78e3-412f-8264-26b4aa06b2d6" status: 200 len: 1367 microversion: 2.1 time: 0.162531 Jun 17 13:40:44.029233 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1753/3555] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:40:43 2022] GET /compute/v2.1/servers/924b7379-78e3-412f-8264-26b4aa06b2d6 => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:40:45.045371 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-1f85bbe0-3d16-4dab-9fce-730e58df5481 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:40:45.047166 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-1f85bbe0-3d16-4dab-9fce-730e58df5481 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] [instance: 924b7379-78e3-412f-8264-26b4aa06b2d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:40:45.050379 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_cell0:SELECT=2 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:40:45.057322 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-1f85bbe0-3d16-4dab-9fce-730e58df5481 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:40:45.057831 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-1f85bbe0-3d16-4dab-9fce-730e58df5481 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:40:45.058654 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-1f85bbe0-3d16-4dab-9fce-730e58df5481 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:40:45.059116 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-1f85bbe0-3d16-4dab-9fce-730e58df5481 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:40:45.209493 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-1f85bbe0-3d16-4dab-9fce-730e58df5481 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da449dd03e364eb0bebabd59bfe1d19c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '082c995275404693ae4f1f686dd8fc92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:40:45.217414 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-1f85bbe0-3d16-4dab-9fce-730e58df5481 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] 10.222.0.48 "GET /compute/v2.1/servers/924b7379-78e3-412f-8264-26b4aa06b2d6" status: 200 len: 1367 microversion: 2.1 time: 0.175936 Jun 17 13:40:45.217982 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1803/3556] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:40:45 2022] GET /compute/v2.1/servers/924b7379-78e3-412f-8264-26b4aa06b2d6 => generated 1367 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:40:46.239986 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-4d17ad88-7ed4-4899-af66-509dd2261df3 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:40:46.240976 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-4d17ad88-7ed4-4899-af66-509dd2261df3 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] [instance: 924b7379-78e3-412f-8264-26b4aa06b2d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:40:46.251315 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4d17ad88-7ed4-4899-af66-509dd2261df3 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:40:46.252004 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4d17ad88-7ed4-4899-af66-509dd2261df3 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:40:46.253165 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4d17ad88-7ed4-4899-af66-509dd2261df3 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:40:46.254074 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4d17ad88-7ed4-4899-af66-509dd2261df3 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:40:46.384554 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-4d17ad88-7ed4-4899-af66-509dd2261df3 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da449dd03e364eb0bebabd59bfe1d19c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '082c995275404693ae4f1f686dd8fc92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:40:46.392158 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-4d17ad88-7ed4-4899-af66-509dd2261df3 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] 10.222.0.48 "GET /compute/v2.1/servers/924b7379-78e3-412f-8264-26b4aa06b2d6" status: 200 len: 1367 microversion: 2.1 time: 0.159032 Jun 17 13:40:46.392952 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1754/3557] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:40:46 2022] GET /compute/v2.1/servers/924b7379-78e3-412f-8264-26b4aa06b2d6 => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:40:47.409019 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-7c98f8e4-97f5-46c0-873c-6f7d927a5439 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:40:47.409681 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-7c98f8e4-97f5-46c0-873c-6f7d927a5439 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] [instance: 924b7379-78e3-412f-8264-26b4aa06b2d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:40:47.416722 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7c98f8e4-97f5-46c0-873c-6f7d927a5439 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:40:47.417132 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7c98f8e4-97f5-46c0-873c-6f7d927a5439 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:40:47.417911 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7c98f8e4-97f5-46c0-873c-6f7d927a5439 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:40:47.418378 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7c98f8e4-97f5-46c0-873c-6f7d927a5439 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:40:47.551884 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-7c98f8e4-97f5-46c0-873c-6f7d927a5439 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da449dd03e364eb0bebabd59bfe1d19c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '082c995275404693ae4f1f686dd8fc92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:40:47.562849 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-7c98f8e4-97f5-46c0-873c-6f7d927a5439 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] 10.222.0.48 "GET /compute/v2.1/servers/924b7379-78e3-412f-8264-26b4aa06b2d6" status: 200 len: 1367 microversion: 2.1 time: 0.157400 Jun 17 13:40:47.563649 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1804/3558] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:40:47 2022] GET /compute/v2.1/servers/924b7379-78e3-412f-8264-26b4aa06b2d6 => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:40:47.847273 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell0:SELECT=8 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:40:47.906355 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [req-cfeae64a-aeea-404a-8c15-7f21536da225 req-d258aa7c-a113-4923-ac2c-aca1f9030bdf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "924b7379-78e3-412f-8264-26b4aa06b2d6", "name": "network-vif-plugged", "status": "completed", "tag": "a876efdd-2c01-4351-ac03-ab112ff48744"}]} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:40:47.909768 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:40:47.915686 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-cfeae64a-aeea-404a-8c15-7f21536da225 req-d258aa7c-a113-4923-ac2c-aca1f9030bdf service nova] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:40:47.916123 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-cfeae64a-aeea-404a-8c15-7f21536da225 req-d258aa7c-a113-4923-ac2c-aca1f9030bdf service nova] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:40:47.925485 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 13:40:47.925653 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Fri Jun 17 13:40:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.48) !!! Jun 17 13:40:47.927862 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.compute.server_external_events [req-cfeae64a-aeea-404a-8c15-7f21536da225 req-d258aa7c-a113-4923-ac2c-aca1f9030bdf service nova] Creating event network-vif-plugged:a876efdd-2c01-4351-ac03-ab112ff48744 for instance 924b7379-78e3-412f-8264-26b4aa06b2d6 on hv-cinder-83754 Jun 17 13:40:47.933383 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [req-cfeae64a-aeea-404a-8c15-7f21536da225 req-d258aa7c-a113-4923-ac2c-aca1f9030bdf service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090453 Jun 17 13:40:47.935239 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1755/3559] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 13:40:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:40:48.583926 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-0e002d4a-64de-4402-910a-a96749c66ac5 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:40:48.584540 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-0e002d4a-64de-4402-910a-a96749c66ac5 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] [instance: 924b7379-78e3-412f-8264-26b4aa06b2d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:40:48.586456 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_cell0:SELECT=10 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:40:48.592709 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0e002d4a-64de-4402-910a-a96749c66ac5 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:40:48.593157 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0e002d4a-64de-4402-910a-a96749c66ac5 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:40:48.593922 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0e002d4a-64de-4402-910a-a96749c66ac5 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:40:48.594406 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0e002d4a-64de-4402-910a-a96749c66ac5 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:40:48.733179 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-0e002d4a-64de-4402-910a-a96749c66ac5 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da449dd03e364eb0bebabd59bfe1d19c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '082c995275404693ae4f1f686dd8fc92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:40:48.741158 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-0e002d4a-64de-4402-910a-a96749c66ac5 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] 10.222.0.48 "GET /compute/v2.1/servers/924b7379-78e3-412f-8264-26b4aa06b2d6" status: 200 len: 1367 microversion: 2.1 time: 0.163121 Jun 17 13:40:48.741732 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1805/3560] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:40:48 2022] GET /compute/v2.1/servers/924b7379-78e3-412f-8264-26b4aa06b2d6 => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:40:49.764524 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-19f95465-42d2-468e-9037-fc7f4194fdf2 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:40:49.765698 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-19f95465-42d2-468e-9037-fc7f4194fdf2 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] [instance: 924b7379-78e3-412f-8264-26b4aa06b2d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:40:49.777534 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-19f95465-42d2-468e-9037-fc7f4194fdf2 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:40:49.778325 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-19f95465-42d2-468e-9037-fc7f4194fdf2 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:40:49.779562 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-19f95465-42d2-468e-9037-fc7f4194fdf2 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:40:49.780271 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-19f95465-42d2-468e-9037-fc7f4194fdf2 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:40:49.935596 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-19f95465-42d2-468e-9037-fc7f4194fdf2 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da449dd03e364eb0bebabd59bfe1d19c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '082c995275404693ae4f1f686dd8fc92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:40:49.943595 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-19f95465-42d2-468e-9037-fc7f4194fdf2 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] 10.222.0.48 "GET /compute/v2.1/servers/924b7379-78e3-412f-8264-26b4aa06b2d6" status: 200 len: 1367 microversion: 2.1 time: 0.186749 Jun 17 13:40:49.944165 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1756/3561] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:40:49 2022] GET /compute/v2.1/servers/924b7379-78e3-412f-8264-26b4aa06b2d6 => generated 1367 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:40:50.965527 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-753fe6eb-2d8f-4857-bb8a-6839f5c15a4c tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:40:50.966614 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-753fe6eb-2d8f-4857-bb8a-6839f5c15a4c tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] [instance: 924b7379-78e3-412f-8264-26b4aa06b2d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:40:50.977463 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-753fe6eb-2d8f-4857-bb8a-6839f5c15a4c tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:40:50.978247 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-753fe6eb-2d8f-4857-bb8a-6839f5c15a4c tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:40:50.979488 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-753fe6eb-2d8f-4857-bb8a-6839f5c15a4c tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:40:50.980194 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-753fe6eb-2d8f-4857-bb8a-6839f5c15a4c tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:40:51.113252 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-753fe6eb-2d8f-4857-bb8a-6839f5c15a4c tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da449dd03e364eb0bebabd59bfe1d19c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '082c995275404693ae4f1f686dd8fc92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:40:51.121479 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-753fe6eb-2d8f-4857-bb8a-6839f5c15a4c tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] 10.222.0.48 "GET /compute/v2.1/servers/924b7379-78e3-412f-8264-26b4aa06b2d6" status: 200 len: 1557 microversion: 2.1 time: 0.162415 Jun 17 13:40:51.122055 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1806/3562] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:40:50 2022] GET /compute/v2.1/servers/924b7379-78e3-412f-8264-26b4aa06b2d6 => generated 1557 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:40:51.141625 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-81fd6c91-3867-4ed8-86c2-364ec8ce7c4a tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:40:51.142754 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-81fd6c91-3867-4ed8-86c2-364ec8ce7c4a tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] [instance: 924b7379-78e3-412f-8264-26b4aa06b2d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:40:51.149962 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-81fd6c91-3867-4ed8-86c2-364ec8ce7c4a tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:40:51.150442 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-81fd6c91-3867-4ed8-86c2-364ec8ce7c4a tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:40:51.151216 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-81fd6c91-3867-4ed8-86c2-364ec8ce7c4a tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:40:51.151653 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-81fd6c91-3867-4ed8-86c2-364ec8ce7c4a tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:40:51.237384 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-81fd6c91-3867-4ed8-86c2-364ec8ce7c4a tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] 10.222.0.48 "GET /compute/v2.1/servers/924b7379-78e3-412f-8264-26b4aa06b2d6/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.099586 Jun 17 13:40:51.238029 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1757/3563] 10.222.0.48 () {58 vars in 1274 bytes} [Fri Jun 17 13:40:51 2022] GET /compute/v2.1/servers/924b7379-78e3-412f-8264-26b4aa06b2d6/os-interface => generated 284 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:40:52.212409 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [req-b90be915-1205-42cc-97cb-12df174df50d req-0df960f6-5ea2-4ef1-9a35-ebc1519fd891 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "924b7379-78e3-412f-8264-26b4aa06b2d6", "tag": "a876efdd-2c01-4351-ac03-ab112ff48744"}]} {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:40:52.221368 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [req-b90be915-1205-42cc-97cb-12df174df50d req-0df960f6-5ea2-4ef1-9a35-ebc1519fd891 service nova] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:40:52.221818 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [req-b90be915-1205-42cc-97cb-12df174df50d req-0df960f6-5ea2-4ef1-9a35-ebc1519fd891 service nova] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:40:52.233936 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.compute.server_external_events [req-b90be915-1205-42cc-97cb-12df174df50d req-0df960f6-5ea2-4ef1-9a35-ebc1519fd891 service nova] Creating event network-changed:a876efdd-2c01-4351-ac03-ab112ff48744 for instance 924b7379-78e3-412f-8264-26b4aa06b2d6 on hv-cinder-83754 Jun 17 13:40:52.240344 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [req-b90be915-1205-42cc-97cb-12df174df50d req-0df960f6-5ea2-4ef1-9a35-ebc1519fd891 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031403 Jun 17 13:40:52.241138 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1807/3564] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 13:40:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:41:15.581691 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_api:SELECT=5 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:41:15.582871 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=36 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:41:15.587646 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-7e024241-b465-4ad7-84cb-917afa073add tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:41:15.588170 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-7e024241-b465-4ad7-84cb-917afa073add tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] [instance: 89e95d57-9d79-4632-b2fb-921e6bc80538] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:41:15.595085 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7e024241-b465-4ad7-84cb-917afa073add tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:41:15.595526 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7e024241-b465-4ad7-84cb-917afa073add tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:41:15.596257 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7e024241-b465-4ad7-84cb-917afa073add tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:41:15.596678 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7e024241-b465-4ad7-84cb-917afa073add tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:41:15.620027 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.objects.instance [None req-7e024241-b465-4ad7-84cb-917afa073add tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lazy-loading 'flavor' on Instance uuid 89e95d57-9d79-4632-b2fb-921e6bc80538 {{(pid=117660) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 13:41:15.706069 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-7e024241-b465-4ad7-84cb-917afa073add tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] 10.222.0.48 "POST /compute/v2.1/servers/89e95d57-9d79-4632-b2fb-921e6bc80538/action" status: 202 len: 0 microversion: 2.1 time: 0.126503 Jun 17 13:41:15.706965 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1758/3565] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Jun 17 13:41:15 2022] POST /compute/v2.1/servers/89e95d57-9d79-4632-b2fb-921e6bc80538/action => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 13:41:15.717623 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-7d535c6e-ebb3-4701-b296-3b97f715eb2c tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:41:15.718332 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-7d535c6e-ebb3-4701-b296-3b97f715eb2c tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] [instance: 89e95d57-9d79-4632-b2fb-921e6bc80538] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:41:15.720526 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:41:15.721259 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_cell1:SELECT=42 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:41:15.727795 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7d535c6e-ebb3-4701-b296-3b97f715eb2c tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:41:15.728308 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7d535c6e-ebb3-4701-b296-3b97f715eb2c tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:41:15.729200 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7d535c6e-ebb3-4701-b296-3b97f715eb2c tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:41:15.730585 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7d535c6e-ebb3-4701-b296-3b97f715eb2c tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:41:15.869381 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-7d535c6e-ebb3-4701-b296-3b97f715eb2c tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a846dc3c667140e99d476aa8722c9052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442ee828e66f48429daed7cd48385680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:41:15.877490 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-7d535c6e-ebb3-4701-b296-3b97f715eb2c tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] 10.222.0.48 "GET /compute/v2.1/servers/89e95d57-9d79-4632-b2fb-921e6bc80538" status: 200 len: 1567 microversion: 2.1 time: 0.165000 Jun 17 13:41:15.878060 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1808/3566] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:41:15 2022] GET /compute/v2.1/servers/89e95d57-9d79-4632-b2fb-921e6bc80538 => generated 1567 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 13:41:16.901332 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-db70ef94-b1eb-439b-b978-9786adb018e1 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:41:16.902544 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-db70ef94-b1eb-439b-b978-9786adb018e1 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] [instance: 89e95d57-9d79-4632-b2fb-921e6bc80538] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:41:16.912859 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-db70ef94-b1eb-439b-b978-9786adb018e1 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:41:16.913308 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-db70ef94-b1eb-439b-b978-9786adb018e1 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:41:16.914121 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-db70ef94-b1eb-439b-b978-9786adb018e1 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:41:16.914556 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-db70ef94-b1eb-439b-b978-9786adb018e1 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:41:17.066417 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-db70ef94-b1eb-439b-b978-9786adb018e1 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a846dc3c667140e99d476aa8722c9052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442ee828e66f48429daed7cd48385680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:41:17.074513 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-db70ef94-b1eb-439b-b978-9786adb018e1 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] 10.222.0.48 "GET /compute/v2.1/servers/89e95d57-9d79-4632-b2fb-921e6bc80538" status: 200 len: 1567 microversion: 2.1 time: 0.181101 Jun 17 13:41:17.075056 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1759/3567] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:41:16 2022] GET /compute/v2.1/servers/89e95d57-9d79-4632-b2fb-921e6bc80538 => generated 1567 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:41:18.099738 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-8a77851b-9961-4a5b-bf29-dfe41c0ef1b7 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:41:18.100655 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-8a77851b-9961-4a5b-bf29-dfe41c0ef1b7 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] [instance: 89e95d57-9d79-4632-b2fb-921e6bc80538] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:41:18.112378 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8a77851b-9961-4a5b-bf29-dfe41c0ef1b7 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:41:18.113147 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8a77851b-9961-4a5b-bf29-dfe41c0ef1b7 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:41:18.114449 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8a77851b-9961-4a5b-bf29-dfe41c0ef1b7 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:41:18.115389 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8a77851b-9961-4a5b-bf29-dfe41c0ef1b7 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:41:18.254670 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-8a77851b-9961-4a5b-bf29-dfe41c0ef1b7 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a846dc3c667140e99d476aa8722c9052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442ee828e66f48429daed7cd48385680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:41:18.262996 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-8a77851b-9961-4a5b-bf29-dfe41c0ef1b7 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] 10.222.0.48 "GET /compute/v2.1/servers/89e95d57-9d79-4632-b2fb-921e6bc80538" status: 200 len: 1567 microversion: 2.1 time: 0.170331 Jun 17 13:41:18.263791 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1809/3568] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:41:18 2022] GET /compute/v2.1/servers/89e95d57-9d79-4632-b2fb-921e6bc80538 => generated 1567 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:41:19.284648 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-fb5827f0-da19-4ab0-be23-9db2440aa4a3 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:41:19.285687 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-fb5827f0-da19-4ab0-be23-9db2440aa4a3 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] [instance: 89e95d57-9d79-4632-b2fb-921e6bc80538] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:41:19.297110 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fb5827f0-da19-4ab0-be23-9db2440aa4a3 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:41:19.297857 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fb5827f0-da19-4ab0-be23-9db2440aa4a3 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:41:19.299170 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fb5827f0-da19-4ab0-be23-9db2440aa4a3 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:41:19.299895 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fb5827f0-da19-4ab0-be23-9db2440aa4a3 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:41:19.453948 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-fb5827f0-da19-4ab0-be23-9db2440aa4a3 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a846dc3c667140e99d476aa8722c9052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442ee828e66f48429daed7cd48385680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:41:19.461924 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-fb5827f0-da19-4ab0-be23-9db2440aa4a3 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] 10.222.0.48 "GET /compute/v2.1/servers/89e95d57-9d79-4632-b2fb-921e6bc80538" status: 200 len: 1567 microversion: 2.1 time: 0.183759 Jun 17 13:41:19.462529 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1760/3569] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:41:19 2022] GET /compute/v2.1/servers/89e95d57-9d79-4632-b2fb-921e6bc80538 => generated 1567 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:41:20.483990 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-be81d944-8d95-441f-9ec6-aa60df0895df tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:41:20.484959 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-be81d944-8d95-441f-9ec6-aa60df0895df tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] [instance: 89e95d57-9d79-4632-b2fb-921e6bc80538] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:41:20.495993 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-be81d944-8d95-441f-9ec6-aa60df0895df tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:41:20.496744 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-be81d944-8d95-441f-9ec6-aa60df0895df tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:41:20.497979 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-be81d944-8d95-441f-9ec6-aa60df0895df tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:41:20.498733 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-be81d944-8d95-441f-9ec6-aa60df0895df tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:41:20.646028 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-be81d944-8d95-441f-9ec6-aa60df0895df tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a846dc3c667140e99d476aa8722c9052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442ee828e66f48429daed7cd48385680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:41:20.654298 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-be81d944-8d95-441f-9ec6-aa60df0895df tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] 10.222.0.48 "GET /compute/v2.1/servers/89e95d57-9d79-4632-b2fb-921e6bc80538" status: 200 len: 1567 microversion: 2.1 time: 0.177401 Jun 17 13:41:20.654875 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1810/3570] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:41:20 2022] GET /compute/v2.1/servers/89e95d57-9d79-4632-b2fb-921e6bc80538 => generated 1567 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:41:21.675619 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-7700f19d-2ce0-406b-ac8c-bf69595e4a56 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:41:21.676632 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-7700f19d-2ce0-406b-ac8c-bf69595e4a56 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] [instance: 89e95d57-9d79-4632-b2fb-921e6bc80538] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:41:21.683493 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7700f19d-2ce0-406b-ac8c-bf69595e4a56 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:41:21.683939 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7700f19d-2ce0-406b-ac8c-bf69595e4a56 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:41:21.684693 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7700f19d-2ce0-406b-ac8c-bf69595e4a56 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:41:21.685123 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7700f19d-2ce0-406b-ac8c-bf69595e4a56 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:41:21.828832 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-7700f19d-2ce0-406b-ac8c-bf69595e4a56 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a846dc3c667140e99d476aa8722c9052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442ee828e66f48429daed7cd48385680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:41:21.837582 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-7700f19d-2ce0-406b-ac8c-bf69595e4a56 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] 10.222.0.48 "GET /compute/v2.1/servers/89e95d57-9d79-4632-b2fb-921e6bc80538" status: 200 len: 1567 microversion: 2.1 time: 0.168775 Jun 17 13:41:21.838183 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1761/3571] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:41:21 2022] GET /compute/v2.1/servers/89e95d57-9d79-4632-b2fb-921e6bc80538 => generated 1567 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:41:22.859317 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-d892c5d1-e09e-44f9-8d58-da2262e40ac3 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:41:22.860143 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-d892c5d1-e09e-44f9-8d58-da2262e40ac3 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] [instance: 89e95d57-9d79-4632-b2fb-921e6bc80538] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:41:22.871503 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d892c5d1-e09e-44f9-8d58-da2262e40ac3 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:41:22.872222 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d892c5d1-e09e-44f9-8d58-da2262e40ac3 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:41:22.873449 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d892c5d1-e09e-44f9-8d58-da2262e40ac3 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:41:22.874177 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d892c5d1-e09e-44f9-8d58-da2262e40ac3 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:41:23.024369 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-d892c5d1-e09e-44f9-8d58-da2262e40ac3 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a846dc3c667140e99d476aa8722c9052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442ee828e66f48429daed7cd48385680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:41:23.036030 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-d892c5d1-e09e-44f9-8d58-da2262e40ac3 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] 10.222.0.48 "GET /compute/v2.1/servers/89e95d57-9d79-4632-b2fb-921e6bc80538" status: 200 len: 1567 microversion: 2.1 time: 0.183435 Jun 17 13:41:23.037101 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1811/3572] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:41:22 2022] GET /compute/v2.1/servers/89e95d57-9d79-4632-b2fb-921e6bc80538 => generated 1567 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:41:24.055905 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-a4db64be-d859-4d83-bb75-e25c49dbf18f tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:41:24.056748 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-a4db64be-d859-4d83-bb75-e25c49dbf18f tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] [instance: 89e95d57-9d79-4632-b2fb-921e6bc80538] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:41:24.064583 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a4db64be-d859-4d83-bb75-e25c49dbf18f tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:41:24.065066 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a4db64be-d859-4d83-bb75-e25c49dbf18f tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:41:24.065866 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a4db64be-d859-4d83-bb75-e25c49dbf18f tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:41:24.066361 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a4db64be-d859-4d83-bb75-e25c49dbf18f tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:41:24.215670 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-a4db64be-d859-4d83-bb75-e25c49dbf18f tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a846dc3c667140e99d476aa8722c9052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442ee828e66f48429daed7cd48385680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:41:24.224006 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-a4db64be-d859-4d83-bb75-e25c49dbf18f tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] 10.222.0.48 "GET /compute/v2.1/servers/89e95d57-9d79-4632-b2fb-921e6bc80538" status: 200 len: 1567 microversion: 2.1 time: 0.173524 Jun 17 13:41:24.224769 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1762/3573] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:41:24 2022] GET /compute/v2.1/servers/89e95d57-9d79-4632-b2fb-921e6bc80538 => generated 1567 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:41:25.243786 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-146bb0c6-fcda-4c3c-99ea-daace6ecb0d0 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:41:25.244474 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-146bb0c6-fcda-4c3c-99ea-daace6ecb0d0 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] [instance: 89e95d57-9d79-4632-b2fb-921e6bc80538] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:41:25.251541 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-146bb0c6-fcda-4c3c-99ea-daace6ecb0d0 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:41:25.251994 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-146bb0c6-fcda-4c3c-99ea-daace6ecb0d0 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:41:25.252744 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-146bb0c6-fcda-4c3c-99ea-daace6ecb0d0 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:41:25.253179 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-146bb0c6-fcda-4c3c-99ea-daace6ecb0d0 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:41:25.404032 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-146bb0c6-fcda-4c3c-99ea-daace6ecb0d0 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a846dc3c667140e99d476aa8722c9052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442ee828e66f48429daed7cd48385680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:41:25.411979 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-146bb0c6-fcda-4c3c-99ea-daace6ecb0d0 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] 10.222.0.48 "GET /compute/v2.1/servers/89e95d57-9d79-4632-b2fb-921e6bc80538" status: 200 len: 1567 microversion: 2.1 time: 0.172390 Jun 17 13:41:25.412403 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1812/3574] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:41:25 2022] GET /compute/v2.1/servers/89e95d57-9d79-4632-b2fb-921e6bc80538 => generated 1567 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:41:26.429432 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-6816e733-088a-48b9-8694-3d79fdaadb04 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:41:26.430049 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-6816e733-088a-48b9-8694-3d79fdaadb04 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] [instance: 89e95d57-9d79-4632-b2fb-921e6bc80538] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:41:26.437428 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6816e733-088a-48b9-8694-3d79fdaadb04 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:41:26.437878 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6816e733-088a-48b9-8694-3d79fdaadb04 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:41:26.438688 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6816e733-088a-48b9-8694-3d79fdaadb04 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:41:26.439124 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6816e733-088a-48b9-8694-3d79fdaadb04 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:41:26.660074 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-6816e733-088a-48b9-8694-3d79fdaadb04 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a846dc3c667140e99d476aa8722c9052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442ee828e66f48429daed7cd48385680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:41:26.668155 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-6816e733-088a-48b9-8694-3d79fdaadb04 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] 10.222.0.48 "GET /compute/v2.1/servers/89e95d57-9d79-4632-b2fb-921e6bc80538" status: 200 len: 1567 microversion: 2.1 time: 0.242839 Jun 17 13:41:26.668728 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1763/3575] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:41:26 2022] GET /compute/v2.1/servers/89e95d57-9d79-4632-b2fb-921e6bc80538 => generated 1567 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:41:27.689458 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-5aa2456a-9763-4836-9bfd-7e8d83506d7a tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:41:27.690520 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-5aa2456a-9763-4836-9bfd-7e8d83506d7a tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] [instance: 89e95d57-9d79-4632-b2fb-921e6bc80538] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:41:27.702134 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-5aa2456a-9763-4836-9bfd-7e8d83506d7a tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:41:27.702922 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-5aa2456a-9763-4836-9bfd-7e8d83506d7a tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:41:27.704162 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-5aa2456a-9763-4836-9bfd-7e8d83506d7a tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:41:27.704873 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-5aa2456a-9763-4836-9bfd-7e8d83506d7a tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:41:27.853051 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-5aa2456a-9763-4836-9bfd-7e8d83506d7a tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a846dc3c667140e99d476aa8722c9052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442ee828e66f48429daed7cd48385680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:41:27.865979 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-5aa2456a-9763-4836-9bfd-7e8d83506d7a tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] 10.222.0.48 "GET /compute/v2.1/servers/89e95d57-9d79-4632-b2fb-921e6bc80538" status: 200 len: 1567 microversion: 2.1 time: 0.183017 Jun 17 13:41:27.866632 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1813/3576] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:41:27 2022] GET /compute/v2.1/servers/89e95d57-9d79-4632-b2fb-921e6bc80538 => generated 1567 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:41:28.885943 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-7a2d1813-9c43-48ef-a7c9-b53d7c60b73c tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:41:28.886871 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-7a2d1813-9c43-48ef-a7c9-b53d7c60b73c tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] [instance: 89e95d57-9d79-4632-b2fb-921e6bc80538] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:41:28.897196 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7a2d1813-9c43-48ef-a7c9-b53d7c60b73c tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:41:28.897777 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7a2d1813-9c43-48ef-a7c9-b53d7c60b73c tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:41:28.899014 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7a2d1813-9c43-48ef-a7c9-b53d7c60b73c tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:41:28.899641 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7a2d1813-9c43-48ef-a7c9-b53d7c60b73c tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:41:29.217525 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-7a2d1813-9c43-48ef-a7c9-b53d7c60b73c tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a846dc3c667140e99d476aa8722c9052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442ee828e66f48429daed7cd48385680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:41:29.227879 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-7a2d1813-9c43-48ef-a7c9-b53d7c60b73c tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] 10.222.0.48 "GET /compute/v2.1/servers/89e95d57-9d79-4632-b2fb-921e6bc80538" status: 200 len: 1567 microversion: 2.1 time: 0.346872 Jun 17 13:41:29.228542 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1764/3577] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:41:28 2022] GET /compute/v2.1/servers/89e95d57-9d79-4632-b2fb-921e6bc80538 => generated 1567 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:41:30.252896 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-91f6d95d-0c73-4618-a4b1-1525f1ad49fd tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:41:30.253883 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-91f6d95d-0c73-4618-a4b1-1525f1ad49fd tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] [instance: 89e95d57-9d79-4632-b2fb-921e6bc80538] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:41:30.261712 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-91f6d95d-0c73-4618-a4b1-1525f1ad49fd tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:41:30.262180 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-91f6d95d-0c73-4618-a4b1-1525f1ad49fd tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:41:30.262934 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-91f6d95d-0c73-4618-a4b1-1525f1ad49fd tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:41:30.263362 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-91f6d95d-0c73-4618-a4b1-1525f1ad49fd tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:41:30.402059 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-91f6d95d-0c73-4618-a4b1-1525f1ad49fd tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a846dc3c667140e99d476aa8722c9052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442ee828e66f48429daed7cd48385680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:41:30.413911 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-91f6d95d-0c73-4618-a4b1-1525f1ad49fd tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] 10.222.0.48 "GET /compute/v2.1/servers/89e95d57-9d79-4632-b2fb-921e6bc80538" status: 200 len: 1508 microversion: 2.1 time: 0.167571 Jun 17 13:41:30.414567 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1814/3578] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:41:30 2022] GET /compute/v2.1/servers/89e95d57-9d79-4632-b2fb-921e6bc80538 => generated 1508 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:41:30.430525 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-d2f4af20-03fe-49fc-9970-bad166f34de4 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:41:30.431196 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-d2f4af20-03fe-49fc-9970-bad166f34de4 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] [instance: 89e95d57-9d79-4632-b2fb-921e6bc80538] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:41:30.438150 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d2f4af20-03fe-49fc-9970-bad166f34de4 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:41:30.438582 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d2f4af20-03fe-49fc-9970-bad166f34de4 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:41:30.439337 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d2f4af20-03fe-49fc-9970-bad166f34de4 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:41:30.439768 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d2f4af20-03fe-49fc-9970-bad166f34de4 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:41:30.582744 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-d2f4af20-03fe-49fc-9970-bad166f34de4 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] 10.222.0.48 "POST /compute/v2.1/servers/89e95d57-9d79-4632-b2fb-921e6bc80538/action" status: 202 len: 0 microversion: 2.1 time: 0.156241 Jun 17 13:41:30.583331 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1765/3579] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Jun 17 13:41:30 2022] POST /compute/v2.1/servers/89e95d57-9d79-4632-b2fb-921e6bc80538/action => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 13:41:30.595984 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-4550b991-6494-4f90-97d2-9afc98cc921d tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:41:30.597194 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-4550b991-6494-4f90-97d2-9afc98cc921d tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] [instance: 89e95d57-9d79-4632-b2fb-921e6bc80538] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:41:30.608397 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4550b991-6494-4f90-97d2-9afc98cc921d tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:41:30.609196 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4550b991-6494-4f90-97d2-9afc98cc921d tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:41:30.610991 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4550b991-6494-4f90-97d2-9afc98cc921d tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:41:30.611729 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4550b991-6494-4f90-97d2-9afc98cc921d tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:41:30.751966 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-4550b991-6494-4f90-97d2-9afc98cc921d tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a846dc3c667140e99d476aa8722c9052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442ee828e66f48429daed7cd48385680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:41:30.760174 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-4550b991-6494-4f90-97d2-9afc98cc921d tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] 10.222.0.48 "GET /compute/v2.1/servers/89e95d57-9d79-4632-b2fb-921e6bc80538" status: 200 len: 1516 microversion: 2.1 time: 0.171873 Jun 17 13:41:30.760804 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1815/3580] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:41:30 2022] GET /compute/v2.1/servers/89e95d57-9d79-4632-b2fb-921e6bc80538 => generated 1516 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:41:31.777983 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-3e00f01a-f50f-487f-a232-dc0b8b8fedaf tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:41:31.778569 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-3e00f01a-f50f-487f-a232-dc0b8b8fedaf tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] [instance: 89e95d57-9d79-4632-b2fb-921e6bc80538] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:41:31.784711 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3e00f01a-f50f-487f-a232-dc0b8b8fedaf tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:41:31.785281 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3e00f01a-f50f-487f-a232-dc0b8b8fedaf tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:41:31.786154 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3e00f01a-f50f-487f-a232-dc0b8b8fedaf tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:41:31.786712 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3e00f01a-f50f-487f-a232-dc0b8b8fedaf tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:41:31.934979 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-3e00f01a-f50f-487f-a232-dc0b8b8fedaf tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a846dc3c667140e99d476aa8722c9052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442ee828e66f48429daed7cd48385680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:41:31.945071 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-3e00f01a-f50f-487f-a232-dc0b8b8fedaf tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] 10.222.0.48 "GET /compute/v2.1/servers/89e95d57-9d79-4632-b2fb-921e6bc80538" status: 200 len: 1518 microversion: 2.1 time: 0.171710 Jun 17 13:41:31.945649 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1766/3581] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:41:31 2022] GET /compute/v2.1/servers/89e95d57-9d79-4632-b2fb-921e6bc80538 => generated 1518 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:41:32.013408 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [req-a4f4f092-c9c8-43cd-98db-41a9fc7eedf6 req-f8e42659-d8b8-43ae-8d60-0b6ddbd66f7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89e95d57-9d79-4632-b2fb-921e6bc80538", "name": "network-vif-unplugged", "status": "completed", "tag": "5708d08c-7f64-44a5-8190-ffa61c858f93"}]} {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:41:32.022552 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [req-a4f4f092-c9c8-43cd-98db-41a9fc7eedf6 req-f8e42659-d8b8-43ae-8d60-0b6ddbd66f7e service nova] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:41:32.023217 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [req-a4f4f092-c9c8-43cd-98db-41a9fc7eedf6 req-f8e42659-d8b8-43ae-8d60-0b6ddbd66f7e service nova] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:41:32.035202 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.compute.server_external_events [req-a4f4f092-c9c8-43cd-98db-41a9fc7eedf6 req-f8e42659-d8b8-43ae-8d60-0b6ddbd66f7e service nova] Unable to find a host for instance 89e95d57-9d79-4632-b2fb-921e6bc80538. Dropping event network-vif-unplugged {{(pid=117659) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 17 13:41:32.036088 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [req-a4f4f092-c9c8-43cd-98db-41a9fc7eedf6 req-f8e42659-d8b8-43ae-8d60-0b6ddbd66f7e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.026785 Jun 17 13:41:32.036651 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1816/3582] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 13:41:32 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 28 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jun 17 13:41:32.963307 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-cd7ba78c-9f20-40d8-b0da-c1252fe6230c tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:41:32.963899 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-cd7ba78c-9f20-40d8-b0da-c1252fe6230c tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] [instance: 89e95d57-9d79-4632-b2fb-921e6bc80538] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:41:32.970341 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cd7ba78c-9f20-40d8-b0da-c1252fe6230c tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:41:32.970789 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cd7ba78c-9f20-40d8-b0da-c1252fe6230c tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:41:32.971553 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cd7ba78c-9f20-40d8-b0da-c1252fe6230c tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:41:32.971988 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cd7ba78c-9f20-40d8-b0da-c1252fe6230c tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:41:33.113669 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-cd7ba78c-9f20-40d8-b0da-c1252fe6230c tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a846dc3c667140e99d476aa8722c9052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442ee828e66f48429daed7cd48385680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:41:33.125088 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-cd7ba78c-9f20-40d8-b0da-c1252fe6230c tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] 10.222.0.48 "GET /compute/v2.1/servers/89e95d57-9d79-4632-b2fb-921e6bc80538" status: 200 len: 1574 microversion: 2.1 time: 0.165937 Jun 17 13:41:33.125868 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1767/3583] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:41:32 2022] GET /compute/v2.1/servers/89e95d57-9d79-4632-b2fb-921e6bc80538 => generated 1574 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:41:34.148132 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-2a4da645-b577-4b5c-b74a-e55adc6c9ea7 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:41:34.149093 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-2a4da645-b577-4b5c-b74a-e55adc6c9ea7 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] [instance: 89e95d57-9d79-4632-b2fb-921e6bc80538] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:41:34.160133 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2a4da645-b577-4b5c-b74a-e55adc6c9ea7 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:41:34.160916 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2a4da645-b577-4b5c-b74a-e55adc6c9ea7 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:41:34.162263 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2a4da645-b577-4b5c-b74a-e55adc6c9ea7 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:41:34.162764 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2a4da645-b577-4b5c-b74a-e55adc6c9ea7 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:41:34.313915 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-2a4da645-b577-4b5c-b74a-e55adc6c9ea7 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a846dc3c667140e99d476aa8722c9052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442ee828e66f48429daed7cd48385680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:41:34.326201 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-2a4da645-b577-4b5c-b74a-e55adc6c9ea7 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] 10.222.0.48 "GET /compute/v2.1/servers/89e95d57-9d79-4632-b2fb-921e6bc80538" status: 200 len: 1574 microversion: 2.1 time: 0.184200 Jun 17 13:41:34.327082 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1817/3584] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:41:34 2022] GET /compute/v2.1/servers/89e95d57-9d79-4632-b2fb-921e6bc80538 => generated 1574 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:41:35.346267 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-8ce9b5bd-10cf-4f20-8453-6885e7e1eefd tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:41:35.346864 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-8ce9b5bd-10cf-4f20-8453-6885e7e1eefd tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] [instance: 89e95d57-9d79-4632-b2fb-921e6bc80538] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:41:35.353994 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8ce9b5bd-10cf-4f20-8453-6885e7e1eefd tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:41:35.354459 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8ce9b5bd-10cf-4f20-8453-6885e7e1eefd tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:41:35.355578 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8ce9b5bd-10cf-4f20-8453-6885e7e1eefd tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:41:35.356020 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8ce9b5bd-10cf-4f20-8453-6885e7e1eefd tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:41:35.490938 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-8ce9b5bd-10cf-4f20-8453-6885e7e1eefd tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a846dc3c667140e99d476aa8722c9052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442ee828e66f48429daed7cd48385680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:41:35.498371 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-8ce9b5bd-10cf-4f20-8453-6885e7e1eefd tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] 10.222.0.48 "GET /compute/v2.1/servers/89e95d57-9d79-4632-b2fb-921e6bc80538" status: 200 len: 1574 microversion: 2.1 time: 0.156094 Jun 17 13:41:35.498928 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1768/3585] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:41:35 2022] GET /compute/v2.1/servers/89e95d57-9d79-4632-b2fb-921e6bc80538 => generated 1574 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:41:36.519761 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-0b42b4e2-df31-4f8b-8931-cd3983e0d248 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:41:36.520724 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-0b42b4e2-df31-4f8b-8931-cd3983e0d248 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] [instance: 89e95d57-9d79-4632-b2fb-921e6bc80538] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:41:36.528323 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0b42b4e2-df31-4f8b-8931-cd3983e0d248 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:41:36.528780 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0b42b4e2-df31-4f8b-8931-cd3983e0d248 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:41:36.529537 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0b42b4e2-df31-4f8b-8931-cd3983e0d248 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:41:36.529972 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0b42b4e2-df31-4f8b-8931-cd3983e0d248 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:41:36.668804 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-0b42b4e2-df31-4f8b-8931-cd3983e0d248 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a846dc3c667140e99d476aa8722c9052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442ee828e66f48429daed7cd48385680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:41:36.676457 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-0b42b4e2-df31-4f8b-8931-cd3983e0d248 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] 10.222.0.48 "GET /compute/v2.1/servers/89e95d57-9d79-4632-b2fb-921e6bc80538" status: 200 len: 1574 microversion: 2.1 time: 0.163174 Jun 17 13:41:36.677008 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1818/3586] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:41:36 2022] GET /compute/v2.1/servers/89e95d57-9d79-4632-b2fb-921e6bc80538 => generated 1574 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:41:37.697231 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-40386c85-df2a-4f35-9106-a427f095dccb tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:41:37.697848 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-40386c85-df2a-4f35-9106-a427f095dccb tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] [instance: 89e95d57-9d79-4632-b2fb-921e6bc80538] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:41:37.704936 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-40386c85-df2a-4f35-9106-a427f095dccb tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:41:37.705388 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-40386c85-df2a-4f35-9106-a427f095dccb tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:41:37.706183 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-40386c85-df2a-4f35-9106-a427f095dccb tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:41:37.706618 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-40386c85-df2a-4f35-9106-a427f095dccb tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:41:37.855293 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-40386c85-df2a-4f35-9106-a427f095dccb tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a846dc3c667140e99d476aa8722c9052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442ee828e66f48429daed7cd48385680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:41:37.867428 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-40386c85-df2a-4f35-9106-a427f095dccb tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] 10.222.0.48 "GET /compute/v2.1/servers/89e95d57-9d79-4632-b2fb-921e6bc80538" status: 200 len: 1574 microversion: 2.1 time: 0.175484 Jun 17 13:41:37.868189 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1769/3587] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:41:37 2022] GET /compute/v2.1/servers/89e95d57-9d79-4632-b2fb-921e6bc80538 => generated 1574 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:41:38.887910 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-7505d7a4-be8e-4bcf-815e-0e0b9f7cc11f tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:41:38.888500 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-7505d7a4-be8e-4bcf-815e-0e0b9f7cc11f tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] [instance: 89e95d57-9d79-4632-b2fb-921e6bc80538] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:41:38.895245 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7505d7a4-be8e-4bcf-815e-0e0b9f7cc11f tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:41:38.895690 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7505d7a4-be8e-4bcf-815e-0e0b9f7cc11f tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:41:38.896545 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7505d7a4-be8e-4bcf-815e-0e0b9f7cc11f tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:41:38.897049 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7505d7a4-be8e-4bcf-815e-0e0b9f7cc11f tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:41:39.058357 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-7505d7a4-be8e-4bcf-815e-0e0b9f7cc11f tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a846dc3c667140e99d476aa8722c9052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442ee828e66f48429daed7cd48385680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:41:39.068430 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-7505d7a4-be8e-4bcf-815e-0e0b9f7cc11f tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] 10.222.0.48 "GET /compute/v2.1/servers/89e95d57-9d79-4632-b2fb-921e6bc80538" status: 200 len: 1574 microversion: 2.1 time: 0.185021 Jun 17 13:41:39.069172 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1819/3588] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:41:38 2022] GET /compute/v2.1/servers/89e95d57-9d79-4632-b2fb-921e6bc80538 => generated 1574 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:41:40.087936 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-e3451849-5d09-42a6-a93a-c80e6c85297d tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:41:40.088516 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-e3451849-5d09-42a6-a93a-c80e6c85297d tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] [instance: 89e95d57-9d79-4632-b2fb-921e6bc80538] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:41:40.095352 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e3451849-5d09-42a6-a93a-c80e6c85297d tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:41:40.095796 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e3451849-5d09-42a6-a93a-c80e6c85297d tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:41:40.096675 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e3451849-5d09-42a6-a93a-c80e6c85297d tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:41:40.097113 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e3451849-5d09-42a6-a93a-c80e6c85297d tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:41:40.236895 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-e3451849-5d09-42a6-a93a-c80e6c85297d tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a846dc3c667140e99d476aa8722c9052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442ee828e66f48429daed7cd48385680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:41:40.245160 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-e3451849-5d09-42a6-a93a-c80e6c85297d tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] 10.222.0.48 "GET /compute/v2.1/servers/89e95d57-9d79-4632-b2fb-921e6bc80538" status: 200 len: 1574 microversion: 2.1 time: 0.161169 Jun 17 13:41:40.245780 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1770/3589] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:41:40 2022] GET /compute/v2.1/servers/89e95d57-9d79-4632-b2fb-921e6bc80538 => generated 1574 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:41:41.266870 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-21db2f1e-b4d9-4af1-afa3-7710e52321cd tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:41:41.267855 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-21db2f1e-b4d9-4af1-afa3-7710e52321cd tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] [instance: 89e95d57-9d79-4632-b2fb-921e6bc80538] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:41:41.276418 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-21db2f1e-b4d9-4af1-afa3-7710e52321cd tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:41:41.276859 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-21db2f1e-b4d9-4af1-afa3-7710e52321cd tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:41:41.277612 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-21db2f1e-b4d9-4af1-afa3-7710e52321cd tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:41:41.278040 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-21db2f1e-b4d9-4af1-afa3-7710e52321cd tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:41:41.428363 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-21db2f1e-b4d9-4af1-afa3-7710e52321cd tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a846dc3c667140e99d476aa8722c9052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442ee828e66f48429daed7cd48385680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:41:41.436173 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-21db2f1e-b4d9-4af1-afa3-7710e52321cd tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] 10.222.0.48 "GET /compute/v2.1/servers/89e95d57-9d79-4632-b2fb-921e6bc80538" status: 200 len: 1574 microversion: 2.1 time: 0.175909 Jun 17 13:41:41.436743 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1820/3590] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:41:41 2022] GET /compute/v2.1/servers/89e95d57-9d79-4632-b2fb-921e6bc80538 => generated 1574 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:41:42.239908 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [req-42acd46b-463a-4e6d-b248-391c48f6d7b6 req-bc89b7be-3fcd-43d1-96a1-ea0beb19cee0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89e95d57-9d79-4632-b2fb-921e6bc80538", "name": "network-vif-plugged", "status": "completed", "tag": "5708d08c-7f64-44a5-8190-ffa61c858f93"}]} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:41:42.249047 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-42acd46b-463a-4e6d-b248-391c48f6d7b6 req-bc89b7be-3fcd-43d1-96a1-ea0beb19cee0 service nova] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:41:42.249469 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-42acd46b-463a-4e6d-b248-391c48f6d7b6 req-bc89b7be-3fcd-43d1-96a1-ea0beb19cee0 service nova] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:41:42.261965 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.compute.server_external_events [req-42acd46b-463a-4e6d-b248-391c48f6d7b6 req-bc89b7be-3fcd-43d1-96a1-ea0beb19cee0 service nova] Creating event network-vif-plugged:5708d08c-7f64-44a5-8190-ffa61c858f93 for instance 89e95d57-9d79-4632-b2fb-921e6bc80538 on hv-cinder-83754 Jun 17 13:41:42.267118 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [req-42acd46b-463a-4e6d-b248-391c48f6d7b6 req-bc89b7be-3fcd-43d1-96a1-ea0beb19cee0 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031114 Jun 17 13:41:42.267706 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1771/3591] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 13:41:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:41:42.453163 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-8ed81416-1ce5-4759-b32a-a9b03d2fde24 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:41:42.453713 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-8ed81416-1ce5-4759-b32a-a9b03d2fde24 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] [instance: 89e95d57-9d79-4632-b2fb-921e6bc80538] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:41:42.461945 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8ed81416-1ce5-4759-b32a-a9b03d2fde24 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:41:42.462433 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8ed81416-1ce5-4759-b32a-a9b03d2fde24 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:41:42.463227 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8ed81416-1ce5-4759-b32a-a9b03d2fde24 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:41:42.463804 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-8ed81416-1ce5-4759-b32a-a9b03d2fde24 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:41:42.657841 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-8ed81416-1ce5-4759-b32a-a9b03d2fde24 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a846dc3c667140e99d476aa8722c9052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442ee828e66f48429daed7cd48385680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:41:42.666350 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-8ed81416-1ce5-4759-b32a-a9b03d2fde24 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] 10.222.0.48 "GET /compute/v2.1/servers/89e95d57-9d79-4632-b2fb-921e6bc80538" status: 200 len: 1574 microversion: 2.1 time: 0.217010 Jun 17 13:41:42.666910 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1821/3592] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:41:42 2022] GET /compute/v2.1/servers/89e95d57-9d79-4632-b2fb-921e6bc80538 => generated 1574 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:41:43.689407 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-337b958c-26d4-4d6a-bd81-0628a2ddf1e7 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:41:43.690617 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-337b958c-26d4-4d6a-bd81-0628a2ddf1e7 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] [instance: 89e95d57-9d79-4632-b2fb-921e6bc80538] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:41:43.698815 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-337b958c-26d4-4d6a-bd81-0628a2ddf1e7 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:41:43.699263 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-337b958c-26d4-4d6a-bd81-0628a2ddf1e7 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:41:43.700018 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-337b958c-26d4-4d6a-bd81-0628a2ddf1e7 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:41:43.700470 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-337b958c-26d4-4d6a-bd81-0628a2ddf1e7 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:41:43.704538 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:41:43.849082 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-337b958c-26d4-4d6a-bd81-0628a2ddf1e7 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a846dc3c667140e99d476aa8722c9052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442ee828e66f48429daed7cd48385680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:41:43.857792 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-337b958c-26d4-4d6a-bd81-0628a2ddf1e7 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] 10.222.0.48 "GET /compute/v2.1/servers/89e95d57-9d79-4632-b2fb-921e6bc80538" status: 200 len: 1574 microversion: 2.1 time: 0.176308 Jun 17 13:41:43.858405 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1772/3593] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:41:43 2022] GET /compute/v2.1/servers/89e95d57-9d79-4632-b2fb-921e6bc80538 => generated 1574 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:41:44.880535 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-b75473d3-0218-4821-8266-d90f75500349 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:41:44.881651 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-b75473d3-0218-4821-8266-d90f75500349 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] [instance: 89e95d57-9d79-4632-b2fb-921e6bc80538] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:41:44.888520 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b75473d3-0218-4821-8266-d90f75500349 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:41:44.888949 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b75473d3-0218-4821-8266-d90f75500349 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:41:44.889743 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b75473d3-0218-4821-8266-d90f75500349 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:41:44.890354 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-b75473d3-0218-4821-8266-d90f75500349 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:41:45.126666 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-b75473d3-0218-4821-8266-d90f75500349 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a846dc3c667140e99d476aa8722c9052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442ee828e66f48429daed7cd48385680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:41:45.135346 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-b75473d3-0218-4821-8266-d90f75500349 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] 10.222.0.48 "GET /compute/v2.1/servers/89e95d57-9d79-4632-b2fb-921e6bc80538" status: 200 len: 1561 microversion: 2.1 time: 0.258749 Jun 17 13:41:45.142512 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1822/3594] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:41:44 2022] GET /compute/v2.1/servers/89e95d57-9d79-4632-b2fb-921e6bc80538 => generated 1561 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:42:07.312272 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-8a0e5070-ab1c-4677-883d-56bbdbe7887e tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:42:07.313194 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-8a0e5070-ab1c-4677-883d-56bbdbe7887e tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] [instance: 924b7379-78e3-412f-8264-26b4aa06b2d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:42:07.316559 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_api:SELECT=32 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:42:07.317269 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=4 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:42:07.327600 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8a0e5070-ab1c-4677-883d-56bbdbe7887e tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:42:07.328349 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8a0e5070-ab1c-4677-883d-56bbdbe7887e tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:42:07.329618 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8a0e5070-ab1c-4677-883d-56bbdbe7887e tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:42:07.330412 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8a0e5070-ab1c-4677-883d-56bbdbe7887e tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:42:07.360410 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-8a0e5070-ab1c-4677-883d-56bbdbe7887e tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] 10.222.0.48 "GET /compute/v2.1/servers/924b7379-78e3-412f-8264-26b4aa06b2d6/ips" status: 200 len: 150 microversion: 2.1 time: 0.054743 Jun 17 13:42:07.361114 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1773/3595] 10.222.0.48 () {58 vars in 1247 bytes} [Fri Jun 17 13:42:07 2022] GET /compute/v2.1/servers/924b7379-78e3-412f-8264-26b4aa06b2d6/ips => generated 150 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:42:08.735882 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-57d0f3d3-e034-46fd-a884-a4e750347185 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2c4c21c4-caec-4d01-9ca3-3d4723313802"}} {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:42:08.736949 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-57d0f3d3-e034-46fd-a884-a4e750347185 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] [instance: 924b7379-78e3-412f-8264-26b4aa06b2d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:42:08.739448 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_api:SELECT=30 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:42:08.740190 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_cell1:SELECT=86 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:42:08.746206 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-57d0f3d3-e034-46fd-a884-a4e750347185 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:42:08.746641 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-57d0f3d3-e034-46fd-a884-a4e750347185 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:42:08.747397 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-57d0f3d3-e034-46fd-a884-a4e750347185 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:42:08.747830 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-57d0f3d3-e034-46fd-a884-a4e750347185 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:42:09.014184 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-57d0f3d3-e034-46fd-a884-a4e750347185 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] 10.222.0.48 "POST /compute/v2.1/servers/924b7379-78e3-412f-8264-26b4aa06b2d6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.282067 Jun 17 13:42:09.014978 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1823/3596] 10.222.0.48 () {60 vars in 1322 bytes} [Fri Jun 17 13:42:08 2022] POST /compute/v2.1/servers/924b7379-78e3-412f-8264-26b4aa06b2d6/os-volume_attachments => generated 194 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:42:16.568348 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-b7a79344-e3a6-4f09-a94e-2b99a46a9a85 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Action: 'create', calling method: .version_select at 0x7f01948f1040>, body: {"keypair": {"name": "tempest-keypair-1895793200", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGu0NirkaHo5X813zGq8YpOskyafhW/QGAtZrL6Wccht8ZXwPefYojYp3N1BtdBpvqeoOaIMelz2Zuclhmb5e/hbTeAYMqOPFIuMeYG5y2U+YiYm9AMCLngqLhkHJ8W6WA=="}} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:42:16.584166 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.quota [None req-b7a79344-e3a6-4f09-a94e-2b99a46a9a85 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Getting quotas for project 082c995275404693ae4f1f686dd8fc92. Resources: {'key_pairs'} {{(pid=117660) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 13:42:16.598215 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.quota [None req-b7a79344-e3a6-4f09-a94e-2b99a46a9a85 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Getting quotas for user da449dd03e364eb0bebabd59bfe1d19c and project 082c995275404693ae4f1f686dd8fc92. Resources: {'key_pairs'} {{(pid=117660) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 13:42:16.625431 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-b7a79344-e3a6-4f09-a94e-2b99a46a9a85 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.061027 Jun 17 13:42:16.626005 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1774/3597] 10.222.0.48 () {60 vars in 1158 bytes} [Fri Jun 17 13:42:16 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:42:17.889971 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-619b80c8-f678-456d-8891-0dd208457524 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-172098600", "imageRef": "ccec3e37-1df8-4f10-a8f6-f97dfac54cf5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1181c118-9277-4f31-b5e1-8dddb2767aa8"}], "security_groups": [{"name": "tempest-securitygroup--783645420"}], "key_name": "tempest-keypair-1895793200", "user_data": "}} {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:42:17.995801 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.network.neutron [None req-619b80c8-f678-456d-8891-0dd208457524 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] validate_networks() for [('1181c118-9277-4f31-b5e1-8dddb2767aa8', None, None, None, None, None)] {{(pid=117659) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 17 13:42:18.431539 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.virt.hardware [None req-619b80c8-f678-456d-8891-0dd208457524 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Flavor limits 0:0:0 {{(pid=117659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 17 13:42:18.431967 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.virt.hardware [None req-619b80c8-f678-456d-8891-0dd208457524 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Image limits 0:0:0 {{(pid=117659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 17 13:42:18.432448 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.virt.hardware [None req-619b80c8-f678-456d-8891-0dd208457524 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Flavor pref 0:0:0 {{(pid=117659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 17 13:42:18.432898 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.virt.hardware [None req-619b80c8-f678-456d-8891-0dd208457524 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Image pref 0:0:0 {{(pid=117659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 17 13:42:18.433337 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.virt.hardware [None req-619b80c8-f678-456d-8891-0dd208457524 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 17 13:42:18.443749 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-619b80c8-f678-456d-8891-0dd208457524 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:42:18.444198 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-619b80c8-f678-456d-8891-0dd208457524 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:42:18.444997 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-619b80c8-f678-456d-8891-0dd208457524 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:42:18.445433 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-619b80c8-f678-456d-8891-0dd208457524 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:42:18.463585 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.quota [None req-619b80c8-f678-456d-8891-0dd208457524 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Getting quotas for project 082c995275404693ae4f1f686dd8fc92. Resources: {'ram', 'cores', 'instances'} {{(pid=117659) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 13:42:18.468133 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.quota [None req-619b80c8-f678-456d-8891-0dd208457524 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Getting quotas for user da449dd03e364eb0bebabd59bfe1d19c and project 082c995275404693ae4f1f686dd8fc92. Resources: {'ram', 'cores', 'instances'} {{(pid=117659) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 13:42:18.481099 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-619b80c8-f678-456d-8891-0dd208457524 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Going to run 1 instances... {{(pid=117659) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 17 13:42:18.483636 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-619b80c8-f678-456d-8891-0dd208457524 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] [instance: 7bfdb0c9-fbed-4d0c-bb40-89018219f4ac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ccec3e37-1df8-4f10-a8f6-f97dfac54cf5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117659) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 17 13:42:18.532970 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-619b80c8-f678-456d-8891-0dd208457524 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.647657 Jun 17 13:42:18.533624 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1824/3598] 10.222.0.48 () {60 vars in 1146 bytes} [Fri Jun 17 13:42:17 2022] POST /compute/v2.1/servers => generated 401 bytes in 649 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 17 13:42:18.544430 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-494e8411-3a1f-457a-ad9f-c12ad028fbce tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:42:18.545067 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-494e8411-3a1f-457a-ad9f-c12ad028fbce tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] [instance: 7bfdb0c9-fbed-4d0c-bb40-89018219f4ac] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:42:18.547044 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=4 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:42:18.608593 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-494e8411-3a1f-457a-ad9f-c12ad028fbce tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da449dd03e364eb0bebabd59bfe1d19c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '082c995275404693ae4f1f686dd8fc92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:42:18.615547 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-494e8411-3a1f-457a-ad9f-c12ad028fbce tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] 10.222.0.48 "GET /compute/v2.1/servers/7bfdb0c9-fbed-4d0c-bb40-89018219f4ac" status: 200 len: 1241 microversion: 2.1 time: 0.075222 Jun 17 13:42:18.616208 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1775/3599] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:42:18 2022] GET /compute/v2.1/servers/7bfdb0c9-fbed-4d0c-bb40-89018219f4ac => generated 1241 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:42:19.634474 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-7f5e9e41-4367-4280-9f74-6b1adadb3c7e tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:42:19.635719 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-7f5e9e41-4367-4280-9f74-6b1adadb3c7e tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] [instance: 7bfdb0c9-fbed-4d0c-bb40-89018219f4ac] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:42:19.642917 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7f5e9e41-4367-4280-9f74-6b1adadb3c7e tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:42:19.643631 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7f5e9e41-4367-4280-9f74-6b1adadb3c7e tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:42:19.644676 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7f5e9e41-4367-4280-9f74-6b1adadb3c7e tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:42:19.645249 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7f5e9e41-4367-4280-9f74-6b1adadb3c7e tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:42:19.727525 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-7f5e9e41-4367-4280-9f74-6b1adadb3c7e tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da449dd03e364eb0bebabd59bfe1d19c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '082c995275404693ae4f1f686dd8fc92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:42:19.738154 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-7f5e9e41-4367-4280-9f74-6b1adadb3c7e tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] 10.222.0.48 "GET /compute/v2.1/servers/7bfdb0c9-fbed-4d0c-bb40-89018219f4ac" status: 200 len: 1301 microversion: 2.1 time: 0.109341 Jun 17 13:42:19.738797 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1825/3600] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:42:19 2022] GET /compute/v2.1/servers/7bfdb0c9-fbed-4d0c-bb40-89018219f4ac => generated 1301 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:42:20.756449 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-294dbe7c-80a8-4127-9330-6c558d934219 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:42:20.757058 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-294dbe7c-80a8-4127-9330-6c558d934219 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] [instance: 7bfdb0c9-fbed-4d0c-bb40-89018219f4ac] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:42:20.763238 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-294dbe7c-80a8-4127-9330-6c558d934219 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:42:20.763700 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-294dbe7c-80a8-4127-9330-6c558d934219 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:42:20.764465 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-294dbe7c-80a8-4127-9330-6c558d934219 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:42:20.764900 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-294dbe7c-80a8-4127-9330-6c558d934219 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:42:20.985423 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-294dbe7c-80a8-4127-9330-6c558d934219 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da449dd03e364eb0bebabd59bfe1d19c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '082c995275404693ae4f1f686dd8fc92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:42:20.994198 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-294dbe7c-80a8-4127-9330-6c558d934219 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] 10.222.0.48 "GET /compute/v2.1/servers/7bfdb0c9-fbed-4d0c-bb40-89018219f4ac" status: 200 len: 1366 microversion: 2.1 time: 0.242337 Jun 17 13:42:20.995326 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1776/3601] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:42:20 2022] GET /compute/v2.1/servers/7bfdb0c9-fbed-4d0c-bb40-89018219f4ac => generated 1366 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:42:21.216810 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [req-b7079673-6697-4ab6-8a55-aceb6362e410 req-ad3c60e4-faca-4881-9775-f43b0f433d00 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7bfdb0c9-fbed-4d0c-bb40-89018219f4ac", "tag": "06f92b19-5756-41ce-9125-60cf502c77a3"}]} {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:42:21.237168 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [req-b7079673-6697-4ab6-8a55-aceb6362e410 req-ad3c60e4-faca-4881-9775-f43b0f433d00 service nova] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:42:21.239298 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [req-b7079673-6697-4ab6-8a55-aceb6362e410 req-ad3c60e4-faca-4881-9775-f43b0f433d00 service nova] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:42:21.260225 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.compute.server_external_events [req-b7079673-6697-4ab6-8a55-aceb6362e410 req-ad3c60e4-faca-4881-9775-f43b0f433d00 service nova] Creating event network-changed:06f92b19-5756-41ce-9125-60cf502c77a3 for instance 7bfdb0c9-fbed-4d0c-bb40-89018219f4ac on hv-cinder-83754 Jun 17 13:42:21.265261 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [req-b7079673-6697-4ab6-8a55-aceb6362e410 req-ad3c60e4-faca-4881-9775-f43b0f433d00 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054727 Jun 17 13:42:21.266330 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1826/3602] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 13:42:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:42:22.015316 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-bc3c37a7-4a73-4589-b9e9-e24b03c0aa26 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:42:22.016307 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-bc3c37a7-4a73-4589-b9e9-e24b03c0aa26 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] [instance: 7bfdb0c9-fbed-4d0c-bb40-89018219f4ac] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:42:22.027336 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bc3c37a7-4a73-4589-b9e9-e24b03c0aa26 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:42:22.028084 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bc3c37a7-4a73-4589-b9e9-e24b03c0aa26 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:42:22.029330 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bc3c37a7-4a73-4589-b9e9-e24b03c0aa26 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:42:22.030135 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bc3c37a7-4a73-4589-b9e9-e24b03c0aa26 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:42:22.163158 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-bc3c37a7-4a73-4589-b9e9-e24b03c0aa26 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da449dd03e364eb0bebabd59bfe1d19c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '082c995275404693ae4f1f686dd8fc92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:42:22.170738 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-bc3c37a7-4a73-4589-b9e9-e24b03c0aa26 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] 10.222.0.48 "GET /compute/v2.1/servers/7bfdb0c9-fbed-4d0c-bb40-89018219f4ac" status: 200 len: 1366 microversion: 2.1 time: 0.161919 Jun 17 13:42:22.171274 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1777/3603] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:42:22 2022] GET /compute/v2.1/servers/7bfdb0c9-fbed-4d0c-bb40-89018219f4ac => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:42:23.193642 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-654d704b-9f91-4251-96aa-f66d48d40dcb tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:42:23.194834 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-654d704b-9f91-4251-96aa-f66d48d40dcb tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] [instance: 7bfdb0c9-fbed-4d0c-bb40-89018219f4ac] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:42:23.205690 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-654d704b-9f91-4251-96aa-f66d48d40dcb tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:42:23.206506 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-654d704b-9f91-4251-96aa-f66d48d40dcb tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:42:23.207736 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-654d704b-9f91-4251-96aa-f66d48d40dcb tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:42:23.208560 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-654d704b-9f91-4251-96aa-f66d48d40dcb tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:42:23.355085 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-654d704b-9f91-4251-96aa-f66d48d40dcb tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da449dd03e364eb0bebabd59bfe1d19c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '082c995275404693ae4f1f686dd8fc92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:42:23.367547 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-654d704b-9f91-4251-96aa-f66d48d40dcb tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] 10.222.0.48 "GET /compute/v2.1/servers/7bfdb0c9-fbed-4d0c-bb40-89018219f4ac" status: 200 len: 1366 microversion: 2.1 time: 0.181540 Jun 17 13:42:23.368374 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1827/3604] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:42:23 2022] GET /compute/v2.1/servers/7bfdb0c9-fbed-4d0c-bb40-89018219f4ac => generated 1366 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:42:24.385526 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-91ddcd99-258d-4348-93b5-c5b27203149a tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:42:24.386734 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-91ddcd99-258d-4348-93b5-c5b27203149a tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] [instance: 7bfdb0c9-fbed-4d0c-bb40-89018219f4ac] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:42:24.394361 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-91ddcd99-258d-4348-93b5-c5b27203149a tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:42:24.394810 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-91ddcd99-258d-4348-93b5-c5b27203149a tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:42:24.395581 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-91ddcd99-258d-4348-93b5-c5b27203149a tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:42:24.396057 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-91ddcd99-258d-4348-93b5-c5b27203149a tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:42:24.564620 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-91ddcd99-258d-4348-93b5-c5b27203149a tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da449dd03e364eb0bebabd59bfe1d19c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '082c995275404693ae4f1f686dd8fc92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:42:24.576573 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-91ddcd99-258d-4348-93b5-c5b27203149a tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] 10.222.0.48 "GET /compute/v2.1/servers/7bfdb0c9-fbed-4d0c-bb40-89018219f4ac" status: 200 len: 1366 microversion: 2.1 time: 0.194651 Jun 17 13:42:24.577343 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1778/3605] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:42:24 2022] GET /compute/v2.1/servers/7bfdb0c9-fbed-4d0c-bb40-89018219f4ac => generated 1366 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:42:25.598501 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-e6417a80-8487-4fc4-bb7f-07fa7b5b1f50 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:42:25.599294 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-e6417a80-8487-4fc4-bb7f-07fa7b5b1f50 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] [instance: 7bfdb0c9-fbed-4d0c-bb40-89018219f4ac] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:42:25.606678 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e6417a80-8487-4fc4-bb7f-07fa7b5b1f50 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:42:25.607130 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e6417a80-8487-4fc4-bb7f-07fa7b5b1f50 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:42:25.607896 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e6417a80-8487-4fc4-bb7f-07fa7b5b1f50 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:42:25.608331 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-e6417a80-8487-4fc4-bb7f-07fa7b5b1f50 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:42:25.742744 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-e6417a80-8487-4fc4-bb7f-07fa7b5b1f50 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da449dd03e364eb0bebabd59bfe1d19c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '082c995275404693ae4f1f686dd8fc92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:42:25.750509 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-e6417a80-8487-4fc4-bb7f-07fa7b5b1f50 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] 10.222.0.48 "GET /compute/v2.1/servers/7bfdb0c9-fbed-4d0c-bb40-89018219f4ac" status: 200 len: 1366 microversion: 2.1 time: 0.158541 Jun 17 13:42:25.751079 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1828/3606] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:42:25 2022] GET /compute/v2.1/servers/7bfdb0c9-fbed-4d0c-bb40-89018219f4ac => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:42:26.390356 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [req-08dd882b-5ae0-41f1-875e-ebbbcb6e9b8e req-64d5b840-fc8e-4856-9d1f-ddf8737ea167 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7bfdb0c9-fbed-4d0c-bb40-89018219f4ac", "name": "network-vif-plugged", "status": "completed", "tag": "06f92b19-5756-41ce-9125-60cf502c77a3"}]} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:42:26.399718 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-08dd882b-5ae0-41f1-875e-ebbbcb6e9b8e req-64d5b840-fc8e-4856-9d1f-ddf8737ea167 service nova] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:42:26.400178 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-08dd882b-5ae0-41f1-875e-ebbbcb6e9b8e req-64d5b840-fc8e-4856-9d1f-ddf8737ea167 service nova] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:42:26.411702 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.compute.server_external_events [req-08dd882b-5ae0-41f1-875e-ebbbcb6e9b8e req-64d5b840-fc8e-4856-9d1f-ddf8737ea167 service nova] Creating event network-vif-plugged:06f92b19-5756-41ce-9125-60cf502c77a3 for instance 7bfdb0c9-fbed-4d0c-bb40-89018219f4ac on hv-cinder-83754 Jun 17 13:42:26.417170 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [req-08dd882b-5ae0-41f1-875e-ebbbcb6e9b8e req-64d5b840-fc8e-4856-9d1f-ddf8737ea167 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034929 Jun 17 13:42:26.417715 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1779/3607] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 13:42:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:42:26.768186 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-2676d739-c4a8-4251-acdb-9fb9091f7d3c tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:42:26.769045 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-2676d739-c4a8-4251-acdb-9fb9091f7d3c tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] [instance: 7bfdb0c9-fbed-4d0c-bb40-89018219f4ac] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:42:26.776296 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2676d739-c4a8-4251-acdb-9fb9091f7d3c tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:42:26.776748 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2676d739-c4a8-4251-acdb-9fb9091f7d3c tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:42:26.777507 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2676d739-c4a8-4251-acdb-9fb9091f7d3c tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:42:26.777940 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-2676d739-c4a8-4251-acdb-9fb9091f7d3c tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:42:26.926774 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-2676d739-c4a8-4251-acdb-9fb9091f7d3c tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da449dd03e364eb0bebabd59bfe1d19c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '082c995275404693ae4f1f686dd8fc92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:42:26.934851 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-2676d739-c4a8-4251-acdb-9fb9091f7d3c tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] 10.222.0.48 "GET /compute/v2.1/servers/7bfdb0c9-fbed-4d0c-bb40-89018219f4ac" status: 200 len: 1366 microversion: 2.1 time: 0.170743 Jun 17 13:42:26.935427 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1829/3608] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:42:26 2022] GET /compute/v2.1/servers/7bfdb0c9-fbed-4d0c-bb40-89018219f4ac => generated 1366 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:42:27.958768 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-fc0ad1ca-6026-4960-849c-9ce1e48d057e tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:42:27.960145 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-fc0ad1ca-6026-4960-849c-9ce1e48d057e tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] [instance: 7bfdb0c9-fbed-4d0c-bb40-89018219f4ac] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:42:27.970732 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fc0ad1ca-6026-4960-849c-9ce1e48d057e tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:42:27.971459 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fc0ad1ca-6026-4960-849c-9ce1e48d057e tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:42:27.972698 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fc0ad1ca-6026-4960-849c-9ce1e48d057e tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:42:27.973409 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fc0ad1ca-6026-4960-849c-9ce1e48d057e tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:42:28.107760 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-fc0ad1ca-6026-4960-849c-9ce1e48d057e tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da449dd03e364eb0bebabd59bfe1d19c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '082c995275404693ae4f1f686dd8fc92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:42:28.116240 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-fc0ad1ca-6026-4960-849c-9ce1e48d057e tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] 10.222.0.48 "GET /compute/v2.1/servers/7bfdb0c9-fbed-4d0c-bb40-89018219f4ac" status: 200 len: 1366 microversion: 2.1 time: 0.165549 Jun 17 13:42:28.116812 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1780/3609] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:42:27 2022] GET /compute/v2.1/servers/7bfdb0c9-fbed-4d0c-bb40-89018219f4ac => generated 1366 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:42:29.138081 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-ae4a8768-15f6-426b-ae94-a571f88d2800 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:42:29.139022 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-ae4a8768-15f6-426b-ae94-a571f88d2800 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] [instance: 7bfdb0c9-fbed-4d0c-bb40-89018219f4ac] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:42:29.142814 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_cell0:SELECT=2 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:42:29.143909 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_cell0:SELECT=6 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:42:29.151531 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ae4a8768-15f6-426b-ae94-a571f88d2800 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:42:29.151982 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ae4a8768-15f6-426b-ae94-a571f88d2800 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:42:29.152736 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ae4a8768-15f6-426b-ae94-a571f88d2800 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:42:29.153172 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-ae4a8768-15f6-426b-ae94-a571f88d2800 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:42:29.288609 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-ae4a8768-15f6-426b-ae94-a571f88d2800 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da449dd03e364eb0bebabd59bfe1d19c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '082c995275404693ae4f1f686dd8fc92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:42:29.296904 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-ae4a8768-15f6-426b-ae94-a571f88d2800 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] 10.222.0.48 "GET /compute/v2.1/servers/7bfdb0c9-fbed-4d0c-bb40-89018219f4ac" status: 200 len: 1557 microversion: 2.1 time: 0.165401 Jun 17 13:42:29.297480 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1830/3610] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:42:29 2022] GET /compute/v2.1/servers/7bfdb0c9-fbed-4d0c-bb40-89018219f4ac => generated 1557 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:42:29.314120 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-d6972990-bf3e-47b8-8572-c3fa8a2f7596 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:42:29.314599 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-d6972990-bf3e-47b8-8572-c3fa8a2f7596 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] [instance: 7bfdb0c9-fbed-4d0c-bb40-89018219f4ac] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:42:29.316625 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell0:SELECT=6 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:42:29.323392 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d6972990-bf3e-47b8-8572-c3fa8a2f7596 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:42:29.323838 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d6972990-bf3e-47b8-8572-c3fa8a2f7596 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:42:29.324601 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d6972990-bf3e-47b8-8572-c3fa8a2f7596 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:42:29.325034 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d6972990-bf3e-47b8-8572-c3fa8a2f7596 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:42:29.413760 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-d6972990-bf3e-47b8-8572-c3fa8a2f7596 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] 10.222.0.48 "GET /compute/v2.1/servers/7bfdb0c9-fbed-4d0c-bb40-89018219f4ac/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.103510 Jun 17 13:42:29.414390 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1781/3611] 10.222.0.48 () {58 vars in 1274 bytes} [Fri Jun 17 13:42:29 2022] GET /compute/v2.1/servers/7bfdb0c9-fbed-4d0c-bb40-89018219f4ac/os-interface => generated 285 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:42:30.405900 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [req-38402206-21af-4cf9-a632-84807572799d req-a7cbc5ec-f9c1-4dbd-9b83-2bdff7792a45 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7bfdb0c9-fbed-4d0c-bb40-89018219f4ac", "tag": "06f92b19-5756-41ce-9125-60cf502c77a3"}]} {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:42:30.414676 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [req-38402206-21af-4cf9-a632-84807572799d req-a7cbc5ec-f9c1-4dbd-9b83-2bdff7792a45 service nova] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:42:30.415109 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [req-38402206-21af-4cf9-a632-84807572799d req-a7cbc5ec-f9c1-4dbd-9b83-2bdff7792a45 service nova] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:42:30.428459 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.compute.server_external_events [req-38402206-21af-4cf9-a632-84807572799d req-a7cbc5ec-f9c1-4dbd-9b83-2bdff7792a45 service nova] Creating event network-changed:06f92b19-5756-41ce-9125-60cf502c77a3 for instance 7bfdb0c9-fbed-4d0c-bb40-89018219f4ac on hv-cinder-83754 Jun 17 13:42:30.433664 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [req-38402206-21af-4cf9-a632-84807572799d req-a7cbc5ec-f9c1-4dbd-9b83-2bdff7792a45 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031402 Jun 17 13:42:30.434469 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1831/3612] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 13:42:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:43:22.094118 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-7c6723cf-b67d-46f6-b923-2f047ed08ce7 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:43:22.094701 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:43:22.095549 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:43:22.095877 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-7c6723cf-b67d-46f6-b923-2f047ed08ce7 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] [instance: 89e95d57-9d79-4632-b2fb-921e6bc80538] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:43:22.099553 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:43:22.100271 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=30 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:43:22.107660 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7c6723cf-b67d-46f6-b923-2f047ed08ce7 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:43:22.108355 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7c6723cf-b67d-46f6-b923-2f047ed08ce7 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:43:22.109363 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7c6723cf-b67d-46f6-b923-2f047ed08ce7 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:43:22.109892 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7c6723cf-b67d-46f6-b923-2f047ed08ce7 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:43:22.139000 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-7c6723cf-b67d-46f6-b923-2f047ed08ce7 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] [instance: 89e95d57-9d79-4632-b2fb-921e6bc80538] Going to try to terminate instance {{(pid=117660) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 17 13:43:22.167868 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [req-3396207c-9076-4653-a23f-5e7ac1bcfb6d req-ecae2735-8b9b-4651-af49-a4c261adb5ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89e95d57-9d79-4632-b2fb-921e6bc80538", "tag": "5708d08c-7f64-44a5-8190-ffa61c858f93"}]} {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:43:22.176474 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [req-3396207c-9076-4653-a23f-5e7ac1bcfb6d req-ecae2735-8b9b-4651-af49-a4c261adb5ee service nova] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:43:22.176919 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [req-3396207c-9076-4653-a23f-5e7ac1bcfb6d req-ecae2735-8b9b-4651-af49-a4c261adb5ee service nova] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:43:22.188868 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.compute.server_external_events [req-3396207c-9076-4653-a23f-5e7ac1bcfb6d req-ecae2735-8b9b-4651-af49-a4c261adb5ee service nova] Creating event network-changed:5708d08c-7f64-44a5-8190-ffa61c858f93 for instance 89e95d57-9d79-4632-b2fb-921e6bc80538 on hv-cinder-83754 Jun 17 13:43:22.194971 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [req-3396207c-9076-4653-a23f-5e7ac1bcfb6d req-ecae2735-8b9b-4651-af49-a4c261adb5ee service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102170 Jun 17 13:43:22.196166 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1832/3613] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 13:43:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:43:22.230757 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-7c6723cf-b67d-46f6-b923-2f047ed08ce7 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] 10.222.0.48 "DELETE /compute/v2.1/servers/89e95d57-9d79-4632-b2fb-921e6bc80538" status: 204 len: 0 microversion: 2.1 time: 0.140403 Jun 17 13:43:22.231581 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1782/3614] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Jun 17 13:43:22 2022] DELETE /compute/v2.1/servers/89e95d57-9d79-4632-b2fb-921e6bc80538 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 17 13:43:22.240912 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-71bdd742-d35e-4f53-a167-e17dc5db03af tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:43:22.242148 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-71bdd742-d35e-4f53-a167-e17dc5db03af tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] [instance: 89e95d57-9d79-4632-b2fb-921e6bc80538] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:43:22.249779 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-71bdd742-d35e-4f53-a167-e17dc5db03af tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:43:22.250520 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-71bdd742-d35e-4f53-a167-e17dc5db03af tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:43:22.251708 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-71bdd742-d35e-4f53-a167-e17dc5db03af tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:43:22.252344 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-71bdd742-d35e-4f53-a167-e17dc5db03af tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:43:22.406412 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-71bdd742-d35e-4f53-a167-e17dc5db03af tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a846dc3c667140e99d476aa8722c9052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442ee828e66f48429daed7cd48385680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:43:22.414959 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-71bdd742-d35e-4f53-a167-e17dc5db03af tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] 10.222.0.48 "GET /compute/v2.1/servers/89e95d57-9d79-4632-b2fb-921e6bc80538" status: 200 len: 1567 microversion: 2.1 time: 0.178849 Jun 17 13:43:22.415538 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1833/3615] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:43:22 2022] GET /compute/v2.1/servers/89e95d57-9d79-4632-b2fb-921e6bc80538 => generated 1567 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:43:23.433808 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-7ff709ce-5deb-494d-b047-b20208e4a8e6 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:43:23.434695 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-7ff709ce-5deb-494d-b047-b20208e4a8e6 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] [instance: 89e95d57-9d79-4632-b2fb-921e6bc80538] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:43:23.441624 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7ff709ce-5deb-494d-b047-b20208e4a8e6 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:43:23.442117 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7ff709ce-5deb-494d-b047-b20208e4a8e6 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:43:23.442870 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7ff709ce-5deb-494d-b047-b20208e4a8e6 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:43:23.443305 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7ff709ce-5deb-494d-b047-b20208e4a8e6 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:43:23.632942 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-7ff709ce-5deb-494d-b047-b20208e4a8e6 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a846dc3c667140e99d476aa8722c9052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442ee828e66f48429daed7cd48385680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:43:23.640589 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-7ff709ce-5deb-494d-b047-b20208e4a8e6 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] 10.222.0.48 "GET /compute/v2.1/servers/89e95d57-9d79-4632-b2fb-921e6bc80538" status: 200 len: 1567 microversion: 2.1 time: 0.211107 Jun 17 13:43:23.641152 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1783/3616] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:43:23 2022] GET /compute/v2.1/servers/89e95d57-9d79-4632-b2fb-921e6bc80538 => generated 1567 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:43:24.658637 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-006927cc-c2fc-495b-90ba-78039a083ea4 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:43:24.659239 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-006927cc-c2fc-495b-90ba-78039a083ea4 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] [instance: 89e95d57-9d79-4632-b2fb-921e6bc80538] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:43:24.666551 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-006927cc-c2fc-495b-90ba-78039a083ea4 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:43:24.667003 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-006927cc-c2fc-495b-90ba-78039a083ea4 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:43:24.667844 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-006927cc-c2fc-495b-90ba-78039a083ea4 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:43:24.668398 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [req-045f654e-beec-4363-a3b6-8da65f865145 req-b86c1f1a-7c2b-439e-bd8c-a82a74f6065b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89e95d57-9d79-4632-b2fb-921e6bc80538", "name": "network-vif-deleted", "tag": "5708d08c-7f64-44a5-8190-ffa61c858f93"}]} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:43:24.669319 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-006927cc-c2fc-495b-90ba-78039a083ea4 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:43:24.677416 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-045f654e-beec-4363-a3b6-8da65f865145 req-b86c1f1a-7c2b-439e-bd8c-a82a74f6065b service nova] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:43:24.677862 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-045f654e-beec-4363-a3b6-8da65f865145 req-b86c1f1a-7c2b-439e-bd8c-a82a74f6065b service nova] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:43:24.689790 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.compute.server_external_events [req-045f654e-beec-4363-a3b6-8da65f865145 req-b86c1f1a-7c2b-439e-bd8c-a82a74f6065b service nova] Creating event network-vif-deleted:5708d08c-7f64-44a5-8190-ffa61c858f93 for instance 89e95d57-9d79-4632-b2fb-921e6bc80538 on hv-cinder-83754 Jun 17 13:43:24.695365 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [req-045f654e-beec-4363-a3b6-8da65f865145 req-b86c1f1a-7c2b-439e-bd8c-a82a74f6065b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030715 Jun 17 13:43:24.696271 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1784/3617] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 13:43:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 13:43:24.740449 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-006927cc-c2fc-495b-90ba-78039a083ea4 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a846dc3c667140e99d476aa8722c9052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442ee828e66f48429daed7cd48385680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:43:24.748125 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-006927cc-c2fc-495b-90ba-78039a083ea4 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] 10.222.0.48 "GET /compute/v2.1/servers/89e95d57-9d79-4632-b2fb-921e6bc80538" status: 200 len: 1380 microversion: 2.1 time: 0.093633 Jun 17 13:43:24.748679 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1834/3618] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:43:24 2022] GET /compute/v2.1/servers/89e95d57-9d79-4632-b2fb-921e6bc80538 => generated 1380 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:43:25.768227 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-ea4311f9-241c-46fe-8438-8507282bee92 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:43:25.769198 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-ea4311f9-241c-46fe-8438-8507282bee92 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] [instance: 89e95d57-9d79-4632-b2fb-921e6bc80538] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:43:25.777895 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ea4311f9-241c-46fe-8438-8507282bee92 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:43:25.778515 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ea4311f9-241c-46fe-8438-8507282bee92 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:43:25.779506 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ea4311f9-241c-46fe-8438-8507282bee92 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:43:25.780071 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ea4311f9-241c-46fe-8438-8507282bee92 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:43:25.794663 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.wsgi [None req-ea4311f9-241c-46fe-8438-8507282bee92 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] HTTP exception thrown: Instance 89e95d57-9d79-4632-b2fb-921e6bc80538 could not be found. Jun 17 13:43:25.796288 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-ea4311f9-241c-46fe-8438-8507282bee92 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Request method failure captured: Jun 17 13:43:25.796288 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: request: GET /compute/v2.1/servers/89e95d57-9d79-4632-b2fb-921e6bc80538 HTTP/1.1 Jun 17 13:43:25.796288 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Accept: application/json Jun 17 13:43:25.796288 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Accept-Encoding: identity Jun 17 13:43:25.796288 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Connection: close Jun 17 13:43:25.796288 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Content-Length: 0 Jun 17 13:43:25.796288 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Content-Type: application/json Jun 17 13:43:25.796288 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Host: 10.222.0.48 Jun 17 13:43:25.796288 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Openstack-System-Scope: None Jun 17 13:43:25.796288 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: User-Agent: python-urllib3/1.26.9 Jun 17 13:43:25.796288 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Auth-Token: gAAAAABirIO-sPS9ugiA-myOMtpjCIJ1tQdbTEsBNrrTbhlczaOn5O03cA_0Sq0dxgXaH41RzRpv1z1MKPvZHKOu-qBTEFeIxQRWQ88BHKfRvIr_vusHwoo9YeGg2n7OVPCQ_LYQk42Lex6wQOfjzKWZrJFhaCJEL-D3S4SOQcLCAEK2HiQGxi8 Jun 17 13:43:25.796288 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Domain-Id: None Jun 17 13:43:25.796288 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Domain-Name: None Jun 17 13:43:25.796288 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Identity-Status: Confirmed Jun 17 13:43:25.796288 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Is-Admin-Project: True Jun 17 13:43:25.796288 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Project-Domain-Id: default Jun 17 13:43:25.796288 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Project-Domain-Name: Default Jun 17 13:43:25.796288 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Project-Id: 442ee828e66f48429daed7cd48385680 Jun 17 13:43:25.796288 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Project-Name: tempest-TestShelveInstance-1033040251 Jun 17 13:43:25.796288 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Role: member,reader Jun 17 13:43:25.796288 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Roles: member,reader Jun 17 13:43:25.797618 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_442ee828e66f48429daed7cd48385680", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/442ee828e66f48429daed7cd48385680"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/442ee828e66f48429daed7cd48385680"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/442ee828e66f48429daed7cd48385680"}]}] Jun 17 13:43:25.797618 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Tenant: tempest-TestShelveInstance-1033040251 Jun 17 13:43:25.797618 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Tenant-Id: 442ee828e66f48429daed7cd48385680 Jun 17 13:43:25.797618 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Tenant-Name: tempest-TestShelveInstance-1033040251 Jun 17 13:43:25.797618 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-User: tempest-TestShelveInstance-1033040251-project Jun 17 13:43:25.797618 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-User-Domain-Id: default Jun 17 13:43:25.797618 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-User-Domain-Name: Default Jun 17 13:43:25.797618 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-User-Id: a846dc3c667140e99d476aa8722c9052 Jun 17 13:43:25.797618 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-User-Name: tempest-TestShelveInstance-1033040251-project Jun 17 13:43:25.797618 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: method: > Jun 17 13:43:25.797618 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: exception: Instance 89e95d57-9d79-4632-b2fb-921e6bc80538 could not be found. Jun 17 13:43:25.797618 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: action_args: {'id': '89e95d57-9d79-4632-b2fb-921e6bc80538'} Jun 17 13:43:25.798387 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 13:43:25.798387 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:43:25.798387 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 13:43:25.798387 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 13:43:25.798387 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 13:43:25.798387 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 13:43:25.798387 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 13:43:25.798387 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 13:43:25.798387 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 13:43:25.798387 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 13:43:25.798387 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89e95d57-9d79-4632-b2fb-921e6bc80538 could not be found. Jun 17 13:43:25.798387 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 13:43:25.798387 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:43:25.798387 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 13:43:25.798387 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:43:25.798387 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:43:25.798387 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:43:25.798387 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 13:43:25.798387 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 13:43:25.798387 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 13:43:25.799882 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 13:43:25.799882 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 13:43:25.799882 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 13:43:25.799882 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 13:43:25.799882 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 13:43:25.799882 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 13:43:25.799882 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 13:43:25.799882 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89e95d57-9d79-4632-b2fb-921e6bc80538 could not be found. Jun 17 13:43:25.799882 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 13:43:25.799882 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:43:25.799882 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 13:43:25.799882 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:43:25.799882 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:43:25.799882 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:43:25.799882 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 13:43:25.799882 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 13:43:25.799882 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89e95d57-9d79-4632-b2fb-921e6bc80538 could not be found. Jun 17 13:43:25.799882 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 13:43:25.801269 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-ea4311f9-241c-46fe-8438-8507282bee92 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Returning 404 to user: Instance 89e95d57-9d79-4632-b2fb-921e6bc80538 could not be found. {{(pid=117660) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 13:43:25.801269 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-ea4311f9-241c-46fe-8438-8507282bee92 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] 10.222.0.48 "GET /compute/v2.1/servers/89e95d57-9d79-4632-b2fb-921e6bc80538" status: 404 len: 111 microversion: 2.1 time: 0.035701 Jun 17 13:43:25.801269 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1785/3619] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:43:25 2022] GET /compute/v2.1/servers/89e95d57-9d79-4632-b2fb-921e6bc80538 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 13:43:25.963926 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-c2adb549-7bc5-40b2-a367-c0f0a74d3cd3 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] Calling method '.version_select at 0x7f0183fbbf70>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:43:25.987989 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-c2adb549-7bc5-40b2-a367-c0f0a74d3cd3 tempest-TestShelveInstance-1033040251 tempest-TestShelveInstance-1033040251-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-930884631" status: 202 len: 0 microversion: 2.1 time: 0.027929 Jun 17 13:43:25.988590 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1835/3620] 10.222.0.48 () {58 vars in 1250 bytes} [Fri Jun 17 13:43:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-930884631 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 13:43:45.712351 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-74cd9cd9-7c50-4388-be73-7023cf6a6fdf tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:43:45.712906 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-74cd9cd9-7c50-4388-be73-7023cf6a6fdf tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] [instance: 7bfdb0c9-fbed-4d0c-bb40-89018219f4ac] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:43:45.715556 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:43:45.716275 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:43:45.721639 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-74cd9cd9-7c50-4388-be73-7023cf6a6fdf tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:43:45.722078 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-74cd9cd9-7c50-4388-be73-7023cf6a6fdf tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:43:45.722850 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-74cd9cd9-7c50-4388-be73-7023cf6a6fdf tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:43:45.723277 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-74cd9cd9-7c50-4388-be73-7023cf6a6fdf tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:43:45.748375 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-74cd9cd9-7c50-4388-be73-7023cf6a6fdf tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] 10.222.0.48 "GET /compute/v2.1/servers/7bfdb0c9-fbed-4d0c-bb40-89018219f4ac/ips" status: 200 len: 151 microversion: 2.1 time: 0.040279 Jun 17 13:43:45.748936 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1786/3621] 10.222.0.48 () {58 vars in 1247 bytes} [Fri Jun 17 13:43:45 2022] GET /compute/v2.1/servers/7bfdb0c9-fbed-4d0c-bb40-89018219f4ac/ips => generated 151 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:43:45.757106 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_cell1:SELECT=14 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:43:45.757856 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:43:45.762476 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-38cca30c-ad06-4bd8-9dda-4c0a8ba97fd5 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2c4c21c4-caec-4d01-9ca3-3d4723313802"}} {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:43:45.763536 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-38cca30c-ad06-4bd8-9dda-4c0a8ba97fd5 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] [instance: 7bfdb0c9-fbed-4d0c-bb40-89018219f4ac] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:43:45.772097 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-38cca30c-ad06-4bd8-9dda-4c0a8ba97fd5 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:43:45.772604 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-38cca30c-ad06-4bd8-9dda-4c0a8ba97fd5 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:43:45.773451 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-38cca30c-ad06-4bd8-9dda-4c0a8ba97fd5 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:43:45.773896 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-38cca30c-ad06-4bd8-9dda-4c0a8ba97fd5 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:43:45.860420 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.wsgi [None req-38cca30c-ad06-4bd8-9dda-4c0a8ba97fd5 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] HTTP exception thrown: Invalid volume: volume 2c4c21c4-caec-4d01-9ca3-3d4723313802 is already attached to instances: 924b7379-78e3-412f-8264-26b4aa06b2d6 Jun 17 13:43:45.862198 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-38cca30c-ad06-4bd8-9dda-4c0a8ba97fd5 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Request method failure captured: Jun 17 13:43:45.862198 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: request: POST /compute/v2.1/servers/7bfdb0c9-fbed-4d0c-bb40-89018219f4ac/os-volume_attachments HTTP/1.1 Jun 17 13:43:45.862198 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Accept: application/json Jun 17 13:43:45.862198 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Accept-Encoding: identity Jun 17 13:43:45.862198 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Connection: close Jun 17 13:43:45.862198 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Content-Length: 74 Jun 17 13:43:45.862198 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Content-Type: application/json Jun 17 13:43:45.862198 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Host: 10.222.0.48 Jun 17 13:43:45.862198 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Openstack-System-Scope: None Jun 17 13:43:45.862198 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: User-Agent: python-urllib3/1.26.9 Jun 17 13:43:45.862198 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Auth-Token: gAAAAABirIRP33kbNc95wQnxZWaHkbIgOW-PC62z_-SPHiqRMyAyyNpDibqzQRov5iswTxwKrFY6HzWqyyJx4eCc6ieRXhm1AsWGCJLm5d50w3GfYQXsn14MemaWj2ArtY6MULK9ImPI2Hy4bwlxQyKmwR6WiLIiU3IKmg-dNxx33oAqk5oHKKk Jun 17 13:43:45.862198 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Domain-Id: None Jun 17 13:43:45.862198 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Domain-Name: None Jun 17 13:43:45.862198 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Identity-Status: Confirmed Jun 17 13:43:45.862198 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Is-Admin-Project: True Jun 17 13:43:45.862198 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Project-Domain-Id: default Jun 17 13:43:45.862198 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Project-Domain-Name: Default Jun 17 13:43:45.862198 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Project-Id: 082c995275404693ae4f1f686dd8fc92 Jun 17 13:43:45.862198 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Project-Name: tempest-AttachVolumeNegativeTest-17794193 Jun 17 13:43:45.862198 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Role: member,reader Jun 17 13:43:45.862198 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Roles: member,reader Jun 17 13:43:45.863617 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_082c995275404693ae4f1f686dd8fc92", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/082c995275404693ae4f1f686dd8fc92"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/082c995275404693ae4f1f686dd8fc92"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/082c995275404693ae4f1f686dd8fc92"}]}] Jun 17 13:43:45.863617 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Tenant: tempest-AttachVolumeNegativeTest-17794193 Jun 17 13:43:45.863617 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Tenant-Id: 082c995275404693ae4f1f686dd8fc92 Jun 17 13:43:45.863617 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-17794193 Jun 17 13:43:45.863617 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User: tempest-AttachVolumeNegativeTest-17794193-project Jun 17 13:43:45.863617 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User-Domain-Id: default Jun 17 13:43:45.863617 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User-Domain-Name: Default Jun 17 13:43:45.863617 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User-Id: da449dd03e364eb0bebabd59bfe1d19c Jun 17 13:43:45.863617 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User-Name: tempest-AttachVolumeNegativeTest-17794193-project Jun 17 13:43:45.863617 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Jun 17 13:43:45.863617 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: {"volumeAttachment": {"volumeId": "2c4c21c4-caec-4d01-9ca3-3d4723313802"}} Jun 17 13:43:45.863617 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: method: > Jun 17 13:43:45.864426 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: exception: Invalid volume: volume 2c4c21c4-caec-4d01-9ca3-3d4723313802 is already attached to instances: 924b7379-78e3-412f-8264-26b4aa06b2d6 Jun 17 13:43:45.864426 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: action_args: {'server_id': '7bfdb0c9-fbed-4d0c-bb40-89018219f4ac', 'body': {'volumeAttachment': {'volumeId': '2c4c21c4-caec-4d01-9ca3-3d4723313802'}}} Jun 17 13:43:45.864426 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 13:43:45.864426 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:43:45.864426 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 17 13:43:45.864426 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 17 13:43:45.864426 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 17 13:43:45.864426 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 17 13:43:45.864426 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 17 13:43:45.864426 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 17 13:43:45.864426 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 17 13:43:45.864426 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 17 13:43:45.864426 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 17 13:43:45.864426 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 17 13:43:45.864426 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 2c4c21c4-caec-4d01-9ca3-3d4723313802 is already attached to instances: 924b7379-78e3-412f-8264-26b4aa06b2d6 Jun 17 13:43:45.864426 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:43:45.864426 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:43:45.864426 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:43:45.864426 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:43:45.865978 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:43:45.865978 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:43:45.865978 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 13:43:45.865978 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 13:43:45.865978 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 13:43:45.865978 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 13:43:45.865978 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 17 13:43:45.865978 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 17 13:43:45.865978 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 17 13:43:45.865978 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 17 13:43:45.865978 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 17 13:43:45.865978 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 17 13:43:45.865978 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 17 13:43:45.865978 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 17 13:43:45.865978 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 2c4c21c4-caec-4d01-9ca3-3d4723313802 is already attached to instances: 924b7379-78e3-412f-8264-26b4aa06b2d6 Jun 17 13:43:45.865978 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:43:45.865978 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:43:45.865978 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:43:45.865978 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:43:45.865978 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:43:45.867571 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:43:45.867571 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 13:43:45.867571 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 13:43:45.867571 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 2c4c21c4-caec-4d01-9ca3-3d4723313802 is already attached to instances: 924b7379-78e3-412f-8264-26b4aa06b2d6 Jun 17 13:43:45.867571 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:43:45.867571 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-38cca30c-ad06-4bd8-9dda-4c0a8ba97fd5 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Returning 400 to user: Invalid volume: volume 2c4c21c4-caec-4d01-9ca3-3d4723313802 is already attached to instances: 924b7379-78e3-412f-8264-26b4aa06b2d6 {{(pid=117659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 13:43:45.867571 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-38cca30c-ad06-4bd8-9dda-4c0a8ba97fd5 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] 10.222.0.48 "POST /compute/v2.1/servers/7bfdb0c9-fbed-4d0c-bb40-89018219f4ac/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.107967 Jun 17 13:43:45.867571 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1836/3622] 10.222.0.48 () {60 vars in 1322 bytes} [Fri Jun 17 13:43:45 2022] POST /compute/v2.1/servers/7bfdb0c9-fbed-4d0c-bb40-89018219f4ac/os-volume_attachments => generated 174 bytes in 109 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 17 13:43:45.872496 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-3ee754fc-d983-41cc-90ac-50cd422c6d81 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:43:45.873000 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-3ee754fc-d983-41cc-90ac-50cd422c6d81 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] [instance: 7bfdb0c9-fbed-4d0c-bb40-89018219f4ac] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:43:45.879206 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3ee754fc-d983-41cc-90ac-50cd422c6d81 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:43:45.879657 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3ee754fc-d983-41cc-90ac-50cd422c6d81 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:43:45.880496 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3ee754fc-d983-41cc-90ac-50cd422c6d81 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:43:45.880933 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3ee754fc-d983-41cc-90ac-50cd422c6d81 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:43:45.907231 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-3ee754fc-d983-41cc-90ac-50cd422c6d81 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] [instance: 7bfdb0c9-fbed-4d0c-bb40-89018219f4ac] Going to try to terminate instance {{(pid=117660) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 17 13:43:45.992411 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-3ee754fc-d983-41cc-90ac-50cd422c6d81 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] 10.222.0.48 "DELETE /compute/v2.1/servers/7bfdb0c9-fbed-4d0c-bb40-89018219f4ac" status: 204 len: 0 microversion: 2.1 time: 0.123446 Jun 17 13:43:45.992957 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1787/3623] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Jun 17 13:43:45 2022] DELETE /compute/v2.1/servers/7bfdb0c9-fbed-4d0c-bb40-89018219f4ac => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 17 13:43:46.001443 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-73224b02-6a72-4cd8-a7b4-0d2e1b788ca1 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:43:46.002065 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-73224b02-6a72-4cd8-a7b4-0d2e1b788ca1 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] [instance: 7bfdb0c9-fbed-4d0c-bb40-89018219f4ac] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:43:46.008918 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-73224b02-6a72-4cd8-a7b4-0d2e1b788ca1 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:43:46.009400 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-73224b02-6a72-4cd8-a7b4-0d2e1b788ca1 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:43:46.010188 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-73224b02-6a72-4cd8-a7b4-0d2e1b788ca1 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:43:46.010622 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-73224b02-6a72-4cd8-a7b4-0d2e1b788ca1 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:43:46.145713 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-73224b02-6a72-4cd8-a7b4-0d2e1b788ca1 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da449dd03e364eb0bebabd59bfe1d19c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '082c995275404693ae4f1f686dd8fc92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:43:46.153447 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-73224b02-6a72-4cd8-a7b4-0d2e1b788ca1 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] 10.222.0.48 "GET /compute/v2.1/servers/7bfdb0c9-fbed-4d0c-bb40-89018219f4ac" status: 200 len: 1682 microversion: 2.1 time: 0.156060 Jun 17 13:43:46.154032 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1837/3624] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:43:45 2022] GET /compute/v2.1/servers/7bfdb0c9-fbed-4d0c-bb40-89018219f4ac => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 13:43:47.180064 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-7bd4ef52-72f6-4d6b-8045-34faf15e0978 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:43:47.180829 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-7bd4ef52-72f6-4d6b-8045-34faf15e0978 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] [instance: 7bfdb0c9-fbed-4d0c-bb40-89018219f4ac] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:43:47.188290 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7bd4ef52-72f6-4d6b-8045-34faf15e0978 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:43:47.188745 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7bd4ef52-72f6-4d6b-8045-34faf15e0978 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:43:47.189602 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7bd4ef52-72f6-4d6b-8045-34faf15e0978 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:43:47.190038 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7bd4ef52-72f6-4d6b-8045-34faf15e0978 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:43:47.327332 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-7bd4ef52-72f6-4d6b-8045-34faf15e0978 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da449dd03e364eb0bebabd59bfe1d19c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '082c995275404693ae4f1f686dd8fc92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:43:47.335211 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-7bd4ef52-72f6-4d6b-8045-34faf15e0978 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] 10.222.0.48 "GET /compute/v2.1/servers/7bfdb0c9-fbed-4d0c-bb40-89018219f4ac" status: 200 len: 1682 microversion: 2.1 time: 0.160908 Jun 17 13:43:47.335776 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1788/3625] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:43:47 2022] GET /compute/v2.1/servers/7bfdb0c9-fbed-4d0c-bb40-89018219f4ac => generated 1682 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:43:48.353532 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-334daed1-e508-432f-8302-8931fc25de3d tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:43:48.354855 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-334daed1-e508-432f-8302-8931fc25de3d tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] [instance: 7bfdb0c9-fbed-4d0c-bb40-89018219f4ac] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:43:48.361865 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-334daed1-e508-432f-8302-8931fc25de3d tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:43:48.362395 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-334daed1-e508-432f-8302-8931fc25de3d tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:43:48.363170 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-334daed1-e508-432f-8302-8931fc25de3d tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:43:48.363630 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-334daed1-e508-432f-8302-8931fc25de3d tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:43:48.433958 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-334daed1-e508-432f-8302-8931fc25de3d tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da449dd03e364eb0bebabd59bfe1d19c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '082c995275404693ae4f1f686dd8fc92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:43:48.442026 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-334daed1-e508-432f-8302-8931fc25de3d tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] 10.222.0.48 "GET /compute/v2.1/servers/7bfdb0c9-fbed-4d0c-bb40-89018219f4ac" status: 200 len: 1615 microversion: 2.1 time: 0.092828 Jun 17 13:43:48.443350 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1838/3626] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:43:48 2022] GET /compute/v2.1/servers/7bfdb0c9-fbed-4d0c-bb40-89018219f4ac => generated 1615 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:43:48.522811 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [req-981dd73a-f946-453c-8441-2675cff4e54f req-cb33fa48-ec5f-495d-9c31-62c3960c9081 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7bfdb0c9-fbed-4d0c-bb40-89018219f4ac", "name": "network-vif-deleted", "tag": "06f92b19-5756-41ce-9125-60cf502c77a3"}]} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:43:48.532386 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-981dd73a-f946-453c-8441-2675cff4e54f req-cb33fa48-ec5f-495d-9c31-62c3960c9081 service nova] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:43:48.532913 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-981dd73a-f946-453c-8441-2675cff4e54f req-cb33fa48-ec5f-495d-9c31-62c3960c9081 service nova] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:43:48.546436 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.compute.server_external_events [req-981dd73a-f946-453c-8441-2675cff4e54f req-cb33fa48-ec5f-495d-9c31-62c3960c9081 service nova] Creating event network-vif-deleted:06f92b19-5756-41ce-9125-60cf502c77a3 for instance 7bfdb0c9-fbed-4d0c-bb40-89018219f4ac on hv-cinder-83754 Jun 17 13:43:48.552252 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [req-981dd73a-f946-453c-8441-2675cff4e54f req-cb33fa48-ec5f-495d-9c31-62c3960c9081 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034699 Jun 17 13:43:48.552844 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1789/3627] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 13:43:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:43:49.462066 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-74bcb3a3-b6b6-4ade-ba7c-7c2125501abe tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:43:49.462983 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-74bcb3a3-b6b6-4ade-ba7c-7c2125501abe tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] [instance: 7bfdb0c9-fbed-4d0c-bb40-89018219f4ac] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:43:49.470434 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-74bcb3a3-b6b6-4ade-ba7c-7c2125501abe tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:43:49.471027 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-74bcb3a3-b6b6-4ade-ba7c-7c2125501abe tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:43:49.471787 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-74bcb3a3-b6b6-4ade-ba7c-7c2125501abe tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:43:49.472292 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-74bcb3a3-b6b6-4ade-ba7c-7c2125501abe tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:43:49.489170 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.wsgi [None req-74bcb3a3-b6b6-4ade-ba7c-7c2125501abe tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] HTTP exception thrown: Instance 7bfdb0c9-fbed-4d0c-bb40-89018219f4ac could not be found. Jun 17 13:43:49.490768 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-74bcb3a3-b6b6-4ade-ba7c-7c2125501abe tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Request method failure captured: Jun 17 13:43:49.490768 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: request: GET /compute/v2.1/servers/7bfdb0c9-fbed-4d0c-bb40-89018219f4ac HTTP/1.1 Jun 17 13:43:49.490768 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Accept: application/json Jun 17 13:43:49.490768 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Accept-Encoding: identity Jun 17 13:43:49.490768 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Connection: close Jun 17 13:43:49.490768 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Content-Length: 0 Jun 17 13:43:49.490768 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Content-Type: application/json Jun 17 13:43:49.490768 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Host: 10.222.0.48 Jun 17 13:43:49.490768 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Openstack-System-Scope: None Jun 17 13:43:49.490768 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: User-Agent: python-urllib3/1.26.9 Jun 17 13:43:49.490768 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Auth-Token: gAAAAABirIRP33kbNc95wQnxZWaHkbIgOW-PC62z_-SPHiqRMyAyyNpDibqzQRov5iswTxwKrFY6HzWqyyJx4eCc6ieRXhm1AsWGCJLm5d50w3GfYQXsn14MemaWj2ArtY6MULK9ImPI2Hy4bwlxQyKmwR6WiLIiU3IKmg-dNxx33oAqk5oHKKk Jun 17 13:43:49.490768 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Domain-Id: None Jun 17 13:43:49.490768 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Domain-Name: None Jun 17 13:43:49.490768 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Identity-Status: Confirmed Jun 17 13:43:49.490768 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Is-Admin-Project: True Jun 17 13:43:49.490768 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Project-Domain-Id: default Jun 17 13:43:49.490768 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Project-Domain-Name: Default Jun 17 13:43:49.490768 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Project-Id: 082c995275404693ae4f1f686dd8fc92 Jun 17 13:43:49.490768 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Project-Name: tempest-AttachVolumeNegativeTest-17794193 Jun 17 13:43:49.490768 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Role: member,reader Jun 17 13:43:49.490768 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Roles: member,reader Jun 17 13:43:49.492172 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_082c995275404693ae4f1f686dd8fc92", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/082c995275404693ae4f1f686dd8fc92"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/082c995275404693ae4f1f686dd8fc92"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/082c995275404693ae4f1f686dd8fc92"}]}] Jun 17 13:43:49.492172 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Tenant: tempest-AttachVolumeNegativeTest-17794193 Jun 17 13:43:49.492172 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Tenant-Id: 082c995275404693ae4f1f686dd8fc92 Jun 17 13:43:49.492172 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-17794193 Jun 17 13:43:49.492172 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User: tempest-AttachVolumeNegativeTest-17794193-project Jun 17 13:43:49.492172 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User-Domain-Id: default Jun 17 13:43:49.492172 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User-Domain-Name: Default Jun 17 13:43:49.492172 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User-Id: da449dd03e364eb0bebabd59bfe1d19c Jun 17 13:43:49.492172 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User-Name: tempest-AttachVolumeNegativeTest-17794193-project Jun 17 13:43:49.492172 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: method: > Jun 17 13:43:49.492172 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: exception: Instance 7bfdb0c9-fbed-4d0c-bb40-89018219f4ac could not be found. Jun 17 13:43:49.492172 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: action_args: {'id': '7bfdb0c9-fbed-4d0c-bb40-89018219f4ac'} Jun 17 13:43:49.492997 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 13:43:49.492997 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:43:49.492997 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 13:43:49.492997 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 13:43:49.492997 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 13:43:49.492997 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 13:43:49.492997 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 13:43:49.492997 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 13:43:49.492997 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 13:43:49.492997 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 13:43:49.492997 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7bfdb0c9-fbed-4d0c-bb40-89018219f4ac could not be found. Jun 17 13:43:49.492997 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:43:49.492997 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:43:49.492997 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:43:49.492997 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:43:49.492997 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:43:49.492997 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:43:49.492997 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 13:43:49.492997 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 13:43:49.492997 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 13:43:49.494434 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 13:43:49.494434 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 13:43:49.494434 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 13:43:49.494434 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 13:43:49.494434 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 13:43:49.494434 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 13:43:49.494434 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 13:43:49.494434 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7bfdb0c9-fbed-4d0c-bb40-89018219f4ac could not be found. Jun 17 13:43:49.494434 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:43:49.494434 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:43:49.494434 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:43:49.494434 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:43:49.494434 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:43:49.494434 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:43:49.494434 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 13:43:49.494434 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 13:43:49.494434 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7bfdb0c9-fbed-4d0c-bb40-89018219f4ac could not be found. Jun 17 13:43:49.494434 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:43:49.495725 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-74bcb3a3-b6b6-4ade-ba7c-7c2125501abe tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Returning 404 to user: Instance 7bfdb0c9-fbed-4d0c-bb40-89018219f4ac could not be found. {{(pid=117659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 13:43:49.495725 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-74bcb3a3-b6b6-4ade-ba7c-7c2125501abe tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] 10.222.0.48 "GET /compute/v2.1/servers/7bfdb0c9-fbed-4d0c-bb40-89018219f4ac" status: 404 len: 111 microversion: 2.1 time: 0.035865 Jun 17 13:43:49.495725 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1839/3628] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:43:49 2022] GET /compute/v2.1/servers/7bfdb0c9-fbed-4d0c-bb40-89018219f4ac => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 13:43:49.502775 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-6330abe5-c70d-464e-8a91-8986006c8277 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Calling method '.version_select at 0x7f0183dffee0>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:43:49.523041 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-6330abe5-c70d-464e-8a91-8986006c8277 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1895793200" status: 202 len: 0 microversion: 2.1 time: 0.024387 Jun 17 13:43:49.523882 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1790/3629] 10.222.0.48 () {58 vars in 1220 bytes} [Fri Jun 17 13:43:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1895793200 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 13:43:50.209564 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-00b5cffa-9b58-4e13-a6b0-599954b025a2 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:43:50.210058 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-00b5cffa-9b58-4e13-a6b0-599954b025a2 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] [instance: 924b7379-78e3-412f-8264-26b4aa06b2d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:43:50.216596 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-00b5cffa-9b58-4e13-a6b0-599954b025a2 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:43:50.217045 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-00b5cffa-9b58-4e13-a6b0-599954b025a2 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:43:50.217806 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-00b5cffa-9b58-4e13-a6b0-599954b025a2 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:43:50.218284 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-00b5cffa-9b58-4e13-a6b0-599954b025a2 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:43:50.303328 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.objects.instance [None req-00b5cffa-9b58-4e13-a6b0-599954b025a2 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lazy-loading 'services' on Instance uuid 924b7379-78e3-412f-8264-26b4aa06b2d6 {{(pid=117659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 13:43:50.380375 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-00b5cffa-9b58-4e13-a6b0-599954b025a2 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] 10.222.0.48 "DELETE /compute/v2.1/servers/924b7379-78e3-412f-8264-26b4aa06b2d6/os-volume_attachments/2c4c21c4-caec-4d01-9ca3-3d4723313802" status: 202 len: 0 microversion: 2.1 time: 0.174972 Jun 17 13:43:50.380987 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1840/3630] 10.222.0.48 () {58 vars in 1415 bytes} [Fri Jun 17 13:43:50 2022] DELETE /compute/v2.1/servers/924b7379-78e3-412f-8264-26b4aa06b2d6/os-volume_attachments/2c4c21c4-caec-4d01-9ca3-3d4723313802 => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 13:43:50.390028 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-36ab7287-bd92-4c65-9baf-0497e1c9c0ec tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:43:50.391162 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-36ab7287-bd92-4c65-9baf-0497e1c9c0ec tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] [instance: 924b7379-78e3-412f-8264-26b4aa06b2d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:43:50.400320 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-36ab7287-bd92-4c65-9baf-0497e1c9c0ec tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:43:50.400830 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-36ab7287-bd92-4c65-9baf-0497e1c9c0ec tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:43:50.401991 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-36ab7287-bd92-4c65-9baf-0497e1c9c0ec tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:43:50.402440 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-36ab7287-bd92-4c65-9baf-0497e1c9c0ec tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:43:50.435613 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-36ab7287-bd92-4c65-9baf-0497e1c9c0ec tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] 10.222.0.48 "GET /compute/v2.1/servers/924b7379-78e3-412f-8264-26b4aa06b2d6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049695 Jun 17 13:43:50.436145 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1791/3631] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:43:50 2022] GET /compute/v2.1/servers/924b7379-78e3-412f-8264-26b4aa06b2d6/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:43:51.449769 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-404dfdfc-38af-4ac0-96e9-94f30869b637 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:43:51.450890 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-404dfdfc-38af-4ac0-96e9-94f30869b637 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] [instance: 924b7379-78e3-412f-8264-26b4aa06b2d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:43:51.457542 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-404dfdfc-38af-4ac0-96e9-94f30869b637 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:43:51.458369 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-404dfdfc-38af-4ac0-96e9-94f30869b637 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:43:51.459146 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-404dfdfc-38af-4ac0-96e9-94f30869b637 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:43:51.459579 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-404dfdfc-38af-4ac0-96e9-94f30869b637 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:43:51.491154 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-404dfdfc-38af-4ac0-96e9-94f30869b637 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] 10.222.0.48 "GET /compute/v2.1/servers/924b7379-78e3-412f-8264-26b4aa06b2d6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046717 Jun 17 13:43:51.491917 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1841/3632] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:43:51 2022] GET /compute/v2.1/servers/924b7379-78e3-412f-8264-26b4aa06b2d6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:43:52.503753 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-8cea7ac7-a010-41f4-b738-4b82bf481692 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:43:52.504682 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-8cea7ac7-a010-41f4-b738-4b82bf481692 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] [instance: 924b7379-78e3-412f-8264-26b4aa06b2d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:43:52.512404 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8cea7ac7-a010-41f4-b738-4b82bf481692 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:43:52.512854 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8cea7ac7-a010-41f4-b738-4b82bf481692 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:43:52.513617 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8cea7ac7-a010-41f4-b738-4b82bf481692 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:43:52.514339 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8cea7ac7-a010-41f4-b738-4b82bf481692 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:43:52.544547 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-8cea7ac7-a010-41f4-b738-4b82bf481692 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] 10.222.0.48 "GET /compute/v2.1/servers/924b7379-78e3-412f-8264-26b4aa06b2d6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044827 Jun 17 13:43:52.545143 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1792/3633] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:43:52 2022] GET /compute/v2.1/servers/924b7379-78e3-412f-8264-26b4aa06b2d6/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 17 13:43:52.612993 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-153a51ff-4ce1-4d3b-9c74-e609908ffde8 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:43:52.613726 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-153a51ff-4ce1-4d3b-9c74-e609908ffde8 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] [instance: 924b7379-78e3-412f-8264-26b4aa06b2d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:43:52.622911 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-153a51ff-4ce1-4d3b-9c74-e609908ffde8 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:43:52.623614 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-153a51ff-4ce1-4d3b-9c74-e609908ffde8 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:43:52.624499 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-153a51ff-4ce1-4d3b-9c74-e609908ffde8 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:43:52.625084 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-153a51ff-4ce1-4d3b-9c74-e609908ffde8 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:43:52.652668 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-153a51ff-4ce1-4d3b-9c74-e609908ffde8 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] [instance: 924b7379-78e3-412f-8264-26b4aa06b2d6] Going to try to terminate instance {{(pid=117659) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 17 13:43:52.734302 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-153a51ff-4ce1-4d3b-9c74-e609908ffde8 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] 10.222.0.48 "DELETE /compute/v2.1/servers/924b7379-78e3-412f-8264-26b4aa06b2d6" status: 204 len: 0 microversion: 2.1 time: 0.126967 Jun 17 13:43:52.734877 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1842/3634] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Jun 17 13:43:52 2022] DELETE /compute/v2.1/servers/924b7379-78e3-412f-8264-26b4aa06b2d6 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 17 13:43:52.743236 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-f1f84408-1563-4be8-b9fb-ee821d57d136 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:43:52.743842 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-f1f84408-1563-4be8-b9fb-ee821d57d136 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] [instance: 924b7379-78e3-412f-8264-26b4aa06b2d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:43:52.749893 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f1f84408-1563-4be8-b9fb-ee821d57d136 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:43:52.750373 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f1f84408-1563-4be8-b9fb-ee821d57d136 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:43:52.751116 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f1f84408-1563-4be8-b9fb-ee821d57d136 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:43:52.751545 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f1f84408-1563-4be8-b9fb-ee821d57d136 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:43:52.887933 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-f1f84408-1563-4be8-b9fb-ee821d57d136 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da449dd03e364eb0bebabd59bfe1d19c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '082c995275404693ae4f1f686dd8fc92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:43:52.898600 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-f1f84408-1563-4be8-b9fb-ee821d57d136 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] 10.222.0.48 "GET /compute/v2.1/servers/924b7379-78e3-412f-8264-26b4aa06b2d6" status: 200 len: 1682 microversion: 2.1 time: 0.159179 Jun 17 13:43:52.899169 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1793/3635] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:43:52 2022] GET /compute/v2.1/servers/924b7379-78e3-412f-8264-26b4aa06b2d6 => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:43:53.921250 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-fc49c3fc-98e5-4bb3-a3de-4e6d697a8ee0 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:43:53.923387 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-fc49c3fc-98e5-4bb3-a3de-4e6d697a8ee0 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] [instance: 924b7379-78e3-412f-8264-26b4aa06b2d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:43:53.931952 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-fc49c3fc-98e5-4bb3-a3de-4e6d697a8ee0 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:43:53.932397 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-fc49c3fc-98e5-4bb3-a3de-4e6d697a8ee0 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:43:53.933151 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-fc49c3fc-98e5-4bb3-a3de-4e6d697a8ee0 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:43:53.933583 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-fc49c3fc-98e5-4bb3-a3de-4e6d697a8ee0 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:43:54.079099 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-fc49c3fc-98e5-4bb3-a3de-4e6d697a8ee0 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da449dd03e364eb0bebabd59bfe1d19c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '082c995275404693ae4f1f686dd8fc92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:43:54.089828 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-fc49c3fc-98e5-4bb3-a3de-4e6d697a8ee0 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] 10.222.0.48 "GET /compute/v2.1/servers/924b7379-78e3-412f-8264-26b4aa06b2d6" status: 200 len: 1682 microversion: 2.1 time: 0.175536 Jun 17 13:43:54.090685 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1843/3636] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:43:53 2022] GET /compute/v2.1/servers/924b7379-78e3-412f-8264-26b4aa06b2d6 => generated 1682 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:43:55.110970 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-a9fdb440-671f-482f-bb67-3e642460375d tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:43:55.112222 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-a9fdb440-671f-482f-bb67-3e642460375d tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] [instance: 924b7379-78e3-412f-8264-26b4aa06b2d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:43:55.119141 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a9fdb440-671f-482f-bb67-3e642460375d tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:43:55.119585 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a9fdb440-671f-482f-bb67-3e642460375d tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:43:55.120389 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a9fdb440-671f-482f-bb67-3e642460375d tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:43:55.120765 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a9fdb440-671f-482f-bb67-3e642460375d tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:43:55.186793 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-a9fdb440-671f-482f-bb67-3e642460375d tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da449dd03e364eb0bebabd59bfe1d19c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '082c995275404693ae4f1f686dd8fc92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:43:55.195084 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-a9fdb440-671f-482f-bb67-3e642460375d tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] 10.222.0.48 "GET /compute/v2.1/servers/924b7379-78e3-412f-8264-26b4aa06b2d6" status: 200 len: 1614 microversion: 2.1 time: 0.088012 Jun 17 13:43:55.195576 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1794/3637] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:43:55 2022] GET /compute/v2.1/servers/924b7379-78e3-412f-8264-26b4aa06b2d6 => generated 1614 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:43:55.403362 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [req-23c33d89-8113-41f9-9471-cb946dfac851 req-0626162c-6955-4ec6-acde-8a4fc70976b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "924b7379-78e3-412f-8264-26b4aa06b2d6", "name": "network-vif-deleted", "tag": "a876efdd-2c01-4351-ac03-ab112ff48744"}]} {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:43:55.414672 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [req-23c33d89-8113-41f9-9471-cb946dfac851 req-0626162c-6955-4ec6-acde-8a4fc70976b4 service nova] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:43:55.415226 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [req-23c33d89-8113-41f9-9471-cb946dfac851 req-0626162c-6955-4ec6-acde-8a4fc70976b4 service nova] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:43:55.426719 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.compute.server_external_events [req-23c33d89-8113-41f9-9471-cb946dfac851 req-0626162c-6955-4ec6-acde-8a4fc70976b4 service nova] Creating event network-vif-deleted:a876efdd-2c01-4351-ac03-ab112ff48744 for instance 924b7379-78e3-412f-8264-26b4aa06b2d6 on hv-cinder-83754 Jun 17 13:43:55.432706 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [req-23c33d89-8113-41f9-9471-cb946dfac851 req-0626162c-6955-4ec6-acde-8a4fc70976b4 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032788 Jun 17 13:43:55.433463 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1844/3638] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 13:43:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:43:56.213072 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-bbb6b898-ec54-418c-889f-629ef744995c tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:43:56.213618 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-bbb6b898-ec54-418c-889f-629ef744995c tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] [instance: 924b7379-78e3-412f-8264-26b4aa06b2d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:43:56.221020 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bbb6b898-ec54-418c-889f-629ef744995c tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:43:56.221548 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bbb6b898-ec54-418c-889f-629ef744995c tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:43:56.222423 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bbb6b898-ec54-418c-889f-629ef744995c tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:43:56.222857 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bbb6b898-ec54-418c-889f-629ef744995c tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:43:56.237805 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.wsgi [None req-bbb6b898-ec54-418c-889f-629ef744995c tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] HTTP exception thrown: Instance 924b7379-78e3-412f-8264-26b4aa06b2d6 could not be found. Jun 17 13:43:56.239858 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-bbb6b898-ec54-418c-889f-629ef744995c tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Request method failure captured: Jun 17 13:43:56.239858 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: request: GET /compute/v2.1/servers/924b7379-78e3-412f-8264-26b4aa06b2d6 HTTP/1.1 Jun 17 13:43:56.239858 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Accept: application/json Jun 17 13:43:56.239858 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Accept-Encoding: identity Jun 17 13:43:56.239858 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Connection: close Jun 17 13:43:56.239858 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Content-Length: 0 Jun 17 13:43:56.239858 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Content-Type: application/json Jun 17 13:43:56.239858 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Host: 10.222.0.48 Jun 17 13:43:56.239858 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Openstack-System-Scope: None Jun 17 13:43:56.239858 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: User-Agent: python-urllib3/1.26.9 Jun 17 13:43:56.239858 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Auth-Token: gAAAAABirIRP33kbNc95wQnxZWaHkbIgOW-PC62z_-SPHiqRMyAyyNpDibqzQRov5iswTxwKrFY6HzWqyyJx4eCc6ieRXhm1AsWGCJLm5d50w3GfYQXsn14MemaWj2ArtY6MULK9ImPI2Hy4bwlxQyKmwR6WiLIiU3IKmg-dNxx33oAqk5oHKKk Jun 17 13:43:56.239858 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Domain-Id: None Jun 17 13:43:56.239858 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Domain-Name: None Jun 17 13:43:56.239858 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Identity-Status: Confirmed Jun 17 13:43:56.239858 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Is-Admin-Project: True Jun 17 13:43:56.239858 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Project-Domain-Id: default Jun 17 13:43:56.239858 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Project-Domain-Name: Default Jun 17 13:43:56.239858 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Project-Id: 082c995275404693ae4f1f686dd8fc92 Jun 17 13:43:56.239858 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Project-Name: tempest-AttachVolumeNegativeTest-17794193 Jun 17 13:43:56.239858 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Role: member,reader Jun 17 13:43:56.239858 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Roles: member,reader Jun 17 13:43:56.241370 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_082c995275404693ae4f1f686dd8fc92", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/082c995275404693ae4f1f686dd8fc92"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/082c995275404693ae4f1f686dd8fc92"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/082c995275404693ae4f1f686dd8fc92"}]}] Jun 17 13:43:56.241370 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Tenant: tempest-AttachVolumeNegativeTest-17794193 Jun 17 13:43:56.241370 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Tenant-Id: 082c995275404693ae4f1f686dd8fc92 Jun 17 13:43:56.241370 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-17794193 Jun 17 13:43:56.241370 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-User: tempest-AttachVolumeNegativeTest-17794193-project Jun 17 13:43:56.241370 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-User-Domain-Id: default Jun 17 13:43:56.241370 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-User-Domain-Name: Default Jun 17 13:43:56.241370 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-User-Id: da449dd03e364eb0bebabd59bfe1d19c Jun 17 13:43:56.241370 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-User-Name: tempest-AttachVolumeNegativeTest-17794193-project Jun 17 13:43:56.241370 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: method: > Jun 17 13:43:56.241370 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: exception: Instance 924b7379-78e3-412f-8264-26b4aa06b2d6 could not be found. Jun 17 13:43:56.241370 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: action_args: {'id': '924b7379-78e3-412f-8264-26b4aa06b2d6'} Jun 17 13:43:56.242144 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 13:43:56.242144 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:43:56.242144 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 13:43:56.242144 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 13:43:56.242144 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 13:43:56.242144 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 13:43:56.242144 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 13:43:56.242144 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 13:43:56.242144 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 13:43:56.242144 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 13:43:56.242144 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 924b7379-78e3-412f-8264-26b4aa06b2d6 could not be found. Jun 17 13:43:56.242144 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 13:43:56.242144 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:43:56.242144 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 13:43:56.242144 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:43:56.242144 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:43:56.242144 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:43:56.242144 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 13:43:56.242144 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 13:43:56.242144 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 13:43:56.243268 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 13:43:56.243268 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 13:43:56.243268 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 13:43:56.243268 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 13:43:56.243268 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 13:43:56.243268 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 13:43:56.243268 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 13:43:56.243268 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 924b7379-78e3-412f-8264-26b4aa06b2d6 could not be found. Jun 17 13:43:56.243268 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 13:43:56.243268 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:43:56.243268 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 13:43:56.243268 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:43:56.243268 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:43:56.243268 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:43:56.243268 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 13:43:56.243268 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 13:43:56.243268 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 924b7379-78e3-412f-8264-26b4aa06b2d6 could not be found. Jun 17 13:43:56.243268 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 13:43:56.244281 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-bbb6b898-ec54-418c-889f-629ef744995c tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Returning 404 to user: Instance 924b7379-78e3-412f-8264-26b4aa06b2d6 could not be found. {{(pid=117660) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 13:43:56.244281 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-bbb6b898-ec54-418c-889f-629ef744995c tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] 10.222.0.48 "GET /compute/v2.1/servers/924b7379-78e3-412f-8264-26b4aa06b2d6" status: 404 len: 111 microversion: 2.1 time: 0.032190 Jun 17 13:43:56.244281 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1795/3639] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:43:56 2022] GET /compute/v2.1/servers/924b7379-78e3-412f-8264-26b4aa06b2d6 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 13:43:56.251070 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-ec9c7bc5-f5c8-4ee1-9183-73da3a965450 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Calling method '.version_select at 0x7f019004a9d0>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:43:56.271485 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-ec9c7bc5-f5c8-4ee1-9183-73da3a965450 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1640334333" status: 202 len: 0 microversion: 2.1 time: 0.024493 Jun 17 13:43:56.272237 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1845/3640] 10.222.0.48 () {58 vars in 1220 bytes} [Fri Jun 17 13:43:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1640334333 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 13:43:56.896503 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-9d460457-03b4-45fb-9104-d0afc1672c72 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Action: 'create', calling method: .version_select at 0x7f01948f1f70>, body: {"keypair": {"name": "tempest-keypair-703628065", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHe0ebSx3V3mUoKLxKQjJ3iAvgiJQ4MrD0zDjp7wgdSCpiRGqcrXrlGQsYC3j2fGfNnXEngNDQpQCEeblEz1oq+wOTOugYjDtUbAOMoqW8LyzmH4JKydXhdT/HxX2ZPcBg=="}} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:43:56.911321 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.quota [None req-9d460457-03b4-45fb-9104-d0afc1672c72 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Getting quotas for project 082c995275404693ae4f1f686dd8fc92. Resources: {'key_pairs'} {{(pid=117660) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 13:43:56.915225 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.quota [None req-9d460457-03b4-45fb-9104-d0afc1672c72 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Getting quotas for user da449dd03e364eb0bebabd59bfe1d19c and project 082c995275404693ae4f1f686dd8fc92. Resources: {'key_pairs'} {{(pid=117660) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 13:43:56.942464 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-9d460457-03b4-45fb-9104-d0afc1672c72 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.049787 Jun 17 13:43:56.944331 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1796/3641] 10.222.0.48 () {60 vars in 1158 bytes} [Fri Jun 17 13:43:56 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:43:58.301994 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-9b585193-fab8-41b8-be28-e410d74a75c6 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1295698402", "imageRef": "ccec3e37-1df8-4f10-a8f6-f97dfac54cf5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1181c118-9277-4f31-b5e1-8dddb2767aa8"}], "security_groups": [{"name": "tempest-securitygroup--311500524"}], "key_name": "tempest-keypair-703628065", "user_data": "}} {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:43:58.413026 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.network.neutron [None req-9b585193-fab8-41b8-be28-e410d74a75c6 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] validate_networks() for [('1181c118-9277-4f31-b5e1-8dddb2767aa8', None, None, None, None, None)] {{(pid=117659) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 17 13:43:58.799187 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.virt.hardware [None req-9b585193-fab8-41b8-be28-e410d74a75c6 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Flavor limits 0:0:0 {{(pid=117659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 17 13:43:58.799777 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.virt.hardware [None req-9b585193-fab8-41b8-be28-e410d74a75c6 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Image limits 0:0:0 {{(pid=117659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 17 13:43:58.800639 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.virt.hardware [None req-9b585193-fab8-41b8-be28-e410d74a75c6 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Flavor pref 0:0:0 {{(pid=117659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 17 13:43:58.801231 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.virt.hardware [None req-9b585193-fab8-41b8-be28-e410d74a75c6 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Image pref 0:0:0 {{(pid=117659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 17 13:43:58.801750 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.virt.hardware [None req-9b585193-fab8-41b8-be28-e410d74a75c6 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 17 13:43:58.815661 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9b585193-fab8-41b8-be28-e410d74a75c6 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:43:58.816284 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9b585193-fab8-41b8-be28-e410d74a75c6 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:43:58.817499 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9b585193-fab8-41b8-be28-e410d74a75c6 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:43:58.818008 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9b585193-fab8-41b8-be28-e410d74a75c6 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:43:58.835370 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.quota [None req-9b585193-fab8-41b8-be28-e410d74a75c6 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Getting quotas for project 082c995275404693ae4f1f686dd8fc92. Resources: {'ram', 'cores', 'instances'} {{(pid=117659) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 13:43:58.839724 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.quota [None req-9b585193-fab8-41b8-be28-e410d74a75c6 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Getting quotas for user da449dd03e364eb0bebabd59bfe1d19c and project 082c995275404693ae4f1f686dd8fc92. Resources: {'ram', 'cores', 'instances'} {{(pid=117659) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 13:43:58.851528 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-9b585193-fab8-41b8-be28-e410d74a75c6 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Going to run 1 instances... {{(pid=117659) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 17 13:43:58.854274 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-9b585193-fab8-41b8-be28-e410d74a75c6 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] [instance: 7ea58164-2a61-4c41-a8cc-0235e03dde98] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ccec3e37-1df8-4f10-a8f6-f97dfac54cf5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117659) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 17 13:43:58.908046 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-9b585193-fab8-41b8-be28-e410d74a75c6 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.610865 Jun 17 13:43:58.908734 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1846/3642] 10.222.0.48 () {60 vars in 1146 bytes} [Fri Jun 17 13:43:58 2022] POST /compute/v2.1/servers => generated 401 bytes in 612 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 17 13:43:58.919614 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-3f09f8f1-b432-41d4-b1a3-e723ce4dfaac tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:43:58.920357 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-3f09f8f1-b432-41d4-b1a3-e723ce4dfaac tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] [instance: 7ea58164-2a61-4c41-a8cc-0235e03dde98] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:43:58.981367 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-3f09f8f1-b432-41d4-b1a3-e723ce4dfaac tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da449dd03e364eb0bebabd59bfe1d19c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '082c995275404693ae4f1f686dd8fc92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:43:58.988097 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-3f09f8f1-b432-41d4-b1a3-e723ce4dfaac tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] 10.222.0.48 "GET /compute/v2.1/servers/7ea58164-2a61-4c41-a8cc-0235e03dde98" status: 200 len: 1241 microversion: 2.1 time: 0.072563 Jun 17 13:43:58.988639 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1797/3643] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:43:58 2022] GET /compute/v2.1/servers/7ea58164-2a61-4c41-a8cc-0235e03dde98 => generated 1241 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:44:00.005579 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-1c4f75fc-2bbe-42cf-932b-232842a87dab tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:44:00.006245 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-1c4f75fc-2bbe-42cf-932b-232842a87dab tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] [instance: 7ea58164-2a61-4c41-a8cc-0235e03dde98] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:44:00.012922 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-1c4f75fc-2bbe-42cf-932b-232842a87dab tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:44:00.013363 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-1c4f75fc-2bbe-42cf-932b-232842a87dab tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:44:00.014211 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-1c4f75fc-2bbe-42cf-932b-232842a87dab tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:44:00.014668 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-1c4f75fc-2bbe-42cf-932b-232842a87dab tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:44:00.080633 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-1c4f75fc-2bbe-42cf-932b-232842a87dab tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da449dd03e364eb0bebabd59bfe1d19c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '082c995275404693ae4f1f686dd8fc92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:44:00.088889 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-1c4f75fc-2bbe-42cf-932b-232842a87dab tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] 10.222.0.48 "GET /compute/v2.1/servers/7ea58164-2a61-4c41-a8cc-0235e03dde98" status: 200 len: 1311 microversion: 2.1 time: 0.087789 Jun 17 13:44:00.089456 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1847/3644] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:43:59 2022] GET /compute/v2.1/servers/7ea58164-2a61-4c41-a8cc-0235e03dde98 => generated 1311 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:44:01.106705 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-ee5a7cf9-9fc8-4e80-8242-0b34fea0f273 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:44:01.107266 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-ee5a7cf9-9fc8-4e80-8242-0b34fea0f273 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] [instance: 7ea58164-2a61-4c41-a8cc-0235e03dde98] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:44:01.117055 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ee5a7cf9-9fc8-4e80-8242-0b34fea0f273 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:44:01.117686 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ee5a7cf9-9fc8-4e80-8242-0b34fea0f273 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:44:01.118788 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ee5a7cf9-9fc8-4e80-8242-0b34fea0f273 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:44:01.119422 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ee5a7cf9-9fc8-4e80-8242-0b34fea0f273 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:44:01.262693 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-ee5a7cf9-9fc8-4e80-8242-0b34fea0f273 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da449dd03e364eb0bebabd59bfe1d19c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '082c995275404693ae4f1f686dd8fc92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:44:01.270830 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-ee5a7cf9-9fc8-4e80-8242-0b34fea0f273 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] 10.222.0.48 "GET /compute/v2.1/servers/7ea58164-2a61-4c41-a8cc-0235e03dde98" status: 200 len: 1366 microversion: 2.1 time: 0.168454 Jun 17 13:44:01.271736 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1798/3645] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:44:01 2022] GET /compute/v2.1/servers/7ea58164-2a61-4c41-a8cc-0235e03dde98 => generated 1366 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:44:01.409248 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [req-ca55e420-52eb-4992-8bb8-7eb50a55f9ca req-25d317dc-e16f-456e-88a9-a72de9df0ecb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ea58164-2a61-4c41-a8cc-0235e03dde98", "tag": "c53bdd3c-18b5-4bb8-8b0f-00e934dc8453"}]} {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:44:01.420792 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [req-ca55e420-52eb-4992-8bb8-7eb50a55f9ca req-25d317dc-e16f-456e-88a9-a72de9df0ecb service nova] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:44:01.421549 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [req-ca55e420-52eb-4992-8bb8-7eb50a55f9ca req-25d317dc-e16f-456e-88a9-a72de9df0ecb service nova] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:44:01.434466 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.compute.server_external_events [req-ca55e420-52eb-4992-8bb8-7eb50a55f9ca req-25d317dc-e16f-456e-88a9-a72de9df0ecb service nova] Creating event network-changed:c53bdd3c-18b5-4bb8-8b0f-00e934dc8453 for instance 7ea58164-2a61-4c41-a8cc-0235e03dde98 on hv-cinder-83754 Jun 17 13:44:01.439461 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [req-ca55e420-52eb-4992-8bb8-7eb50a55f9ca req-25d317dc-e16f-456e-88a9-a72de9df0ecb service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033870 Jun 17 13:44:01.440232 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1848/3646] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 13:44:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:44:02.290106 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-a9425807-466b-4185-ab9c-f3e3d7015440 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:44:02.290738 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-a9425807-466b-4185-ab9c-f3e3d7015440 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] [instance: 7ea58164-2a61-4c41-a8cc-0235e03dde98] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:44:02.297809 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a9425807-466b-4185-ab9c-f3e3d7015440 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:44:02.298280 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a9425807-466b-4185-ab9c-f3e3d7015440 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:44:02.299053 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a9425807-466b-4185-ab9c-f3e3d7015440 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:44:02.299479 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a9425807-466b-4185-ab9c-f3e3d7015440 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:44:02.447371 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-a9425807-466b-4185-ab9c-f3e3d7015440 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da449dd03e364eb0bebabd59bfe1d19c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '082c995275404693ae4f1f686dd8fc92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:44:02.458646 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-a9425807-466b-4185-ab9c-f3e3d7015440 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] 10.222.0.48 "GET /compute/v2.1/servers/7ea58164-2a61-4c41-a8cc-0235e03dde98" status: 200 len: 1366 microversion: 2.1 time: 0.172721 Jun 17 13:44:02.459377 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1799/3647] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:44:02 2022] GET /compute/v2.1/servers/7ea58164-2a61-4c41-a8cc-0235e03dde98 => generated 1366 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:44:03.486023 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-77db326a-4f63-479f-a5e5-7ecdf3990527 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:44:03.487218 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-77db326a-4f63-479f-a5e5-7ecdf3990527 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] [instance: 7ea58164-2a61-4c41-a8cc-0235e03dde98] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:44:03.494918 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-77db326a-4f63-479f-a5e5-7ecdf3990527 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:44:03.495347 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-77db326a-4f63-479f-a5e5-7ecdf3990527 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:44:03.496128 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-77db326a-4f63-479f-a5e5-7ecdf3990527 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:44:03.496564 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-77db326a-4f63-479f-a5e5-7ecdf3990527 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:44:03.636229 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-77db326a-4f63-479f-a5e5-7ecdf3990527 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da449dd03e364eb0bebabd59bfe1d19c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '082c995275404693ae4f1f686dd8fc92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:44:03.644227 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-77db326a-4f63-479f-a5e5-7ecdf3990527 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] 10.222.0.48 "GET /compute/v2.1/servers/7ea58164-2a61-4c41-a8cc-0235e03dde98" status: 200 len: 1366 microversion: 2.1 time: 0.166505 Jun 17 13:44:03.644801 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1849/3648] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:44:03 2022] GET /compute/v2.1/servers/7ea58164-2a61-4c41-a8cc-0235e03dde98 => generated 1366 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:44:04.662735 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-870e6301-4ed4-48c4-bcf0-1974124a3a21 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:44:04.663352 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-870e6301-4ed4-48c4-bcf0-1974124a3a21 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] [instance: 7ea58164-2a61-4c41-a8cc-0235e03dde98] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:44:04.670400 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-870e6301-4ed4-48c4-bcf0-1974124a3a21 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:44:04.670854 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-870e6301-4ed4-48c4-bcf0-1974124a3a21 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:44:04.671613 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-870e6301-4ed4-48c4-bcf0-1974124a3a21 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:44:04.672049 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-870e6301-4ed4-48c4-bcf0-1974124a3a21 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:44:04.811435 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-870e6301-4ed4-48c4-bcf0-1974124a3a21 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da449dd03e364eb0bebabd59bfe1d19c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '082c995275404693ae4f1f686dd8fc92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:44:04.821142 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-870e6301-4ed4-48c4-bcf0-1974124a3a21 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] 10.222.0.48 "GET /compute/v2.1/servers/7ea58164-2a61-4c41-a8cc-0235e03dde98" status: 200 len: 1366 microversion: 2.1 time: 0.163906 Jun 17 13:44:04.821703 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1800/3649] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:44:04 2022] GET /compute/v2.1/servers/7ea58164-2a61-4c41-a8cc-0235e03dde98 => generated 1366 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:44:05.842125 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-f7c99eed-5322-427b-9e87-49566682b15a tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:44:05.843157 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-f7c99eed-5322-427b-9e87-49566682b15a tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] [instance: 7ea58164-2a61-4c41-a8cc-0235e03dde98] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:44:05.854737 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f7c99eed-5322-427b-9e87-49566682b15a tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:44:05.855477 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f7c99eed-5322-427b-9e87-49566682b15a tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:44:05.856713 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f7c99eed-5322-427b-9e87-49566682b15a tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:44:05.857423 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-f7c99eed-5322-427b-9e87-49566682b15a tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:44:06.009419 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-f7c99eed-5322-427b-9e87-49566682b15a tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da449dd03e364eb0bebabd59bfe1d19c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '082c995275404693ae4f1f686dd8fc92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:44:06.017502 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-f7c99eed-5322-427b-9e87-49566682b15a tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] 10.222.0.48 "GET /compute/v2.1/servers/7ea58164-2a61-4c41-a8cc-0235e03dde98" status: 200 len: 1366 microversion: 2.1 time: 0.181883 Jun 17 13:44:06.018068 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1850/3650] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:44:05 2022] GET /compute/v2.1/servers/7ea58164-2a61-4c41-a8cc-0235e03dde98 => generated 1366 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:44:07.038754 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-890aae76-a015-4d58-92d0-9868494039c4 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:44:07.039349 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-890aae76-a015-4d58-92d0-9868494039c4 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] [instance: 7ea58164-2a61-4c41-a8cc-0235e03dde98] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:44:07.046732 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-890aae76-a015-4d58-92d0-9868494039c4 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:44:07.047194 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-890aae76-a015-4d58-92d0-9868494039c4 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:44:07.047984 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-890aae76-a015-4d58-92d0-9868494039c4 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:44:07.048429 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-890aae76-a015-4d58-92d0-9868494039c4 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:44:07.184098 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-890aae76-a015-4d58-92d0-9868494039c4 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da449dd03e364eb0bebabd59bfe1d19c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '082c995275404693ae4f1f686dd8fc92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:44:07.195734 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-890aae76-a015-4d58-92d0-9868494039c4 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] 10.222.0.48 "GET /compute/v2.1/servers/7ea58164-2a61-4c41-a8cc-0235e03dde98" status: 200 len: 1366 microversion: 2.1 time: 0.162215 Jun 17 13:44:07.196476 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1801/3651] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:44:07 2022] GET /compute/v2.1/servers/7ea58164-2a61-4c41-a8cc-0235e03dde98 => generated 1366 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:44:07.940847 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 13:44:07.941229 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Fri Jun 17 13:44:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 17 13:44:08.221190 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-0071f66a-8bc4-4d98-89dd-ff53d1df134a tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:44:08.222065 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-0071f66a-8bc4-4d98-89dd-ff53d1df134a tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] [instance: 7ea58164-2a61-4c41-a8cc-0235e03dde98] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:44:08.233365 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0071f66a-8bc4-4d98-89dd-ff53d1df134a tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:44:08.234178 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0071f66a-8bc4-4d98-89dd-ff53d1df134a tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:44:08.235525 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0071f66a-8bc4-4d98-89dd-ff53d1df134a tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:44:08.236254 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-0071f66a-8bc4-4d98-89dd-ff53d1df134a tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:44:08.380858 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-0071f66a-8bc4-4d98-89dd-ff53d1df134a tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da449dd03e364eb0bebabd59bfe1d19c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '082c995275404693ae4f1f686dd8fc92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:44:08.388436 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-0071f66a-8bc4-4d98-89dd-ff53d1df134a tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] 10.222.0.48 "GET /compute/v2.1/servers/7ea58164-2a61-4c41-a8cc-0235e03dde98" status: 200 len: 1366 microversion: 2.1 time: 0.173687 Jun 17 13:44:08.389004 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1851/3652] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:44:08 2022] GET /compute/v2.1/servers/7ea58164-2a61-4c41-a8cc-0235e03dde98 => generated 1366 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:44:08.831731 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [req-0c61b7f3-80ba-4f7b-a6a0-78e3ba585a3a req-c9ea9ca4-9115-4f10-b800-4ddd338ea112 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ea58164-2a61-4c41-a8cc-0235e03dde98", "name": "network-vif-plugged", "status": "completed", "tag": "c53bdd3c-18b5-4bb8-8b0f-00e934dc8453"}]} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:44:08.841179 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-0c61b7f3-80ba-4f7b-a6a0-78e3ba585a3a req-c9ea9ca4-9115-4f10-b800-4ddd338ea112 service nova] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:44:08.842440 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-0c61b7f3-80ba-4f7b-a6a0-78e3ba585a3a req-c9ea9ca4-9115-4f10-b800-4ddd338ea112 service nova] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:44:08.854769 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.compute.server_external_events [req-0c61b7f3-80ba-4f7b-a6a0-78e3ba585a3a req-c9ea9ca4-9115-4f10-b800-4ddd338ea112 service nova] Creating event network-vif-plugged:c53bdd3c-18b5-4bb8-8b0f-00e934dc8453 for instance 7ea58164-2a61-4c41-a8cc-0235e03dde98 on hv-cinder-83754 Jun 17 13:44:08.859898 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [req-0c61b7f3-80ba-4f7b-a6a0-78e3ba585a3a req-c9ea9ca4-9115-4f10-b800-4ddd338ea112 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032340 Jun 17 13:44:08.860690 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1802/3653] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 13:44:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:44:09.409833 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-d909cd42-07a4-4892-9068-c32c29d3f7e7 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:44:09.410421 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-d909cd42-07a4-4892-9068-c32c29d3f7e7 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] [instance: 7ea58164-2a61-4c41-a8cc-0235e03dde98] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:44:09.412676 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_cell0:SELECT=2 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:44:09.413359 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_cell0:SELECT=6 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:44:09.419432 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d909cd42-07a4-4892-9068-c32c29d3f7e7 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:44:09.419851 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d909cd42-07a4-4892-9068-c32c29d3f7e7 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:44:09.420625 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d909cd42-07a4-4892-9068-c32c29d3f7e7 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:44:09.421052 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d909cd42-07a4-4892-9068-c32c29d3f7e7 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:44:09.560024 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-d909cd42-07a4-4892-9068-c32c29d3f7e7 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da449dd03e364eb0bebabd59bfe1d19c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '082c995275404693ae4f1f686dd8fc92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:44:09.572512 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-d909cd42-07a4-4892-9068-c32c29d3f7e7 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] 10.222.0.48 "GET /compute/v2.1/servers/7ea58164-2a61-4c41-a8cc-0235e03dde98" status: 200 len: 1366 microversion: 2.1 time: 0.166375 Jun 17 13:44:09.573171 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1852/3654] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:44:09 2022] GET /compute/v2.1/servers/7ea58164-2a61-4c41-a8cc-0235e03dde98 => generated 1366 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:44:10.593670 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-26faae5b-cda5-429f-8806-7a5eae5d8026 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:44:10.594393 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-26faae5b-cda5-429f-8806-7a5eae5d8026 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] [instance: 7ea58164-2a61-4c41-a8cc-0235e03dde98] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:44:10.597103 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell0:SELECT=6 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:44:10.603469 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-26faae5b-cda5-429f-8806-7a5eae5d8026 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:44:10.604225 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-26faae5b-cda5-429f-8806-7a5eae5d8026 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:44:10.604972 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-26faae5b-cda5-429f-8806-7a5eae5d8026 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:44:10.605366 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-26faae5b-cda5-429f-8806-7a5eae5d8026 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:44:10.748873 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-26faae5b-cda5-429f-8806-7a5eae5d8026 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da449dd03e364eb0bebabd59bfe1d19c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '082c995275404693ae4f1f686dd8fc92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:44:10.756685 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-26faae5b-cda5-429f-8806-7a5eae5d8026 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] 10.222.0.48 "GET /compute/v2.1/servers/7ea58164-2a61-4c41-a8cc-0235e03dde98" status: 200 len: 1557 microversion: 2.1 time: 0.169714 Jun 17 13:44:10.757213 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1803/3655] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:44:10 2022] GET /compute/v2.1/servers/7ea58164-2a61-4c41-a8cc-0235e03dde98 => generated 1557 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:44:10.772846 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-d2beaa3f-68d8-4218-a2f4-3df587d5ee67 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:44:10.773344 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-d2beaa3f-68d8-4218-a2f4-3df587d5ee67 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] [instance: 7ea58164-2a61-4c41-a8cc-0235e03dde98] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:44:10.780178 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d2beaa3f-68d8-4218-a2f4-3df587d5ee67 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:44:10.780627 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d2beaa3f-68d8-4218-a2f4-3df587d5ee67 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:44:10.781382 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d2beaa3f-68d8-4218-a2f4-3df587d5ee67 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:44:10.781816 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d2beaa3f-68d8-4218-a2f4-3df587d5ee67 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:44:10.870624 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-d2beaa3f-68d8-4218-a2f4-3df587d5ee67 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] 10.222.0.48 "GET /compute/v2.1/servers/7ea58164-2a61-4c41-a8cc-0235e03dde98/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.101236 Jun 17 13:44:10.871442 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1853/3656] 10.222.0.48 () {58 vars in 1274 bytes} [Fri Jun 17 13:44:10 2022] GET /compute/v2.1/servers/7ea58164-2a61-4c41-a8cc-0235e03dde98/os-interface => generated 285 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:44:11.859401 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [req-c1445a60-99c9-4b64-9391-40301f553f92 req-8aeed43c-8215-426f-bc88-5df8b18a5c9a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ea58164-2a61-4c41-a8cc-0235e03dde98", "tag": "c53bdd3c-18b5-4bb8-8b0f-00e934dc8453"}]} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:44:11.868559 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-c1445a60-99c9-4b64-9391-40301f553f92 req-8aeed43c-8215-426f-bc88-5df8b18a5c9a service nova] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:44:11.868982 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-c1445a60-99c9-4b64-9391-40301f553f92 req-8aeed43c-8215-426f-bc88-5df8b18a5c9a service nova] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:44:11.880806 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.compute.server_external_events [req-c1445a60-99c9-4b64-9391-40301f553f92 req-8aeed43c-8215-426f-bc88-5df8b18a5c9a service nova] Creating event network-changed:c53bdd3c-18b5-4bb8-8b0f-00e934dc8453 for instance 7ea58164-2a61-4c41-a8cc-0235e03dde98 on hv-cinder-83754 Jun 17 13:44:11.886029 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [req-c1445a60-99c9-4b64-9391-40301f553f92 req-8aeed43c-8215-426f-bc88-5df8b18a5c9a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030384 Jun 17 13:44:11.886693 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1804/3657] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 13:44:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:45:26.926433 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:45:26.927423 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:45:26.933452 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-4ddff26e-d572-4c4a-b4fb-7dbcb4fc58ac tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:45:26.934146 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-4ddff26e-d572-4c4a-b4fb-7dbcb4fc58ac tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] [instance: 7ea58164-2a61-4c41-a8cc-0235e03dde98] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:45:26.944853 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4ddff26e-d572-4c4a-b4fb-7dbcb4fc58ac tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:45:26.945443 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4ddff26e-d572-4c4a-b4fb-7dbcb4fc58ac tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:45:26.946484 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4ddff26e-d572-4c4a-b4fb-7dbcb4fc58ac tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:45:26.947060 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-4ddff26e-d572-4c4a-b4fb-7dbcb4fc58ac tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:45:26.974618 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-4ddff26e-d572-4c4a-b4fb-7dbcb4fc58ac tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] 10.222.0.48 "GET /compute/v2.1/servers/7ea58164-2a61-4c41-a8cc-0235e03dde98/ips" status: 200 len: 151 microversion: 2.1 time: 0.051454 Jun 17 13:45:26.975184 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1854/3658] 10.222.0.48 () {58 vars in 1247 bytes} [Fri Jun 17 13:45:26 2022] GET /compute/v2.1/servers/7ea58164-2a61-4c41-a8cc-0235e03dde98/ips => generated 151 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:45:28.315100 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:45:28.316906 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:45:28.324572 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-5086b8b1-6e21-463e-ba07-a3822b983b68 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "20c69f5a-92b4-416f-8da6-c365c95ad71b"}} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:45:28.326354 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-5086b8b1-6e21-463e-ba07-a3822b983b68 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] [instance: 7ea58164-2a61-4c41-a8cc-0235e03dde98] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:45:28.335373 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5086b8b1-6e21-463e-ba07-a3822b983b68 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:45:28.336010 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5086b8b1-6e21-463e-ba07-a3822b983b68 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:45:28.336774 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5086b8b1-6e21-463e-ba07-a3822b983b68 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:45:28.337205 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5086b8b1-6e21-463e-ba07-a3822b983b68 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:45:28.837161 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-5086b8b1-6e21-463e-ba07-a3822b983b68 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] 10.222.0.48 "POST /compute/v2.1/servers/7ea58164-2a61-4c41-a8cc-0235e03dde98/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.525442 Jun 17 13:45:28.837895 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1805/3659] 10.222.0.48 () {60 vars in 1322 bytes} [Fri Jun 17 13:45:28 2022] POST /compute/v2.1/servers/7ea58164-2a61-4c41-a8cc-0235e03dde98/os-volume_attachments => generated 194 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:45:36.453188 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-56f974b5-48fd-46d0-ab14-0aafd18b4320 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "20c69f5a-92b4-416f-8da6-c365c95ad71b"}} {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:45:36.454606 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-56f974b5-48fd-46d0-ab14-0aafd18b4320 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] [instance: 7ea58164-2a61-4c41-a8cc-0235e03dde98] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:45:36.461504 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-56f974b5-48fd-46d0-ab14-0aafd18b4320 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:45:36.461940 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-56f974b5-48fd-46d0-ab14-0aafd18b4320 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:45:36.462804 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-56f974b5-48fd-46d0-ab14-0aafd18b4320 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:45:36.463229 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-56f974b5-48fd-46d0-ab14-0aafd18b4320 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:45:36.605164 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.wsgi [None req-56f974b5-48fd-46d0-ab14-0aafd18b4320 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] HTTP exception thrown: Invalid volume: volume 20c69f5a-92b4-416f-8da6-c365c95ad71b is already attached to instances: 7ea58164-2a61-4c41-a8cc-0235e03dde98 Jun 17 13:45:36.606972 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-56f974b5-48fd-46d0-ab14-0aafd18b4320 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Request method failure captured: Jun 17 13:45:36.606972 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: request: POST /compute/v2.1/servers/7ea58164-2a61-4c41-a8cc-0235e03dde98/os-volume_attachments HTTP/1.1 Jun 17 13:45:36.606972 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Accept: application/json Jun 17 13:45:36.606972 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Accept-Encoding: identity Jun 17 13:45:36.606972 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Connection: close Jun 17 13:45:36.606972 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Content-Length: 74 Jun 17 13:45:36.606972 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Content-Type: application/json Jun 17 13:45:36.606972 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Host: 10.222.0.48 Jun 17 13:45:36.606972 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Openstack-System-Scope: None Jun 17 13:45:36.606972 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: User-Agent: python-urllib3/1.26.9 Jun 17 13:45:36.606972 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Auth-Token: gAAAAABirIRP33kbNc95wQnxZWaHkbIgOW-PC62z_-SPHiqRMyAyyNpDibqzQRov5iswTxwKrFY6HzWqyyJx4eCc6ieRXhm1AsWGCJLm5d50w3GfYQXsn14MemaWj2ArtY6MULK9ImPI2Hy4bwlxQyKmwR6WiLIiU3IKmg-dNxx33oAqk5oHKKk Jun 17 13:45:36.606972 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Domain-Id: None Jun 17 13:45:36.606972 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Domain-Name: None Jun 17 13:45:36.606972 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Identity-Status: Confirmed Jun 17 13:45:36.606972 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Is-Admin-Project: True Jun 17 13:45:36.606972 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Project-Domain-Id: default Jun 17 13:45:36.606972 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Project-Domain-Name: Default Jun 17 13:45:36.606972 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Project-Id: 082c995275404693ae4f1f686dd8fc92 Jun 17 13:45:36.606972 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Project-Name: tempest-AttachVolumeNegativeTest-17794193 Jun 17 13:45:36.606972 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Role: member,reader Jun 17 13:45:36.606972 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Roles: member,reader Jun 17 13:45:36.608363 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_082c995275404693ae4f1f686dd8fc92", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/082c995275404693ae4f1f686dd8fc92"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/082c995275404693ae4f1f686dd8fc92"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/082c995275404693ae4f1f686dd8fc92"}]}] Jun 17 13:45:36.608363 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Tenant: tempest-AttachVolumeNegativeTest-17794193 Jun 17 13:45:36.608363 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Tenant-Id: 082c995275404693ae4f1f686dd8fc92 Jun 17 13:45:36.608363 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-17794193 Jun 17 13:45:36.608363 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User: tempest-AttachVolumeNegativeTest-17794193-project Jun 17 13:45:36.608363 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User-Domain-Id: default Jun 17 13:45:36.608363 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User-Domain-Name: Default Jun 17 13:45:36.608363 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User-Id: da449dd03e364eb0bebabd59bfe1d19c Jun 17 13:45:36.608363 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User-Name: tempest-AttachVolumeNegativeTest-17794193-project Jun 17 13:45:36.608363 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Jun 17 13:45:36.608363 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: {"volumeAttachment": {"volumeId": "20c69f5a-92b4-416f-8da6-c365c95ad71b"}} Jun 17 13:45:36.608363 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: method: > Jun 17 13:45:36.609043 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: exception: Invalid volume: volume 20c69f5a-92b4-416f-8da6-c365c95ad71b is already attached to instances: 7ea58164-2a61-4c41-a8cc-0235e03dde98 Jun 17 13:45:36.609043 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: action_args: {'server_id': '7ea58164-2a61-4c41-a8cc-0235e03dde98', 'body': {'volumeAttachment': {'volumeId': '20c69f5a-92b4-416f-8da6-c365c95ad71b'}}} Jun 17 13:45:36.609043 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 13:45:36.609043 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:45:36.609043 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 17 13:45:36.609043 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 17 13:45:36.609043 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 17 13:45:36.609043 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 17 13:45:36.609043 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 17 13:45:36.609043 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 17 13:45:36.609043 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 17 13:45:36.609043 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 17 13:45:36.609043 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 17 13:45:36.609043 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 17 13:45:36.609043 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 20c69f5a-92b4-416f-8da6-c365c95ad71b is already attached to instances: 7ea58164-2a61-4c41-a8cc-0235e03dde98 Jun 17 13:45:36.609043 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:45:36.609043 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:45:36.609043 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:45:36.609043 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:45:36.610141 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:45:36.610141 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:45:36.610141 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 13:45:36.610141 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 13:45:36.610141 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 13:45:36.610141 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 13:45:36.610141 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 17 13:45:36.610141 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 17 13:45:36.610141 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 17 13:45:36.610141 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 17 13:45:36.610141 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 17 13:45:36.610141 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 17 13:45:36.610141 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 17 13:45:36.610141 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 17 13:45:36.610141 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 20c69f5a-92b4-416f-8da6-c365c95ad71b is already attached to instances: 7ea58164-2a61-4c41-a8cc-0235e03dde98 Jun 17 13:45:36.610141 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:45:36.610141 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:45:36.610141 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:45:36.610141 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:45:36.610141 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:45:36.611436 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:45:36.611436 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 13:45:36.611436 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 13:45:36.611436 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 20c69f5a-92b4-416f-8da6-c365c95ad71b is already attached to instances: 7ea58164-2a61-4c41-a8cc-0235e03dde98 Jun 17 13:45:36.611436 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:45:36.611436 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-56f974b5-48fd-46d0-ab14-0aafd18b4320 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Returning 400 to user: Invalid volume: volume 20c69f5a-92b4-416f-8da6-c365c95ad71b is already attached to instances: 7ea58164-2a61-4c41-a8cc-0235e03dde98 {{(pid=117659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 13:45:36.611436 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-56f974b5-48fd-46d0-ab14-0aafd18b4320 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] 10.222.0.48 "POST /compute/v2.1/servers/7ea58164-2a61-4c41-a8cc-0235e03dde98/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.159150 Jun 17 13:45:36.611436 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1855/3660] 10.222.0.48 () {60 vars in 1322 bytes} [Fri Jun 17 13:45:36 2022] POST /compute/v2.1/servers/7ea58164-2a61-4c41-a8cc-0235e03dde98/os-volume_attachments => generated 174 bytes in 160 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 17 13:45:36.671561 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-d7ec4ef0-f50a-4029-9b3a-1d3636cd17ba tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:45:36.672146 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-d7ec4ef0-f50a-4029-9b3a-1d3636cd17ba tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] [instance: 7ea58164-2a61-4c41-a8cc-0235e03dde98] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:45:36.679217 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d7ec4ef0-f50a-4029-9b3a-1d3636cd17ba tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:45:36.679661 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d7ec4ef0-f50a-4029-9b3a-1d3636cd17ba tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:45:36.680418 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d7ec4ef0-f50a-4029-9b3a-1d3636cd17ba tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:45:36.680850 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d7ec4ef0-f50a-4029-9b3a-1d3636cd17ba tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:45:36.765384 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.objects.instance [None req-d7ec4ef0-f50a-4029-9b3a-1d3636cd17ba tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lazy-loading 'services' on Instance uuid 7ea58164-2a61-4c41-a8cc-0235e03dde98 {{(pid=117660) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 13:45:36.843323 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-d7ec4ef0-f50a-4029-9b3a-1d3636cd17ba tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] 10.222.0.48 "DELETE /compute/v2.1/servers/7ea58164-2a61-4c41-a8cc-0235e03dde98/os-volume_attachments/20c69f5a-92b4-416f-8da6-c365c95ad71b" status: 202 len: 0 microversion: 2.1 time: 0.175929 Jun 17 13:45:36.843968 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1806/3661] 10.222.0.48 () {58 vars in 1415 bytes} [Fri Jun 17 13:45:36 2022] DELETE /compute/v2.1/servers/7ea58164-2a61-4c41-a8cc-0235e03dde98/os-volume_attachments/20c69f5a-92b4-416f-8da6-c365c95ad71b => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 13:45:36.859088 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-d6300aae-9c49-4a8a-b9f3-1860b97cafe9 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:45:36.860160 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-d6300aae-9c49-4a8a-b9f3-1860b97cafe9 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] [instance: 7ea58164-2a61-4c41-a8cc-0235e03dde98] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:45:36.867270 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d6300aae-9c49-4a8a-b9f3-1860b97cafe9 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:45:36.867748 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d6300aae-9c49-4a8a-b9f3-1860b97cafe9 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:45:36.868520 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d6300aae-9c49-4a8a-b9f3-1860b97cafe9 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:45:36.869136 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d6300aae-9c49-4a8a-b9f3-1860b97cafe9 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:45:36.900544 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-d6300aae-9c49-4a8a-b9f3-1860b97cafe9 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] 10.222.0.48 "GET /compute/v2.1/servers/7ea58164-2a61-4c41-a8cc-0235e03dde98/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045529 Jun 17 13:45:36.901096 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1856/3662] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:45:36 2022] GET /compute/v2.1/servers/7ea58164-2a61-4c41-a8cc-0235e03dde98/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:45:37.918072 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-47ad314d-f875-4ce4-aa53-8412834756c7 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:45:37.919810 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-47ad314d-f875-4ce4-aa53-8412834756c7 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] [instance: 7ea58164-2a61-4c41-a8cc-0235e03dde98] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:45:37.930390 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-47ad314d-f875-4ce4-aa53-8412834756c7 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:45:37.931131 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-47ad314d-f875-4ce4-aa53-8412834756c7 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:45:37.932390 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-47ad314d-f875-4ce4-aa53-8412834756c7 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:45:37.933114 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-47ad314d-f875-4ce4-aa53-8412834756c7 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:45:37.965587 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-47ad314d-f875-4ce4-aa53-8412834756c7 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] 10.222.0.48 "GET /compute/v2.1/servers/7ea58164-2a61-4c41-a8cc-0235e03dde98/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.055452 Jun 17 13:45:37.966137 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1807/3663] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:45:37 2022] GET /compute/v2.1/servers/7ea58164-2a61-4c41-a8cc-0235e03dde98/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 17 13:45:38.032559 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-24ef92f4-6922-43b8-9a82-ff66ccb6b7b7 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:45:38.033321 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-24ef92f4-6922-43b8-9a82-ff66ccb6b7b7 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] [instance: 7ea58164-2a61-4c41-a8cc-0235e03dde98] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:45:38.043493 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-24ef92f4-6922-43b8-9a82-ff66ccb6b7b7 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:45:38.044113 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-24ef92f4-6922-43b8-9a82-ff66ccb6b7b7 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:45:38.045259 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-24ef92f4-6922-43b8-9a82-ff66ccb6b7b7 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:45:38.045878 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-24ef92f4-6922-43b8-9a82-ff66ccb6b7b7 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:45:38.072769 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-24ef92f4-6922-43b8-9a82-ff66ccb6b7b7 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] [instance: 7ea58164-2a61-4c41-a8cc-0235e03dde98] Going to try to terminate instance {{(pid=117659) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 17 13:45:38.159104 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-24ef92f4-6922-43b8-9a82-ff66ccb6b7b7 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] 10.222.0.48 "DELETE /compute/v2.1/servers/7ea58164-2a61-4c41-a8cc-0235e03dde98" status: 204 len: 0 microversion: 2.1 time: 0.132525 Jun 17 13:45:38.159805 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1857/3664] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Jun 17 13:45:38 2022] DELETE /compute/v2.1/servers/7ea58164-2a61-4c41-a8cc-0235e03dde98 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 17 13:45:38.168443 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-a4c02202-a949-442b-8d9c-582a4b10e976 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:45:38.168975 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-a4c02202-a949-442b-8d9c-582a4b10e976 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] [instance: 7ea58164-2a61-4c41-a8cc-0235e03dde98] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:45:38.176102 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a4c02202-a949-442b-8d9c-582a4b10e976 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:45:38.176547 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a4c02202-a949-442b-8d9c-582a4b10e976 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:45:38.177293 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a4c02202-a949-442b-8d9c-582a4b10e976 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:45:38.177725 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a4c02202-a949-442b-8d9c-582a4b10e976 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:45:38.325475 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-a4c02202-a949-442b-8d9c-582a4b10e976 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da449dd03e364eb0bebabd59bfe1d19c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '082c995275404693ae4f1f686dd8fc92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:45:38.333415 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-a4c02202-a949-442b-8d9c-582a4b10e976 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] 10.222.0.48 "GET /compute/v2.1/servers/7ea58164-2a61-4c41-a8cc-0235e03dde98" status: 200 len: 1682 microversion: 2.1 time: 0.169119 Jun 17 13:45:38.333985 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1808/3665] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:45:38 2022] GET /compute/v2.1/servers/7ea58164-2a61-4c41-a8cc-0235e03dde98 => generated 1682 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:45:39.355213 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-eca909fc-e622-4fef-86fa-7fa15461c5e6 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:45:39.356278 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-eca909fc-e622-4fef-86fa-7fa15461c5e6 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] [instance: 7ea58164-2a61-4c41-a8cc-0235e03dde98] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:45:39.366289 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-eca909fc-e622-4fef-86fa-7fa15461c5e6 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:45:39.366973 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-eca909fc-e622-4fef-86fa-7fa15461c5e6 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:45:39.368117 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-eca909fc-e622-4fef-86fa-7fa15461c5e6 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:45:39.368793 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-eca909fc-e622-4fef-86fa-7fa15461c5e6 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:45:39.513673 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-eca909fc-e622-4fef-86fa-7fa15461c5e6 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da449dd03e364eb0bebabd59bfe1d19c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '082c995275404693ae4f1f686dd8fc92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:45:39.523072 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-eca909fc-e622-4fef-86fa-7fa15461c5e6 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] 10.222.0.48 "GET /compute/v2.1/servers/7ea58164-2a61-4c41-a8cc-0235e03dde98" status: 200 len: 1682 microversion: 2.1 time: 0.174815 Jun 17 13:45:39.523648 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1858/3666] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:45:39 2022] GET /compute/v2.1/servers/7ea58164-2a61-4c41-a8cc-0235e03dde98 => generated 1682 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:45:40.540595 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-4cfedd35-0e63-4957-aaad-9cce9decf0d4 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:45:40.541137 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-4cfedd35-0e63-4957-aaad-9cce9decf0d4 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] [instance: 7ea58164-2a61-4c41-a8cc-0235e03dde98] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:45:40.548238 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4cfedd35-0e63-4957-aaad-9cce9decf0d4 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:45:40.548685 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4cfedd35-0e63-4957-aaad-9cce9decf0d4 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:45:40.549513 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4cfedd35-0e63-4957-aaad-9cce9decf0d4 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:45:40.549939 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4cfedd35-0e63-4957-aaad-9cce9decf0d4 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:45:40.682870 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-4cfedd35-0e63-4957-aaad-9cce9decf0d4 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da449dd03e364eb0bebabd59bfe1d19c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '082c995275404693ae4f1f686dd8fc92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:45:40.690634 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-4cfedd35-0e63-4957-aaad-9cce9decf0d4 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] 10.222.0.48 "GET /compute/v2.1/servers/7ea58164-2a61-4c41-a8cc-0235e03dde98" status: 200 len: 1682 microversion: 2.1 time: 0.154139 Jun 17 13:45:40.691196 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1809/3667] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:45:40 2022] GET /compute/v2.1/servers/7ea58164-2a61-4c41-a8cc-0235e03dde98 => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:45:41.090752 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [req-0d8706cb-26ce-4969-9126-5bfa31cea007 req-a17a84a4-f536-45b6-a6e3-e15883e21a30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ea58164-2a61-4c41-a8cc-0235e03dde98", "name": "network-vif-deleted", "tag": "c53bdd3c-18b5-4bb8-8b0f-00e934dc8453"}]} {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:45:41.099562 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [req-0d8706cb-26ce-4969-9126-5bfa31cea007 req-a17a84a4-f536-45b6-a6e3-e15883e21a30 service nova] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:45:41.100028 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [req-0d8706cb-26ce-4969-9126-5bfa31cea007 req-a17a84a4-f536-45b6-a6e3-e15883e21a30 service nova] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:45:41.112498 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.compute.server_external_events [req-0d8706cb-26ce-4969-9126-5bfa31cea007 req-a17a84a4-f536-45b6-a6e3-e15883e21a30 service nova] Creating event network-vif-deleted:c53bdd3c-18b5-4bb8-8b0f-00e934dc8453 for instance 7ea58164-2a61-4c41-a8cc-0235e03dde98 on hv-cinder-83754 Jun 17 13:45:41.117902 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [req-0d8706cb-26ce-4969-9126-5bfa31cea007 req-a17a84a4-f536-45b6-a6e3-e15883e21a30 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030787 Jun 17 13:45:41.118833 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1859/3668] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 13:45:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:45:41.707553 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-ba0e2b7a-5c2f-43e9-88c2-0338e473b872 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:45:41.708268 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-ba0e2b7a-5c2f-43e9-88c2-0338e473b872 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] [instance: 7ea58164-2a61-4c41-a8cc-0235e03dde98] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:45:41.715100 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ba0e2b7a-5c2f-43e9-88c2-0338e473b872 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:45:41.715646 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ba0e2b7a-5c2f-43e9-88c2-0338e473b872 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:45:41.716496 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ba0e2b7a-5c2f-43e9-88c2-0338e473b872 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:45:41.716994 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ba0e2b7a-5c2f-43e9-88c2-0338e473b872 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:45:41.732496 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.wsgi [None req-ba0e2b7a-5c2f-43e9-88c2-0338e473b872 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] HTTP exception thrown: Instance 7ea58164-2a61-4c41-a8cc-0235e03dde98 could not be found. Jun 17 13:45:41.734201 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-ba0e2b7a-5c2f-43e9-88c2-0338e473b872 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Request method failure captured: Jun 17 13:45:41.734201 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: request: GET /compute/v2.1/servers/7ea58164-2a61-4c41-a8cc-0235e03dde98 HTTP/1.1 Jun 17 13:45:41.734201 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Accept: application/json Jun 17 13:45:41.734201 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Accept-Encoding: identity Jun 17 13:45:41.734201 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Connection: close Jun 17 13:45:41.734201 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Content-Length: 0 Jun 17 13:45:41.734201 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Content-Type: application/json Jun 17 13:45:41.734201 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Host: 10.222.0.48 Jun 17 13:45:41.734201 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Openstack-System-Scope: None Jun 17 13:45:41.734201 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: User-Agent: python-urllib3/1.26.9 Jun 17 13:45:41.734201 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Auth-Token: gAAAAABirIRP33kbNc95wQnxZWaHkbIgOW-PC62z_-SPHiqRMyAyyNpDibqzQRov5iswTxwKrFY6HzWqyyJx4eCc6ieRXhm1AsWGCJLm5d50w3GfYQXsn14MemaWj2ArtY6MULK9ImPI2Hy4bwlxQyKmwR6WiLIiU3IKmg-dNxx33oAqk5oHKKk Jun 17 13:45:41.734201 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Domain-Id: None Jun 17 13:45:41.734201 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Domain-Name: None Jun 17 13:45:41.734201 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Identity-Status: Confirmed Jun 17 13:45:41.734201 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Is-Admin-Project: True Jun 17 13:45:41.734201 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Project-Domain-Id: default Jun 17 13:45:41.734201 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Project-Domain-Name: Default Jun 17 13:45:41.734201 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Project-Id: 082c995275404693ae4f1f686dd8fc92 Jun 17 13:45:41.734201 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Project-Name: tempest-AttachVolumeNegativeTest-17794193 Jun 17 13:45:41.734201 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Role: member,reader Jun 17 13:45:41.734201 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Roles: member,reader Jun 17 13:45:41.735499 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_082c995275404693ae4f1f686dd8fc92", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/082c995275404693ae4f1f686dd8fc92"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/082c995275404693ae4f1f686dd8fc92"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/082c995275404693ae4f1f686dd8fc92"}]}] Jun 17 13:45:41.735499 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Tenant: tempest-AttachVolumeNegativeTest-17794193 Jun 17 13:45:41.735499 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Tenant-Id: 082c995275404693ae4f1f686dd8fc92 Jun 17 13:45:41.735499 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-17794193 Jun 17 13:45:41.735499 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-User: tempest-AttachVolumeNegativeTest-17794193-project Jun 17 13:45:41.735499 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-User-Domain-Id: default Jun 17 13:45:41.735499 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-User-Domain-Name: Default Jun 17 13:45:41.735499 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-User-Id: da449dd03e364eb0bebabd59bfe1d19c Jun 17 13:45:41.735499 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-User-Name: tempest-AttachVolumeNegativeTest-17794193-project Jun 17 13:45:41.735499 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: method: > Jun 17 13:45:41.735499 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: exception: Instance 7ea58164-2a61-4c41-a8cc-0235e03dde98 could not be found. Jun 17 13:45:41.735499 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: action_args: {'id': '7ea58164-2a61-4c41-a8cc-0235e03dde98'} Jun 17 13:45:41.736217 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 13:45:41.736217 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:45:41.736217 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 13:45:41.736217 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 13:45:41.736217 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 13:45:41.736217 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 13:45:41.736217 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 13:45:41.736217 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 13:45:41.736217 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 13:45:41.736217 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 13:45:41.736217 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ea58164-2a61-4c41-a8cc-0235e03dde98 could not be found. Jun 17 13:45:41.736217 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 13:45:41.736217 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:45:41.736217 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 13:45:41.736217 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:45:41.736217 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:45:41.736217 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:45:41.736217 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 13:45:41.736217 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 13:45:41.736217 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 13:45:41.737837 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 13:45:41.737837 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 13:45:41.737837 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 13:45:41.737837 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 13:45:41.737837 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 13:45:41.737837 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 13:45:41.737837 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 13:45:41.737837 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ea58164-2a61-4c41-a8cc-0235e03dde98 could not be found. Jun 17 13:45:41.737837 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 13:45:41.737837 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:45:41.737837 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 13:45:41.737837 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:45:41.737837 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:45:41.737837 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:45:41.737837 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 13:45:41.737837 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 13:45:41.737837 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ea58164-2a61-4c41-a8cc-0235e03dde98 could not be found. Jun 17 13:45:41.737837 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 13:45:41.739117 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-ba0e2b7a-5c2f-43e9-88c2-0338e473b872 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Returning 404 to user: Instance 7ea58164-2a61-4c41-a8cc-0235e03dde98 could not be found. {{(pid=117660) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 13:45:41.739117 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-ba0e2b7a-5c2f-43e9-88c2-0338e473b872 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] 10.222.0.48 "GET /compute/v2.1/servers/7ea58164-2a61-4c41-a8cc-0235e03dde98" status: 404 len: 111 microversion: 2.1 time: 0.032242 Jun 17 13:45:41.739117 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1810/3669] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:45:41 2022] GET /compute/v2.1/servers/7ea58164-2a61-4c41-a8cc-0235e03dde98 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 13:45:41.746284 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-b534f2a9-7610-40f7-92e0-677f9d6fc4ab tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Calling method '.version_select at 0x7f01902518b0>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:45:41.765933 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-b534f2a9-7610-40f7-92e0-677f9d6fc4ab tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-703628065" status: 202 len: 0 microversion: 2.1 time: 0.024216 Jun 17 13:45:41.766550 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1860/3670] 10.222.0.48 () {58 vars in 1217 bytes} [Fri Jun 17 13:45:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-703628065 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 13:45:42.417569 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-78b73d30-453a-4f5c-b6c2-0fea83d35ff5 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Action: 'create', calling method: .version_select at 0x7f0190437280>, body: {"keypair": {"name": "tempest-keypair-1487240096", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMteeTum0PcpcoSysmgt0sh4qC/8nep+sU7624ZH+6G6hF0CNX3F4QhFdUaFcvDIiv9yPSna1hHZb39ZVuTzFEMHlq6B6UvySlBYcYtFa3E3oN762Lk3LWdwRyvrtOJpDA=="}} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:45:42.431888 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.quota [None req-78b73d30-453a-4f5c-b6c2-0fea83d35ff5 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Getting quotas for project 082c995275404693ae4f1f686dd8fc92. Resources: {'key_pairs'} {{(pid=117660) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 13:45:42.436050 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.quota [None req-78b73d30-453a-4f5c-b6c2-0fea83d35ff5 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Getting quotas for user da449dd03e364eb0bebabd59bfe1d19c and project 082c995275404693ae4f1f686dd8fc92. Resources: {'key_pairs'} {{(pid=117660) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 13:45:42.461346 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-78b73d30-453a-4f5c-b6c2-0fea83d35ff5 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.047666 Jun 17 13:45:42.461930 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1811/3671] 10.222.0.48 () {60 vars in 1158 bytes} [Fri Jun 17 13:45:42 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:45:44.044392 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-1e992aca-bc5d-40a6-aab9-ef9484e9e060 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-870411412", "imageRef": "ccec3e37-1df8-4f10-a8f6-f97dfac54cf5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1181c118-9277-4f31-b5e1-8dddb2767aa8"}], "security_groups": [{"name": "tempest-securitygroup--1256686600"}], "key_name": "tempest-keypair-1487240096", "user_data": "}} {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:45:44.173189 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.network.neutron [None req-1e992aca-bc5d-40a6-aab9-ef9484e9e060 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] validate_networks() for [('1181c118-9277-4f31-b5e1-8dddb2767aa8', None, None, None, None, None)] {{(pid=117659) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 17 13:45:44.602338 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.virt.hardware [None req-1e992aca-bc5d-40a6-aab9-ef9484e9e060 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Flavor limits 0:0:0 {{(pid=117659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 17 13:45:44.603353 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.virt.hardware [None req-1e992aca-bc5d-40a6-aab9-ef9484e9e060 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Image limits 0:0:0 {{(pid=117659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 17 13:45:44.604137 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.virt.hardware [None req-1e992aca-bc5d-40a6-aab9-ef9484e9e060 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Flavor pref 0:0:0 {{(pid=117659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 17 13:45:44.604784 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.virt.hardware [None req-1e992aca-bc5d-40a6-aab9-ef9484e9e060 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Image pref 0:0:0 {{(pid=117659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 17 13:45:44.605489 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.virt.hardware [None req-1e992aca-bc5d-40a6-aab9-ef9484e9e060 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 17 13:45:44.617601 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-1e992aca-bc5d-40a6-aab9-ef9484e9e060 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:45:44.618102 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-1e992aca-bc5d-40a6-aab9-ef9484e9e060 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:45:44.618894 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-1e992aca-bc5d-40a6-aab9-ef9484e9e060 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:45:44.619319 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-1e992aca-bc5d-40a6-aab9-ef9484e9e060 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:45:44.637737 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.quota [None req-1e992aca-bc5d-40a6-aab9-ef9484e9e060 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Getting quotas for project 082c995275404693ae4f1f686dd8fc92. Resources: {'ram', 'cores', 'instances'} {{(pid=117659) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 13:45:44.643518 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.quota [None req-1e992aca-bc5d-40a6-aab9-ef9484e9e060 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Getting quotas for user da449dd03e364eb0bebabd59bfe1d19c and project 082c995275404693ae4f1f686dd8fc92. Resources: {'ram', 'cores', 'instances'} {{(pid=117659) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 13:45:44.656051 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-1e992aca-bc5d-40a6-aab9-ef9484e9e060 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Going to run 1 instances... {{(pid=117659) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 17 13:45:44.658535 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-1e992aca-bc5d-40a6-aab9-ef9484e9e060 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] [instance: d7ea06f1-4862-4bde-9332-6229c49edf25] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ccec3e37-1df8-4f10-a8f6-f97dfac54cf5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117659) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 17 13:45:44.713670 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-1e992aca-bc5d-40a6-aab9-ef9484e9e060 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.674755 Jun 17 13:45:44.714398 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1861/3672] 10.222.0.48 () {60 vars in 1146 bytes} [Fri Jun 17 13:45:44 2022] POST /compute/v2.1/servers => generated 402 bytes in 676 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 17 13:45:44.725317 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-d5cb1253-7873-4828-8d38-56fb386d3c70 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:45:44.725929 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-d5cb1253-7873-4828-8d38-56fb386d3c70 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] [instance: d7ea06f1-4862-4bde-9332-6229c49edf25] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:45:44.782158 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-d5cb1253-7873-4828-8d38-56fb386d3c70 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da449dd03e364eb0bebabd59bfe1d19c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '082c995275404693ae4f1f686dd8fc92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:45:44.789753 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-d5cb1253-7873-4828-8d38-56fb386d3c70 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] 10.222.0.48 "GET /compute/v2.1/servers/d7ea06f1-4862-4bde-9332-6229c49edf25" status: 200 len: 1241 microversion: 2.1 time: 0.068452 Jun 17 13:45:44.790350 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1812/3673] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:45:44 2022] GET /compute/v2.1/servers/d7ea06f1-4862-4bde-9332-6229c49edf25 => generated 1241 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:45:45.807533 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-26b41f6b-3208-4eb6-824b-2f12e4f15e89 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:45:45.808141 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-26b41f6b-3208-4eb6-824b-2f12e4f15e89 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] [instance: d7ea06f1-4862-4bde-9332-6229c49edf25] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:45:45.816179 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-26b41f6b-3208-4eb6-824b-2f12e4f15e89 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:45:45.816629 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-26b41f6b-3208-4eb6-824b-2f12e4f15e89 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:45:45.817404 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-26b41f6b-3208-4eb6-824b-2f12e4f15e89 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:45:45.817837 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-26b41f6b-3208-4eb6-824b-2f12e4f15e89 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:45:45.887971 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-26b41f6b-3208-4eb6-824b-2f12e4f15e89 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da449dd03e364eb0bebabd59bfe1d19c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '082c995275404693ae4f1f686dd8fc92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:45:45.897155 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-26b41f6b-3208-4eb6-824b-2f12e4f15e89 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] 10.222.0.48 "GET /compute/v2.1/servers/d7ea06f1-4862-4bde-9332-6229c49edf25" status: 200 len: 1311 microversion: 2.1 time: 0.094062 Jun 17 13:45:45.897730 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1862/3674] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:45:45 2022] GET /compute/v2.1/servers/d7ea06f1-4862-4bde-9332-6229c49edf25 => generated 1311 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 13:45:46.914972 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-308b6c68-2954-4131-95c4-9afe14ebc46f tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:45:46.916218 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-308b6c68-2954-4131-95c4-9afe14ebc46f tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] [instance: d7ea06f1-4862-4bde-9332-6229c49edf25] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:45:46.922993 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-308b6c68-2954-4131-95c4-9afe14ebc46f tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:45:46.923432 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-308b6c68-2954-4131-95c4-9afe14ebc46f tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:45:46.924340 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-308b6c68-2954-4131-95c4-9afe14ebc46f tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:45:46.924340 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-308b6c68-2954-4131-95c4-9afe14ebc46f tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:45:47.063672 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-308b6c68-2954-4131-95c4-9afe14ebc46f tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da449dd03e364eb0bebabd59bfe1d19c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '082c995275404693ae4f1f686dd8fc92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:45:47.071391 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-308b6c68-2954-4131-95c4-9afe14ebc46f tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] 10.222.0.48 "GET /compute/v2.1/servers/d7ea06f1-4862-4bde-9332-6229c49edf25" status: 200 len: 1367 microversion: 2.1 time: 0.160632 Jun 17 13:45:47.081277 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1813/3675] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:45:46 2022] GET /compute/v2.1/servers/d7ea06f1-4862-4bde-9332-6229c49edf25 => generated 1367 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:45:47.511345 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [req-b766c73c-42f9-4181-993e-24257392face req-2d360592-b179-4a03-b141-4a25c2d9c5a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7ea06f1-4862-4bde-9332-6229c49edf25", "tag": "a8edff0f-bb01-4450-81d1-c4f719d30ee9"}]} {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:45:47.528066 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [req-b766c73c-42f9-4181-993e-24257392face req-2d360592-b179-4a03-b141-4a25c2d9c5a6 service nova] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:45:47.528562 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [req-b766c73c-42f9-4181-993e-24257392face req-2d360592-b179-4a03-b141-4a25c2d9c5a6 service nova] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:45:47.543029 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.compute.server_external_events [req-b766c73c-42f9-4181-993e-24257392face req-2d360592-b179-4a03-b141-4a25c2d9c5a6 service nova] Creating event network-changed:a8edff0f-bb01-4450-81d1-c4f719d30ee9 for instance d7ea06f1-4862-4bde-9332-6229c49edf25 on hv-cinder-83754 Jun 17 13:45:47.548059 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [req-b766c73c-42f9-4181-993e-24257392face req-2d360592-b179-4a03-b141-4a25c2d9c5a6 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042431 Jun 17 13:45:47.548672 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1863/3676] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 13:45:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:45:48.092557 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-c54ddf63-c3db-4c78-b0f6-0efafbf4444c tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:45:48.093438 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-c54ddf63-c3db-4c78-b0f6-0efafbf4444c tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] [instance: d7ea06f1-4862-4bde-9332-6229c49edf25] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:45:48.101586 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c54ddf63-c3db-4c78-b0f6-0efafbf4444c tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:45:48.102034 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c54ddf63-c3db-4c78-b0f6-0efafbf4444c tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:45:48.102828 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c54ddf63-c3db-4c78-b0f6-0efafbf4444c tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:45:48.103573 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c54ddf63-c3db-4c78-b0f6-0efafbf4444c tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:45:48.244654 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-c54ddf63-c3db-4c78-b0f6-0efafbf4444c tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da449dd03e364eb0bebabd59bfe1d19c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '082c995275404693ae4f1f686dd8fc92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:45:48.255368 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-c54ddf63-c3db-4c78-b0f6-0efafbf4444c tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] 10.222.0.48 "GET /compute/v2.1/servers/d7ea06f1-4862-4bde-9332-6229c49edf25" status: 200 len: 1367 microversion: 2.1 time: 0.169366 Jun 17 13:45:48.255935 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1814/3677] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:45:48 2022] GET /compute/v2.1/servers/d7ea06f1-4862-4bde-9332-6229c49edf25 => generated 1367 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:45:49.282268 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-1d039c37-ca50-45c8-ade3-bce2d9620f4b tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:45:49.283355 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-1d039c37-ca50-45c8-ade3-bce2d9620f4b tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] [instance: d7ea06f1-4862-4bde-9332-6229c49edf25] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:45:49.294269 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-1d039c37-ca50-45c8-ade3-bce2d9620f4b tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:45:49.295025 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-1d039c37-ca50-45c8-ade3-bce2d9620f4b tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:45:49.296272 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-1d039c37-ca50-45c8-ade3-bce2d9620f4b tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:45:49.296996 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-1d039c37-ca50-45c8-ade3-bce2d9620f4b tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:45:49.445403 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-1d039c37-ca50-45c8-ade3-bce2d9620f4b tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da449dd03e364eb0bebabd59bfe1d19c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '082c995275404693ae4f1f686dd8fc92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:45:49.453305 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-1d039c37-ca50-45c8-ade3-bce2d9620f4b tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] 10.222.0.48 "GET /compute/v2.1/servers/d7ea06f1-4862-4bde-9332-6229c49edf25" status: 200 len: 1367 microversion: 2.1 time: 0.179162 Jun 17 13:45:49.453876 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1864/3678] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:45:49 2022] GET /compute/v2.1/servers/d7ea06f1-4862-4bde-9332-6229c49edf25 => generated 1367 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:45:50.473542 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-8f59eaca-07c8-4c73-b6ff-102cc538ac46 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:45:50.474428 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-8f59eaca-07c8-4c73-b6ff-102cc538ac46 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] [instance: d7ea06f1-4862-4bde-9332-6229c49edf25] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:45:50.482837 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8f59eaca-07c8-4c73-b6ff-102cc538ac46 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:45:50.483363 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8f59eaca-07c8-4c73-b6ff-102cc538ac46 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:45:50.484256 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8f59eaca-07c8-4c73-b6ff-102cc538ac46 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:45:50.484767 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8f59eaca-07c8-4c73-b6ff-102cc538ac46 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:45:50.626457 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-8f59eaca-07c8-4c73-b6ff-102cc538ac46 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da449dd03e364eb0bebabd59bfe1d19c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '082c995275404693ae4f1f686dd8fc92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:45:50.634539 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-8f59eaca-07c8-4c73-b6ff-102cc538ac46 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] 10.222.0.48 "GET /compute/v2.1/servers/d7ea06f1-4862-4bde-9332-6229c49edf25" status: 200 len: 1367 microversion: 2.1 time: 0.166403 Jun 17 13:45:50.635095 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1815/3679] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:45:50 2022] GET /compute/v2.1/servers/d7ea06f1-4862-4bde-9332-6229c49edf25 => generated 1367 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:45:51.656025 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-d674cd6d-b24d-4c07-a13d-3e460f92b311 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:45:51.656906 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-d674cd6d-b24d-4c07-a13d-3e460f92b311 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] [instance: d7ea06f1-4862-4bde-9332-6229c49edf25] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:45:51.667200 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d674cd6d-b24d-4c07-a13d-3e460f92b311 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:45:51.667907 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d674cd6d-b24d-4c07-a13d-3e460f92b311 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:45:51.669128 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d674cd6d-b24d-4c07-a13d-3e460f92b311 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:45:51.669869 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-d674cd6d-b24d-4c07-a13d-3e460f92b311 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:45:51.807456 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-d674cd6d-b24d-4c07-a13d-3e460f92b311 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da449dd03e364eb0bebabd59bfe1d19c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '082c995275404693ae4f1f686dd8fc92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:45:51.815458 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-d674cd6d-b24d-4c07-a13d-3e460f92b311 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] 10.222.0.48 "GET /compute/v2.1/servers/d7ea06f1-4862-4bde-9332-6229c49edf25" status: 200 len: 1367 microversion: 2.1 time: 0.164818 Jun 17 13:45:51.816183 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1865/3680] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:45:51 2022] GET /compute/v2.1/servers/d7ea06f1-4862-4bde-9332-6229c49edf25 => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:45:52.832613 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-fa604f3a-af8c-4b60-9d72-1da4de9520ae tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:45:52.833172 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-fa604f3a-af8c-4b60-9d72-1da4de9520ae tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] [instance: d7ea06f1-4862-4bde-9332-6229c49edf25] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:45:52.840335 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fa604f3a-af8c-4b60-9d72-1da4de9520ae tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:45:52.840782 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fa604f3a-af8c-4b60-9d72-1da4de9520ae tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:45:52.841546 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fa604f3a-af8c-4b60-9d72-1da4de9520ae tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:45:52.841975 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fa604f3a-af8c-4b60-9d72-1da4de9520ae tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:45:52.987926 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-fa604f3a-af8c-4b60-9d72-1da4de9520ae tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da449dd03e364eb0bebabd59bfe1d19c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '082c995275404693ae4f1f686dd8fc92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:45:52.996434 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-fa604f3a-af8c-4b60-9d72-1da4de9520ae tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] 10.222.0.48 "GET /compute/v2.1/servers/d7ea06f1-4862-4bde-9332-6229c49edf25" status: 200 len: 1367 microversion: 2.1 time: 0.167857 Jun 17 13:45:52.997030 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1816/3681] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:45:52 2022] GET /compute/v2.1/servers/d7ea06f1-4862-4bde-9332-6229c49edf25 => generated 1367 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:45:53.359907 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [req-7085fdc7-90d3-4362-8aa0-adb55e6dc201 req-4cb1360d-4020-4e58-8b37-67351d71cac6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7ea06f1-4862-4bde-9332-6229c49edf25", "name": "network-vif-plugged", "status": "completed", "tag": "a8edff0f-bb01-4450-81d1-c4f719d30ee9"}]} {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:45:53.368353 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [req-7085fdc7-90d3-4362-8aa0-adb55e6dc201 req-4cb1360d-4020-4e58-8b37-67351d71cac6 service nova] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:45:53.368787 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [req-7085fdc7-90d3-4362-8aa0-adb55e6dc201 req-4cb1360d-4020-4e58-8b37-67351d71cac6 service nova] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:45:53.379612 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.compute.server_external_events [req-7085fdc7-90d3-4362-8aa0-adb55e6dc201 req-4cb1360d-4020-4e58-8b37-67351d71cac6 service nova] Creating event network-vif-plugged:a8edff0f-bb01-4450-81d1-c4f719d30ee9 for instance d7ea06f1-4862-4bde-9332-6229c49edf25 on hv-cinder-83754 Jun 17 13:45:53.384569 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [req-7085fdc7-90d3-4362-8aa0-adb55e6dc201 req-4cb1360d-4020-4e58-8b37-67351d71cac6 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095476 Jun 17 13:45:53.385127 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1866/3682] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 13:45:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:45:54.017057 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-5434066c-d556-4ea3-9a65-55fef4220440 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:45:54.018267 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-5434066c-d556-4ea3-9a65-55fef4220440 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] [instance: d7ea06f1-4862-4bde-9332-6229c49edf25] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:45:54.026337 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5434066c-d556-4ea3-9a65-55fef4220440 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:45:54.026783 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5434066c-d556-4ea3-9a65-55fef4220440 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:45:54.027551 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5434066c-d556-4ea3-9a65-55fef4220440 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:45:54.028109 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5434066c-d556-4ea3-9a65-55fef4220440 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:45:54.162532 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-5434066c-d556-4ea3-9a65-55fef4220440 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da449dd03e364eb0bebabd59bfe1d19c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '082c995275404693ae4f1f686dd8fc92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:45:54.173687 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-5434066c-d556-4ea3-9a65-55fef4220440 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] 10.222.0.48 "GET /compute/v2.1/servers/d7ea06f1-4862-4bde-9332-6229c49edf25" status: 200 len: 1367 microversion: 2.1 time: 0.162965 Jun 17 13:45:54.174431 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1817/3683] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:45:54 2022] GET /compute/v2.1/servers/d7ea06f1-4862-4bde-9332-6229c49edf25 => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:45:55.190962 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_cell0:SELECT=2 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:45:55.192194 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_cell0:SELECT=6 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:45:55.198848 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-9ef7637a-52f8-4b6e-8919-c22822f01c7d tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:45:55.200050 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-9ef7637a-52f8-4b6e-8919-c22822f01c7d tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] [instance: d7ea06f1-4862-4bde-9332-6229c49edf25] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:45:55.211632 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9ef7637a-52f8-4b6e-8919-c22822f01c7d tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:45:55.212384 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9ef7637a-52f8-4b6e-8919-c22822f01c7d tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:45:55.213635 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9ef7637a-52f8-4b6e-8919-c22822f01c7d tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:45:55.214432 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-9ef7637a-52f8-4b6e-8919-c22822f01c7d tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:45:55.360532 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-9ef7637a-52f8-4b6e-8919-c22822f01c7d tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da449dd03e364eb0bebabd59bfe1d19c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '082c995275404693ae4f1f686dd8fc92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:45:55.369006 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-9ef7637a-52f8-4b6e-8919-c22822f01c7d tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] 10.222.0.48 "GET /compute/v2.1/servers/d7ea06f1-4862-4bde-9332-6229c49edf25" status: 200 len: 1557 microversion: 2.1 time: 0.180704 Jun 17 13:45:55.369576 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1867/3684] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:45:55 2022] GET /compute/v2.1/servers/d7ea06f1-4862-4bde-9332-6229c49edf25 => generated 1557 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:45:55.385847 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-ee067c83-a475-4d64-9fb4-cc854a4035e8 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:45:55.386631 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-ee067c83-a475-4d64-9fb4-cc854a4035e8 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] [instance: d7ea06f1-4862-4bde-9332-6229c49edf25] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:45:55.388315 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell0:SELECT=6 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:45:55.395360 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ee067c83-a475-4d64-9fb4-cc854a4035e8 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:45:55.395818 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ee067c83-a475-4d64-9fb4-cc854a4035e8 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:45:55.396585 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ee067c83-a475-4d64-9fb4-cc854a4035e8 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:45:55.397012 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ee067c83-a475-4d64-9fb4-cc854a4035e8 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:45:55.485338 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-ee067c83-a475-4d64-9fb4-cc854a4035e8 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] 10.222.0.48 "GET /compute/v2.1/servers/d7ea06f1-4862-4bde-9332-6229c49edf25/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.103097 Jun 17 13:45:55.486202 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1818/3685] 10.222.0.48 () {58 vars in 1274 bytes} [Fri Jun 17 13:45:55 2022] GET /compute/v2.1/servers/d7ea06f1-4862-4bde-9332-6229c49edf25/os-interface => generated 284 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:45:56.496367 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [req-9c6f6c88-de83-4fa8-b3ae-294fa156702f req-8cf31f28-2a97-4492-82b1-fc9425ce87b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7ea06f1-4862-4bde-9332-6229c49edf25", "tag": "a8edff0f-bb01-4450-81d1-c4f719d30ee9"}]} {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:45:56.505070 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [req-9c6f6c88-de83-4fa8-b3ae-294fa156702f req-8cf31f28-2a97-4492-82b1-fc9425ce87b3 service nova] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:45:56.505500 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [req-9c6f6c88-de83-4fa8-b3ae-294fa156702f req-8cf31f28-2a97-4492-82b1-fc9425ce87b3 service nova] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:45:56.517350 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.compute.server_external_events [req-9c6f6c88-de83-4fa8-b3ae-294fa156702f req-8cf31f28-2a97-4492-82b1-fc9425ce87b3 service nova] Creating event network-changed:a8edff0f-bb01-4450-81d1-c4f719d30ee9 for instance d7ea06f1-4862-4bde-9332-6229c49edf25 on hv-cinder-83754 Jun 17 13:45:56.522483 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [req-9c6f6c88-de83-4fa8-b3ae-294fa156702f req-8cf31f28-2a97-4492-82b1-fc9425ce87b3 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089582 Jun 17 13:45:56.523290 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1868/3686] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 13:45:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:47:11.473833 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:47:11.475157 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:47:11.481228 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-ca86ac82-d5c1-4bc9-8e0b-40b19e0c6bfc tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:47:11.481719 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-ca86ac82-d5c1-4bc9-8e0b-40b19e0c6bfc tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] [instance: d7ea06f1-4862-4bde-9332-6229c49edf25] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:47:11.489869 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ca86ac82-d5c1-4bc9-8e0b-40b19e0c6bfc tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:47:11.490307 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ca86ac82-d5c1-4bc9-8e0b-40b19e0c6bfc tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:47:11.491042 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ca86ac82-d5c1-4bc9-8e0b-40b19e0c6bfc tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:47:11.491463 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ca86ac82-d5c1-4bc9-8e0b-40b19e0c6bfc tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:47:11.516389 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-ca86ac82-d5c1-4bc9-8e0b-40b19e0c6bfc tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] 10.222.0.48 "GET /compute/v2.1/servers/d7ea06f1-4862-4bde-9332-6229c49edf25/ips" status: 200 len: 149 microversion: 2.1 time: 0.045996 Jun 17 13:47:11.516935 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1819/3687] 10.222.0.48 () {58 vars in 1247 bytes} [Fri Jun 17 13:47:11 2022] GET /compute/v2.1/servers/d7ea06f1-4862-4bde-9332-6229c49edf25/ips => generated 149 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:47:12.862262 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:47:12.863002 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG dbcounter [-] [117659] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:47:12.868569 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-c4a11709-13c9-4429-90c2-5dd144be5c1b tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "50a4d7b9-9f41-4d79-bf5e-a3728a8d3c8f"}} {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:47:12.869722 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-c4a11709-13c9-4429-90c2-5dd144be5c1b tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] [instance: d7ea06f1-4862-4bde-9332-6229c49edf25] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:47:12.878933 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c4a11709-13c9-4429-90c2-5dd144be5c1b tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:47:12.879381 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c4a11709-13c9-4429-90c2-5dd144be5c1b tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:47:12.880136 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c4a11709-13c9-4429-90c2-5dd144be5c1b tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:47:12.880567 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-c4a11709-13c9-4429-90c2-5dd144be5c1b tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:47:13.152750 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-c4a11709-13c9-4429-90c2-5dd144be5c1b tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] 10.222.0.48 "POST /compute/v2.1/servers/d7ea06f1-4862-4bde-9332-6229c49edf25/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.292099 Jun 17 13:47:13.153397 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1869/3688] 10.222.0.48 () {60 vars in 1322 bytes} [Fri Jun 17 13:47:12 2022] POST /compute/v2.1/servers/d7ea06f1-4862-4bde-9332-6229c49edf25/os-volume_attachments => generated 194 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:47:20.830639 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-43d37842-3407-47ed-87c6-126c6e22d747 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:47:20.831231 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-43d37842-3407-47ed-87c6-126c6e22d747 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] [instance: d7ea06f1-4862-4bde-9332-6229c49edf25] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:47:20.837734 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-43d37842-3407-47ed-87c6-126c6e22d747 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:47:20.838221 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-43d37842-3407-47ed-87c6-126c6e22d747 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:47:20.839028 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-43d37842-3407-47ed-87c6-126c6e22d747 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:47:20.839568 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-43d37842-3407-47ed-87c6-126c6e22d747 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:47:20.923333 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.objects.instance [None req-43d37842-3407-47ed-87c6-126c6e22d747 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lazy-loading 'services' on Instance uuid d7ea06f1-4862-4bde-9332-6229c49edf25 {{(pid=117660) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 13:47:21.020613 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-43d37842-3407-47ed-87c6-126c6e22d747 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] 10.222.0.48 "DELETE /compute/v2.1/servers/d7ea06f1-4862-4bde-9332-6229c49edf25/os-volume_attachments/50a4d7b9-9f41-4d79-bf5e-a3728a8d3c8f" status: 202 len: 0 microversion: 2.1 time: 0.193912 Jun 17 13:47:21.021231 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1820/3689] 10.222.0.48 () {58 vars in 1415 bytes} [Fri Jun 17 13:47:20 2022] DELETE /compute/v2.1/servers/d7ea06f1-4862-4bde-9332-6229c49edf25/os-volume_attachments/50a4d7b9-9f41-4d79-bf5e-a3728a8d3c8f => generated 0 bytes in 195 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 17 13:47:21.030266 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-7ddfa294-6d53-49ff-abf5-91ba7ee3604e tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:47:21.031338 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-7ddfa294-6d53-49ff-abf5-91ba7ee3604e tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] [instance: d7ea06f1-4862-4bde-9332-6229c49edf25] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:47:21.038627 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7ddfa294-6d53-49ff-abf5-91ba7ee3604e tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:47:21.039097 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7ddfa294-6d53-49ff-abf5-91ba7ee3604e tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:47:21.039958 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7ddfa294-6d53-49ff-abf5-91ba7ee3604e tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:47:21.040358 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-7ddfa294-6d53-49ff-abf5-91ba7ee3604e tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:47:21.073619 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-7ddfa294-6d53-49ff-abf5-91ba7ee3604e tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] 10.222.0.48 "GET /compute/v2.1/servers/d7ea06f1-4862-4bde-9332-6229c49edf25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047742 Jun 17 13:47:21.074435 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1870/3690] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:47:21 2022] GET /compute/v2.1/servers/d7ea06f1-4862-4bde-9332-6229c49edf25/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:47:22.087499 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-37e8c9c7-34fb-4fee-8b7b-3f66e7a4c571 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:47:22.088584 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-37e8c9c7-34fb-4fee-8b7b-3f66e7a4c571 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] [instance: d7ea06f1-4862-4bde-9332-6229c49edf25] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:47:22.095340 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-37e8c9c7-34fb-4fee-8b7b-3f66e7a4c571 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:47:22.095792 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-37e8c9c7-34fb-4fee-8b7b-3f66e7a4c571 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:47:22.096547 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-37e8c9c7-34fb-4fee-8b7b-3f66e7a4c571 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:47:22.096976 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-37e8c9c7-34fb-4fee-8b7b-3f66e7a4c571 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:47:22.125363 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-37e8c9c7-34fb-4fee-8b7b-3f66e7a4c571 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] 10.222.0.48 "GET /compute/v2.1/servers/d7ea06f1-4862-4bde-9332-6229c49edf25/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042979 Jun 17 13:47:22.125900 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1821/3691] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 13:47:22 2022] GET /compute/v2.1/servers/d7ea06f1-4862-4bde-9332-6229c49edf25/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 17 13:47:22.188210 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-64033666-0da7-4949-95af-75197a8e886b tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:47:22.188812 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-64033666-0da7-4949-95af-75197a8e886b tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] [instance: d7ea06f1-4862-4bde-9332-6229c49edf25] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:47:22.195481 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-64033666-0da7-4949-95af-75197a8e886b tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:47:22.195955 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-64033666-0da7-4949-95af-75197a8e886b tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:47:22.196695 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-64033666-0da7-4949-95af-75197a8e886b tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:47:22.197162 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-64033666-0da7-4949-95af-75197a8e886b tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:47:22.223816 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-64033666-0da7-4949-95af-75197a8e886b tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] [instance: d7ea06f1-4862-4bde-9332-6229c49edf25] Going to try to terminate instance {{(pid=117659) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 17 13:47:22.313285 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-64033666-0da7-4949-95af-75197a8e886b tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] 10.222.0.48 "DELETE /compute/v2.1/servers/d7ea06f1-4862-4bde-9332-6229c49edf25" status: 204 len: 0 microversion: 2.1 time: 0.128497 Jun 17 13:47:22.313784 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1871/3692] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Jun 17 13:47:22 2022] DELETE /compute/v2.1/servers/d7ea06f1-4862-4bde-9332-6229c49edf25 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 17 13:47:22.322020 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-13b37178-3f26-46ad-b4a5-4a50d27998a1 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:47:22.322685 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-13b37178-3f26-46ad-b4a5-4a50d27998a1 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] [instance: d7ea06f1-4862-4bde-9332-6229c49edf25] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:47:22.329109 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-13b37178-3f26-46ad-b4a5-4a50d27998a1 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:47:22.329541 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-13b37178-3f26-46ad-b4a5-4a50d27998a1 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:47:22.330331 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-13b37178-3f26-46ad-b4a5-4a50d27998a1 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:47:22.330762 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-13b37178-3f26-46ad-b4a5-4a50d27998a1 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:47:22.479835 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-13b37178-3f26-46ad-b4a5-4a50d27998a1 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da449dd03e364eb0bebabd59bfe1d19c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '082c995275404693ae4f1f686dd8fc92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:47:22.487626 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-13b37178-3f26-46ad-b4a5-4a50d27998a1 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] 10.222.0.48 "GET /compute/v2.1/servers/d7ea06f1-4862-4bde-9332-6229c49edf25" status: 200 len: 1681 microversion: 2.1 time: 0.169544 Jun 17 13:47:22.488185 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1822/3693] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:47:22 2022] GET /compute/v2.1/servers/d7ea06f1-4862-4bde-9332-6229c49edf25 => generated 1681 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:47:23.509691 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-cbbbc4c4-edc7-4515-8ffd-9e87936cb0b4 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:47:23.511006 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-cbbbc4c4-edc7-4515-8ffd-9e87936cb0b4 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] [instance: d7ea06f1-4862-4bde-9332-6229c49edf25] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:47:23.518240 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-cbbbc4c4-edc7-4515-8ffd-9e87936cb0b4 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:47:23.518684 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-cbbbc4c4-edc7-4515-8ffd-9e87936cb0b4 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:47:23.519449 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-cbbbc4c4-edc7-4515-8ffd-9e87936cb0b4 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:47:23.519880 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-cbbbc4c4-edc7-4515-8ffd-9e87936cb0b4 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:47:23.662590 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.policy [None req-cbbbc4c4-edc7-4515-8ffd-9e87936cb0b4 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da449dd03e364eb0bebabd59bfe1d19c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '082c995275404693ae4f1f686dd8fc92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117659) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:47:23.673988 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-cbbbc4c4-edc7-4515-8ffd-9e87936cb0b4 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] 10.222.0.48 "GET /compute/v2.1/servers/d7ea06f1-4862-4bde-9332-6229c49edf25" status: 200 len: 1681 microversion: 2.1 time: 0.171075 Jun 17 13:47:23.674830 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1872/3694] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:47:23 2022] GET /compute/v2.1/servers/d7ea06f1-4862-4bde-9332-6229c49edf25 => generated 1681 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:47:24.694039 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-4a292012-d5af-4746-8f83-f06ed65b5f31 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:47:24.694858 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-4a292012-d5af-4746-8f83-f06ed65b5f31 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] [instance: d7ea06f1-4862-4bde-9332-6229c49edf25] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:47:24.702009 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4a292012-d5af-4746-8f83-f06ed65b5f31 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:47:24.702452 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4a292012-d5af-4746-8f83-f06ed65b5f31 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:47:24.703248 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4a292012-d5af-4746-8f83-f06ed65b5f31 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:47:24.703681 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4a292012-d5af-4746-8f83-f06ed65b5f31 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:47:24.840136 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-4a292012-d5af-4746-8f83-f06ed65b5f31 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da449dd03e364eb0bebabd59bfe1d19c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '082c995275404693ae4f1f686dd8fc92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 13:47:24.847875 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-4a292012-d5af-4746-8f83-f06ed65b5f31 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] 10.222.0.48 "GET /compute/v2.1/servers/d7ea06f1-4862-4bde-9332-6229c49edf25" status: 200 len: 1681 microversion: 2.1 time: 0.157792 Jun 17 13:47:24.848524 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1823/3695] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:47:24 2022] GET /compute/v2.1/servers/d7ea06f1-4862-4bde-9332-6229c49edf25 => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 13:47:25.200916 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [req-a5cf4f1f-756b-4c58-ba30-ce3654e1c9c2 req-e7067b0e-1053-4cd4-92c6-e67f2c6b104d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7ea06f1-4862-4bde-9332-6229c49edf25", "name": "network-vif-deleted", "tag": "a8edff0f-bb01-4450-81d1-c4f719d30ee9"}]} {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 13:47:25.210251 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [req-a5cf4f1f-756b-4c58-ba30-ce3654e1c9c2 req-e7067b0e-1053-4cd4-92c6-e67f2c6b104d service nova] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:47:25.210686 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [req-a5cf4f1f-756b-4c58-ba30-ce3654e1c9c2 req-e7067b0e-1053-4cd4-92c6-e67f2c6b104d service nova] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:47:25.222334 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.compute.server_external_events [req-a5cf4f1f-756b-4c58-ba30-ce3654e1c9c2 req-e7067b0e-1053-4cd4-92c6-e67f2c6b104d service nova] Creating event network-vif-deleted:a8edff0f-bb01-4450-81d1-c4f719d30ee9 for instance d7ea06f1-4862-4bde-9332-6229c49edf25 on hv-cinder-83754 Jun 17 13:47:25.227285 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [req-a5cf4f1f-756b-4c58-ba30-ce3654e1c9c2 req-e7067b0e-1053-4cd4-92c6-e67f2c6b104d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030090 Jun 17 13:47:25.228224 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1873/3696] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 13:47:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 13:47:25.865299 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-5f810bd2-0555-4d27-9f58-0497c7963660 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:47:25.865905 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-5f810bd2-0555-4d27-9f58-0497c7963660 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] [instance: d7ea06f1-4862-4bde-9332-6229c49edf25] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:47:25.873217 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5f810bd2-0555-4d27-9f58-0497c7963660 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:47:25.873667 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5f810bd2-0555-4d27-9f58-0497c7963660 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:47:25.874436 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5f810bd2-0555-4d27-9f58-0497c7963660 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:47:25.874875 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5f810bd2-0555-4d27-9f58-0497c7963660 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:47:25.888644 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.wsgi [None req-5f810bd2-0555-4d27-9f58-0497c7963660 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] HTTP exception thrown: Instance d7ea06f1-4862-4bde-9332-6229c49edf25 could not be found. Jun 17 13:47:25.890348 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-5f810bd2-0555-4d27-9f58-0497c7963660 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Request method failure captured: Jun 17 13:47:25.890348 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: request: GET /compute/v2.1/servers/d7ea06f1-4862-4bde-9332-6229c49edf25 HTTP/1.1 Jun 17 13:47:25.890348 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Accept: application/json Jun 17 13:47:25.890348 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Accept-Encoding: identity Jun 17 13:47:25.890348 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Connection: close Jun 17 13:47:25.890348 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Content-Length: 0 Jun 17 13:47:25.890348 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Content-Type: application/json Jun 17 13:47:25.890348 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Host: 10.222.0.48 Jun 17 13:47:25.890348 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Openstack-System-Scope: None Jun 17 13:47:25.890348 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: User-Agent: python-urllib3/1.26.9 Jun 17 13:47:25.890348 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Auth-Token: gAAAAABirIRP33kbNc95wQnxZWaHkbIgOW-PC62z_-SPHiqRMyAyyNpDibqzQRov5iswTxwKrFY6HzWqyyJx4eCc6ieRXhm1AsWGCJLm5d50w3GfYQXsn14MemaWj2ArtY6MULK9ImPI2Hy4bwlxQyKmwR6WiLIiU3IKmg-dNxx33oAqk5oHKKk Jun 17 13:47:25.890348 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Domain-Id: None Jun 17 13:47:25.890348 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Domain-Name: None Jun 17 13:47:25.890348 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Identity-Status: Confirmed Jun 17 13:47:25.890348 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Is-Admin-Project: True Jun 17 13:47:25.890348 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Project-Domain-Id: default Jun 17 13:47:25.890348 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Project-Domain-Name: Default Jun 17 13:47:25.890348 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Project-Id: 082c995275404693ae4f1f686dd8fc92 Jun 17 13:47:25.890348 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Project-Name: tempest-AttachVolumeNegativeTest-17794193 Jun 17 13:47:25.890348 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Role: member,reader Jun 17 13:47:25.890348 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Roles: member,reader Jun 17 13:47:25.891885 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_082c995275404693ae4f1f686dd8fc92", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/082c995275404693ae4f1f686dd8fc92"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/082c995275404693ae4f1f686dd8fc92"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/082c995275404693ae4f1f686dd8fc92"}]}] Jun 17 13:47:25.891885 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Tenant: tempest-AttachVolumeNegativeTest-17794193 Jun 17 13:47:25.891885 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Tenant-Id: 082c995275404693ae4f1f686dd8fc92 Jun 17 13:47:25.891885 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-17794193 Jun 17 13:47:25.891885 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-User: tempest-AttachVolumeNegativeTest-17794193-project Jun 17 13:47:25.891885 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-User-Domain-Id: default Jun 17 13:47:25.891885 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-User-Domain-Name: Default Jun 17 13:47:25.891885 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-User-Id: da449dd03e364eb0bebabd59bfe1d19c Jun 17 13:47:25.891885 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-User-Name: tempest-AttachVolumeNegativeTest-17794193-project Jun 17 13:47:25.891885 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: method: > Jun 17 13:47:25.891885 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: exception: Instance d7ea06f1-4862-4bde-9332-6229c49edf25 could not be found. Jun 17 13:47:25.891885 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: action_args: {'id': 'd7ea06f1-4862-4bde-9332-6229c49edf25'} Jun 17 13:47:25.896194 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 13:47:25.896194 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:47:25.896194 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 13:47:25.896194 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 13:47:25.896194 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 13:47:25.896194 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 13:47:25.896194 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 13:47:25.896194 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 13:47:25.896194 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 13:47:25.896194 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 13:47:25.896194 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7ea06f1-4862-4bde-9332-6229c49edf25 could not be found. Jun 17 13:47:25.896194 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 13:47:25.896194 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:47:25.896194 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 13:47:25.896194 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:47:25.896194 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:47:25.896194 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:47:25.896194 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 13:47:25.896194 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 13:47:25.896194 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 13:47:25.897659 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 13:47:25.897659 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 13:47:25.897659 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 13:47:25.897659 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 13:47:25.897659 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 13:47:25.897659 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 13:47:25.897659 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 13:47:25.897659 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7ea06f1-4862-4bde-9332-6229c49edf25 could not be found. Jun 17 13:47:25.897659 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 13:47:25.897659 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:47:25.897659 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 13:47:25.897659 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:47:25.897659 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:47:25.897659 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:47:25.897659 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 13:47:25.897659 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 13:47:25.897659 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7ea06f1-4862-4bde-9332-6229c49edf25 could not be found. Jun 17 13:47:25.897659 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 13:47:25.899017 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-5f810bd2-0555-4d27-9f58-0497c7963660 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Returning 404 to user: Instance d7ea06f1-4862-4bde-9332-6229c49edf25 could not be found. {{(pid=117660) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 13:47:25.899017 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-5f810bd2-0555-4d27-9f58-0497c7963660 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] 10.222.0.48 "GET /compute/v2.1/servers/d7ea06f1-4862-4bde-9332-6229c49edf25" status: 404 len: 111 microversion: 2.1 time: 0.030391 Jun 17 13:47:25.899017 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1824/3697] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:47:25 2022] GET /compute/v2.1/servers/d7ea06f1-4862-4bde-9332-6229c49edf25 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 13:47:25.901203 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-ad5906bc-62ef-4895-a38a-26f122b2b206 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Calling method '.version_select at 0x7f0183fbbf70>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:47:25.920634 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-ad5906bc-62ef-4895-a38a-26f122b2b206 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1487240096" status: 202 len: 0 microversion: 2.1 time: 0.023474 Jun 17 13:47:25.921195 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1874/3698] 10.222.0.48 () {58 vars in 1220 bytes} [Fri Jun 17 13:47:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1487240096 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 13:47:27.723106 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-a945a40f-c56f-4b30-b68d-2c765256ef3b tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:47:27.723601 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-a945a40f-c56f-4b30-b68d-2c765256ef3b tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] [instance: d7ea06f1-4862-4bde-9332-6229c49edf25] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:47:27.730958 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a945a40f-c56f-4b30-b68d-2c765256ef3b tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:47:27.731405 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a945a40f-c56f-4b30-b68d-2c765256ef3b tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:47:27.732171 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a945a40f-c56f-4b30-b68d-2c765256ef3b tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:47:27.732605 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a945a40f-c56f-4b30-b68d-2c765256ef3b tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:47:27.746532 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.wsgi [None req-a945a40f-c56f-4b30-b68d-2c765256ef3b tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] HTTP exception thrown: Instance d7ea06f1-4862-4bde-9332-6229c49edf25 could not be found. Jun 17 13:47:27.748097 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-a945a40f-c56f-4b30-b68d-2c765256ef3b tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Request method failure captured: Jun 17 13:47:27.748097 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: request: DELETE /compute/v2.1/servers/d7ea06f1-4862-4bde-9332-6229c49edf25 HTTP/1.1 Jun 17 13:47:27.748097 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Accept: application/json Jun 17 13:47:27.748097 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Accept-Encoding: identity Jun 17 13:47:27.748097 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Connection: close Jun 17 13:47:27.748097 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Content-Length: 0 Jun 17 13:47:27.748097 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Content-Type: application/json Jun 17 13:47:27.748097 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Host: 10.222.0.48 Jun 17 13:47:27.748097 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Openstack-System-Scope: None Jun 17 13:47:27.748097 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: User-Agent: python-urllib3/1.26.9 Jun 17 13:47:27.748097 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Auth-Token: gAAAAABirIRP33kbNc95wQnxZWaHkbIgOW-PC62z_-SPHiqRMyAyyNpDibqzQRov5iswTxwKrFY6HzWqyyJx4eCc6ieRXhm1AsWGCJLm5d50w3GfYQXsn14MemaWj2ArtY6MULK9ImPI2Hy4bwlxQyKmwR6WiLIiU3IKmg-dNxx33oAqk5oHKKk Jun 17 13:47:27.748097 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Domain-Id: None Jun 17 13:47:27.748097 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Domain-Name: None Jun 17 13:47:27.748097 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Identity-Status: Confirmed Jun 17 13:47:27.748097 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Is-Admin-Project: True Jun 17 13:47:27.748097 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Project-Domain-Id: default Jun 17 13:47:27.748097 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Project-Domain-Name: Default Jun 17 13:47:27.748097 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Project-Id: 082c995275404693ae4f1f686dd8fc92 Jun 17 13:47:27.748097 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Project-Name: tempest-AttachVolumeNegativeTest-17794193 Jun 17 13:47:27.748097 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Role: member,reader Jun 17 13:47:27.748097 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Roles: member,reader Jun 17 13:47:27.749505 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_082c995275404693ae4f1f686dd8fc92", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/082c995275404693ae4f1f686dd8fc92"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/082c995275404693ae4f1f686dd8fc92"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/082c995275404693ae4f1f686dd8fc92"}]}] Jun 17 13:47:27.749505 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Tenant: tempest-AttachVolumeNegativeTest-17794193 Jun 17 13:47:27.749505 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Tenant-Id: 082c995275404693ae4f1f686dd8fc92 Jun 17 13:47:27.749505 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-17794193 Jun 17 13:47:27.749505 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-User: tempest-AttachVolumeNegativeTest-17794193-project Jun 17 13:47:27.749505 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-User-Domain-Id: default Jun 17 13:47:27.749505 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-User-Domain-Name: Default Jun 17 13:47:27.749505 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-User-Id: da449dd03e364eb0bebabd59bfe1d19c Jun 17 13:47:27.749505 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-User-Name: tempest-AttachVolumeNegativeTest-17794193-project Jun 17 13:47:27.749505 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: method: > Jun 17 13:47:27.749505 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: exception: Instance d7ea06f1-4862-4bde-9332-6229c49edf25 could not be found. Jun 17 13:47:27.749505 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: action_args: {'id': 'd7ea06f1-4862-4bde-9332-6229c49edf25'} Jun 17 13:47:27.750396 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 13:47:27.750396 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:47:27.750396 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 13:47:27.750396 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 13:47:27.750396 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 13:47:27.750396 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 13:47:27.750396 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 13:47:27.750396 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 13:47:27.750396 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 13:47:27.750396 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 13:47:27.750396 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7ea06f1-4862-4bde-9332-6229c49edf25 could not be found. Jun 17 13:47:27.750396 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 13:47:27.750396 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:47:27.750396 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 13:47:27.750396 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:47:27.750396 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:47:27.750396 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:47:27.750396 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 13:47:27.750396 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 13:47:27.750396 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 13:47:27.751763 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 13:47:27.751763 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 17 13:47:27.751763 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 17 13:47:27.751763 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 17 13:47:27.751763 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 17 13:47:27.751763 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 13:47:27.751763 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 13:47:27.751763 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 13:47:27.751763 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 13:47:27.751763 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7ea06f1-4862-4bde-9332-6229c49edf25 could not be found. Jun 17 13:47:27.751763 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 13:47:27.751763 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:47:27.751763 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 13:47:27.751763 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:47:27.751763 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:47:27.751763 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:47:27.751763 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 13:47:27.751763 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 13:47:27.751763 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7ea06f1-4862-4bde-9332-6229c49edf25 could not be found. Jun 17 13:47:27.751763 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 13:47:27.753247 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-a945a40f-c56f-4b30-b68d-2c765256ef3b tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Returning 404 to user: Instance d7ea06f1-4862-4bde-9332-6229c49edf25 could not be found. {{(pid=117660) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 13:47:27.753247 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-a945a40f-c56f-4b30-b68d-2c765256ef3b tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] 10.222.0.48 "DELETE /compute/v2.1/servers/d7ea06f1-4862-4bde-9332-6229c49edf25" status: 404 len: 111 microversion: 2.1 time: 0.030304 Jun 17 13:47:27.753247 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1825/3699] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Jun 17 13:47:27 2022] DELETE /compute/v2.1/servers/d7ea06f1-4862-4bde-9332-6229c49edf25 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 13:47:27.758651 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-eb174dea-bd0d-4d89-bb51-6af30e9da97d tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:47:27.759391 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-eb174dea-bd0d-4d89-bb51-6af30e9da97d tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] [instance: d7ea06f1-4862-4bde-9332-6229c49edf25] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:47:27.766763 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-eb174dea-bd0d-4d89-bb51-6af30e9da97d tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:47:27.767211 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-eb174dea-bd0d-4d89-bb51-6af30e9da97d tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:47:27.767961 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-eb174dea-bd0d-4d89-bb51-6af30e9da97d tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:47:27.768390 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-eb174dea-bd0d-4d89-bb51-6af30e9da97d tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:47:27.782301 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.wsgi [None req-eb174dea-bd0d-4d89-bb51-6af30e9da97d tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] HTTP exception thrown: Instance d7ea06f1-4862-4bde-9332-6229c49edf25 could not be found. Jun 17 13:47:27.783969 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-eb174dea-bd0d-4d89-bb51-6af30e9da97d tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Request method failure captured: Jun 17 13:47:27.783969 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: request: GET /compute/v2.1/servers/d7ea06f1-4862-4bde-9332-6229c49edf25 HTTP/1.1 Jun 17 13:47:27.783969 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Accept: application/json Jun 17 13:47:27.783969 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Accept-Encoding: identity Jun 17 13:47:27.783969 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Connection: close Jun 17 13:47:27.783969 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Content-Length: 0 Jun 17 13:47:27.783969 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Content-Type: application/json Jun 17 13:47:27.783969 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Host: 10.222.0.48 Jun 17 13:47:27.783969 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Openstack-System-Scope: None Jun 17 13:47:27.783969 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: User-Agent: python-urllib3/1.26.9 Jun 17 13:47:27.783969 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Auth-Token: gAAAAABirIRP33kbNc95wQnxZWaHkbIgOW-PC62z_-SPHiqRMyAyyNpDibqzQRov5iswTxwKrFY6HzWqyyJx4eCc6ieRXhm1AsWGCJLm5d50w3GfYQXsn14MemaWj2ArtY6MULK9ImPI2Hy4bwlxQyKmwR6WiLIiU3IKmg-dNxx33oAqk5oHKKk Jun 17 13:47:27.783969 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Domain-Id: None Jun 17 13:47:27.783969 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Domain-Name: None Jun 17 13:47:27.783969 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Identity-Status: Confirmed Jun 17 13:47:27.783969 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Is-Admin-Project: True Jun 17 13:47:27.783969 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Project-Domain-Id: default Jun 17 13:47:27.783969 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Project-Domain-Name: Default Jun 17 13:47:27.783969 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Project-Id: 082c995275404693ae4f1f686dd8fc92 Jun 17 13:47:27.783969 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Project-Name: tempest-AttachVolumeNegativeTest-17794193 Jun 17 13:47:27.783969 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Role: member,reader Jun 17 13:47:27.783969 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Roles: member,reader Jun 17 13:47:27.785476 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_082c995275404693ae4f1f686dd8fc92", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/082c995275404693ae4f1f686dd8fc92"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/082c995275404693ae4f1f686dd8fc92"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/082c995275404693ae4f1f686dd8fc92"}]}] Jun 17 13:47:27.785476 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Tenant: tempest-AttachVolumeNegativeTest-17794193 Jun 17 13:47:27.785476 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Tenant-Id: 082c995275404693ae4f1f686dd8fc92 Jun 17 13:47:27.785476 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-17794193 Jun 17 13:47:27.785476 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User: tempest-AttachVolumeNegativeTest-17794193-project Jun 17 13:47:27.785476 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User-Domain-Id: default Jun 17 13:47:27.785476 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User-Domain-Name: Default Jun 17 13:47:27.785476 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User-Id: da449dd03e364eb0bebabd59bfe1d19c Jun 17 13:47:27.785476 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User-Name: tempest-AttachVolumeNegativeTest-17794193-project Jun 17 13:47:27.785476 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: method: > Jun 17 13:47:27.785476 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: exception: Instance d7ea06f1-4862-4bde-9332-6229c49edf25 could not be found. Jun 17 13:47:27.785476 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: action_args: {'id': 'd7ea06f1-4862-4bde-9332-6229c49edf25'} Jun 17 13:47:27.786270 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 13:47:27.786270 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:47:27.786270 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 13:47:27.786270 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 13:47:27.786270 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 13:47:27.786270 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 13:47:27.786270 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 13:47:27.786270 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 13:47:27.786270 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 13:47:27.786270 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 13:47:27.786270 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7ea06f1-4862-4bde-9332-6229c49edf25 could not be found. Jun 17 13:47:27.786270 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:47:27.786270 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:47:27.786270 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:47:27.786270 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:47:27.786270 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:47:27.786270 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:47:27.786270 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 13:47:27.786270 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 13:47:27.786270 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 13:47:27.787371 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 13:47:27.787371 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 13:47:27.787371 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 13:47:27.787371 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 13:47:27.787371 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 13:47:27.787371 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 13:47:27.787371 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 13:47:27.787371 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7ea06f1-4862-4bde-9332-6229c49edf25 could not be found. Jun 17 13:47:27.787371 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:47:27.787371 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:47:27.787371 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:47:27.787371 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:47:27.787371 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:47:27.787371 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:47:27.787371 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 13:47:27.787371 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 13:47:27.787371 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7ea06f1-4862-4bde-9332-6229c49edf25 could not be found. Jun 17 13:47:27.787371 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:47:27.788423 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-eb174dea-bd0d-4d89-bb51-6af30e9da97d tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Returning 404 to user: Instance d7ea06f1-4862-4bde-9332-6229c49edf25 could not be found. {{(pid=117659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 13:47:27.788423 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-eb174dea-bd0d-4d89-bb51-6af30e9da97d tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] 10.222.0.48 "GET /compute/v2.1/servers/d7ea06f1-4862-4bde-9332-6229c49edf25" status: 404 len: 111 microversion: 2.1 time: 0.031134 Jun 17 13:47:27.788423 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1875/3700] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:47:27 2022] GET /compute/v2.1/servers/d7ea06f1-4862-4bde-9332-6229c49edf25 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 13:47:27.954042 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 13:47:27.954266 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Fri Jun 17 13:47:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 17 13:47:28.935325 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-35a3651a-358a-4fc5-8881-a9f4868686f7 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:47:28.935928 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-35a3651a-358a-4fc5-8881-a9f4868686f7 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] [instance: 7ea58164-2a61-4c41-a8cc-0235e03dde98] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:47:28.943082 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-35a3651a-358a-4fc5-8881-a9f4868686f7 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:47:28.943504 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-35a3651a-358a-4fc5-8881-a9f4868686f7 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:47:28.944273 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-35a3651a-358a-4fc5-8881-a9f4868686f7 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:47:28.944708 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-35a3651a-358a-4fc5-8881-a9f4868686f7 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:47:28.959434 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.wsgi [None req-35a3651a-358a-4fc5-8881-a9f4868686f7 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] HTTP exception thrown: Instance 7ea58164-2a61-4c41-a8cc-0235e03dde98 could not be found. Jun 17 13:47:28.961013 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-35a3651a-358a-4fc5-8881-a9f4868686f7 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Request method failure captured: Jun 17 13:47:28.961013 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: request: DELETE /compute/v2.1/servers/7ea58164-2a61-4c41-a8cc-0235e03dde98 HTTP/1.1 Jun 17 13:47:28.961013 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Accept: application/json Jun 17 13:47:28.961013 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Accept-Encoding: identity Jun 17 13:47:28.961013 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Connection: close Jun 17 13:47:28.961013 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Content-Length: 0 Jun 17 13:47:28.961013 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Content-Type: application/json Jun 17 13:47:28.961013 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Host: 10.222.0.48 Jun 17 13:47:28.961013 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Openstack-System-Scope: None Jun 17 13:47:28.961013 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: User-Agent: python-urllib3/1.26.9 Jun 17 13:47:28.961013 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Auth-Token: gAAAAABirIRP33kbNc95wQnxZWaHkbIgOW-PC62z_-SPHiqRMyAyyNpDibqzQRov5iswTxwKrFY6HzWqyyJx4eCc6ieRXhm1AsWGCJLm5d50w3GfYQXsn14MemaWj2ArtY6MULK9ImPI2Hy4bwlxQyKmwR6WiLIiU3IKmg-dNxx33oAqk5oHKKk Jun 17 13:47:28.961013 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Domain-Id: None Jun 17 13:47:28.961013 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Domain-Name: None Jun 17 13:47:28.961013 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Identity-Status: Confirmed Jun 17 13:47:28.961013 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Is-Admin-Project: True Jun 17 13:47:28.961013 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Project-Domain-Id: default Jun 17 13:47:28.961013 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Project-Domain-Name: Default Jun 17 13:47:28.961013 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Project-Id: 082c995275404693ae4f1f686dd8fc92 Jun 17 13:47:28.961013 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Project-Name: tempest-AttachVolumeNegativeTest-17794193 Jun 17 13:47:28.961013 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Role: member,reader Jun 17 13:47:28.961013 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Roles: member,reader Jun 17 13:47:28.962429 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_082c995275404693ae4f1f686dd8fc92", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/082c995275404693ae4f1f686dd8fc92"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/082c995275404693ae4f1f686dd8fc92"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/082c995275404693ae4f1f686dd8fc92"}]}] Jun 17 13:47:28.962429 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Tenant: tempest-AttachVolumeNegativeTest-17794193 Jun 17 13:47:28.962429 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Tenant-Id: 082c995275404693ae4f1f686dd8fc92 Jun 17 13:47:28.962429 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-17794193 Jun 17 13:47:28.962429 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-User: tempest-AttachVolumeNegativeTest-17794193-project Jun 17 13:47:28.962429 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-User-Domain-Id: default Jun 17 13:47:28.962429 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-User-Domain-Name: Default Jun 17 13:47:28.962429 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-User-Id: da449dd03e364eb0bebabd59bfe1d19c Jun 17 13:47:28.962429 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-User-Name: tempest-AttachVolumeNegativeTest-17794193-project Jun 17 13:47:28.962429 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: method: > Jun 17 13:47:28.962429 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: exception: Instance 7ea58164-2a61-4c41-a8cc-0235e03dde98 could not be found. Jun 17 13:47:28.962429 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: action_args: {'id': '7ea58164-2a61-4c41-a8cc-0235e03dde98'} Jun 17 13:47:28.964130 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 13:47:28.964130 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:47:28.964130 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 13:47:28.964130 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 13:47:28.964130 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 13:47:28.964130 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 13:47:28.964130 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 13:47:28.964130 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 13:47:28.964130 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 13:47:28.964130 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 13:47:28.964130 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ea58164-2a61-4c41-a8cc-0235e03dde98 could not be found. Jun 17 13:47:28.964130 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 13:47:28.964130 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:47:28.964130 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 13:47:28.964130 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:47:28.964130 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:47:28.964130 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:47:28.964130 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 13:47:28.964130 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 13:47:28.964130 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 13:47:28.965635 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 13:47:28.965635 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 17 13:47:28.965635 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 17 13:47:28.965635 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 17 13:47:28.965635 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 17 13:47:28.965635 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 13:47:28.965635 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 13:47:28.965635 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 13:47:28.965635 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 13:47:28.965635 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ea58164-2a61-4c41-a8cc-0235e03dde98 could not be found. Jun 17 13:47:28.965635 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 13:47:28.965635 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:47:28.965635 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 13:47:28.965635 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:47:28.965635 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:47:28.965635 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:47:28.965635 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 13:47:28.965635 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 13:47:28.965635 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ea58164-2a61-4c41-a8cc-0235e03dde98 could not be found. Jun 17 13:47:28.965635 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 13:47:28.966996 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-35a3651a-358a-4fc5-8881-a9f4868686f7 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Returning 404 to user: Instance 7ea58164-2a61-4c41-a8cc-0235e03dde98 could not be found. {{(pid=117660) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 13:47:28.966996 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-35a3651a-358a-4fc5-8881-a9f4868686f7 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] 10.222.0.48 "DELETE /compute/v2.1/servers/7ea58164-2a61-4c41-a8cc-0235e03dde98" status: 404 len: 111 microversion: 2.1 time: 0.031595 Jun 17 13:47:28.966996 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1826/3701] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Jun 17 13:47:28 2022] DELETE /compute/v2.1/servers/7ea58164-2a61-4c41-a8cc-0235e03dde98 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 13:47:28.971503 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-a785cbe3-f443-4834-a5c6-6dd0bb9e8405 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:47:28.972118 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-a785cbe3-f443-4834-a5c6-6dd0bb9e8405 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] [instance: 7ea58164-2a61-4c41-a8cc-0235e03dde98] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:47:28.979090 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a785cbe3-f443-4834-a5c6-6dd0bb9e8405 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:47:28.979539 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a785cbe3-f443-4834-a5c6-6dd0bb9e8405 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:47:28.980291 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a785cbe3-f443-4834-a5c6-6dd0bb9e8405 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:47:28.980718 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-a785cbe3-f443-4834-a5c6-6dd0bb9e8405 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:47:28.994401 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.wsgi [None req-a785cbe3-f443-4834-a5c6-6dd0bb9e8405 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] HTTP exception thrown: Instance 7ea58164-2a61-4c41-a8cc-0235e03dde98 could not be found. Jun 17 13:47:28.996157 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-a785cbe3-f443-4834-a5c6-6dd0bb9e8405 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Request method failure captured: Jun 17 13:47:28.996157 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: request: GET /compute/v2.1/servers/7ea58164-2a61-4c41-a8cc-0235e03dde98 HTTP/1.1 Jun 17 13:47:28.996157 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Accept: application/json Jun 17 13:47:28.996157 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Accept-Encoding: identity Jun 17 13:47:28.996157 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Connection: close Jun 17 13:47:28.996157 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Content-Length: 0 Jun 17 13:47:28.996157 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Content-Type: application/json Jun 17 13:47:28.996157 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Host: 10.222.0.48 Jun 17 13:47:28.996157 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Openstack-System-Scope: None Jun 17 13:47:28.996157 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: User-Agent: python-urllib3/1.26.9 Jun 17 13:47:28.996157 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Auth-Token: gAAAAABirIRP33kbNc95wQnxZWaHkbIgOW-PC62z_-SPHiqRMyAyyNpDibqzQRov5iswTxwKrFY6HzWqyyJx4eCc6ieRXhm1AsWGCJLm5d50w3GfYQXsn14MemaWj2ArtY6MULK9ImPI2Hy4bwlxQyKmwR6WiLIiU3IKmg-dNxx33oAqk5oHKKk Jun 17 13:47:28.996157 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Domain-Id: None Jun 17 13:47:28.996157 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Domain-Name: None Jun 17 13:47:28.996157 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Identity-Status: Confirmed Jun 17 13:47:28.996157 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Is-Admin-Project: True Jun 17 13:47:28.996157 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Project-Domain-Id: default Jun 17 13:47:28.996157 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Project-Domain-Name: Default Jun 17 13:47:28.996157 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Project-Id: 082c995275404693ae4f1f686dd8fc92 Jun 17 13:47:28.996157 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Project-Name: tempest-AttachVolumeNegativeTest-17794193 Jun 17 13:47:28.996157 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Role: member,reader Jun 17 13:47:28.996157 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Roles: member,reader Jun 17 13:47:28.997619 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_082c995275404693ae4f1f686dd8fc92", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/082c995275404693ae4f1f686dd8fc92"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/082c995275404693ae4f1f686dd8fc92"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/082c995275404693ae4f1f686dd8fc92"}]}] Jun 17 13:47:28.997619 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Tenant: tempest-AttachVolumeNegativeTest-17794193 Jun 17 13:47:28.997619 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Tenant-Id: 082c995275404693ae4f1f686dd8fc92 Jun 17 13:47:28.997619 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-17794193 Jun 17 13:47:28.997619 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User: tempest-AttachVolumeNegativeTest-17794193-project Jun 17 13:47:28.997619 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User-Domain-Id: default Jun 17 13:47:28.997619 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User-Domain-Name: Default Jun 17 13:47:28.997619 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User-Id: da449dd03e364eb0bebabd59bfe1d19c Jun 17 13:47:28.997619 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User-Name: tempest-AttachVolumeNegativeTest-17794193-project Jun 17 13:47:28.997619 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: method: > Jun 17 13:47:28.997619 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: exception: Instance 7ea58164-2a61-4c41-a8cc-0235e03dde98 could not be found. Jun 17 13:47:28.997619 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: action_args: {'id': '7ea58164-2a61-4c41-a8cc-0235e03dde98'} Jun 17 13:47:28.998540 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 13:47:28.998540 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:47:28.998540 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 13:47:28.998540 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 13:47:28.998540 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 13:47:28.998540 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 13:47:28.998540 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 13:47:28.998540 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 13:47:28.998540 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 13:47:28.998540 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 13:47:28.998540 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ea58164-2a61-4c41-a8cc-0235e03dde98 could not be found. Jun 17 13:47:28.998540 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:47:28.998540 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:47:28.998540 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:47:28.998540 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:47:28.998540 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:47:28.998540 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:47:28.998540 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 13:47:28.998540 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 13:47:28.998540 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 13:47:28.999994 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 13:47:28.999994 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 13:47:28.999994 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 13:47:28.999994 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 13:47:28.999994 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 13:47:28.999994 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 13:47:28.999994 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 13:47:28.999994 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ea58164-2a61-4c41-a8cc-0235e03dde98 could not be found. Jun 17 13:47:28.999994 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:47:28.999994 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:47:28.999994 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:47:28.999994 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:47:28.999994 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:47:28.999994 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:47:28.999994 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 13:47:28.999994 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 13:47:28.999994 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ea58164-2a61-4c41-a8cc-0235e03dde98 could not be found. Jun 17 13:47:28.999994 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:47:29.001609 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-a785cbe3-f443-4834-a5c6-6dd0bb9e8405 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Returning 404 to user: Instance 7ea58164-2a61-4c41-a8cc-0235e03dde98 could not be found. {{(pid=117659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 13:47:29.001609 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-a785cbe3-f443-4834-a5c6-6dd0bb9e8405 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] 10.222.0.48 "GET /compute/v2.1/servers/7ea58164-2a61-4c41-a8cc-0235e03dde98" status: 404 len: 111 microversion: 2.1 time: 0.030039 Jun 17 13:47:29.001609 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1876/3702] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:47:28 2022] GET /compute/v2.1/servers/7ea58164-2a61-4c41-a8cc-0235e03dde98 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 13:47:29.008773 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-e1dfd724-fb5e-4d67-856f-b1ecc37eeee7 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:47:29.009564 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-e1dfd724-fb5e-4d67-856f-b1ecc37eeee7 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] [instance: 7bfdb0c9-fbed-4d0c-bb40-89018219f4ac] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:47:29.019291 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e1dfd724-fb5e-4d67-856f-b1ecc37eeee7 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:47:29.019883 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e1dfd724-fb5e-4d67-856f-b1ecc37eeee7 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:47:29.020969 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e1dfd724-fb5e-4d67-856f-b1ecc37eeee7 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:47:29.021606 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e1dfd724-fb5e-4d67-856f-b1ecc37eeee7 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:47:29.036900 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.wsgi [None req-e1dfd724-fb5e-4d67-856f-b1ecc37eeee7 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] HTTP exception thrown: Instance 7bfdb0c9-fbed-4d0c-bb40-89018219f4ac could not be found. Jun 17 13:47:29.038479 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-e1dfd724-fb5e-4d67-856f-b1ecc37eeee7 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Request method failure captured: Jun 17 13:47:29.038479 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: request: DELETE /compute/v2.1/servers/7bfdb0c9-fbed-4d0c-bb40-89018219f4ac HTTP/1.1 Jun 17 13:47:29.038479 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Accept: application/json Jun 17 13:47:29.038479 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Accept-Encoding: identity Jun 17 13:47:29.038479 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Connection: close Jun 17 13:47:29.038479 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Content-Length: 0 Jun 17 13:47:29.038479 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Content-Type: application/json Jun 17 13:47:29.038479 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Host: 10.222.0.48 Jun 17 13:47:29.038479 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Openstack-System-Scope: None Jun 17 13:47:29.038479 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: User-Agent: python-urllib3/1.26.9 Jun 17 13:47:29.038479 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Auth-Token: gAAAAABirIRP33kbNc95wQnxZWaHkbIgOW-PC62z_-SPHiqRMyAyyNpDibqzQRov5iswTxwKrFY6HzWqyyJx4eCc6ieRXhm1AsWGCJLm5d50w3GfYQXsn14MemaWj2ArtY6MULK9ImPI2Hy4bwlxQyKmwR6WiLIiU3IKmg-dNxx33oAqk5oHKKk Jun 17 13:47:29.038479 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Domain-Id: None Jun 17 13:47:29.038479 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Domain-Name: None Jun 17 13:47:29.038479 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Identity-Status: Confirmed Jun 17 13:47:29.038479 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Is-Admin-Project: True Jun 17 13:47:29.038479 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Project-Domain-Id: default Jun 17 13:47:29.038479 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Project-Domain-Name: Default Jun 17 13:47:29.038479 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Project-Id: 082c995275404693ae4f1f686dd8fc92 Jun 17 13:47:29.038479 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Project-Name: tempest-AttachVolumeNegativeTest-17794193 Jun 17 13:47:29.038479 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Role: member,reader Jun 17 13:47:29.038479 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Roles: member,reader Jun 17 13:47:29.040058 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_082c995275404693ae4f1f686dd8fc92", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/082c995275404693ae4f1f686dd8fc92"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/082c995275404693ae4f1f686dd8fc92"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/082c995275404693ae4f1f686dd8fc92"}]}] Jun 17 13:47:29.040058 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Tenant: tempest-AttachVolumeNegativeTest-17794193 Jun 17 13:47:29.040058 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Tenant-Id: 082c995275404693ae4f1f686dd8fc92 Jun 17 13:47:29.040058 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-17794193 Jun 17 13:47:29.040058 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-User: tempest-AttachVolumeNegativeTest-17794193-project Jun 17 13:47:29.040058 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-User-Domain-Id: default Jun 17 13:47:29.040058 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-User-Domain-Name: Default Jun 17 13:47:29.040058 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-User-Id: da449dd03e364eb0bebabd59bfe1d19c Jun 17 13:47:29.040058 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-User-Name: tempest-AttachVolumeNegativeTest-17794193-project Jun 17 13:47:29.040058 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: method: > Jun 17 13:47:29.040058 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: exception: Instance 7bfdb0c9-fbed-4d0c-bb40-89018219f4ac could not be found. Jun 17 13:47:29.040058 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: action_args: {'id': '7bfdb0c9-fbed-4d0c-bb40-89018219f4ac'} Jun 17 13:47:29.040837 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 13:47:29.040837 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:47:29.040837 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 13:47:29.040837 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 13:47:29.040837 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 13:47:29.040837 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 13:47:29.040837 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 13:47:29.040837 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 13:47:29.040837 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 13:47:29.040837 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 13:47:29.040837 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7bfdb0c9-fbed-4d0c-bb40-89018219f4ac could not be found. Jun 17 13:47:29.040837 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 13:47:29.040837 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:47:29.040837 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 13:47:29.040837 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:47:29.040837 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:47:29.040837 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:47:29.040837 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 13:47:29.040837 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 13:47:29.040837 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 13:47:29.042283 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 13:47:29.042283 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 17 13:47:29.042283 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 17 13:47:29.042283 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 17 13:47:29.042283 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 17 13:47:29.042283 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 13:47:29.042283 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 13:47:29.042283 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 13:47:29.042283 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 13:47:29.042283 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7bfdb0c9-fbed-4d0c-bb40-89018219f4ac could not be found. Jun 17 13:47:29.042283 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 13:47:29.042283 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:47:29.042283 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 13:47:29.042283 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:47:29.042283 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:47:29.042283 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:47:29.042283 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 13:47:29.042283 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 13:47:29.042283 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7bfdb0c9-fbed-4d0c-bb40-89018219f4ac could not be found. Jun 17 13:47:29.042283 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 13:47:29.043750 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-e1dfd724-fb5e-4d67-856f-b1ecc37eeee7 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Returning 404 to user: Instance 7bfdb0c9-fbed-4d0c-bb40-89018219f4ac could not be found. {{(pid=117660) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 13:47:29.043750 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-e1dfd724-fb5e-4d67-856f-b1ecc37eeee7 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] 10.222.0.48 "DELETE /compute/v2.1/servers/7bfdb0c9-fbed-4d0c-bb40-89018219f4ac" status: 404 len: 111 microversion: 2.1 time: 0.037668 Jun 17 13:47:29.043750 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1827/3703] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Jun 17 13:47:29 2022] DELETE /compute/v2.1/servers/7bfdb0c9-fbed-4d0c-bb40-89018219f4ac => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 13:47:29.048573 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-69fcdc24-1b1a-4cbb-8099-ef7fa035061a tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:47:29.049188 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-69fcdc24-1b1a-4cbb-8099-ef7fa035061a tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] [instance: 7bfdb0c9-fbed-4d0c-bb40-89018219f4ac] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:47:29.055676 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-69fcdc24-1b1a-4cbb-8099-ef7fa035061a tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:47:29.056130 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-69fcdc24-1b1a-4cbb-8099-ef7fa035061a tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:47:29.056879 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-69fcdc24-1b1a-4cbb-8099-ef7fa035061a tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:47:29.057313 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-69fcdc24-1b1a-4cbb-8099-ef7fa035061a tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:47:29.071165 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.wsgi [None req-69fcdc24-1b1a-4cbb-8099-ef7fa035061a tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] HTTP exception thrown: Instance 7bfdb0c9-fbed-4d0c-bb40-89018219f4ac could not be found. Jun 17 13:47:29.072677 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-69fcdc24-1b1a-4cbb-8099-ef7fa035061a tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Request method failure captured: Jun 17 13:47:29.072677 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: request: GET /compute/v2.1/servers/7bfdb0c9-fbed-4d0c-bb40-89018219f4ac HTTP/1.1 Jun 17 13:47:29.072677 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Accept: application/json Jun 17 13:47:29.072677 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Accept-Encoding: identity Jun 17 13:47:29.072677 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Connection: close Jun 17 13:47:29.072677 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Content-Length: 0 Jun 17 13:47:29.072677 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Content-Type: application/json Jun 17 13:47:29.072677 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Host: 10.222.0.48 Jun 17 13:47:29.072677 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Openstack-System-Scope: None Jun 17 13:47:29.072677 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: User-Agent: python-urllib3/1.26.9 Jun 17 13:47:29.072677 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Auth-Token: gAAAAABirIRP33kbNc95wQnxZWaHkbIgOW-PC62z_-SPHiqRMyAyyNpDibqzQRov5iswTxwKrFY6HzWqyyJx4eCc6ieRXhm1AsWGCJLm5d50w3GfYQXsn14MemaWj2ArtY6MULK9ImPI2Hy4bwlxQyKmwR6WiLIiU3IKmg-dNxx33oAqk5oHKKk Jun 17 13:47:29.072677 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Domain-Id: None Jun 17 13:47:29.072677 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Domain-Name: None Jun 17 13:47:29.072677 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Identity-Status: Confirmed Jun 17 13:47:29.072677 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Is-Admin-Project: True Jun 17 13:47:29.072677 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Project-Domain-Id: default Jun 17 13:47:29.072677 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Project-Domain-Name: Default Jun 17 13:47:29.072677 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Project-Id: 082c995275404693ae4f1f686dd8fc92 Jun 17 13:47:29.072677 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Project-Name: tempest-AttachVolumeNegativeTest-17794193 Jun 17 13:47:29.072677 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Role: member,reader Jun 17 13:47:29.072677 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Roles: member,reader Jun 17 13:47:29.074351 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_082c995275404693ae4f1f686dd8fc92", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/082c995275404693ae4f1f686dd8fc92"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/082c995275404693ae4f1f686dd8fc92"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/082c995275404693ae4f1f686dd8fc92"}]}] Jun 17 13:47:29.074351 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Tenant: tempest-AttachVolumeNegativeTest-17794193 Jun 17 13:47:29.074351 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Tenant-Id: 082c995275404693ae4f1f686dd8fc92 Jun 17 13:47:29.074351 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-17794193 Jun 17 13:47:29.074351 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User: tempest-AttachVolumeNegativeTest-17794193-project Jun 17 13:47:29.074351 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User-Domain-Id: default Jun 17 13:47:29.074351 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User-Domain-Name: Default Jun 17 13:47:29.074351 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User-Id: da449dd03e364eb0bebabd59bfe1d19c Jun 17 13:47:29.074351 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User-Name: tempest-AttachVolumeNegativeTest-17794193-project Jun 17 13:47:29.074351 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: method: > Jun 17 13:47:29.074351 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: exception: Instance 7bfdb0c9-fbed-4d0c-bb40-89018219f4ac could not be found. Jun 17 13:47:29.074351 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: action_args: {'id': '7bfdb0c9-fbed-4d0c-bb40-89018219f4ac'} Jun 17 13:47:29.075198 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 13:47:29.075198 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:47:29.075198 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 13:47:29.075198 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 13:47:29.075198 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 13:47:29.075198 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 13:47:29.075198 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 13:47:29.075198 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 13:47:29.075198 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 13:47:29.075198 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 13:47:29.075198 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7bfdb0c9-fbed-4d0c-bb40-89018219f4ac could not be found. Jun 17 13:47:29.075198 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:47:29.075198 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:47:29.075198 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:47:29.075198 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:47:29.075198 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:47:29.075198 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:47:29.075198 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 13:47:29.075198 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 13:47:29.075198 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 13:47:29.076689 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 13:47:29.076689 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 13:47:29.076689 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 13:47:29.076689 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 13:47:29.076689 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 13:47:29.076689 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 13:47:29.076689 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 13:47:29.076689 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7bfdb0c9-fbed-4d0c-bb40-89018219f4ac could not be found. Jun 17 13:47:29.076689 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:47:29.076689 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:47:29.076689 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:47:29.076689 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:47:29.076689 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:47:29.076689 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:47:29.076689 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 13:47:29.076689 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 13:47:29.076689 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7bfdb0c9-fbed-4d0c-bb40-89018219f4ac could not be found. Jun 17 13:47:29.076689 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:47:29.078145 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-69fcdc24-1b1a-4cbb-8099-ef7fa035061a tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Returning 404 to user: Instance 7bfdb0c9-fbed-4d0c-bb40-89018219f4ac could not be found. {{(pid=117659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 13:47:29.078145 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-69fcdc24-1b1a-4cbb-8099-ef7fa035061a tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] 10.222.0.48 "GET /compute/v2.1/servers/7bfdb0c9-fbed-4d0c-bb40-89018219f4ac" status: 404 len: 111 microversion: 2.1 time: 0.029381 Jun 17 13:47:29.078145 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1877/3704] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:47:29 2022] GET /compute/v2.1/servers/7bfdb0c9-fbed-4d0c-bb40-89018219f4ac => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 13:47:30.237623 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-1c413c1f-4f8e-44f9-9b7b-47a22f1bf324 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:47:30.238195 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-1c413c1f-4f8e-44f9-9b7b-47a22f1bf324 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] [instance: 924b7379-78e3-412f-8264-26b4aa06b2d6] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:47:30.245216 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1c413c1f-4f8e-44f9-9b7b-47a22f1bf324 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:47:30.245658 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1c413c1f-4f8e-44f9-9b7b-47a22f1bf324 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:47:30.246447 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1c413c1f-4f8e-44f9-9b7b-47a22f1bf324 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:47:30.246874 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1c413c1f-4f8e-44f9-9b7b-47a22f1bf324 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:47:30.260864 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.wsgi [None req-1c413c1f-4f8e-44f9-9b7b-47a22f1bf324 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] HTTP exception thrown: Instance 924b7379-78e3-412f-8264-26b4aa06b2d6 could not be found. Jun 17 13:47:30.262477 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-1c413c1f-4f8e-44f9-9b7b-47a22f1bf324 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Request method failure captured: Jun 17 13:47:30.262477 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: request: DELETE /compute/v2.1/servers/924b7379-78e3-412f-8264-26b4aa06b2d6 HTTP/1.1 Jun 17 13:47:30.262477 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Accept: application/json Jun 17 13:47:30.262477 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Accept-Encoding: identity Jun 17 13:47:30.262477 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Connection: close Jun 17 13:47:30.262477 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Content-Length: 0 Jun 17 13:47:30.262477 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Content-Type: application/json Jun 17 13:47:30.262477 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Host: 10.222.0.48 Jun 17 13:47:30.262477 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Openstack-System-Scope: None Jun 17 13:47:30.262477 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: User-Agent: python-urllib3/1.26.9 Jun 17 13:47:30.262477 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Auth-Token: gAAAAABirIRP33kbNc95wQnxZWaHkbIgOW-PC62z_-SPHiqRMyAyyNpDibqzQRov5iswTxwKrFY6HzWqyyJx4eCc6ieRXhm1AsWGCJLm5d50w3GfYQXsn14MemaWj2ArtY6MULK9ImPI2Hy4bwlxQyKmwR6WiLIiU3IKmg-dNxx33oAqk5oHKKk Jun 17 13:47:30.262477 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Domain-Id: None Jun 17 13:47:30.262477 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Domain-Name: None Jun 17 13:47:30.262477 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Identity-Status: Confirmed Jun 17 13:47:30.262477 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Is-Admin-Project: True Jun 17 13:47:30.262477 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Project-Domain-Id: default Jun 17 13:47:30.262477 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Project-Domain-Name: Default Jun 17 13:47:30.262477 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Project-Id: 082c995275404693ae4f1f686dd8fc92 Jun 17 13:47:30.262477 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Project-Name: tempest-AttachVolumeNegativeTest-17794193 Jun 17 13:47:30.262477 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Role: member,reader Jun 17 13:47:30.262477 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Roles: member,reader Jun 17 13:47:30.264305 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_082c995275404693ae4f1f686dd8fc92", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/082c995275404693ae4f1f686dd8fc92"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/082c995275404693ae4f1f686dd8fc92"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/082c995275404693ae4f1f686dd8fc92"}]}] Jun 17 13:47:30.264305 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Tenant: tempest-AttachVolumeNegativeTest-17794193 Jun 17 13:47:30.264305 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Tenant-Id: 082c995275404693ae4f1f686dd8fc92 Jun 17 13:47:30.264305 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-17794193 Jun 17 13:47:30.264305 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-User: tempest-AttachVolumeNegativeTest-17794193-project Jun 17 13:47:30.264305 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-User-Domain-Id: default Jun 17 13:47:30.264305 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-User-Domain-Name: Default Jun 17 13:47:30.264305 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-User-Id: da449dd03e364eb0bebabd59bfe1d19c Jun 17 13:47:30.264305 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: X-User-Name: tempest-AttachVolumeNegativeTest-17794193-project Jun 17 13:47:30.264305 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: method: > Jun 17 13:47:30.264305 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: exception: Instance 924b7379-78e3-412f-8264-26b4aa06b2d6 could not be found. Jun 17 13:47:30.264305 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: action_args: {'id': '924b7379-78e3-412f-8264-26b4aa06b2d6'} Jun 17 13:47:30.265310 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 13:47:30.265310 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:47:30.265310 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 13:47:30.265310 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 13:47:30.265310 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 13:47:30.265310 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 13:47:30.265310 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 13:47:30.265310 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 13:47:30.265310 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 13:47:30.265310 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 13:47:30.265310 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 924b7379-78e3-412f-8264-26b4aa06b2d6 could not be found. Jun 17 13:47:30.265310 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 13:47:30.265310 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:47:30.265310 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 13:47:30.265310 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:47:30.265310 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:47:30.265310 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:47:30.265310 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 13:47:30.265310 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 13:47:30.265310 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 13:47:30.266738 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 13:47:30.266738 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 17 13:47:30.266738 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 17 13:47:30.266738 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 17 13:47:30.266738 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 17 13:47:30.266738 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 13:47:30.266738 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 13:47:30.266738 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 13:47:30.266738 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 13:47:30.266738 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 924b7379-78e3-412f-8264-26b4aa06b2d6 could not be found. Jun 17 13:47:30.266738 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 13:47:30.266738 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:47:30.266738 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 13:47:30.266738 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:47:30.266738 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:47:30.266738 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:47:30.266738 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 13:47:30.266738 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 13:47:30.266738 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 924b7379-78e3-412f-8264-26b4aa06b2d6 could not be found. Jun 17 13:47:30.266738 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Jun 17 13:47:30.268284 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-1c413c1f-4f8e-44f9-9b7b-47a22f1bf324 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Returning 404 to user: Instance 924b7379-78e3-412f-8264-26b4aa06b2d6 could not be found. {{(pid=117660) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 13:47:30.268284 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-1c413c1f-4f8e-44f9-9b7b-47a22f1bf324 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] 10.222.0.48 "DELETE /compute/v2.1/servers/924b7379-78e3-412f-8264-26b4aa06b2d6" status: 404 len: 111 microversion: 2.1 time: 0.030233 Jun 17 13:47:30.268284 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1828/3705] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Jun 17 13:47:30 2022] DELETE /compute/v2.1/servers/924b7379-78e3-412f-8264-26b4aa06b2d6 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 13:47:30.272434 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-1fa09817-7d0e-4a4d-8eb4-ac12480bf518 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Calling method '>' {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 13:47:30.273044 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.compute.api [None req-1fa09817-7d0e-4a4d-8eb4-ac12480bf518 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] [instance: 924b7379-78e3-412f-8264-26b4aa06b2d6] Fetching instance by UUID {{(pid=117659) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 13:47:30.280179 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-1fa09817-7d0e-4a4d-8eb4-ac12480bf518 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:47:30.280624 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-1fa09817-7d0e-4a4d-8eb4-ac12480bf518 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:47:30.281375 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-1fa09817-7d0e-4a4d-8eb4-ac12480bf518 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 13:47:30.281805 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG oslo_concurrency.lockutils [None req-1fa09817-7d0e-4a4d-8eb4-ac12480bf518 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Lock "c05da03c-5209-4a2b-9567-14e1f38bc35b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 13:47:30.295517 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.wsgi [None req-1fa09817-7d0e-4a4d-8eb4-ac12480bf518 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] HTTP exception thrown: Instance 924b7379-78e3-412f-8264-26b4aa06b2d6 could not be found. Jun 17 13:47:30.297101 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-1fa09817-7d0e-4a4d-8eb4-ac12480bf518 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Request method failure captured: Jun 17 13:47:30.297101 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: request: GET /compute/v2.1/servers/924b7379-78e3-412f-8264-26b4aa06b2d6 HTTP/1.1 Jun 17 13:47:30.297101 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Accept: application/json Jun 17 13:47:30.297101 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Accept-Encoding: identity Jun 17 13:47:30.297101 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Connection: close Jun 17 13:47:30.297101 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Content-Length: 0 Jun 17 13:47:30.297101 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Content-Type: application/json Jun 17 13:47:30.297101 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Host: 10.222.0.48 Jun 17 13:47:30.297101 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Openstack-System-Scope: None Jun 17 13:47:30.297101 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: User-Agent: python-urllib3/1.26.9 Jun 17 13:47:30.297101 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Auth-Token: gAAAAABirIRP33kbNc95wQnxZWaHkbIgOW-PC62z_-SPHiqRMyAyyNpDibqzQRov5iswTxwKrFY6HzWqyyJx4eCc6ieRXhm1AsWGCJLm5d50w3GfYQXsn14MemaWj2ArtY6MULK9ImPI2Hy4bwlxQyKmwR6WiLIiU3IKmg-dNxx33oAqk5oHKKk Jun 17 13:47:30.297101 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Domain-Id: None Jun 17 13:47:30.297101 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Domain-Name: None Jun 17 13:47:30.297101 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Identity-Status: Confirmed Jun 17 13:47:30.297101 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Is-Admin-Project: True Jun 17 13:47:30.297101 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Project-Domain-Id: default Jun 17 13:47:30.297101 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Project-Domain-Name: Default Jun 17 13:47:30.297101 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Project-Id: 082c995275404693ae4f1f686dd8fc92 Jun 17 13:47:30.297101 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Project-Name: tempest-AttachVolumeNegativeTest-17794193 Jun 17 13:47:30.297101 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Role: member,reader Jun 17 13:47:30.297101 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Roles: member,reader Jun 17 13:47:30.298556 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_082c995275404693ae4f1f686dd8fc92", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/082c995275404693ae4f1f686dd8fc92"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/082c995275404693ae4f1f686dd8fc92"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/082c995275404693ae4f1f686dd8fc92"}]}] Jun 17 13:47:30.298556 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Tenant: tempest-AttachVolumeNegativeTest-17794193 Jun 17 13:47:30.298556 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Tenant-Id: 082c995275404693ae4f1f686dd8fc92 Jun 17 13:47:30.298556 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-17794193 Jun 17 13:47:30.298556 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User: tempest-AttachVolumeNegativeTest-17794193-project Jun 17 13:47:30.298556 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User-Domain-Id: default Jun 17 13:47:30.298556 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User-Domain-Name: Default Jun 17 13:47:30.298556 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User-Id: da449dd03e364eb0bebabd59bfe1d19c Jun 17 13:47:30.298556 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: X-User-Name: tempest-AttachVolumeNegativeTest-17794193-project Jun 17 13:47:30.298556 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: method: > Jun 17 13:47:30.298556 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: exception: Instance 924b7379-78e3-412f-8264-26b4aa06b2d6 could not be found. Jun 17 13:47:30.298556 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: action_args: {'id': '924b7379-78e3-412f-8264-26b4aa06b2d6'} Jun 17 13:47:30.299462 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: {{(pid=117659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 13:47:30.299462 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:47:30.299462 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 13:47:30.299462 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 13:47:30.299462 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 13:47:30.299462 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 13:47:30.299462 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 13:47:30.299462 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 13:47:30.299462 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 13:47:30.299462 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 13:47:30.299462 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 924b7379-78e3-412f-8264-26b4aa06b2d6 could not be found. Jun 17 13:47:30.299462 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:47:30.299462 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:47:30.299462 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:47:30.299462 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:47:30.299462 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:47:30.299462 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:47:30.299462 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 13:47:30.299462 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 13:47:30.299462 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 13:47:30.300965 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 13:47:30.300965 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 13:47:30.300965 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 13:47:30.300965 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 13:47:30.300965 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 13:47:30.300965 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 13:47:30.300965 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 13:47:30.300965 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 924b7379-78e3-412f-8264-26b4aa06b2d6 could not be found. Jun 17 13:47:30.300965 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:47:30.300965 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 13:47:30.300965 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:47:30.300965 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 13:47:30.300965 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 13:47:30.300965 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 13:47:30.300965 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 13:47:30.300965 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 13:47:30.300965 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 924b7379-78e3-412f-8264-26b4aa06b2d6 could not be found. Jun 17 13:47:30.300965 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: ERROR nova.api.openstack.wsgi Jun 17 13:47:30.302332 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: DEBUG nova.api.openstack.wsgi [None req-1fa09817-7d0e-4a4d-8eb4-ac12480bf518 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] Returning 404 to user: Instance 924b7379-78e3-412f-8264-26b4aa06b2d6 could not be found. {{(pid=117659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 13:47:30.302332 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO nova.api.openstack.requestlog [None req-1fa09817-7d0e-4a4d-8eb4-ac12480bf518 tempest-AttachVolumeNegativeTest-17794193 tempest-AttachVolumeNegativeTest-17794193-project] 10.222.0.48 "GET /compute/v2.1/servers/924b7379-78e3-412f-8264-26b4aa06b2d6" status: 404 len: 111 microversion: 2.1 time: 0.029943 Jun 17 13:47:30.302332 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: [pid: 117659|app: 0|req: 1878/3706] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 13:47:30 2022] GET /compute/v2.1/servers/924b7379-78e3-412f-8264-26b4aa06b2d6 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 13:48:58.921546 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 13:48:58.922460 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Fri Jun 17 13:48:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 17 13:49:28.447330 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 13:49:28.448126 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Fri Jun 17 13:49:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 17 13:50:41.308370 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 13:50:41.309979 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Fri Jun 17 13:50:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 17 13:50:47.963797 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 13:50:47.964731 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Fri Jun 17 13:50:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 17 13:50:49.662287 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 13:50:49.663039 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Fri Jun 17 13:50:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 17 13:52:18.933602 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 13:52:18.934271 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Fri Jun 17 13:52:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 17 13:52:44.679421 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 13:52:44.680674 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Fri Jun 17 13:52:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 17 13:52:48.458745 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 13:52:48.459610 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Fri Jun 17 13:52:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 17 13:54:01.321933 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 13:54:01.322596 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Fri Jun 17 13:54:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 17 13:54:07.977454 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 13:54:07.978370 dv-cinder-837543-5-iscsi devstack@n-api.service[117660]: Fri Jun 17 13:54:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 17 13:54:09.672819 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 13:54:09.673455 dv-cinder-837543-5-iscsi devstack@n-api.service[117659]: Fri Jun 17 13:54:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!